2024-05-27T09:20:59.637 INFO:root:teuthology version: 0.0.1.dev291+ge7ae758 2024-05-27T09:20:59.637 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} --owner scheduled_vshankar@teuthology --name vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi --verbose -- /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/orig.config.yaml 2024-05-27T09:20:59.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-27T09:20:59.789 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695 branch: wip-vshankar-testing-20240521.105740-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} email: vshankar@redhat.com first_in_suite: false job_id: '7727695' kernel: client: branch: testing flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240521.105740-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: a6507388dd5057528934822c0163b0c347ef1d5d subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: a6507388dd5057528934822c0163b0c347ef1d5d kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240521.105740-debug sha1: a6507388dd5057528934822c0163b0c347ef1d5d owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2274 sha1: a6507388dd5057528934822c0163b0c347ef1d5d sleep_before_teardown: 0 subset: 442/1024 suite: fs suite_branch: wip-vshankar-testing-20240521.105740-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a6507388dd5057528934822c0163b0c347ef1d5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDg5E4Q7srWiIUO1yCV/M4T4qEdA7AyijqC48+2z3I7pIVm4sAcik7csdTqdzBiZR7KFpp8d0kvOG1ZwWyaofnE= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAahKXYaAbdV6VdlcT6y696nVsGWJLweSgzIDIE8lk+iS9UnUQWpZxCP0WFhmUmpA+7q3viQkY6dNKl8013TU0= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMkeZi+LMb1ODSMXyUxVmyJSVB1PGAXQUe+HHKM243A4tdHDph5xID/j9h7UQZZlMjXU5UGTStLKO/eO+L1KJDg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e7ae7580c417d6ab27fda98fecadca5d9f85d63e timestamp: 2024-05-27_06:46:53 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-27T09:20:59.790 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa; will attempt to use it 2024-05-27T09:20:59.791 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa/tasks 2024-05-27T09:20:59.791 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-27T09:20:59.792 INFO:teuthology.task.internal:Checking packages... 2024-05-27T09:20:59.813 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a6507388dd5057528934822c0163b0c347ef1d5d' 2024-05-27T09:20:59.814 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-27T09:20:59.814 INFO:teuthology.packaging:ref: None 2024-05-27T09:20:59.814 INFO:teuthology.packaging:tag: None 2024-05-27T09:20:59.814 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240521.105740-debug 2024-05-27T09:20:59.814 INFO:teuthology.packaging:sha1: a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:20:59.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240521.105740-debug 2024-05-27T09:21:00.045 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3868.ga6507388 2024-05-27T09:21:00.047 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-27T09:21:00.054 INFO:teuthology.task.internal:no buildpackages task found 2024-05-27T09:21:00.054 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-27T09:21:00.071 INFO:teuthology.task.internal:Saving configuration 2024-05-27T09:21:00.093 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-27T09:21:00.100 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-27T09:21:00.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 09:15:27.190156', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDg5E4Q7srWiIUO1yCV/M4T4qEdA7AyijqC48+2z3I7pIVm4sAcik7csdTqdzBiZR7KFpp8d0kvOG1ZwWyaofnE='} 2024-05-27T09:21:00.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 09:15:27.191785', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAahKXYaAbdV6VdlcT6y696nVsGWJLweSgzIDIE8lk+iS9UnUQWpZxCP0WFhmUmpA+7q3viQkY6dNKl8013TU0='} 2024-05-27T09:21:00.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 09:15:27.193126', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMkeZi+LMb1ODSMXyUxVmyJSVB1PGAXQUe+HHKM243A4tdHDph5xID/j9h7UQZZlMjXU5UGTStLKO/eO+L1KJDg='} 2024-05-27T09:21:00.161 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-27T09:21:00.167 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-27T09:21:00.167 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-27T09:21:00.167 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-27T09:21:00.167 INFO:teuthology.run_tasks:Running task console_log... 2024-05-27T09:21:00.275 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faf630e1090>, signals=[15]) 2024-05-27T09:21:00.275 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-27T09:21:00.281 INFO:teuthology.task.internal:Opening connections... 2024-05-27T09:21:00.282 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:21:00.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:21:00.359 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T09:21:00.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:21:00.436 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-05-27T09:21:00.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:21:00.509 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-27T09:21:00.516 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-05-27T09:21:00.534 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-05-27T09:21:00.534 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-05-27T09:21:00.590 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-05-27T09:21:00.590 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-27T09:21:00.591 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-27T09:21:00.592 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-05-27T09:21:00.632 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-05-27T09:21:00.649 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-05-27T09:21:00.649 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-27T09:21:00.706 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-05-27T09:21:00.707 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2024-05-27T09:21:00.707 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-27T09:21:00.707 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-05-27T09:21:00.707 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-27T09:21:00.707 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-27T09:21:00.707 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-27T09:21:00.707 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-05-27T09:21:00.731 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-05-27T09:21:00.748 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-05-27T09:21:00.749 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-05-27T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-05-27T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-05-27T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-05-27T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-05-27T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-27T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-27T09:21:00.806 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-05-27T09:21:00.966 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-27T09:21:00.990 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-27T09:21:00.996 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-27T09:21:00.996 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-05-27T09:21:00.999 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-05-27T09:21:01.001 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-05-27T09:21:01.017 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-27T09:21:01.023 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-27T09:21:01.023 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-05-27T09:21:01.056 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-05-27T09:21:01.058 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-05-27T09:21:01.092 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-27T09:21:01.171 INFO:teuthology.run_tasks:Running task kernel... 2024-05-27T09:21:01.221 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-27T09:21:01.221 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-27T09:21:01.222 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-27T09:21:01.222 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T09:21:01.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T09:21:01.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-27T09:21:01.530 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T09:21:01.530 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-27T09:21:01.530 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-05-27T09:21:01.547 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-437.el9.x86_64 2024-05-27T09:21:01.547 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T09:21:01.547 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-27T09:21:01.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum upgrade -y linux-firmware 2024-05-27T09:21:07.311 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.1 MB 00:04 2024-05-27T09:21:10.645 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 19 MB 00:02 2024-05-27T09:21:14.846 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-27T09:21:16.438 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 17 kB 00:00 2024-05-27T09:21:18.242 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-27T09:21:23.450 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-27T09:21:25.444 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-05-27T09:21:25.445 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-05-27T09:21:25.445 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-05-27T09:21:25.576 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-27T09:21:25.576 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T09:21:25.725 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-05-27T09:21:25.725 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-27T09:21:25.728 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi071.front.sepia.ceph.com to complete... 2024-05-27T09:21:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27 09:21:39 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-27T09:21:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:FINISHED --2024-05-27 09:21:39-- 2024-05-27T09:21:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:Total wall clock time: 14s 2024-05-27T09:21:39.955 INFO:teuthology.orchestra.run.smithi071.stderr:Downloaded: 1 files, 340M in 14s (24.6 MB/s) 2024-05-27T09:21:39.957 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-27T09:21:39.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-27T09:21:42.062 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying... ######################################## 2024-05-27T09:21:42.191 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing... ######################################## 2024-05-27T09:21:42.311 INFO:teuthology.orchestra.run.smithi071.stdout:Updating / installing... 2024-05-27T09:21:50.236 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-05-27T09:22:29.874 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-27T09:22:29.875 DEBUG:teuthology.orchestra.run.smithi071:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-27T09:22:29.957 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-05-27T09:22:29.957 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/config-6.9.0-gb9459a26b088 2024-05-27T09:22:29.957 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T09:22:29.957 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-05-27T09:22:29.957 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-05-27T09:22:29.957 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-27T09:22:29.958 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-27T09:22:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-27T09:22:29.960 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-27T09:22:29.960 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-05-27T09:22:29.960 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-05-27T09:22:29.960 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-05-27T09:22:29.960 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-27T09:22:29.960 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-05-27T09:22:29.960 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-27T09:22:29.961 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-27T09:22:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-27T09:22:29.963 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-27T09:22:29.963 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-27T09:22:29.965 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-27T09:22:29.965 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-27T09:22:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-27T09:22:29.967 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-27T09:22:29.968 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-27T09:22:29.969 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-27T09:22:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-27T09:22:29.971 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-27T09:22:29.972 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-27T09:22:29.973 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-05-27T09:22:29.974 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-05-27T09:22:29.975 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-27T09:22:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-05-27T09:22:29.977 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-27T09:22:29.978 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-05-27T09:22:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-27T09:22:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-05-27T09:22:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-27T09:22:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-27T09:22:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-27T09:22:29.984 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-27T09:22:29.985 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-27T09:22:29.986 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-27T09:22:29.987 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-27T09:22:29.988 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-27T09:22:29.989 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-27T09:22:29.990 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-27T09:22:29.991 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-27T09:22:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-27T09:22:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-27T09:22:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-27T09:22:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-27T09:22:29.996 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-27T09:22:29.997 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-27T09:22:29.998 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-27T09:22:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-27T09:22:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-27T09:22:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-27T09:22:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-27T09:22:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-27T09:22:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-27T09:22:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-27T09:22:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-27T09:22:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-27T09:22:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-27T09:22:30.009 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-05-27T09:22:30.010 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-27T09:22:30.011 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-27T09:22:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-27T09:22:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-27T09:22:30.014 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-27T09:22:30.015 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-27T09:22:30.016 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-05-27T09:22:30.017 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-27T09:22:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-27T09:22:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-27T09:22:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-27T09:22:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-27T09:22:30.022 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-27T09:22:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-27T09:22:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-27T09:22:30.025 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-27T09:22:30.026 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-27T09:22:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-27T09:22:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-05-27T09:22:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-05-27T09:22:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-05-27T09:22:30.031 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-27T09:22:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-27T09:22:30.033 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-05-27T09:22:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-27T09:22:30.035 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-27T09:22:30.036 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-27T09:22:30.037 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-05-27T09:22:30.038 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-27T09:22:30.039 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-27T09:22:30.040 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-27T09:22:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-05-27T09:22:30.042 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-27T09:22:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-27T09:22:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-27T09:22:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-27T09:22:30.046 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-27T09:22:30.047 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-27T09:22:30.048 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-05-27T09:22:30.049 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-27T09:22:30.050 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-27T09:22:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-27T09:22:30.052 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-27T09:22:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-27T09:22:30.054 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-27T09:22:30.055 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-05-27T09:22:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-05-27T09:22:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-27T09:22:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-27T09:22:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-27T09:22:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-27T09:22:30.061 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-27T09:22:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-05-27T09:22:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-05-27T09:22:30.064 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-05-27T09:22:30.065 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-27T09:22:30.066 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-27T09:22:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-27T09:22:30.068 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-27T09:22:30.069 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-27T09:22:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-27T09:22:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-27T09:22:30.072 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-05-27T09:22:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-05-27T09:22:30.074 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-05-27T09:22:30.075 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-27T09:22:30.076 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-27T09:22:30.077 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-27T09:22:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-05-27T09:22:30.079 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-27T09:22:30.080 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-27T09:22:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-27T09:22:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-27T09:22:30.083 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-27T09:22:30.084 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-27T09:22:30.085 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-27T09:22:30.086 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-05-27T09:22:30.087 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-05-27T09:22:30.088 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-27T09:22:30.089 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-27T09:22:30.090 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-27T09:22:30.091 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-27T09:22:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-27T09:22:30.093 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-05-27T09:22:30.094 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-27T09:22:30.095 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-27T09:22:30.096 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-27T09:22:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-27T09:22:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-27T09:22:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-05-27T09:22:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-27T09:22:30.101 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-27T09:22:30.102 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-27T09:22:30.103 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-05-27T09:22:30.104 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-05-27T09:22:30.105 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-27T09:22:30.106 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-27T09:22:30.107 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-27T09:22:30.107 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-27T09:22:30.107 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-27T09:22:30.107 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-27T09:22:30.107 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-27T09:22:30.107 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-27T09:22:30.107 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-27T09:22:30.110 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-27T09:22:30.111 DEBUG:teuthology.orchestra.run.smithi071:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout:postinstall scriptlet (using /bin/sh): 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout:for file in vmlinuz System.map config; do 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-05-27T09:22:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: fi 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:done 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-05-27T09:22:30.135 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-05-27T09:22:30.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 68.el9 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8264254 2024-05-27T09:22:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-27T09:22:30.210 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-27T09:22:30.211 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-05-27T09:22:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:22:30.211 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-05-27T09:22:30.211 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-27T09:22:30.212 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 6.9.0-gb9459a26b088 2024-05-27T09:22:30.212 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-27T09:22:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-05-27T09:22:32.198 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-27T09:22:32.226 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-05-27T09:22:32.229 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-05-27T09:22:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.JVJxtAe2dB 2024-05-27T09:22:32.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JVJxtAe2dB 2024-05-27T09:22:32.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.JVJxtAe2dB 2024-05-27T09:22:32.446 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.JVJxtAe2dB is 6KB 2024-05-27T09:22:32.465 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.JVJxtAe2dB 2024-05-27T09:22:32.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-05-27T09:22:32.540 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-27T09:22:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-27T09:22:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-27T09:22:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-05-27T09:22:32.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-05-27T09:22:32.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-05-27T09:23:02.735 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-27T09:23:02.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-05-27T09:23:02.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:24:02.740 DEBUG:teuthology.orchestra.remote:timed out 2024-05-27T09:24:11.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-05-27T09:24:11.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:24:13.141 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-05-27T09:24:13.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-05-27T09:24:13.774 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-05-27T09:24:13.774 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-05-27T09:24:13.815 INFO:teuthology.orchestra.run.smithi071.stdout:6.9.0-gb9459a26b088 2024-05-27T09:24:13.815 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-27T09:24:13.815 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-27T09:24:13.815 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-27T09:24:14.818 DEBUG:teuthology.parallel:result is None 2024-05-27T09:24:14.818 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-27T09:24:14.826 INFO:teuthology.task.internal:Creating test directory... 2024-05-27T09:24:14.826 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T09:24:14.833 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T09:24:14.836 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T09:24:14.881 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-27T09:24:14.887 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-27T09:24:14.899 INFO:teuthology.task.internal:Creating archive directory... 2024-05-27T09:24:14.899 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T09:24:14.906 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T09:24:14.908 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T09:24:15.036 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-27T09:24:15.043 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-27T09:24:15.043 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T09:24:15.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T09:24:15.059 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T09:24:15.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T09:24:15.076 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T09:24:15.083 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T09:24:15.101 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T09:24:15.134 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T09:24:15.175 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T09:24:15.176 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T09:24:15.193 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T09:24:15.206 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T09:24:15.251 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T09:24:15.256 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-27T09:24:15.263 INFO:teuthology.task.internal:Configuring sudo... 2024-05-27T09:24:15.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T09:24:15.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T09:24:15.269 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T09:24:15.328 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-27T09:24:15.340 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-27T09:24:15.340 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T09:24:15.345 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T09:24:15.347 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T09:24:15.378 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T09:24:15.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T09:24:15.579 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T09:24:15.648 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T09:24:15.725 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:24:15.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T09:24:15.816 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T09:24:15.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T09:24:15.913 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T09:24:15.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T09:24:16.037 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:24:16.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T09:24:16.102 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T09:24:16.145 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T09:24:16.203 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T09:24:16.287 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T09:24:16.327 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:24:16.327 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T09:24:16.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-05-27T09:24:16.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-05-27T09:24:16.400 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-05-27T09:24:16.433 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T09:24:16.465 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T09:24:16.511 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T09:24:16.881 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-27T09:24:16.888 INFO:teuthology.task.internal:Starting timer... 2024-05-27T09:24:16.888 INFO:teuthology.run_tasks:Running task pcp... 2024-05-27T09:24:16.898 INFO:teuthology.run_tasks:Running task selinux... 2024-05-27T09:24:16.907 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-27T09:24:16.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-05-27T09:24:17.023 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-05-27T09:24:17.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2024-05-27T09:24:17.127 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2024-05-27T09:24:17.129 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-05-27T09:24:17.182 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-05-27T09:24:17.184 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-27T09:24:17.184 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-05-27T09:24:17.238 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-05-27T09:24:17.239 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2024-05-27T09:24:17.266 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2024-05-27T09:24:17.266 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-05-27T09:24:17.300 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-05-27T09:24:17.300 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2024-05-27T09:24:17.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T09:24:17.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T09:24:17.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T09:24:17.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T09:24:17.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T09:24:17.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T09:24:17.429 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-27T09:24:17.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-05-27T09:24:17.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2024-05-27T09:24:17.545 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-05-27T09:24:17.568 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-27T09:24:17.578 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-27T09:24:17.589 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-27T09:24:17.590 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi072.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-27T09:30:29.717 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-05-27T09:30:29.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-05-27T09:30:29.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:30:29.826 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-05-27T09:30:29.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-05-27T09:30:29.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T09:30:29.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:30:30.061 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-05-27T09:30:30.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T09:30:30.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-27T09:30:30.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T09:30:30.217 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-05-27T09:30:30.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-27T09:30:30.303 INFO:teuthology.run_tasks:Running task clock... 2024-05-27T09:30:30.314 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-27T09:30:30.314 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T09:30:30.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T09:30:30.322 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T09:30:30.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T09:30:30.325 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T09:30:30.325 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T09:30:30.351 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-27T09:30:30.364 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-27T09:30:30.373 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-27T09:30:30.387 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-27T09:30:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2024-05-27T09:30:30.397 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2024-05-27T09:30:30.410 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-05-27T09:30:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-27T09:30:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-27T09:30:30.421 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-05-27T09:30:30.423 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-27T09:30:30.434 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-27T09:30:30.447 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-27T09:30:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-27T09:30:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-05-27T09:30:30.478 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T09:30:30.479 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-05-27T09:30:30.479 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.479 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.479 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.479 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.503 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-05-27T09:30:30.506 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T09:30:30.506 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-05-27T09:30:30.507 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.507 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.507 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.507 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-05-27T09:30:30.562 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-05-27T09:30:30.603 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-27T09:30:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-27T09:30:30.780 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-05-27T09:30:30.789 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T09:30:30.789 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-05-27T09:30:30.789 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.789 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.789 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.789 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T09:30:30.790 INFO:teuthology.run_tasks:Running task install... 2024-05-27T09:30:30.800 DEBUG:teuthology.task.install:project ceph 2024-05-27T09:30:30.800 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d'}} 2024-05-27T09:30:30.800 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d'} 2024-05-27T09:30:30.800 INFO:teuthology.task.install:Using flavor: default 2024-05-27T09:30:30.806 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-27T09:30:30.806 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-27T09:30:30.806 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d', 'tag': None, 'wait_for_package': False} 2024-05-27T09:30:30.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:30:30.808 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d', 'tag': None, 'wait_for_package': False} 2024-05-27T09:30:30.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:30:30.809 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d', 'tag': None, 'wait_for_package': False} 2024-05-27T09:30:30.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:30:30.960 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/ 2024-05-27T09:30:30.960 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3868.ga6507388 2024-05-27T09:30:30.963 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/ 2024-05-27T09:30:30.964 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3868.ga6507388 2024-05-27T09:30:31.040 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/ 2024-05-27T09:30:31.040 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3868.ga6507388 2024-05-27T09:30:31.144 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-27T09:30:31.144 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:30:31.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-27T09:30:31.148 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-27T09:30:31.148 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:30:31.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-27T09:30:31.172 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-27T09:30:31.172 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6507388dd5057528934822c0163b0c347ef1d5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-27T09:30:31.212 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-27T09:30:31.212 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:30:31.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-27T09:30:31.239 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-27T09:30:31.239 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6507388dd5057528934822c0163b0c347ef1d5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-27T09:30:31.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-27T09:30:31.240 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-27T09:30:31.240 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6507388dd5057528934822c0163b0c347ef1d5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-27T09:30:31.304 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-27T09:30:31.314 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-27T09:30:31.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-27T09:30:31.377 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-27T09:30:31.378 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2024-05-27T09:30:31.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2024-05-27T09:30:31.441 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-05-27T09:30:31.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-05-27T09:30:31.483 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-27T09:30:31.563 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-05-27T09:30:31.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-05-27T09:30:31.602 INFO:teuthology.orchestra.run.smithi072.stdout:45 files removed 2024-05-27T09:30:31.628 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-27T09:30:31.664 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-05-27T09:30:31.691 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-27T09:30:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-05-27T09:30:31.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-27T09:30:32.273 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 258 kB/s | 84 kB 00:00 2024-05-27T09:30:32.309 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-05-27T09:30:32.627 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 43 kB/s | 12 kB 00:00 2024-05-27T09:30:32.632 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-05-27T09:30:32.752 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 212 kB/s | 84 kB 00:00 2024-05-27T09:30:32.982 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-05-27T09:30:32.987 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-05-27T09:30:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-05-27T09:30:33.383 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 22 MB/s | 8.1 MB 00:00 2024-05-27T09:30:33.572 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-27T09:30:33.804 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-05-27T09:30:35.060 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 31 MB/s | 19 MB 00:00 2024-05-27T09:30:35.374 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-27T09:30:36.602 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.1 MB 00:02 2024-05-27T09:30:38.669 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-05-27T09:30:40.912 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-05-27T09:30:41.094 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-05-27T09:30:42.363 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 17 kB 00:00 2024-05-27T09:30:42.545 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 17 kB 00:00 2024-05-27T09:30:43.500 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-05-27T09:30:43.530 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-05-27T09:30:46.953 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.2 MB 00:04 2024-05-27T09:30:48.545 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 17 kB 00:00 2024-05-27T09:30:48.669 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-27T09:30:48.689 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-27T09:30:50.874 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T09:30:50.875 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T09:30:50.878 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 21 MB 00:02 2024-05-27T09:30:50.881 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T09:30:50.881 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T09:30:50.885 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-27T09:30:50.886 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-27T09:30:50.887 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-27T09:30:50.888 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-27T09:30:50.890 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-27T09:30:50.892 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-27T09:30:50.892 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-27T09:30:50.893 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-27T09:30:50.893 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-27T09:30:50.894 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-27T09:30:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-27T09:30:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-27T09:30:50.899 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-27T09:30:50.900 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-27T09:30:50.955 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-05-27T09:30:50.961 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:19.0.0-3868.ga6507388.el9 ceph 6.6 k 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:19.0.0-3868.ga6507388.el9 ceph 5.4 M 2024-05-27T09:30:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 863 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3868.ga6507388.el9 ceph 147 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:19.0.0-3868.ga6507388.el9 ceph 1.5 M 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 143 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 3.5 M 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 7.4 M 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 49 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:19.0.0-3868.ga6507388.el9 ceph 10 M 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:19.0.0-3868.ga6507388.el9 ceph 43 M 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 273 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 764 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:19.0.0-3868.ga6507388.el9 ceph 224 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell x86_64 2:19.0.0-3868.ga6507388.el9 ceph 27 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 18 k 2024-05-27T09:30:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:19.0.0-3868.ga6507388.el9 ceph 32 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 756 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:19.0.0-3868.ga6507388.el9 ceph 127 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-27T09:30:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:19.0.0-3868.ga6507388.el9 ceph 161 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:19.0.0-3868.ga6507388.el9 ceph 321 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 301 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:19.0.0-3868.ga6507388.el9 ceph 100 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 86 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.0 M 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 170 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-27T09:30:50.979 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.3 M 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.1 M 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-27T09:30:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:19.0.0-3868.ga6507388.el9 ceph 20 M 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 34 k 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:19.0.0-3868.ga6507388.el9 ceph 2.3 M 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 274 k 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:19.0.0-3868.ga6507388.el9 ceph 4.9 M 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 18 M 2024-05-27T09:30:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 16 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:19.0.0-3868.ga6507388.el9 ceph 25 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-27T09:30:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:19.0.0-3868.ga6507388.el9 ceph 157 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 497 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 5.2 M 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-27T09:30:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-27T09:30:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 45 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:19.0.0-3868.ga6507388.el9 ceph 136 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-27T09:30:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-27T09:30:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-27T09:30:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-27T09:30:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-27T09:30:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-27T09:30:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-27T09:30:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-27T09:30:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-27T09:30:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-27T09:30:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-27T09:30:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-27T09:30:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-27T09:30:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-27T09:30:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-27T09:30:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-27T09:30:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-27T09:30:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-27T09:30:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout:Install 148 Packages 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 11 Packages 2024-05-27T09:30:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:30:50.992 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================= 2024-05-27T09:30:50.992 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-05-27T09:30:50.992 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================= 2024-05-27T09:30:50.992 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-05-27T09:30:50.992 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:19.0.0-3868.ga6507388.el9 ceph 6.6 k 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:19.0.0-3868.ga6507388.el9 ceph 5.4 M 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 863 k 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3868.ga6507388.el9 ceph 147 k 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:19.0.0-3868.ga6507388.el9 ceph 1.5 M 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 143 k 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 3.5 M 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 7.4 M 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 49 k 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:19.0.0-3868.ga6507388.el9 ceph 10 M 2024-05-27T09:30:50.993 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:19.0.0-3868.ga6507388.el9 ceph 43 M 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 273 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 764 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:19.0.0-3868.ga6507388.el9 ceph 224 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell x86_64 2:19.0.0-3868.ga6507388.el9 ceph 27 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 18 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:19.0.0-3868.ga6507388.el9 ceph 32 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 756 k 2024-05-27T09:30:50.994 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:19.0.0-3868.ga6507388.el9 ceph 127 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:19.0.0-3868.ga6507388.el9 ceph 161 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:19.0.0-3868.ga6507388.el9 ceph 321 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 301 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:19.0.0-3868.ga6507388.el9 ceph 100 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 86 k 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.0 M 2024-05-27T09:30:50.995 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 170 k 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.3 M 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.1 M 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-27T09:30:50.996 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:19.0.0-3868.ga6507388.el9 ceph 20 M 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 34 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:19.0.0-3868.ga6507388.el9 ceph 2.3 M 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 274 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:19.0.0-3868.ga6507388.el9 ceph 4.9 M 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 18 M 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 16 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:19.0.0-3868.ga6507388.el9 ceph 25 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-27T09:30:50.997 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:19.0.0-3868.ga6507388.el9 ceph 157 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 497 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-27T09:30:50.998 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 5.2 M 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-27T09:30:50.999 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 45 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:19.0.0-3868.ga6507388.el9 ceph 136 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-27T09:30:51.000 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-27T09:30:51.001 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-27T09:30:51.002 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-27T09:30:51.003 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-27T09:30:51.004 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================= 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout:Install 148 Packages 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 11 Packages 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 219 M 2024-05-27T09:30:51.005 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-05-27T09:30:51.006 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 219 M 2024-05-27T09:30:51.006 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-05-27T09:30:51.707 INFO:teuthology.orchestra.run.smithi122.stdout:(1/159): ceph-19.0.0-3868.ga6507388.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-27T09:30:51.730 INFO:teuthology.orchestra.run.smithi072.stdout:(1/159): ceph-19.0.0-3868.ga6507388.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-05-27T09:30:52.715 INFO:teuthology.orchestra.run.smithi122.stdout:(2/159): ceph-fuse-19.0.0-3868.ga6507388.el9.x8 856 kB/s | 863 kB 00:01 2024-05-27T09:30:52.916 INFO:teuthology.orchestra.run.smithi122.stdout:(3/159): ceph-immutable-object-cache-19.0.0-386 735 kB/s | 147 kB 00:00 2024-05-27T09:30:53.439 INFO:teuthology.orchestra.run.smithi072.stdout:(2/159): ceph-fuse-19.0.0-3868.ga6507388.el9.x8 505 kB/s | 863 kB 00:01 2024-05-27T09:30:53.474 INFO:teuthology.orchestra.run.smithi122.stdout:(4/159): ceph-base-19.0.0-3868.ga6507388.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-05-27T09:30:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:(3/159): ceph-immutable-object-cache-19.0.0-386 928 kB/s | 147 kB 00:00 2024-05-27T09:30:53.725 INFO:teuthology.orchestra.run.smithi122.stdout:(5/159): ceph-mgr-19.0.0-3868.ga6507388.el9.x86 6.0 MB/s | 1.5 MB 00:00 2024-05-27T09:30:53.883 INFO:teuthology.orchestra.run.smithi122.stdout:(6/159): ceph-mds-19.0.0-3868.ga6507388.el9.x86 2.3 MB/s | 2.3 MB 00:00 2024-05-27T09:30:54.909 INFO:teuthology.orchestra.run.smithi122.stdout:(7/159): ceph-mon-19.0.0-3868.ga6507388.el9.x86 4.1 MB/s | 4.9 MB 00:01 2024-05-27T09:30:55.557 INFO:teuthology.orchestra.run.smithi072.stdout:(4/159): ceph-mds-19.0.0-3868.ga6507388.el9.x86 1.2 MB/s | 2.3 MB 00:01 2024-05-27T09:30:56.091 INFO:teuthology.orchestra.run.smithi072.stdout:(5/159): ceph-base-19.0.0-3868.ga6507388.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-05-27T09:30:56.592 INFO:teuthology.orchestra.run.smithi122.stdout:(8/159): ceph-osd-19.0.0-3868.ga6507388.el9.x86 6.6 MB/s | 18 MB 00:02 2024-05-27T09:30:56.599 INFO:teuthology.orchestra.run.smithi072.stdout:(6/159): ceph-mgr-19.0.0-3868.ga6507388.el9.x86 1.4 MB/s | 1.5 MB 00:01 2024-05-27T09:30:56.709 INFO:teuthology.orchestra.run.smithi122.stdout:(9/159): ceph-selinux-19.0.0-3868.ga6507388.el9 216 kB/s | 25 kB 00:00 2024-05-27T09:30:57.013 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-27T09:30:57.384 INFO:teuthology.orchestra.run.smithi122.stdout:(10/159): ceph-common-19.0.0-3868.ga6507388.el9 3.3 MB/s | 20 MB 00:06 2024-05-27T09:30:57.551 INFO:teuthology.orchestra.run.smithi122.stdout:(11/159): cephfs-mirror-19.0.0-3868.ga6507388.e 1.3 MB/s | 224 kB 00:00 2024-05-27T09:30:57.635 INFO:teuthology.orchestra.run.smithi122.stdout:(12/159): cephfs-shell-19.0.0-3868.ga6507388.el 324 kB/s | 27 kB 00:00 2024-05-27T09:30:57.718 INFO:teuthology.orchestra.run.smithi122.stdout:(13/159): libcephfs-devel-19.0.0-3868.ga6507388 381 kB/s | 32 kB 00:00 2024-05-27T09:30:58.094 INFO:teuthology.orchestra.run.smithi122.stdout:(14/159): libcephfs2-19.0.0-3868.ga6507388.el9. 2.0 MB/s | 756 kB 00:00 2024-05-27T09:30:58.270 INFO:teuthology.orchestra.run.smithi122.stdout:(15/159): ceph-radosgw-19.0.0-3868.ga6507388.el 3.0 MB/s | 10 MB 00:03 2024-05-27T09:30:58.295 INFO:teuthology.orchestra.run.smithi122.stdout:(16/159): libcephsqlite-19.0.0-3868.ga6507388.e 784 kB/s | 157 kB 00:00 2024-05-27T09:30:58.362 INFO:teuthology.orchestra.run.smithi122.stdout:(17/159): librados-devel-19.0.0-3868.ga6507388. 1.4 MB/s | 127 kB 00:00 2024-05-27T09:30:58.545 INFO:teuthology.orchestra.run.smithi122.stdout:(18/159): libradosstriper1-19.0.0-3868.ga650738 1.9 MB/s | 497 kB 00:00 2024-05-27T09:30:58.637 INFO:teuthology.orchestra.run.smithi122.stdout:(19/159): python3-ceph-argparse-19.0.0-3868.ga6 492 kB/s | 45 kB 00:00 2024-05-27T09:30:58.729 INFO:teuthology.orchestra.run.smithi122.stdout:(20/159): python3-ceph-common-19.0.0-3868.ga650 1.4 MB/s | 136 kB 00:00 2024-05-27T09:30:58.821 INFO:teuthology.orchestra.run.smithi122.stdout:(21/159): python3-cephfs-19.0.0-3868.ga6507388. 1.7 MB/s | 161 kB 00:00 2024-05-27T09:30:58.980 INFO:teuthology.orchestra.run.smithi122.stdout:(22/159): python3-rados-19.0.0-3868.ga6507388.e 2.0 MB/s | 321 kB 00:00 2024-05-27T09:30:59.147 INFO:teuthology.orchestra.run.smithi122.stdout:(23/159): python3-rbd-19.0.0-3868.ga6507388.el9 1.8 MB/s | 301 kB 00:00 2024-05-27T09:30:59.247 INFO:teuthology.orchestra.run.smithi122.stdout:(24/159): python3-rgw-19.0.0-3868.ga6507388.el9 997 kB/s | 100 kB 00:00 2024-05-27T09:30:59.333 INFO:teuthology.orchestra.run.smithi072.stdout:(7/159): ceph-mon-19.0.0-3868.ga6507388.el9.x86 1.5 MB/s | 4.9 MB 00:03 2024-05-27T09:30:59.339 INFO:teuthology.orchestra.run.smithi122.stdout:(25/159): rbd-fuse-19.0.0-3868.ga6507388.el9.x8 936 kB/s | 86 kB 00:00 2024-05-27T09:30:59.448 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T09:30:59.449 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T09:30:59.470 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-27T09:30:59.471 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-27T09:30:59.473 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-27T09:30:59.474 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-27T09:30:59.476 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-27T09:30:59.480 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-27T09:30:59.481 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-27T09:30:59.552 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-05-27T09:30:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-05-27T09:30:59.567 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.0.0-3868.ga6507388.el9 ceph 6.6 k 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.0.0-3868.ga6507388.el9 ceph 5.4 M 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 863 k 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3868.ga6507388.el9 ceph 147 k 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.0.0-3868.ga6507388.el9 ceph 1.5 M 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 143 k 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 3.5 M 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 7.4 M 2024-05-27T09:30:59.568 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 49 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.0.0-3868.ga6507388.el9 ceph 10 M 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.0.0-3868.ga6507388.el9 ceph 43 M 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 273 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 764 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.0.0-3868.ga6507388.el9 ceph 224 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.0.0-3868.ga6507388.el9 ceph 27 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 18 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.0.0-3868.ga6507388.el9 ceph 32 k 2024-05-27T09:30:59.569 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 756 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.0.0-3868.ga6507388.el9 ceph 127 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.0.0-3868.ga6507388.el9 ceph 161 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.0.0-3868.ga6507388.el9 ceph 321 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 301 k 2024-05-27T09:30:59.570 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.0.0-3868.ga6507388.el9 ceph 100 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 86 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.0 M 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 170 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-27T09:30:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.3 M 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 3.1 M 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.0.0-3868.ga6507388.el9 ceph 20 M 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 34 k 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.0.0-3868.ga6507388.el9 ceph 2.3 M 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 274 k 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.0.0-3868.ga6507388.el9 ceph 4.9 M 2024-05-27T09:30:59.572 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.0.0-3868.ga6507388.el9 ceph 18 M 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3868.ga6507388.el9 ceph-noarch 16 k 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.0.0-3868.ga6507388.el9 ceph 25 k 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-27T09:30:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.0.0-3868.ga6507388.el9 ceph 157 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 497 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.0.0-3868.ga6507388.el9 ceph 5.2 M 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-27T09:30:59.574 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-27T09:30:59.575 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.0.0-3868.ga6507388.el9 ceph 45 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.0.0-3868.ga6507388.el9 ceph 136 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-27T09:30:59.576 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-27T09:30:59.577 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-27T09:30:59.578 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-27T09:30:59.579 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-27T09:30:59.580 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:Install 148 Packages 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 11 Packages 2024-05-27T09:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:30:59.582 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 219 M 2024-05-27T09:30:59.582 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-05-27T09:31:00.490 INFO:teuthology.orchestra.run.smithi071.stdout:(1/159): ceph-19.0.0-3868.ga6507388.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-05-27T09:31:00.748 INFO:teuthology.orchestra.run.smithi122.stdout:(26/159): rbd-mirror-19.0.0-3868.ga6507388.el9. 2.2 MB/s | 3.0 MB 00:01 2024-05-27T09:31:00.823 INFO:teuthology.orchestra.run.smithi122.stdout:(27/159): librgw2-19.0.0-3868.ga6507388.el9.x86 2.1 MB/s | 5.2 MB 00:02 2024-05-27T09:31:00.923 INFO:teuthology.orchestra.run.smithi122.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3868.g 343 kB/s | 34 kB 00:00 2024-05-27T09:31:00.949 INFO:teuthology.orchestra.run.smithi122.stdout:(29/159): rbd-nbd-19.0.0-3868.ga6507388.el9.x86 848 kB/s | 170 kB 00:00 2024-05-27T09:31:01.024 INFO:teuthology.orchestra.run.smithi122.stdout:(30/159): ceph-mgr-cephadm-19.0.0-3868.ga650738 1.4 MB/s | 143 kB 00:00 2024-05-27T09:31:01.340 INFO:teuthology.orchestra.run.smithi071.stdout:(2/159): ceph-fuse-19.0.0-3868.ga6507388.el9.x8 1.0 MB/s | 863 kB 00:00 2024-05-27T09:31:01.573 INFO:teuthology.orchestra.run.smithi071.stdout:(3/159): ceph-immutable-object-cache-19.0.0-386 633 kB/s | 147 kB 00:00 2024-05-27T09:31:02.557 INFO:teuthology.orchestra.run.smithi071.stdout:(4/159): ceph-mds-19.0.0-3868.ga6507388.el9.x86 2.3 MB/s | 2.3 MB 00:00 2024-05-27T09:31:02.692 INFO:teuthology.orchestra.run.smithi122.stdout:(31/159): ceph-test-19.0.0-3868.ga6507388.el9.x 7.2 MB/s | 43 MB 00:05 2024-05-27T09:31:02.758 INFO:teuthology.orchestra.run.smithi122.stdout:(32/159): ceph-mgr-dashboard-19.0.0-3868.ga6507 2.0 MB/s | 3.5 MB 00:01 2024-05-27T09:31:02.858 INFO:teuthology.orchestra.run.smithi122.stdout:(33/159): ceph-mgr-rook-19.0.0-3868.ga6507388.e 494 kB/s | 49 kB 00:00 2024-05-27T09:31:02.893 INFO:teuthology.orchestra.run.smithi122.stdout:(34/159): ceph-mgr-modules-core-19.0.0-3868.ga6 1.3 MB/s | 274 kB 00:00 2024-05-27T09:31:02.926 INFO:teuthology.orchestra.run.smithi122.stdout:(35/159): ceph-prometheus-alerts-19.0.0-3868.ga 245 kB/s | 16 kB 00:00 2024-05-27T09:31:02.993 INFO:teuthology.orchestra.run.smithi122.stdout:(36/159): ceph-volume-19.0.0-3868.ga6507388.el9 2.7 MB/s | 273 kB 00:00 2024-05-27T09:31:03.090 INFO:teuthology.orchestra.run.smithi071.stdout:(5/159): ceph-mgr-19.0.0-3868.ga6507388.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-05-27T09:31:03.101 INFO:teuthology.orchestra.run.smithi122.stdout:(37/159): cephfs-top-19.0.0-3868.ga6507388.el9. 168 kB/s | 18 kB 00:00 2024-05-27T09:31:03.310 INFO:teuthology.orchestra.run.smithi122.stdout:(38/159): cephadm-19.0.0-3868.ga6507388.el9.noa 1.9 MB/s | 764 kB 00:00 2024-05-27T09:31:03.335 INFO:teuthology.orchestra.run.smithi122.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 344 kB/s | 80 kB 00:00 2024-05-27T09:31:03.461 INFO:teuthology.orchestra.run.smithi122.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-05-27T09:31:03.586 INFO:teuthology.orchestra.run.smithi122.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-05-27T09:31:03.762 INFO:teuthology.orchestra.run.smithi122.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-05-27T09:31:03.812 INFO:teuthology.orchestra.run.smithi122.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-27T09:31:03.862 INFO:teuthology.orchestra.run.smithi122.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-05-27T09:31:03.896 INFO:teuthology.orchestra.run.smithi122.stdout:(45/159): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-05-27T09:31:03.979 INFO:teuthology.orchestra.run.smithi122.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-27T09:31:04.046 INFO:teuthology.orchestra.run.smithi122.stdout:(47/159): python3-requests-2.25.1-8.el9.noarch. 679 kB/s | 125 kB 00:00 2024-05-27T09:31:04.155 INFO:teuthology.orchestra.run.smithi122.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-05-27T09:31:04.247 INFO:teuthology.orchestra.run.smithi122.stdout:(49/159): ceph-mgr-diskprediction-local-19.0.0- 2.3 MB/s | 7.4 MB 00:03 2024-05-27T09:31:04.265 INFO:teuthology.orchestra.run.smithi071.stdout:(6/159): ceph-mon-19.0.0-3868.ga6507388.el9.x86 4.2 MB/s | 4.9 MB 00:01 2024-05-27T09:31:04.272 INFO:teuthology.orchestra.run.smithi122.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 913 kB/s | 107 kB 00:00 2024-05-27T09:31:04.331 INFO:teuthology.orchestra.run.smithi122.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-05-27T09:31:04.356 INFO:teuthology.orchestra.run.smithi122.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-05-27T09:31:04.390 INFO:teuthology.orchestra.run.smithi122.stdout:(53/159): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-05-27T09:31:04.415 INFO:teuthology.orchestra.run.smithi122.stdout:(54/159): flexiblas-3.0.4-8.el9.x86_64.rpm 389 kB/s | 33 kB 00:00 2024-05-27T09:31:04.441 INFO:teuthology.orchestra.run.smithi122.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-05-27T09:31:04.466 INFO:teuthology.orchestra.run.smithi071.stdout:(7/159): ceph-base-19.0.0-3868.ga6507388.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-05-27T09:31:04.466 INFO:teuthology.orchestra.run.smithi122.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 220 kB/s | 11 kB 00:00 2024-05-27T09:31:04.525 INFO:teuthology.orchestra.run.smithi122.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-05-27T09:31:04.550 INFO:teuthology.orchestra.run.smithi122.stdout:(58/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-27T09:31:04.692 INFO:teuthology.orchestra.run.smithi122.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 582 kB 00:00 2024-05-27T09:31:04.702 INFO:teuthology.orchestra.run.smithi072.stdout:(8/159): ceph-radosgw-19.0.0-3868.ga6507388.el9 1.9 MB/s | 10 MB 00:05 2024-05-27T09:31:04.717 INFO:teuthology.orchestra.run.smithi122.stdout:(60/159): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-05-27T09:31:04.776 INFO:teuthology.orchestra.run.smithi122.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-05-27T09:31:04.794 INFO:teuthology.orchestra.run.smithi072.stdout:(9/159): ceph-selinux-19.0.0-3868.ga6507388.el9 275 kB/s | 25 kB 00:00 2024-05-27T09:31:04.802 INFO:teuthology.orchestra.run.smithi122.stdout:(62/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 233 kB/s | 25 kB 00:00 2024-05-27T09:31:04.868 INFO:teuthology.orchestra.run.smithi122.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-27T09:31:04.910 INFO:teuthology.orchestra.run.smithi122.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-27T09:31:04.936 INFO:teuthology.orchestra.run.smithi122.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-05-27T09:31:04.978 INFO:teuthology.orchestra.run.smithi122.stdout:(66/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-05-27T09:31:05.288 INFO:teuthology.orchestra.run.smithi122.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-05-27T09:31:05.470 INFO:teuthology.orchestra.run.smithi122.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 4.9 MB/s | 911 kB 00:00 2024-05-27T09:31:05.529 INFO:teuthology.orchestra.run.smithi122.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-27T09:31:05.569 INFO:teuthology.orchestra.run.smithi072.stdout:(10/159): ceph-common-19.0.0-3868.ga6507388.el9 1.4 MB/s | 20 MB 00:14 2024-05-27T09:31:05.787 INFO:teuthology.orchestra.run.smithi122.stdout:(70/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-05-27T09:31:05.879 INFO:teuthology.orchestra.run.smithi072.stdout:(11/159): cephfs-mirror-19.0.0-3868.ga6507388.e 726 kB/s | 224 kB 00:00 2024-05-27T09:31:05.979 INFO:teuthology.orchestra.run.smithi072.stdout:(12/159): cephfs-shell-19.0.0-3868.ga6507388.el 270 kB/s | 27 kB 00:00 2024-05-27T09:31:05.979 INFO:teuthology.orchestra.run.smithi122.stdout:(71/159): openblas-openmp-0.3.21-2.el9.x86_64.r 4.4 MB/s | 4.7 MB 00:01 2024-05-27T09:31:06.013 INFO:teuthology.orchestra.run.smithi122.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-05-27T09:31:06.038 INFO:teuthology.orchestra.run.smithi122.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-27T09:31:06.079 INFO:teuthology.orchestra.run.smithi072.stdout:(13/159): libcephfs-devel-19.0.0-3868.ga6507388 316 kB/s | 32 kB 00:00 2024-05-27T09:31:06.089 INFO:teuthology.orchestra.run.smithi122.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-05-27T09:31:06.180 INFO:teuthology.orchestra.run.smithi122.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-05-27T09:31:06.273 INFO:teuthology.orchestra.run.smithi122.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-05-27T09:31:06.323 INFO:teuthology.orchestra.run.smithi122.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-05-27T09:31:06.373 INFO:teuthology.orchestra.run.smithi122.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-05-27T09:31:06.474 INFO:teuthology.orchestra.run.smithi122.stdout:(79/159): postgresql-server-13.14-1.el9.x86_64. 6.1 MB/s | 5.8 MB 00:00 2024-05-27T09:31:06.499 INFO:teuthology.orchestra.run.smithi122.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-05-27T09:31:06.516 INFO:teuthology.orchestra.run.smithi122.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 822 kB/s | 35 kB 00:00 2024-05-27T09:31:06.575 INFO:teuthology.orchestra.run.smithi122.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-05-27T09:31:06.633 INFO:teuthology.orchestra.run.smithi122.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-05-27T09:31:06.655 INFO:teuthology.orchestra.run.smithi072.stdout:(14/159): libcephfs2-19.0.0-3868.ga6507388.el9. 1.3 MB/s | 756 kB 00:00 2024-05-27T09:31:06.692 INFO:teuthology.orchestra.run.smithi122.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-27T09:31:06.751 INFO:teuthology.orchestra.run.smithi122.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 725 kB/s | 42 kB 00:00 2024-05-27T09:31:06.822 INFO:teuthology.orchestra.run.smithi072.stdout:(15/159): libcephsqlite-19.0.0-3868.ga6507388.e 942 kB/s | 157 kB 00:00 2024-05-27T09:31:06.834 INFO:teuthology.orchestra.run.smithi122.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-05-27T09:31:06.893 INFO:teuthology.orchestra.run.smithi122.stdout:(87/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-05-27T09:31:06.965 INFO:teuthology.orchestra.run.smithi072.stdout:(16/159): librados-devel-19.0.0-3868.ga6507388. 894 kB/s | 127 kB 00:00 2024-05-27T09:31:07.018 INFO:teuthology.orchestra.run.smithi122.stdout:(88/159): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-05-27T09:31:07.024 INFO:teuthology.orchestra.run.smithi071.stdout:(8/159): ceph-osd-19.0.0-3868.ga6507388.el9.x86 6.4 MB/s | 18 MB 00:02 2024-05-27T09:31:07.044 INFO:teuthology.orchestra.run.smithi122.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-05-27T09:31:07.069 INFO:teuthology.orchestra.run.smithi122.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-27T09:31:07.094 INFO:teuthology.orchestra.run.smithi122.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-27T09:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout:(9/159): ceph-selinux-19.0.0-3868.ga6507388.el9 235 kB/s | 25 kB 00:00 2024-05-27T09:31:07.145 INFO:teuthology.orchestra.run.smithi122.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-05-27T09:31:07.203 INFO:teuthology.orchestra.run.smithi122.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 760 kB/s | 44 kB 00:00 2024-05-27T09:31:07.262 INFO:teuthology.orchestra.run.smithi122.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-27T09:31:07.321 INFO:teuthology.orchestra.run.smithi122.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-05-27T09:31:07.379 INFO:teuthology.orchestra.run.smithi122.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-05-27T09:31:07.477 INFO:teuthology.orchestra.run.smithi072.stdout:(17/159): libradosstriper1-19.0.0-3868.ga650738 970 kB/s | 497 kB 00:00 2024-05-27T09:31:07.505 INFO:teuthology.orchestra.run.smithi122.stdout:(97/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.1 MB/s | 5.1 MB 00:01 2024-05-27T09:31:07.530 INFO:teuthology.orchestra.run.smithi122.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 2.0 MB/s | 305 kB 00:00 2024-05-27T09:31:07.555 INFO:teuthology.orchestra.run.smithi122.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-27T09:31:07.589 INFO:teuthology.orchestra.run.smithi122.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-05-27T09:31:07.614 INFO:teuthology.orchestra.run.smithi122.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-27T09:31:07.640 INFO:teuthology.orchestra.run.smithi122.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-05-27T09:31:07.665 INFO:teuthology.orchestra.run.smithi122.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2024-05-27T09:31:07.791 INFO:teuthology.orchestra.run.smithi122.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-05-27T09:31:07.991 INFO:teuthology.orchestra.run.smithi122.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-05-27T09:31:08.050 INFO:teuthology.orchestra.run.smithi122.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-05-27T09:31:08.183 INFO:teuthology.orchestra.run.smithi122.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 787 kB/s | 309 kB 00:00 2024-05-27T09:31:08.275 INFO:teuthology.orchestra.run.smithi122.stdout:(108/159): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-05-27T09:31:08.301 INFO:teuthology.orchestra.run.smithi122.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-05-27T09:31:08.326 INFO:teuthology.orchestra.run.smithi122.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-05-27T09:31:08.385 INFO:teuthology.orchestra.run.smithi122.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-27T09:31:08.410 INFO:teuthology.orchestra.run.smithi122.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 618 kB/s | 67 kB 00:00 2024-05-27T09:31:08.452 INFO:teuthology.orchestra.run.smithi122.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-05-27T09:31:08.511 INFO:teuthology.orchestra.run.smithi122.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 747 kB/s | 43 kB 00:00 2024-05-27T09:31:08.561 INFO:teuthology.orchestra.run.smithi122.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 645 kB/s | 32 kB 00:00 2024-05-27T09:31:08.603 INFO:teuthology.orchestra.run.smithi122.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-05-27T09:31:08.661 INFO:teuthology.orchestra.run.smithi122.stdout:(117/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-27T09:31:08.720 INFO:teuthology.orchestra.run.smithi122.stdout:(118/159): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-05-27T09:31:08.771 INFO:teuthology.orchestra.run.smithi122.stdout:(119/159): python3-asyncssh-2.13.2-5.el9.noarch 1.5 MB/s | 548 kB 00:00 2024-05-27T09:31:08.796 INFO:teuthology.orchestra.run.smithi122.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-27T09:31:08.888 INFO:teuthology.orchestra.run.smithi122.stdout:(121/159): python3-grpcio-1.46.7-10.el9.x86_64. 22 MB/s | 2.0 MB 00:00 2024-05-27T09:31:08.922 INFO:teuthology.orchestra.run.smithi122.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-05-27T09:31:08.947 INFO:teuthology.orchestra.run.smithi122.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-27T09:31:08.981 INFO:teuthology.orchestra.run.smithi122.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-05-27T09:31:09.006 INFO:teuthology.orchestra.run.smithi122.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-05-27T09:31:09.048 INFO:teuthology.orchestra.run.smithi122.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 345 kB/s | 23 kB 00:00 2024-05-27T09:31:09.073 INFO:teuthology.orchestra.run.smithi122.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-05-27T09:31:09.107 INFO:teuthology.orchestra.run.smithi122.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-05-27T09:31:09.266 INFO:teuthology.orchestra.run.smithi122.stdout:(129/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-05-27T09:31:09.291 INFO:teuthology.orchestra.run.smithi122.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 252 kB/s | 46 kB 00:00 2024-05-27T09:31:09.325 INFO:teuthology.orchestra.run.smithi122.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-05-27T09:31:09.375 INFO:teuthology.orchestra.run.smithi122.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2024-05-27T09:31:09.401 INFO:teuthology.orchestra.run.smithi122.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-27T09:31:09.434 INFO:teuthology.orchestra.run.smithi122.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-05-27T09:31:09.460 INFO:teuthology.orchestra.run.smithi122.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-27T09:31:09.485 INFO:teuthology.orchestra.run.smithi122.stdout:(136/159): python3-more-itertools-8.12.0-2.el9. 361 kB/s | 79 kB 00:00 2024-05-27T09:31:09.510 INFO:teuthology.orchestra.run.smithi122.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 372 kB/s | 28 kB 00:00 2024-05-27T09:31:09.536 INFO:teuthology.orchestra.run.smithi122.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-27T09:31:09.586 INFO:teuthology.orchestra.run.smithi122.stdout:(139/159): python3-tempora-5.0.0-2.el9.noarch.r 717 kB/s | 36 kB 00:00 2024-05-27T09:31:09.611 INFO:teuthology.orchestra.run.smithi122.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-05-27T09:31:09.636 INFO:teuthology.orchestra.run.smithi122.stdout:(141/159): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-05-27T09:31:09.641 INFO:teuthology.orchestra.run.smithi072.stdout:(18/159): ceph-osd-19.0.0-3868.ga6507388.el9.x8 1.4 MB/s | 18 MB 00:13 2024-05-27T09:31:09.662 INFO:teuthology.orchestra.run.smithi122.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-05-27T09:31:09.704 INFO:teuthology.orchestra.run.smithi122.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-27T09:31:09.729 INFO:teuthology.orchestra.run.smithi122.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-05-27T09:31:09.741 INFO:teuthology.orchestra.run.smithi072.stdout:(19/159): python3-ceph-argparse-19.0.0-3868.ga6 452 kB/s | 45 kB 00:00 2024-05-27T09:31:09.763 INFO:teuthology.orchestra.run.smithi122.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-05-27T09:31:09.788 INFO:teuthology.orchestra.run.smithi122.stdout:(146/159): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-05-27T09:31:09.813 INFO:teuthology.orchestra.run.smithi122.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-05-27T09:31:09.930 INFO:teuthology.orchestra.run.smithi122.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-05-27T09:31:09.933 INFO:teuthology.orchestra.run.smithi072.stdout:(20/159): python3-ceph-common-19.0.0-3868.ga650 707 kB/s | 136 kB 00:00 2024-05-27T09:31:10.111 INFO:teuthology.orchestra.run.smithi072.stdout:(21/159): python3-cephfs-19.0.0-3868.ga6507388. 913 kB/s | 161 kB 00:00 2024-05-27T09:31:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:(149/159): NetworkManager-1.47.90-1.el9.x86_64. 6.9 MB/s | 2.3 MB 00:00 2024-05-27T09:31:10.458 INFO:teuthology.orchestra.run.smithi071.stdout:(10/159): ceph-radosgw-19.0.0-3868.ga6507388.el 1.7 MB/s | 10 MB 00:05 2024-05-27T09:31:10.494 INFO:teuthology.orchestra.run.smithi072.stdout:(22/159): python3-rados-19.0.0-3868.ga6507388.e 836 kB/s | 321 kB 00:00 2024-05-27T09:31:10.506 INFO:teuthology.orchestra.run.smithi122.stdout:(150/159): NetworkManager-libnm-1.47.90-1.el9.x 7.5 MB/s | 1.8 MB 00:00 2024-05-27T09:31:10.556 INFO:teuthology.orchestra.run.smithi122.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 830 kB/s | 41 kB 00:00 2024-05-27T09:31:10.615 INFO:teuthology.orchestra.run.smithi122.stdout:(152/159): NetworkManager-tui-1.47.90-1.el9.x86 4.1 MB/s | 248 kB 00:00 2024-05-27T09:31:10.665 INFO:teuthology.orchestra.run.smithi122.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 735 kB/s | 37 kB 00:00 2024-05-27T09:31:10.666 INFO:teuthology.orchestra.run.smithi071.stdout:(11/159): cephfs-mirror-19.0.0-3868.ga6507388.e 1.1 MB/s | 224 kB 00:00 2024-05-27T09:31:10.724 INFO:teuthology.orchestra.run.smithi122.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-05-27T09:31:10.783 INFO:teuthology.orchestra.run.smithi122.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-05-27T09:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout:(12/159): cephfs-shell-19.0.0-3868.ga6507388.el 203 kB/s | 27 kB 00:00 2024-05-27T09:31:10.850 INFO:teuthology.orchestra.run.smithi122.stdout:(156/159): librados2-19.0.0-3868.ga6507388.el9. 3.1 MB/s | 3.3 MB 00:01 2024-05-27T09:31:10.853 INFO:teuthology.orchestra.run.smithi072.stdout:(23/159): python3-rbd-19.0.0-3868.ga6507388.el9 840 kB/s | 301 kB 00:00 2024-05-27T09:31:10.900 INFO:teuthology.orchestra.run.smithi071.stdout:(13/159): libcephfs-devel-19.0.0-3868.ga6507388 320 kB/s | 32 kB 00:00 2024-05-27T09:31:10.987 INFO:teuthology.orchestra.run.smithi072.stdout:(24/159): python3-rgw-19.0.0-3868.ga6507388.el9 745 kB/s | 100 kB 00:00 2024-05-27T09:31:11.008 INFO:teuthology.orchestra.run.smithi122.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 1.3 MB 00:00 2024-05-27T09:31:11.121 INFO:teuthology.orchestra.run.smithi072.stdout:(25/159): rbd-fuse-19.0.0-3868.ga6507388.el9.x8 644 kB/s | 86 kB 00:00 2024-05-27T09:31:11.225 INFO:teuthology.orchestra.run.smithi122.stdout:(158/159): librbd1-19.0.0-3868.ga6507388.el9.x8 2.2 MB/s | 3.1 MB 00:01 2024-05-27T09:31:11.284 INFO:teuthology.orchestra.run.smithi122.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.5 MB/s | 2.4 MB 00:00 2024-05-27T09:31:11.287 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-05-27T09:31:11.287 INFO:teuthology.orchestra.run.smithi122.stdout:Total 11 MB/s | 219 MB 00:20 2024-05-27T09:31:11.372 INFO:teuthology.orchestra.run.smithi072.stdout:(26/159): librgw2-19.0.0-3868.ga6507388.el9.x86 1.3 MB/s | 5.2 MB 00:03 2024-05-27T09:31:11.400 INFO:teuthology.orchestra.run.smithi071.stdout:(14/159): libcephfs2-19.0.0-3868.ga6507388.el9. 1.5 MB/s | 756 kB 00:00 2024-05-27T09:31:11.497 INFO:teuthology.orchestra.run.smithi072.stdout:(27/159): rbd-nbd-19.0.0-3868.ga6507388.el9.x86 1.3 MB/s | 170 kB 00:00 2024-05-27T09:31:11.550 INFO:teuthology.orchestra.run.smithi071.stdout:(15/159): libcephsqlite-19.0.0-3868.ga6507388.e 1.0 MB/s | 157 kB 00:00 2024-05-27T09:31:11.564 INFO:teuthology.orchestra.run.smithi072.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3868.g 512 kB/s | 34 kB 00:00 2024-05-27T09:31:11.690 INFO:teuthology.orchestra.run.smithi072.stdout:(29/159): ceph-mgr-cephadm-19.0.0-3868.ga650738 1.1 MB/s | 143 kB 00:00 2024-05-27T09:31:11.701 INFO:teuthology.orchestra.run.smithi071.stdout:(16/159): librados-devel-19.0.0-3868.ga6507388. 849 kB/s | 127 kB 00:00 2024-05-27T09:31:12.001 INFO:teuthology.orchestra.run.smithi071.stdout:(17/159): libradosstriper1-19.0.0-3868.ga650738 1.6 MB/s | 497 kB 00:00 2024-05-27T09:31:12.463 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-05-27T09:31:12.619 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-05-27T09:31:12.619 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-05-27T09:31:13.324 INFO:teuthology.orchestra.run.smithi072.stdout:(30/159): rbd-mirror-19.0.0-3868.ga6507388.el9. 1.4 MB/s | 3.0 MB 00:02 2024-05-27T09:31:13.400 INFO:teuthology.orchestra.run.smithi072.stdout:(31/159): ceph-mgr-dashboard-19.0.0-3868.ga6507 2.1 MB/s | 3.5 MB 00:01 2024-05-27T09:31:13.608 INFO:teuthology.orchestra.run.smithi072.stdout:(32/159): ceph-mgr-modules-core-19.0.0-3868.ga6 1.3 MB/s | 274 kB 00:00 2024-05-27T09:31:13.693 INFO:teuthology.orchestra.run.smithi072.stdout:(33/159): ceph-mgr-rook-19.0.0-3868.ga6507388.e 589 kB/s | 49 kB 00:00 2024-05-27T09:31:13.777 INFO:teuthology.orchestra.run.smithi072.stdout:(34/159): ceph-prometheus-alerts-19.0.0-3868.ga 197 kB/s | 16 kB 00:00 2024-05-27T09:31:13.920 INFO:teuthology.orchestra.run.smithi072.stdout:(35/159): ceph-volume-19.0.0-3868.ga6507388.el9 1.9 MB/s | 273 kB 00:00 2024-05-27T09:31:14.321 INFO:teuthology.orchestra.run.smithi072.stdout:(36/159): cephadm-19.0.0-3868.ga6507388.el9.noa 1.9 MB/s | 764 kB 00:00 2024-05-27T09:31:14.369 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-05-27T09:31:14.369 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-05-27T09:31:14.404 INFO:teuthology.orchestra.run.smithi072.stdout:(37/159): cephfs-top-19.0.0-3868.ga6507388.el9. 219 kB/s | 18 kB 00:00 2024-05-27T09:31:14.513 INFO:teuthology.orchestra.run.smithi072.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 741 kB/s | 80 kB 00:00 2024-05-27T09:31:14.606 INFO:teuthology.orchestra.run.smithi072.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2024-05-27T09:31:14.648 INFO:teuthology.orchestra.run.smithi072.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-05-27T09:31:14.691 INFO:teuthology.orchestra.run.smithi072.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-05-27T09:31:14.758 INFO:teuthology.orchestra.run.smithi072.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-05-27T09:31:14.800 INFO:teuthology.orchestra.run.smithi072.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-05-27T09:31:14.842 INFO:teuthology.orchestra.run.smithi072.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.1 MB/s | 135 kB 00:00 2024-05-27T09:31:14.885 INFO:teuthology.orchestra.run.smithi072.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-05-27T09:31:14.901 INFO:teuthology.orchestra.run.smithi071.stdout:(18/159): librgw2-19.0.0-3868.ga6507388.el9.x86 1.8 MB/s | 5.2 MB 00:02 2024-05-27T09:31:14.927 INFO:teuthology.orchestra.run.smithi072.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-05-27T09:31:15.018 INFO:teuthology.orchestra.run.smithi071.stdout:(19/159): python3-ceph-argparse-19.0.0-3868.ga6 390 kB/s | 45 kB 00:00 2024-05-27T09:31:15.118 INFO:teuthology.orchestra.run.smithi071.stdout:(20/159): python3-ceph-common-19.0.0-3868.ga650 1.3 MB/s | 136 kB 00:00 2024-05-27T09:31:15.144 INFO:teuthology.orchestra.run.smithi072.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-05-27T09:31:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-05-27T09:31:15.280 INFO:teuthology.orchestra.run.smithi072.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.0 MB/s | 107 kB 00:00 2024-05-27T09:31:15.285 INFO:teuthology.orchestra.run.smithi071.stdout:(21/159): python3-cephfs-19.0.0-3868.ga6507388. 973 kB/s | 161 kB 00:00 2024-05-27T09:31:15.331 INFO:teuthology.orchestra.run.smithi072.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-05-27T09:31:15.381 INFO:teuthology.orchestra.run.smithi072.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-05-27T09:31:15.432 INFO:teuthology.orchestra.run.smithi072.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-05-27T09:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout:(22/159): python3-rados-19.0.0-3868.ga6507388.e 1.2 MB/s | 321 kB 00:00 2024-05-27T09:31:15.557 INFO:teuthology.orchestra.run.smithi072.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-05-27T09:31:15.608 INFO:teuthology.orchestra.run.smithi072.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-05-27T09:31:15.659 INFO:teuthology.orchestra.run.smithi072.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-05-27T09:31:15.710 INFO:teuthology.orchestra.run.smithi072.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-27T09:31:15.753 INFO:teuthology.orchestra.run.smithi071.stdout:(23/159): python3-rbd-19.0.0-3868.ga6507388.el9 1.4 MB/s | 301 kB 00:00 2024-05-27T09:31:15.760 INFO:teuthology.orchestra.run.smithi072.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-05-27T09:31:15.819 INFO:teuthology.orchestra.run.smithi072.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-27T09:31:15.877 INFO:teuthology.orchestra.run.smithi072.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-05-27T09:31:15.878 INFO:teuthology.orchestra.run.smithi071.stdout:(24/159): python3-rgw-19.0.0-3868.ga6507388.el9 802 kB/s | 100 kB 00:00 2024-05-27T09:31:15.920 INFO:teuthology.orchestra.run.smithi072.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 606 kB/s | 25 kB 00:00 2024-05-27T09:31:15.962 INFO:teuthology.orchestra.run.smithi072.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-27T09:31:16.003 INFO:teuthology.orchestra.run.smithi071.stdout:(25/159): rbd-fuse-19.0.0-3868.ga6507388.el9.x8 692 kB/s | 86 kB 00:00 2024-05-27T09:31:16.021 INFO:teuthology.orchestra.run.smithi072.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-27T09:31:16.073 INFO:teuthology.orchestra.run.smithi072.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 3.6 MB/s | 188 kB 00:00 2024-05-27T09:31:16.124 INFO:teuthology.orchestra.run.smithi072.stdout:(64/159): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-05-27T09:31:16.299 INFO:teuthology.orchestra.run.smithi072.stdout:(65/159): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-05-27T09:31:16.467 INFO:teuthology.orchestra.run.smithi072.stdout:(66/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-05-27T09:31:16.551 INFO:teuthology.orchestra.run.smithi072.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-05-27T09:31:16.626 INFO:teuthology.orchestra.run.smithi072.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-05-27T09:31:16.668 INFO:teuthology.orchestra.run.smithi072.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 3.1 MB/s | 133 kB 00:00 2024-05-27T09:31:16.861 INFO:teuthology.orchestra.run.smithi072.stdout:(70/159): postgresql-server-13.14-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-05-27T09:31:16.895 INFO:teuthology.orchestra.run.smithi071.stdout:(26/159): ceph-common-19.0.0-3868.ga6507388.el9 1.2 MB/s | 20 MB 00:16 2024-05-27T09:31:16.928 INFO:teuthology.orchestra.run.smithi072.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-05-27T09:31:16.970 INFO:teuthology.orchestra.run.smithi072.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 2.0 MB/s | 87 kB 00:00 2024-05-27T09:31:17.079 INFO:teuthology.orchestra.run.smithi071.stdout:(27/159): rbd-nbd-19.0.0-3868.ga6507388.el9.x86 932 kB/s | 170 kB 00:00 2024-05-27T09:31:17.154 INFO:teuthology.orchestra.run.smithi071.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3868.g 463 kB/s | 34 kB 00:00 2024-05-27T09:31:17.171 INFO:teuthology.orchestra.run.smithi072.stdout:(73/159): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-05-27T09:31:17.213 INFO:teuthology.orchestra.run.smithi072.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-05-27T09:31:17.264 INFO:teuthology.orchestra.run.smithi072.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.7 MB/s | 244 kB 00:00 2024-05-27T09:31:17.271 INFO:teuthology.orchestra.run.smithi071.stdout:(29/159): ceph-mgr-cephadm-19.0.0-3868.ga650738 1.2 MB/s | 143 kB 00:00 2024-05-27T09:31:17.324 INFO:teuthology.orchestra.run.smithi072.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.0 MB/s | 248 kB 00:00 2024-05-27T09:31:17.375 INFO:teuthology.orchestra.run.smithi072.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-05-27T09:31:17.425 INFO:teuthology.orchestra.run.smithi072.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-05-27T09:31:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-27T09:31:17.527 INFO:teuthology.orchestra.run.smithi072.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 688 kB/s | 35 kB 00:00 2024-05-27T09:31:17.572 INFO:teuthology.orchestra.run.smithi071.stdout:(30/159): rbd-mirror-19.0.0-3868.ga6507388.el9. 1.9 MB/s | 3.0 MB 00:01 2024-05-27T09:31:17.944 INFO:teuthology.orchestra.run.smithi072.stdout:(81/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-27T09:31:18.003 INFO:teuthology.orchestra.run.smithi072.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-05-27T09:31:18.145 INFO:teuthology.orchestra.run.smithi072.stdout:(83/159): ceph-mgr-diskprediction-local-19.0.0- 1.5 MB/s | 7.4 MB 00:04 2024-05-27T09:31:18.171 INFO:teuthology.orchestra.run.smithi072.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-05-27T09:31:18.221 INFO:teuthology.orchestra.run.smithi072.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-05-27T09:31:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-05-27T09:31:18.306 INFO:teuthology.orchestra.run.smithi072.stdout:(87/159): python3-packaging-20.9-5.el9.noarch.r 482 kB/s | 77 kB 00:00 2024-05-27T09:31:18.331 INFO:teuthology.orchestra.run.smithi072.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-27T09:31:18.382 INFO:teuthology.orchestra.run.smithi072.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-27T09:31:18.443 INFO:teuthology.orchestra.run.smithi072.stdout:(90/159): python3-requests-oauthlib-1.3.0-12.el 894 kB/s | 54 kB 00:00 2024-05-27T09:31:18.468 INFO:teuthology.orchestra.run.smithi072.stdout:(91/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-05-27T09:31:18.544 INFO:teuthology.orchestra.run.smithi072.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-05-27T09:31:18.611 INFO:teuthology.orchestra.run.smithi072.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 659 kB/s | 44 kB 00:00 2024-05-27T09:31:18.720 INFO:teuthology.orchestra.run.smithi072.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-27T09:31:18.812 INFO:teuthology.orchestra.run.smithi072.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-05-27T09:31:18.863 INFO:teuthology.orchestra.run.smithi072.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-05-27T09:31:19.080 INFO:teuthology.orchestra.run.smithi071.stdout:(31/159): ceph-mgr-dashboard-19.0.0-3868.ga6507 2.0 MB/s | 3.5 MB 00:01 2024-05-27T09:31:19.130 INFO:teuthology.orchestra.run.smithi072.stdout:(97/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-05-27T09:31:19.156 INFO:teuthology.orchestra.run.smithi072.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-05-27T09:31:19.181 INFO:teuthology.orchestra.run.smithi072.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-27T09:31:19.207 INFO:teuthology.orchestra.run.smithi072.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-05-27T09:31:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:(32/159): ceph-mgr-modules-core-19.0.0-3868.ga6 1.8 MB/s | 274 kB 00:00 2024-05-27T09:31:19.249 INFO:teuthology.orchestra.run.smithi072.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 943 kB/s | 64 kB 00:00 2024-05-27T09:31:19.274 INFO:teuthology.orchestra.run.smithi072.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 666 kB/s | 45 kB 00:00 2024-05-27T09:31:19.300 INFO:teuthology.orchestra.run.smithi072.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 438 kB/s | 22 kB 00:00 2024-05-27T09:31:19.322 INFO:teuthology.orchestra.run.smithi071.stdout:(33/159): ceph-mgr-rook-19.0.0-3868.ga6507388.e 543 kB/s | 49 kB 00:00 2024-05-27T09:31:19.452 INFO:teuthology.orchestra.run.smithi072.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-05-27T09:31:19.653 INFO:teuthology.orchestra.run.smithi072.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-05-27T09:31:19.712 INFO:teuthology.orchestra.run.smithi072.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 331 kB/s | 19 kB 00:00 2024-05-27T09:31:19.746 INFO:teuthology.orchestra.run.smithi072.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-05-27T09:31:19.790 INFO:teuthology.orchestra.run.smithi071.stdout:(34/159): ceph-test-19.0.0-3868.ga6507388.el9.x 3.4 MB/s | 43 MB 00:12 2024-05-27T09:31:19.804 INFO:teuthology.orchestra.run.smithi072.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-05-27T09:31:19.806 INFO:teuthology.orchestra.run.smithi071.stdout:(35/159): ceph-prometheus-alerts-19.0.0-3868.ga 34 kB/s | 16 kB 00:00 2024-05-27T09:31:19.872 INFO:teuthology.orchestra.run.smithi072.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 727 kB/s | 49 kB 00:00 2024-05-27T09:31:19.956 INFO:teuthology.orchestra.run.smithi071.stdout:(36/159): ceph-volume-19.0.0-3868.ga6507388.el9 1.6 MB/s | 273 kB 00:00 2024-05-27T09:31:19.964 INFO:teuthology.orchestra.run.smithi072.stdout:(110/159): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-27T09:31:19.990 INFO:teuthology.orchestra.run.smithi072.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 573 kB/s | 67 kB 00:00 2024-05-27T09:31:20.023 INFO:teuthology.orchestra.run.smithi072.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-27T09:31:20.048 INFO:teuthology.orchestra.run.smithi071.stdout:(37/159): cephfs-top-19.0.0-3868.ga6507388.el9. 200 kB/s | 18 kB 00:00 2024-05-27T09:31:20.091 INFO:teuthology.orchestra.run.smithi072.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-05-27T09:31:20.133 INFO:teuthology.orchestra.run.smithi072.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 839 kB 00:00 2024-05-27T09:31:20.167 INFO:teuthology.orchestra.run.smithi072.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 573 kB/s | 43 kB 00:00 2024-05-27T09:31:20.192 INFO:teuthology.orchestra.run.smithi072.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 544 kB/s | 32 kB 00:00 2024-05-27T09:31:20.226 INFO:teuthology.orchestra.run.smithi072.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 254 kB/s | 15 kB 00:00 2024-05-27T09:31:20.253 INFO:teuthology.orchestra.run.smithi072.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-05-27T09:31:20.274 INFO:teuthology.orchestra.run.smithi071.stdout:(38/159): cephadm-19.0.0-3868.ga6507388.el9.noa 1.6 MB/s | 764 kB 00:00 2024-05-27T09:31:20.296 INFO:teuthology.orchestra.run.smithi072.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 5.1 MB/s | 358 kB 00:00 2024-05-27T09:31:20.330 INFO:teuthology.orchestra.run.smithi072.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-27T09:31:20.355 INFO:teuthology.orchestra.run.smithi072.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-05-27T09:31:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-27T09:31:20.473 INFO:teuthology.orchestra.run.smithi072.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-05-27T09:31:20.482 INFO:teuthology.orchestra.run.smithi071.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 185 kB/s | 80 kB 00:00 2024-05-27T09:31:20.498 INFO:teuthology.orchestra.run.smithi072.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 127 kB/s | 11 kB 00:00 2024-05-27T09:31:20.533 INFO:teuthology.orchestra.run.smithi072.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 298 kB/s | 18 kB 00:00 2024-05-27T09:31:20.558 INFO:teuthology.orchestra.run.smithi072.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 392 kB/s | 23 kB 00:00 2024-05-27T09:31:20.592 INFO:teuthology.orchestra.run.smithi072.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2024-05-27T09:31:20.617 INFO:teuthology.orchestra.run.smithi072.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 332 kB/s | 20 kB 00:00 2024-05-27T09:31:20.691 INFO:teuthology.orchestra.run.smithi071.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 940 kB/s | 195 kB 00:00 2024-05-27T09:31:20.701 INFO:teuthology.orchestra.run.smithi072.stdout:(129/159): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-05-27T09:31:20.727 INFO:teuthology.orchestra.run.smithi072.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 424 kB/s | 46 kB 00:00 2024-05-27T09:31:20.761 INFO:teuthology.orchestra.run.smithi072.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-05-27T09:31:20.773 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-05-27T09:31:20.786 INFO:teuthology.orchestra.run.smithi072.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 979 kB/s | 58 kB 00:00 2024-05-27T09:31:20.822 INFO:teuthology.orchestra.run.smithi072.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 4.4 MB/s | 272 kB 00:00 2024-05-27T09:31:20.847 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-27T09:31:20.847 INFO:teuthology.orchestra.run.smithi072.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 270 kB/s | 16 kB 00:00 2024-05-27T09:31:20.881 INFO:teuthology.orchestra.run.smithi072.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-27T09:31:20.883 INFO:teuthology.orchestra.run.smithi071.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-27T09:31:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-27T09:31:20.907 INFO:teuthology.orchestra.run.smithi072.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 478 kB/s | 28 kB 00:00 2024-05-27T09:31:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-27T09:31:20.941 INFO:teuthology.orchestra.run.smithi072.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 520 kB/s | 31 kB 00:00 2024-05-27T09:31:20.966 INFO:teuthology.orchestra.run.smithi072.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-05-27T09:31:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-27T09:31:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-27T09:31:21.000 INFO:teuthology.orchestra.run.smithi072.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-27T09:31:21.026 INFO:teuthology.orchestra.run.smithi072.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 604 kB/s | 36 kB 00:00 2024-05-27T09:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-05-27T09:31:21.041 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-27T09:31:21.060 INFO:teuthology.orchestra.run.smithi072.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 862 kB/s | 51 kB 00:00 2024-05-27T09:31:21.102 INFO:teuthology.orchestra.run.smithi072.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-27T09:31:21.127 INFO:teuthology.orchestra.run.smithi072.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-27T09:31:21.142 INFO:teuthology.orchestra.run.smithi071.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 990 kB/s | 106 kB 00:00 2024-05-27T09:31:21.170 INFO:teuthology.orchestra.run.smithi072.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-05-27T09:31:21.195 INFO:teuthology.orchestra.run.smithi072.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 296 kB/s | 20 kB 00:00 2024-05-27T09:31:21.229 INFO:teuthology.orchestra.run.smithi072.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-05-27T09:31:21.259 INFO:teuthology.orchestra.run.smithi071.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-05-27T09:31:21.293 INFO:teuthology.orchestra.run.smithi071.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 905 kB/s | 135 kB 00:00 2024-05-27T09:31:21.298 INFO:teuthology.orchestra.run.smithi072.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-27T09:31:21.375 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-27T09:31:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-27T09:31:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-05-27T09:31:21.500 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:31:21.625 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:31:21.652 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:31:21.677 INFO:teuthology.orchestra.run.smithi071.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-05-27T09:31:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-05-27T09:31:21.742 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:31:21.744 INFO:teuthology.orchestra.run.smithi071.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-27T09:31:21.770 INFO:teuthology.orchestra.run.smithi071.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-05-27T09:31:21.772 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 10/170 2024-05-27T09:31:21.805 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-27T09:31:21.828 INFO:teuthology.orchestra.run.smithi071.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 568 kB/s | 33 kB 00:00 2024-05-27T09:31:21.862 INFO:teuthology.orchestra.run.smithi071.stdout:(53/159): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-27T09:31:21.921 INFO:teuthology.orchestra.run.smithi071.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 316 kB/s | 18 kB 00:00 2024-05-27T09:31:21.980 INFO:teuthology.orchestra.run.smithi071.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 194 kB/s | 11 kB 00:00 2024-05-27T09:31:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-27T09:31:22.038 INFO:teuthology.orchestra.run.smithi071.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-27T09:31:22.055 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-27T09:31:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:31:22.088 INFO:teuthology.orchestra.run.smithi071.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 922 kB/s | 45 kB 00:00 2024-05-27T09:31:22.180 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:31:22.209 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 15/170 2024-05-27T09:31:22.255 INFO:teuthology.orchestra.run.smithi071.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-05-27T09:31:22.263 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 15/170 2024-05-27T09:31:22.285 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T09:31:22.308 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T09:31:22.356 INFO:teuthology.orchestra.run.smithi071.stdout:(59/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.7 MB/s | 3.0 MB 00:00 2024-05-27T09:31:22.406 INFO:teuthology.orchestra.run.smithi071.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 518 kB/s | 25 kB 00:00 2024-05-27T09:31:22.440 INFO:teuthology.orchestra.run.smithi071.stdout:(61/159): libtool-2.4.6-45.el9.x86_64.rpm 3.1 MB/s | 582 kB 00:00 2024-05-27T09:31:22.481 INFO:teuthology.orchestra.run.smithi071.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 644 kB/s | 47 kB 00:00 2024-05-27T09:31:22.493 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T09:31:22.532 INFO:teuthology.orchestra.run.smithi071.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-27T09:31:22.557 INFO:teuthology.orchestra.run.smithi071.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-05-27T09:31:22.583 INFO:teuthology.orchestra.run.smithi071.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 713 kB/s | 35 kB 00:00 2024-05-27T09:31:22.619 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T09:31:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T09:31:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T09:31:22.900 INFO:teuthology.orchestra.run.smithi071.stdout:(66/159): ceph-mgr-diskprediction-local-19.0.0- 1.4 MB/s | 7.4 MB 00:05 2024-05-27T09:31:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:23.317 INFO:teuthology.orchestra.run.smithi071.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 3.8 MB/s | 1.6 MB 00:00 2024-05-27T09:31:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-27T09:31:23.409 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-27T09:31:23.417 INFO:teuthology.orchestra.run.smithi071.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 5.5 MB/s | 4.7 MB 00:00 2024-05-27T09:31:23.443 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-05-27T09:31:23.484 INFO:teuthology.orchestra.run.smithi071.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-27T09:31:23.507 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-05-27T09:31:23.542 INFO:teuthology.orchestra.run.smithi071.stdout:(70/159): postgresql-contrib-13.14-1.el9.x86_64 4.0 MB/s | 911 kB 00:00 2024-05-27T09:31:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-05-27T09:31:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/170 2024-05-27T09:31:23.636 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/170 2024-05-27T09:31:23.643 INFO:teuthology.orchestra.run.smithi071.stdout:(71/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-05-27T09:31:23.664 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/170 2024-05-27T09:31:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-27T09:31:23.732 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/170 2024-05-27T09:31:23.765 INFO:teuthology.orchestra.run.smithi072.stdout:(148/159): ceph-test-19.0.0-3868.ga6507388.el9. 2.3 MB/s | 43 MB 00:18 2024-05-27T09:31:23.777 INFO:teuthology.orchestra.run.smithi071.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-05-27T09:31:23.785 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/170 2024-05-27T09:31:23.817 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/170 2024-05-27T09:31:23.836 INFO:teuthology.orchestra.run.smithi071.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-05-27T09:31:23.841 INFO:teuthology.orchestra.run.smithi072.stdout:(149/159): librados2-19.0.0-3868.ga6507388.el9. 1.3 MB/s | 3.3 MB 00:02 2024-05-27T09:31:23.852 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/170 2024-05-27T09:31:23.929 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/170 2024-05-27T09:31:23.936 INFO:teuthology.orchestra.run.smithi071.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-05-27T09:31:23.963 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:19.0.0-3868.ga6507388.el9. 33/170 2024-05-27T09:31:23.991 INFO:teuthology.orchestra.run.smithi072.stdout:(150/159): NetworkManager-1.47.90-1.el9.x86_64. 10 MB/s | 2.3 MB 00:00 2024-05-27T09:31:24.006 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:19.0.0-3868.ga6507388.el 34/170 2024-05-27T09:31:24.025 INFO:teuthology.orchestra.run.smithi072.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-05-27T09:31:24.028 INFO:teuthology.orchestra.run.smithi071.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-05-27T09:31:24.035 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_6 35/170 2024-05-27T09:31:24.076 INFO:teuthology.orchestra.run.smithi072.stdout:(152/159): NetworkManager-libnm-1.47.90-1.el9.x 7.7 MB/s | 1.8 MB 00:00 2024-05-27T09:31:24.087 INFO:teuthology.orchestra.run.smithi071.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 444 kB/s | 26 kB 00:00 2024-05-27T09:31:24.104 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/170 2024-05-27T09:31:24.109 INFO:teuthology.orchestra.run.smithi072.stdout:(153/159): NetworkManager-tui-1.47.90-1.el9.x86 2.9 MB/s | 248 kB 00:00 2024-05-27T09:31:24.135 INFO:teuthology.orchestra.run.smithi072.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 624 kB/s | 37 kB 00:00 2024-05-27T09:31:24.150 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/170 2024-05-27T09:31:24.160 INFO:teuthology.orchestra.run.smithi072.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.0 MB/s | 207 kB 00:00 2024-05-27T09:31:24.171 INFO:teuthology.orchestra.run.smithi071.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 232 kB/s | 19 kB 00:00 2024-05-27T09:31:24.194 INFO:teuthology.orchestra.run.smithi072.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-05-27T09:31:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/170 2024-05-27T09:31:24.229 INFO:teuthology.orchestra.run.smithi071.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-27T09:31:24.245 INFO:teuthology.orchestra.run.smithi072.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-05-27T09:31:24.346 INFO:teuthology.orchestra.run.smithi072.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-05-27T09:31:24.357 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/170 2024-05-27T09:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout:(80/159): postgresql-server-13.14-1.el9.x86_64. 6.5 MB/s | 5.8 MB 00:00 2024-05-27T09:31:24.397 INFO:teuthology.orchestra.run.smithi071.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 208 kB/s | 35 kB 00:00 2024-05-27T09:31:24.410 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/170 2024-05-27T09:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-05-27T09:31:24.564 INFO:teuthology.orchestra.run.smithi071.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-27T09:31:24.623 INFO:teuthology.orchestra.run.smithi071.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-27T09:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 736 kB/s | 42 kB 00:00 2024-05-27T09:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-05-27T09:31:24.840 INFO:teuthology.orchestra.run.smithi071.stdout:(87/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-05-27T09:31:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/170 2024-05-27T09:31:25.007 INFO:teuthology.orchestra.run.smithi071.stdout:(88/159): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-05-27T09:31:25.014 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/170 2024-05-27T09:31:25.041 INFO:teuthology.orchestra.run.smithi071.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-05-27T09:31:25.043 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/170 2024-05-27T09:31:25.058 INFO:teuthology.orchestra.run.smithi071.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-27T09:31:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/170 2024-05-27T09:31:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 45/170 2024-05-27T09:31:25.138 INFO:teuthology.orchestra.run.smithi072.stdout:(159/159): librbd1-19.0.0-3868.ga6507388.el9.x8 825 kB/s | 3.1 MB 00:03 2024-05-27T09:31:25.141 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-05-27T09:31:25.142 INFO:teuthology.orchestra.run.smithi072.stdout:Total 6.4 MB/s | 219 MB 00:34 2024-05-27T09:31:25.158 INFO:teuthology.orchestra.run.smithi071.stdout:(91/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.5 MB/s | 5.1 MB 00:00 2024-05-27T09:31:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:19.0.0-3868.ga6507388.el9.x86_6 46/170 2024-05-27T09:31:25.175 INFO:teuthology.orchestra.run.smithi071.stdout:(92/159): python3-requests-oauthlib-1.3.0-12.el 403 kB/s | 54 kB 00:00 2024-05-27T09:31:25.200 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/170 2024-05-27T09:31:25.209 INFO:teuthology.orchestra.run.smithi071.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 843 kB/s | 42 kB 00:00 2024-05-27T09:31:25.226 INFO:teuthology.orchestra.run.smithi071.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 891 kB/s | 44 kB 00:00 2024-05-27T09:31:25.276 INFO:teuthology.orchestra.run.smithi071.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 729 kB/s | 36 kB 00:00 2024-05-27T09:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout:(96/159): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-05-27T09:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 821 kB/s | 47 kB 00:00 2024-05-27T09:31:25.351 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 48/170 2024-05-27T09:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-27T09:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 872 kB/s | 58 kB 00:00 2024-05-27T09:31:25.403 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 49/170 2024-05-27T09:31:25.436 INFO:teuthology.orchestra.run.smithi071.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-05-27T09:31:25.461 INFO:teuthology.orchestra.run.smithi071.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-27T09:31:25.493 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/170 2024-05-27T09:31:25.495 INFO:teuthology.orchestra.run.smithi071.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-05-27T09:31:25.558 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/170 2024-05-27T09:31:25.570 INFO:teuthology.orchestra.run.smithi071.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-05-27T09:31:25.630 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-27T09:31:25.671 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-27T09:31:25.679 INFO:teuthology.orchestra.run.smithi071.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-05-27T09:31:25.707 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-27T09:31:25.754 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-27T09:31:25.790 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-27T09:31:25.833 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-27T09:31:25.846 INFO:teuthology.orchestra.run.smithi071.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-05-27T09:31:25.875 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-27T09:31:25.905 INFO:teuthology.orchestra.run.smithi071.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 338 kB/s | 19 kB 00:00 2024-05-27T09:31:25.939 INFO:teuthology.orchestra.run.smithi071.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-05-27T09:31:25.997 INFO:teuthology.orchestra.run.smithi071.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 455 kB/s | 26 kB 00:00 2024-05-27T09:31:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-27T09:31:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-27T09:31:26.057 INFO:teuthology.orchestra.run.smithi071.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 847 kB/s | 49 kB 00:00 2024-05-27T09:31:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-27T09:31:26.156 INFO:teuthology.orchestra.run.smithi071.stdout:(110/159): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-27T09:31:26.179 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-27T09:31:26.181 INFO:teuthology.orchestra.run.smithi071.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 541 kB/s | 67 kB 00:00 2024-05-27T09:31:26.215 INFO:teuthology.orchestra.run.smithi071.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-05-27T09:31:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-27T09:31:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-27T09:31:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-27T09:31:26.299 INFO:teuthology.orchestra.run.smithi071.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 6.5 MB/s | 548 kB 00:00 2024-05-27T09:31:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-27T09:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-05-27T09:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 585 kB/s | 43 kB 00:00 2024-05-27T09:31:26.375 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-05-27T09:31:26.383 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-27T09:31:26.408 INFO:teuthology.orchestra.run.smithi071.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 558 kB/s | 32 kB 00:00 2024-05-27T09:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 258 kB/s | 15 kB 00:00 2024-05-27T09:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-27T09:31:26.509 INFO:teuthology.orchestra.run.smithi071.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-27T09:31:26.510 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-27T09:31:26.532 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-05-27T09:31:26.532 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-05-27T09:31:26.541 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-27T09:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-05-27T09:31:26.569 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-27T09:31:26.576 INFO:teuthology.orchestra.run.smithi071.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-05-27T09:31:26.603 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-27T09:31:26.642 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-27T09:31:26.660 INFO:teuthology.orchestra.run.smithi071.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-27T09:31:26.674 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-27T09:31:26.704 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-27T09:31:26.727 INFO:teuthology.orchestra.run.smithi071.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-05-27T09:31:26.730 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-27T09:31:26.744 INFO:teuthology.orchestra.run.smithi071.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2024-05-27T09:31:26.763 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-27T09:31:26.778 INFO:teuthology.orchestra.run.smithi071.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-05-27T09:31:26.803 INFO:teuthology.orchestra.run.smithi071.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 400 kB/s | 23 kB 00:00 2024-05-27T09:31:26.805 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-27T09:31:26.837 INFO:teuthology.orchestra.run.smithi071.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 335 kB/s | 19 kB 00:00 2024-05-27T09:31:26.839 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-27T09:31:26.862 INFO:teuthology.orchestra.run.smithi071.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 338 kB/s | 20 kB 00:00 2024-05-27T09:31:26.926 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-27T09:31:26.929 INFO:teuthology.orchestra.run.smithi071.stdout:(129/159): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-05-27T09:31:26.954 INFO:teuthology.orchestra.run.smithi071.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 508 kB/s | 46 kB 00:00 2024-05-27T09:31:26.970 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-27T09:31:26.988 INFO:teuthology.orchestra.run.smithi071.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-05-27T09:31:27.001 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-27T09:31:27.013 INFO:teuthology.orchestra.run.smithi071.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 995 kB/s | 58 kB 00:00 2024-05-27T09:31:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-27T09:31:27.055 INFO:teuthology.orchestra.run.smithi071.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-27T09:31:27.081 INFO:teuthology.orchestra.run.smithi071.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 249 kB/s | 16 kB 00:00 2024-05-27T09:31:27.114 INFO:teuthology.orchestra.run.smithi071.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-27T09:31:27.137 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-27T09:31:27.140 INFO:teuthology.orchestra.run.smithi071.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 487 kB/s | 28 kB 00:00 2024-05-27T09:31:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-27T09:31:27.365 INFO:teuthology.orchestra.run.smithi071.stdout:(137/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-05-27T09:31:27.390 INFO:teuthology.orchestra.run.smithi071.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 112 kB/s | 31 kB 00:00 2024-05-27T09:31:27.424 INFO:teuthology.orchestra.run.smithi071.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 666 kB/s | 188 kB 00:00 2024-05-27T09:31:27.474 INFO:teuthology.orchestra.run.smithi071.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 431 kB/s | 36 kB 00:00 2024-05-27T09:31:27.508 INFO:teuthology.orchestra.run.smithi071.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 614 kB/s | 51 kB 00:00 2024-05-27T09:31:27.542 INFO:teuthology.orchestra.run.smithi071.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-05-27T09:31:27.567 INFO:teuthology.orchestra.run.smithi071.stdout:(143/159): python3-rsa-4.9-2.el9.noarch.rpm 295 kB/s | 59 kB 00:00 2024-05-27T09:31:27.592 INFO:teuthology.orchestra.run.smithi071.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-27T09:31:27.626 INFO:teuthology.orchestra.run.smithi071.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-27T09:31:27.651 INFO:teuthology.orchestra.run.smithi071.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 240 kB/s | 20 kB 00:00 2024-05-27T09:31:27.685 INFO:teuthology.orchestra.run.smithi071.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-05-27T09:31:27.752 INFO:teuthology.orchestra.run.smithi071.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-27T09:31:27.898 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-27T09:31:27.950 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-27T09:31:27.984 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-27T09:31:28.081 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-27T09:31:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-27T09:31:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-27T09:31:28.261 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-27T09:31:28.303 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-27T09:31:28.305 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-05-27T09:31:28.305 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-05-27T09:31:28.496 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-27T09:31:28.525 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-27T09:31:28.602 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-27T09:31:28.777 INFO:teuthology.orchestra.run.smithi071.stdout:(149/159): NetworkManager-1.47.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-05-27T09:31:29.011 INFO:teuthology.orchestra.run.smithi071.stdout:(150/159): NetworkManager-libnm-1.47.90-1.el9.x 7.8 MB/s | 1.8 MB 00:00 2024-05-27T09:31:29.111 INFO:teuthology.orchestra.run.smithi071.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 419 kB/s | 41 kB 00:00 2024-05-27T09:31:29.228 INFO:teuthology.orchestra.run.smithi071.stdout:(152/159): NetworkManager-tui-1.47.90-1.el9.x86 2.1 MB/s | 248 kB 00:00 2024-05-27T09:31:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-27T09:31:29.337 INFO:teuthology.orchestra.run.smithi071.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 341 kB/s | 37 kB 00:00 2024-05-27T09:31:29.349 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-27T09:31:29.454 INFO:teuthology.orchestra.run.smithi071.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 1.7 MB/s | 207 kB 00:00 2024-05-27T09:31:29.546 INFO:teuthology.orchestra.run.smithi071.stdout:(155/159): librados2-19.0.0-3868.ga6507388.el9. 1.8 MB/s | 3.3 MB 00:01 2024-05-27T09:31:29.579 INFO:teuthology.orchestra.run.smithi071.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 2.0 MB/s | 260 kB 00:00 2024-05-27T09:31:30.480 INFO:teuthology.orchestra.run.smithi071.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 1.4 MB/s | 1.3 MB 00:00 2024-05-27T09:31:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-27T09:31:30.647 INFO:teuthology.orchestra.run.smithi071.stdout:(158/159): librbd1-19.0.0-3868.ga6507388.el9.x8 1.0 MB/s | 3.1 MB 00:02 2024-05-27T09:31:30.663 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-27T09:31:30.690 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-27T09:31:30.723 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-27T09:31:30.864 INFO:teuthology.orchestra.run.smithi071.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-05-27T09:31:30.869 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-05-27T09:31:30.870 INFO:teuthology.orchestra.run.smithi071.stdout:Total 7.0 MB/s | 219 MB 00:31 2024-05-27T09:31:31.039 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-27T09:31:31.078 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 103/170 2024-05-27T09:31:31.152 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 103/170 2024-05-27T09:31:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 104/170 2024-05-27T09:31:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-27T09:31:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-27T09:31:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 107/170 2024-05-27T09:31:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 107/170 2024-05-27T09:31:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 108/170 2024-05-27T09:31:33.985 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-05-27T09:31:34.044 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:31:34.087 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:31:34.236 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-05-27T09:31:34.236 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-05-27T09:31:34.486 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-05-27T09:31:34.605 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-27T09:31:34.640 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:31:34.643 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-27T09:31:34.682 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 110/170 2024-05-27T09:31:34.706 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-27T09:31:34.749 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-27T09:31:34.776 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-27T09:31:34.778 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 110/170 2024-05-27T09:31:34.778 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-27T09:31:34.778 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-27T09:31:34.779 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:34.808 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 111/170 2024-05-27T09:31:34.819 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-27T09:31:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-27T09:31:35.355 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:31:35.488 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:31:35.524 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:31:35.617 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:31:35.647 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 10/170 2024-05-27T09:31:35.688 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-27T09:31:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-27T09:31:35.959 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-27T09:31:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:31:36.084 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:31:36.114 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 15/170 2024-05-27T09:31:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 15/170 2024-05-27T09:31:36.208 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T09:31:36.231 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T09:31:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T09:31:36.569 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T09:31:36.762 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T09:31:36.832 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T09:31:36.931 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:36.946 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-05-27T09:31:36.946 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-05-27T09:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-27T09:31:37.408 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-27T09:31:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-05-27T09:31:37.521 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-05-27T09:31:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-05-27T09:31:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/170 2024-05-27T09:31:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/170 2024-05-27T09:31:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/170 2024-05-27T09:31:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/170 2024-05-27T09:31:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/170 2024-05-27T09:31:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/170 2024-05-27T09:31:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/170 2024-05-27T09:31:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/170 2024-05-27T09:31:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:19.0.0-3868.ga6507388.el9. 33/170 2024-05-27T09:31:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:19.0.0-3868.ga6507388.el 34/170 2024-05-27T09:31:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_6 35/170 2024-05-27T09:31:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/170 2024-05-27T09:31:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/170 2024-05-27T09:31:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/170 2024-05-27T09:31:38.389 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/170 2024-05-27T09:31:38.446 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/170 2024-05-27T09:31:38.970 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/170 2024-05-27T09:31:39.060 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/170 2024-05-27T09:31:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/170 2024-05-27T09:31:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/170 2024-05-27T09:31:39.186 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 45/170 2024-05-27T09:31:39.225 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:19.0.0-3868.ga6507388.el9.x86_6 46/170 2024-05-27T09:31:39.267 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/170 2024-05-27T09:31:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 48/170 2024-05-27T09:31:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 49/170 2024-05-27T09:31:39.616 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/170 2024-05-27T09:31:39.682 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/170 2024-05-27T09:31:39.754 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-27T09:31:39.787 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-27T09:31:39.834 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-27T09:31:39.889 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-27T09:31:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-27T09:31:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-27T09:31:40.013 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-27T09:31:40.157 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-27T09:31:40.202 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-27T09:31:40.243 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-27T09:31:40.339 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-27T09:31:40.378 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-27T09:31:40.420 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-27T09:31:40.447 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-27T09:31:40.473 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-27T09:31:40.558 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-27T09:31:40.687 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-27T09:31:40.736 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-27T09:31:40.764 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-27T09:31:40.800 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-27T09:31:40.839 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-27T09:31:40.879 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-27T09:31:40.912 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-27T09:31:40.947 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-27T09:31:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-27T09:31:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-27T09:31:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-27T09:31:41.153 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-27T09:31:41.206 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-27T09:31:41.248 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-27T09:31:41.296 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-27T09:31:41.395 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-27T09:31:41.451 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-27T09:31:42.179 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-27T09:31:42.237 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-27T09:31:42.271 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-27T09:31:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-27T09:31:42.438 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-27T09:31:42.492 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-27T09:31:42.579 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-27T09:31:42.621 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-27T09:31:42.796 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-27T09:31:42.827 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-27T09:31:42.905 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-27T09:31:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-05-27T09:31:43.513 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-27T09:31:43.545 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-27T09:31:43.585 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-27T09:31:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-27T09:31:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-27T09:31:43.750 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-27T09:31:43.783 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-27T09:31:43.887 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-27T09:31:44.303 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-27T09:31:44.414 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:31:44.596 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:31:44.623 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:31:44.762 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 10/170 2024-05-27T09:31:44.876 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-27T09:31:44.887 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-27T09:31:44.990 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-27T09:31:45.018 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-27T09:31:45.052 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-27T09:31:45.229 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-27T09:31:45.288 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-27T09:31:45.313 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:31:45.368 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-27T09:31:45.433 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 103/170 2024-05-27T09:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:31:45.506 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 15/170 2024-05-27T09:31:45.535 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 103/170 2024-05-27T09:31:45.566 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 104/170 2024-05-27T09:31:45.582 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 15/170 2024-05-27T09:31:45.607 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T09:31:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-27T09:31:45.665 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T09:31:45.988 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T09:31:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-27T09:31:46.132 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 107/170 2024-05-27T09:31:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 107/170 2024-05-27T09:31:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 108/170 2024-05-27T09:31:46.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T09:31:46.531 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T09:31:46.644 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T09:31:46.790 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 111/170 2024-05-27T09:31:46.790 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-05-27T09:31:46.790 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-05-27T09:31:46.790 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-05-27T09:31:46.790 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-05-27T09:31:46.790 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-05-27T09:31:46.790 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-05-27T09:31:46.791 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-05-27T09:31:46.791 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:46.825 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:46.918 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 112/170 2024-05-27T09:31:46.998 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 112/170 2024-05-27T09:31:46.998 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:46.998 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-27T09:31:46.998 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:47.216 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T09:31:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-27T09:31:47.465 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-27T09:31:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-05-27T09:31:47.638 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-05-27T09:31:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-05-27T09:31:47.752 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/170 2024-05-27T09:31:47.799 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/170 2024-05-27T09:31:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/170 2024-05-27T09:31:47.955 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/170 2024-05-27T09:31:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/170 2024-05-27T09:31:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/170 2024-05-27T09:31:48.121 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/170 2024-05-27T09:31:48.228 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/170 2024-05-27T09:31:48.289 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.0.0-3868.ga6507388.el9. 33/170 2024-05-27T09:31:48.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.0.0-3868.ga6507388.el 34/170 2024-05-27T09:31:48.376 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_6 35/170 2024-05-27T09:31:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:31:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/170 2024-05-27T09:31:48.539 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:31:48.555 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/170 2024-05-27T09:31:48.585 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 113/170 2024-05-27T09:31:48.610 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 113/170 2024-05-27T09:31:48.610 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:48.610 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-27T09:31:48.610 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T09:31:48.610 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T09:31:48.610 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:48.655 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/170 2024-05-27T09:31:48.831 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/170 2024-05-27T09:31:48.835 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 114/170 2024-05-27T09:31:48.858 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 114/170 2024-05-27T09:31:48.858 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:48.858 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-27T09:31:48.858 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T09:31:48.858 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T09:31:48.858 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:48.900 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/170 2024-05-27T09:31:49.098 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:31:49.146 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 110/170 2024-05-27T09:31:49.236 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 110/170 2024-05-27T09:31:49.236 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-27T09:31:49.236 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-27T09:31:49.236 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:31:49.275 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 111/170 2024-05-27T09:31:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 115/170 2024-05-27T09:31:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 115/170 2024-05-27T09:31:49.342 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:49.342 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-27T09:31:49.342 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T09:31:49.342 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T09:31:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-27T09:31:49.506 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-27T09:31:49.561 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-27T09:31:49.580 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/170 2024-05-27T09:31:49.697 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/170 2024-05-27T09:31:49.742 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/170 2024-05-27T09:31:49.748 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-27T09:31:49.791 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/170 2024-05-27T09:31:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-27T09:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 45/170 2024-05-27T09:31:49.872 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-27T09:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.0.0-3868.ga6507388.el9.x86_6 46/170 2024-05-27T09:31:49.961 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-27T09:31:50.015 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/170 2024-05-27T09:31:50.109 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-27T09:31:50.154 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-27T09:31:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-27T09:31:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-27T09:31:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 48/170 2024-05-27T09:31:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 49/170 2024-05-27T09:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/170 2024-05-27T09:31:50.502 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/170 2024-05-27T09:31:50.587 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-27T09:31:50.631 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-27T09:31:50.641 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.0.0-3868.ga6507388.el9.noarch 127/170 2024-05-27T09:31:50.669 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-27T09:31:50.670 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:19.0.0-3868.ga6507388.el9.noarch 127/170 2024-05-27T09:31:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.e 128/170 2024-05-27T09:31:50.733 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-27T09:31:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3868.ga6507388. 129/170 2024-05-27T09:31:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 130/170 2024-05-27T09:31:50.804 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-27T09:31:50.866 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-27T09:31:50.932 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-27T09:31:51.129 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-27T09:31:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-27T09:31:51.235 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-27T09:31:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-27T09:31:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-27T09:31:51.450 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-27T09:31:51.495 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-27T09:31:51.519 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-27T09:31:51.724 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-27T09:31:51.828 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 130/170 2024-05-27T09:31:51.881 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 131/170 2024-05-27T09:31:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-27T09:31:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-27T09:31:52.002 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-27T09:31:52.051 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-27T09:31:52.114 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-27T09:31:52.164 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-27T09:31:52.206 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-27T09:31:52.251 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-27T09:31:52.293 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-27T09:31:52.357 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-27T09:31:52.408 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-27T09:31:52.578 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-27T09:31:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-27T09:31:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-27T09:31:52.764 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-27T09:31:52.837 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 131/170 2024-05-27T09:31:52.870 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 132/170 2024-05-27T09:31:52.920 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-27T09:31:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 132/170 2024-05-27T09:31:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-27T09:31:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el 133/170 2024-05-27T09:31:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 134/170 2024-05-27T09:31:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 134/170 2024-05-27T09:31:53.204 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:53.204 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-27T09:31:53.204 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T09:31:53.204 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T09:31:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 135/170 2024-05-27T09:31:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 135/170 2024-05-27T09:31:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:19.0.0-3868.ga6507388.el9.x86_64 136/170 2024-05-27T09:31:53.413 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 137/170 2024-05-27T09:31:53.977 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-27T09:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-27T09:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-27T09:31:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-27T09:31:54.289 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-27T09:31:54.340 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-27T09:31:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-27T09:31:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 139/170 2024-05-27T09:31:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 139/170 2024-05-27T09:31:54.406 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:54.407 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-27T09:31:54.407 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T09:31:54.407 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T09:31:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:54.440 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-27T09:31:54.459 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3868.ga6507 140/170 2024-05-27T09:31:54.481 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3868.ga6507 140/170 2024-05-27T09:31:54.481 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:54.481 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-27T09:31:54.481 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:54.489 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-27T09:31:54.527 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 141/170 2024-05-27T09:31:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 141/170 2024-05-27T09:31:54.549 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:54.549 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-27T09:31:54.549 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T09:31:54.549 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T09:31:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:54.724 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-27T09:31:54.752 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-27T09:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-27T09:31:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 142/170 2024-05-27T09:31:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 142/170 2024-05-27T09:31:54.884 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:31:54.884 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-27T09:31:54.884 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T09:31:54.884 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T09:31:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:31:55.666 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-27T09:31:55.798 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-27T09:31:57.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-27T09:31:57.483 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-27T09:31:57.518 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-27T09:31:57.554 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-27T09:31:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-27T09:31:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 103/170 2024-05-27T09:31:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 103/170 2024-05-27T09:31:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 104/170 2024-05-27T09:31:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-27T09:31:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-27T09:31:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 107/170 2024-05-27T09:31:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 107/170 2024-05-27T09:31:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 108/170 2024-05-27T09:31:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 143/170 2024-05-27T09:31:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 144/170 2024-05-27T09:31:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 145/170 2024-05-27T09:31:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-27T09:31:59.281 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-27T09:31:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 148/170 2024-05-27T09:31:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-27T09:31:59.535 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_ 150/170 2024-05-27T09:31:59.567 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-27T09:31:59.598 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-27T09:31:59.635 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T09:32:00.256 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:00.291 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:00.310 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:01.137 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 155/170 2024-05-27T09:32:01.221 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-27T09:32:01.261 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-27T09:32:01.341 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-27T09:32:01.382 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-27T09:32:01.407 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T09:32:01.433 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-27T09:32:01.459 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-27T09:32:01.459 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T09:32:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T09:32:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-27T09:32:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T09:32:01.582 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:32:01.627 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T09:32:01.644 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-27T09:32:01.649 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:01.649 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:32:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T09:32:01.922 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T09:32:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-27T09:32:02.011 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T09:32:02.356 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 109/170 2024-05-27T09:32:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 110/170 2024-05-27T09:32:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 110/170 2024-05-27T09:32:02.620 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-27T09:32:02.620 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-27T09:32:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 111/170 2024-05-27T09:32:04.766 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 111/170 2024-05-27T09:32:04.767 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2024-05-27T09:32:04.767 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2024-05-27T09:32:04.767 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2024-05-27T09:32:04.767 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2024-05-27T09:32:04.767 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2024-05-27T09:32:04.767 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /root 2024-05-27T09:32:04.768 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2024-05-27T09:32:04.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:04.948 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 112/170 2024-05-27T09:32:04.964 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 112/170 2024-05-27T09:32:04.964 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:04.964 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-27T09:32:04.964 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:06.567 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 113/170 2024-05-27T09:32:06.592 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 113/170 2024-05-27T09:32:06.593 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:06.593 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-27T09:32:06.593 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T09:32:06.593 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T09:32:06.593 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:06.818 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 114/170 2024-05-27T09:32:06.840 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 114/170 2024-05-27T09:32:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-27T09:32:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T09:32:06.841 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T09:32:06.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:07.304 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 115/170 2024-05-27T09:32:07.327 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 115/170 2024-05-27T09:32:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-27T09:32:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T09:32:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T09:32:07.327 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:07.435 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-27T09:32:07.493 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-27T09:32:07.558 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-27T09:32:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-27T09:32:07.812 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-27T09:32:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-27T09:32:07.923 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T09:32:07.923 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:19.0.0-3868.ga6507388.el9.x86_64 1/170 2024-05-27T09:32:07.923 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 2/170 2024-05-27T09:32:07.923 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 3/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 4/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3868.ga6507 5/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 6/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 7/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 10/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 11/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 12/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 13/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_ 15/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 16/170 2024-05-27T09:32:07.924 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 17/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:19.0.0-3868.ga6507388.el9.x86_6 18/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 19/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 20/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3868.ga6507388.el 21/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:19.0.0-3868.ga6507388.el9. 22/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_6 23/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 24/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 25/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 26/170 2024-05-27T09:32:07.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 27/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 28/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 29/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3868.ga6507388. 30/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 31/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 32/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 33/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el 34/170 2024-05-27T09:32:07.938 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 35/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.e 36/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 37/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:19.0.0-3868.ga6507388.el9.noarch 38/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 39/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-27T09:32:07.939 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-27T09:32:07.940 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-27T09:32:07.941 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-27T09:32:07.942 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-27T09:32:07.943 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-27T09:32:07.944 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-27T09:32:07.945 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-27T09:32:07.946 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:19.0.0-3868.ga6507388.el9.x86_64 149/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-27T09:32:07.947 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 151/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-27T09:32:07.948 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-27T09:32:07.949 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-27T09:32:07.949 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-27T09:32:07.949 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-27T09:32:07.949 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-27T09:32:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-27T09:32:08.121 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-27T09:32:08.174 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-27T09:32:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-27T09:32:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-27T09:32:08.701 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:19.0.0-3868.ga6507388.el9.noarch 127/170 2024-05-27T09:32:08.731 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:19.0.0-3868.ga6507388.el9.noarch 127/170 2024-05-27T09:32:08.771 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.e 128/170 2024-05-27T09:32:08.841 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3868.ga6507388. 129/170 2024-05-27T09:32:08.872 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 130/170 2024-05-27T09:32:09.909 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 130/170 2024-05-27T09:32:09.958 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 131/170 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:10.859 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.2-8.el9.noarch 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.7.4-5.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-27T09:32:10.860 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.861 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:10.862 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.4-9.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.863 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-27T09:32:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: lua-5.4.4-4.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-13.14-1.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-27T09:32:10.865 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-27T09:32:10.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-27T09:32:10.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-27T09:32:10.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-27T09:32:10.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-27T09:32:10.870 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-3.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-27T09:32:10.871 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-27T09:32:10.872 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-27T09:32:10.872 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-27T09:32:10.872 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-27T09:32:10.872 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-27T09:32:10.872 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:32:10.872 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-05-27T09:32:10.916 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 131/170 2024-05-27T09:32:10.944 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 132/170 2024-05-27T09:32:11.055 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 132/170 2024-05-27T09:32:11.228 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el 133/170 2024-05-27T09:32:11.258 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 134/170 2024-05-27T09:32:11.265 DEBUG:teuthology.parallel:result is None 2024-05-27T09:32:11.280 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 134/170 2024-05-27T09:32:11.280 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:11.280 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-27T09:32:11.280 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T09:32:11.280 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T09:32:11.280 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:11.333 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 135/170 2024-05-27T09:32:11.344 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 135/170 2024-05-27T09:32:11.451 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:19.0.0-3868.ga6507388.el9.x86_64 136/170 2024-05-27T09:32:11.499 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 137/170 2024-05-27T09:32:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-27T09:32:12.481 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 139/170 2024-05-27T09:32:12.503 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 139/170 2024-05-27T09:32:12.503 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:12.504 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-27T09:32:12.504 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T09:32:12.504 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T09:32:12.504 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:12.548 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3868.ga6507 140/170 2024-05-27T09:32:12.570 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3868.ga6507 140/170 2024-05-27T09:32:12.570 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:12.570 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-27T09:32:12.571 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:12.624 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 141/170 2024-05-27T09:32:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 141/170 2024-05-27T09:32:12.647 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:12.647 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-27T09:32:12.647 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T09:32:12.647 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T09:32:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:12.968 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 142/170 2024-05-27T09:32:12.990 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 142/170 2024-05-27T09:32:12.990 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:12.991 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-27T09:32:12.991 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T09:32:12.991 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T09:32:12.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 111/170 2024-05-27T09:32:15.679 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-05-27T09:32:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-05-27T09:32:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-05-27T09:32:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-05-27T09:32:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-05-27T09:32:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-05-27T09:32:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-05-27T09:32:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 112/170 2024-05-27T09:32:15.970 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 112/170 2024-05-27T09:32:15.970 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:15.970 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-27T09:32:15.970 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 143/170 2024-05-27T09:32:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 144/170 2024-05-27T09:32:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 145/170 2024-05-27T09:32:17.403 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-27T09:32:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-27T09:32:17.628 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 148/170 2024-05-27T09:32:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-27T09:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 113/170 2024-05-27T09:32:17.715 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_ 150/170 2024-05-27T09:32:17.756 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-27T09:32:17.798 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-27T09:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 113/170 2024-05-27T09:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-27T09:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T09:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T09:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:17.853 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T09:32:18.068 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 114/170 2024-05-27T09:32:18.136 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 114/170 2024-05-27T09:32:18.136 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:18.137 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-27T09:32:18.137 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T09:32:18.137 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T09:32:18.137 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:18.421 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:18.474 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:18.494 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:18.652 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 115/170 2024-05-27T09:32:18.744 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 115/170 2024-05-27T09:32:18.744 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:18.744 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-27T09:32:18.745 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T09:32:18.745 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T09:32:18.745 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-27T09:32:18.941 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-27T09:32:19.018 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-27T09:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-27T09:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-27T09:32:19.342 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 155/170 2024-05-27T09:32:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-27T09:32:19.453 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-27T09:32:19.502 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-27T09:32:19.507 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-27T09:32:19.594 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-27T09:32:19.627 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-27T09:32:19.652 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T09:32:19.673 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-27T09:32:19.678 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-27T09:32:19.714 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-27T09:32:19.714 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T09:32:19.730 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-27T09:32:19.771 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-27T09:32:19.804 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-27T09:32:19.807 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T09:32:19.843 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-27T09:32:19.843 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T09:32:19.927 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T09:32:19.961 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-27T09:32:19.967 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:19.967 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:20.147 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:20.147 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T09:32:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T09:32:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-27T09:32:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T09:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.0.0-3868.ga6507388.el9.noarch 127/170 2024-05-27T09:32:20.476 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.0.0-3868.ga6507388.el9.noarch 127/170 2024-05-27T09:32:20.542 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.e 128/170 2024-05-27T09:32:20.661 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3868.ga6507388. 129/170 2024-05-27T09:32:20.693 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 130/170 2024-05-27T09:32:22.012 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 130/170 2024-05-27T09:32:22.069 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 131/170 2024-05-27T09:32:23.174 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 131/170 2024-05-27T09:32:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 132/170 2024-05-27T09:32:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 132/170 2024-05-27T09:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el 133/170 2024-05-27T09:32:23.577 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 134/170 2024-05-27T09:32:23.647 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 134/170 2024-05-27T09:32:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-27T09:32:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T09:32:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T09:32:23.647 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 135/170 2024-05-27T09:32:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 135/170 2024-05-27T09:32:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.0.0-3868.ga6507388.el9.x86_64 136/170 2024-05-27T09:32:24.000 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 137/170 2024-05-27T09:32:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-27T09:32:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 139/170 2024-05-27T09:32:25.181 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 139/170 2024-05-27T09:32:25.181 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:25.182 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-27T09:32:25.182 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T09:32:25.182 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T09:32:25.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:25.239 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3868.ga6507 140/170 2024-05-27T09:32:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3868.ga6507 140/170 2024-05-27T09:32:25.332 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:25.332 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-27T09:32:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 141/170 2024-05-27T09:32:25.510 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 141/170 2024-05-27T09:32:25.510 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:25.510 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-27T09:32:25.510 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T09:32:25.510 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T09:32:25.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 142/170 2024-05-27T09:32:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 142/170 2024-05-27T09:32:26.012 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T09:32:26.012 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-27T09:32:26.012 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T09:32:26.012 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T09:32:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:19.0.0-3868.ga6507388.el9.x86_64 1/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 2/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 3/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 4/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3868.ga6507 5/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 6/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 7/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:32:30.478 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 10/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 11/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 12/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 13/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_ 15/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 16/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 17/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:19.0.0-3868.ga6507388.el9.x86_6 18/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 19/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 20/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3868.ga6507388.el 21/170 2024-05-27T09:32:30.479 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:19.0.0-3868.ga6507388.el9. 22/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_6 23/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 24/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 25/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 26/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 27/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 28/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 29/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3868.ga6507388. 30/170 2024-05-27T09:32:30.480 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 31/170 2024-05-27T09:32:30.491 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 32/170 2024-05-27T09:32:30.491 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 33/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el 34/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 35/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.e 36/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 37/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:19.0.0-3868.ga6507388.el9.noarch 38/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 39/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-27T09:32:30.492 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-27T09:32:30.493 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-27T09:32:30.494 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-27T09:32:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-27T09:32:30.496 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-27T09:32:30.497 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-27T09:32:30.498 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-27T09:32:30.499 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:19.0.0-3868.ga6507388.el9.x86_64 149/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-27T09:32:30.500 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 151/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-27T09:32:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-27T09:32:30.502 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-27T09:32:30.502 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-27T09:32:30.502 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-27T09:32:30.502 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-27T09:32:30.502 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-27T09:32:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 143/170 2024-05-27T09:32:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 144/170 2024-05-27T09:32:30.814 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 145/170 2024-05-27T09:32:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-27T09:32:30.891 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-27T09:32:31.157 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 148/170 2024-05-27T09:32:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-27T09:32:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_ 150/170 2024-05-27T09:32:31.301 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-27T09:32:31.354 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-27T09:32:31.406 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T09:32:32.326 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:32.369 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:32.430 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T09:32:33.050 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-27T09:32:33.050 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:33.050 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-05-27T09:32:33.050 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-27T09:32:33.051 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.2-8.el9.noarch 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.7.4-5.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.052 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.4-9.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-27T09:32:33.054 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.055 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: lua-5.4.4-4.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:33.056 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-13.14-1.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-27T09:32:33.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-27T09:32:33.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply-3.11-14.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-27T09:32:33.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-27T09:32:33.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: re2-1:20211101-3.el9.x86_64 2024-05-27T09:32:33.062 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-27T09:32:33.063 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-27T09:32:33.063 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-27T09:32:33.063 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-27T09:32:33.063 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-27T09:32:33.063 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-27T09:32:33.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T09:32:33.063 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-05-27T09:32:33.611 DEBUG:teuthology.parallel:result is None 2024-05-27T09:32:33.809 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 155/170 2024-05-27T09:32:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-27T09:32:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-27T09:32:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-27T09:32:34.135 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-27T09:32:34.167 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T09:32:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-27T09:32:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-27T09:32:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T09:32:34.373 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T09:32:34.414 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-27T09:32:34.414 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T09:32:34.551 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T09:32:34.590 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-27T09:32:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:34.960 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T09:32:34.961 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T09:32:35.098 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T09:32:35.142 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-27T09:32:35.262 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T09:32:35.499 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T09:32:35.499 INFO:teuthology.orchestra.run.smithi071.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-27T09:32:35.499 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.0.0-3868.ga6507388.el9.x86_64 1/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 2/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 3/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 4/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3868.ga6507 5/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 6/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 7/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 8/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 9/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 10/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 11/170 2024-05-27T09:32:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 12/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 13/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 14/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_ 15/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 16/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 17/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.0.0-3868.ga6507388.el9.x86_6 18/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86 19/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 20/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3868.ga6507388.el 21/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.0.0-3868.ga6507388.el9. 22/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_6 23/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 24/170 2024-05-27T09:32:41.380 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 25/170 2024-05-27T09:32:41.381 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 26/170 2024-05-27T09:32:41.381 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 27/170 2024-05-27T09:32:41.392 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 28/170 2024-05-27T09:32:41.392 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 29/170 2024-05-27T09:32:41.392 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3868.ga6507388. 30/170 2024-05-27T09:32:41.392 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noa 31/170 2024-05-27T09:32:41.392 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.n 32/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3868.ga65 33/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el 34/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 35/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.e 36/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 37/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.0.0-3868.ga6507388.el9.noarch 38/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 39/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-27T09:32:41.393 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-27T09:32:41.394 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-27T09:32:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-27T09:32:41.396 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-27T09:32:41.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-27T09:32:41.398 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-27T09:32:41.399 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-27T09:32:41.400 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.0.0-3868.ga6507388.el9.x86_64 149/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 151/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T09:32:41.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-27T09:32:41.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-27T09:32:41.403 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-27T09:32:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.0.0-3868.ga6507388.el9.noarch 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-05-27T09:32:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-27T09:32:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.14-1.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-27T09:32:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-27T09:32:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-27T09:32:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-05-27T09:32:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-27T09:32:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-27T09:32:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.0.0-3868.ga6507388.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-3.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-27T09:32:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-27T09:32:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-27T09:32:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:32:43.680 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-05-27T09:32:44.346 DEBUG:teuthology.parallel:result is None 2024-05-27T09:32:44.346 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:32:44.669 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-27T09:32:44.721 INFO:teuthology.orchestra.run.smithi071.stdout:19.0.0-3868.ga6507388.el9 2024-05-27T09:32:44.721 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3868.ga6507388.el9 2024-05-27T09:32:44.721 INFO:teuthology.task.install:The correct ceph version 19.0.0-3868.ga6507388 is installed. 2024-05-27T09:32:44.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:32:44.860 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-27T09:32:44.885 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-3868.ga6507388.el9 2024-05-27T09:32:44.885 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3868.ga6507388.el9 2024-05-27T09:32:44.886 INFO:teuthology.task.install:The correct ceph version 19.0.0-3868.ga6507388 is installed. 2024-05-27T09:32:44.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:32:45.023 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-27T09:32:45.048 INFO:teuthology.orchestra.run.smithi122.stdout:19.0.0-3868.ga6507388.el9 2024-05-27T09:32:45.048 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3868.ga6507388.el9 2024-05-27T09:32:45.048 INFO:teuthology.task.install:The correct ceph version 19.0.0-3868.ga6507388 is installed. 2024-05-27T09:32:45.050 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-27T09:32:45.050 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:32:45.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T09:32:45.119 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:32:45.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T09:32:45.150 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:32:45.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T09:32:45.180 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-27T09:32:45.181 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:32:45.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T09:32:45.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T09:32:45.371 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:32:45.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T09:32:45.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T09:32:45.466 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:32:45.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T09:32:45.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T09:32:45.571 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-27T09:32:45.571 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:32:45.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T09:32:45.637 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T09:32:45.743 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:32:45.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T09:32:45.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T09:32:45.835 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:32:45.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T09:32:45.859 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T09:32:45.921 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-27T09:32:45.922 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:32:45.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T09:32:45.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T09:32:46.097 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:32:46.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T09:32:46.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T09:32:46.183 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:32:46.183 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T09:32:46.206 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T09:32:46.269 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-27T09:32:46.361 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d', 'subvols': {'create': 2}} 2024-05-27T09:32:46.361 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:32:46.361 INFO:tasks.cephadm:Cluster fsid is 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:32:46.361 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-27T09:32:46.361 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.71', 'mon.b': '172.21.15.72', 'mon.c': '172.21.15.122'} 2024-05-27T09:32:46.362 INFO:tasks.cephadm:First mon is mon.a on smithi071 2024-05-27T09:32:46.362 INFO:tasks.cephadm:First mgr is x 2024-05-27T09:32:46.362 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-27T09:32:46.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-05-27T09:32:46.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname $(hostname -s) 2024-05-27T09:32:46.456 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname $(hostname -s) 2024-05-27T09:32:46.480 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-27T09:32:46.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:32:46.707 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79602/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3868-ga6507388', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3868.ga6507388'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-21 12:50:55.456707', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240521.105740-debug', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'a6507388dd5057528934822c0163b0c347ef1d5d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79604/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3868-ga6507388', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3868.ga6507388'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-21 12:34:17.608165', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240521.105740-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-27T09:32:46.928 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-vshankar-testing-20240521.105740-debug, sha1 a6507388dd5057528934822c0163b0c347ef1d5d from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:32:46.929 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/x86_64/flavors/default/cephadm 2024-05-27T09:32:46.930 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/x86_64/flavors/default/cephadm 2024-05-27T09:32:46.930 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:48.008 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 782785 May 27 09:32 /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:48.009 DEBUG:teuthology.orchestra.run.smithi072:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:48.541 INFO:teuthology.orchestra.run.smithi072.stdout:-rw-r--r--. 1 ubuntu ubuntu 782785 May 27 09:32 /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:48.541 DEBUG:teuthology.orchestra.run.smithi122:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240521.105740-debug/a6507388dd5057528934822c0163b0c347ef1d5d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:49.085 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r--. 1 ubuntu ubuntu 782785 May 27 09:32 /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:49.086 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:49.146 DEBUG:teuthology.orchestra.run.smithi072:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:49.165 DEBUG:teuthology.orchestra.run.smithi122:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-27T09:32:49.198 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d on all hosts... 2024-05-27T09:32:49.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d pull 2024-05-27T09:32:49.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d pull 2024-05-27T09:32:49.208 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d pull 2024-05-27T09:32:50.071 INFO:teuthology.orchestra.run.smithi072.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d... 2024-05-27T09:32:50.080 INFO:teuthology.orchestra.run.smithi122.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d... 2024-05-27T09:32:50.399 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d... 2024-05-27T09:33:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:33:34.399 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.0.0-3868-ga6507388 (a6507388dd5057528934822c0163b0c347ef1d5d) squid (dev)", 2024-05-27T09:33:34.399 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76", 2024-05-27T09:33:34.399 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-05-27T09:33:34.399 INFO:teuthology.orchestra.run.smithi071.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6" 2024-05-27T09:33:34.399 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:33:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:33:44.717 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-27T09:33:44.717 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-3868-ga6507388 (a6507388dd5057528934822c0163b0c347ef1d5d) squid (dev)", 2024-05-27T09:33:44.717 INFO:teuthology.orchestra.run.smithi072.stdout: "image_id": "850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76", 2024-05-27T09:33:44.717 INFO:teuthology.orchestra.run.smithi072.stdout: "repo_digests": [ 2024-05-27T09:33:44.717 INFO:teuthology.orchestra.run.smithi072.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6" 2024-05-27T09:33:44.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-05-27T09:33:44.718 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-27T09:33:49.509 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-27T09:33:49.509 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 19.0.0-3868-ga6507388 (a6507388dd5057528934822c0163b0c347ef1d5d) squid (dev)", 2024-05-27T09:33:49.509 INFO:teuthology.orchestra.run.smithi122.stdout: "image_id": "850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76", 2024-05-27T09:33:49.509 INFO:teuthology.orchestra.run.smithi122.stdout: "repo_digests": [ 2024-05-27T09:33:49.510 INFO:teuthology.orchestra.run.smithi122.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6" 2024-05-27T09:33:49.510 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-05-27T09:33:49.510 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-27T09:33:49.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-05-27T09:33:49.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph 2024-05-27T09:33:49.663 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph 2024-05-27T09:33:49.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-05-27T09:33:49.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /etc/ceph 2024-05-27T09:33:49.805 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /etc/ceph 2024-05-27T09:33:49.829 INFO:tasks.cephadm:Writing seed config... 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-27T09:33:49.830 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-27T09:33:49.831 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-27T09:33:49.832 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-27T09:33:49.833 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-27T09:33:49.834 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:33:49.834 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-27T09:33:49.893 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 13785e2a-1c0c-11ef-bc9b-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-27T09:33:49.893 DEBUG:teuthology.orchestra.run.smithi071:mon.a> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a.service 2024-05-27T09:33:49.940 DEBUG:teuthology.orchestra.run.smithi071:mgr.x> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.x.service 2024-05-27T09:33:49.985 INFO:tasks.cephadm:Bootstrapping... 2024-05-27T09:33:49.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d -v bootstrap --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.71 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-27T09:33:50.253 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-05-27T09:33:50.254 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d', '-v', 'bootstrap', '--fsid', '13785e2a-1c0c-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.71', '--skip-admin-label'] 2024-05-27T09:33:50.254 INFO:teuthology.orchestra.run.smithi071.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-27T09:33:50.254 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying podman|docker is present... 2024-05-27T09:33:50.312 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stdout 5.0.2 2024-05-27T09:33:50.312 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying lvm2 is present... 2024-05-27T09:33:50.313 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying time synchronization is in place... 2024-05-27T09:33:50.328 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-27T09:33:50.328 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-27T09:33:50.344 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-27T09:33:50.344 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-05-27T09:33:50.366 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout enabled 2024-05-27T09:33:50.386 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout active 2024-05-27T09:33:50.386 INFO:teuthology.orchestra.run.smithi071.stdout:Unit chronyd.service is enabled and running 2024-05-27T09:33:50.386 INFO:teuthology.orchestra.run.smithi071.stdout:Repeating the final host check... 2024-05-27T09:33:50.443 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stdout 5.0.2 2024-05-27T09:33:50.443 INFO:teuthology.orchestra.run.smithi071.stdout:podman (/bin/podman) version 5.0.2 is present 2024-05-27T09:33:50.443 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl is present 2024-05-27T09:33:50.443 INFO:teuthology.orchestra.run.smithi071.stdout:lvcreate is present 2024-05-27T09:33:50.460 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-27T09:33:50.460 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-27T09:33:50.475 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-27T09:33:50.475 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-05-27T09:33:50.497 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout enabled 2024-05-27T09:33:50.518 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout active 2024-05-27T09:33:50.519 INFO:teuthology.orchestra.run.smithi071.stdout:Unit chronyd.service is enabled and running 2024-05-27T09:33:50.519 INFO:teuthology.orchestra.run.smithi071.stdout:Host looks OK 2024-05-27T09:33:50.519 INFO:teuthology.orchestra.run.smithi071.stdout:Cluster fsid: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:33:50.520 INFO:teuthology.orchestra.run.smithi071.stdout:Acquiring lock 140529044557344 on /run/cephadm/13785e2a-1c0c-11ef-bc9b-c7b262605968.lock 2024-05-27T09:33:50.520 INFO:teuthology.orchestra.run.smithi071.stdout:Lock 140529044557344 acquired on /run/cephadm/13785e2a-1c0c-11ef-bc9b-c7b262605968.lock 2024-05-27T09:33:50.522 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying IP 172.21.15.71 port 3300 ... 2024-05-27T09:33:50.523 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying IP 172.21.15.71 port 6789 ... 2024-05-27T09:33:50.523 INFO:teuthology.orchestra.run.smithi071.stdout:Base mon IP(s) is [172.21.15.71:3300, 172.21.15.71:6789], mon addrv is [v2:172.21.15.71:3300,v1:172.21.15.71:6789] 2024-05-27T09:33:50.538 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.71 metric 100 2024-05-27T09:33:50.538 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.71 metric 100 2024-05-27T09:33:50.551 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-27T09:33:50.551 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-27T09:33:50.552 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1765sec hoplimit 64 pref medium 2024-05-27T09:33:50.562 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-27T09:33:50.562 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-27T09:33:50.563 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-27T09:33:50.563 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-27T09:33:50.563 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-05-27T09:33:50.563 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-27T09:33:50.564 INFO:teuthology.orchestra.run.smithi071.stdout:Mon IP `172.21.15.71` is in CIDR network `172.21.0.0/20` 2024-05-27T09:33:50.565 INFO:teuthology.orchestra.run.smithi071.stdout:Mon IP `172.21.15.71` is in CIDR network `172.21.0.0/20` 2024-05-27T09:33:50.565 INFO:teuthology.orchestra.run.smithi071.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-27T09:33:50.569 INFO:teuthology.orchestra.run.smithi071.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-27T09:33:50.571 INFO:teuthology.orchestra.run.smithi071.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d... 2024-05-27T09:33:51.183 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stdout 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 2024-05-27T09:33:51.183 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d... 2024-05-27T09:33:51.183 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Getting image source signatures 2024-05-27T09:33:51.183 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Copying blob sha256:30c527fbaaeaa4fed4aa057eca2023a2923eff3c212014d5d990bfbe5e3b29dc 2024-05-27T09:33:51.184 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Copying blob sha256:6ac36e7c57f227110df5cd65cfdca1cc05e0b17df6748637a6aa04c5c80f89c6 2024-05-27T09:33:51.184 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Copying config sha256:850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 2024-05-27T09:33:51.184 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-27T09:33:52.544 INFO:teuthology.orchestra.run.smithi071.stdout:ceph: stdout ceph version 19.0.0-3868-ga6507388 (a6507388dd5057528934822c0163b0c347ef1d5d) squid (dev) 2024-05-27T09:33:52.545 INFO:teuthology.orchestra.run.smithi071.stdout:Ceph version: ceph version 19.0.0-3868-ga6507388 (a6507388dd5057528934822c0163b0c347ef1d5d) squid (dev) 2024-05-27T09:33:52.545 INFO:teuthology.orchestra.run.smithi071.stdout:Extracting ceph user uid/gid from container image... 2024-05-27T09:33:53.718 INFO:teuthology.orchestra.run.smithi071.stdout:stat: stdout 167 167 2024-05-27T09:33:53.718 INFO:teuthology.orchestra.run.smithi071.stdout:Creating initial keys... 2024-05-27T09:33:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph-authtool: stdout AQCCU1RmRDPoDhAAvRo+YUonZhY9HxHYrBiXpQ== 2024-05-27T09:33:56.015 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph-authtool: stdout AQCDU1RmNMehGhAA++uIQGwHuXDBdEDbjWgKAg== 2024-05-27T09:34:08.078 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph-authtool: stdout AQCIU1Rm6kP4ARAAcWzJxT0HOSlVEFD7MvWG7A== 2024-05-27T09:34:08.079 INFO:teuthology.orchestra.run.smithi071.stdout:Creating initial monmap... 2024-05-27T09:34:09.353 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-27T09:34:09.353 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-27T09:34:09.353 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:09.353 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-27T09:34:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool for a [v2:172.21.15.71:3300,v1:172.21.15.71:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-27T09:34:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = quincy 2024-05-27T09:34:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: set fsid to 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-27T09:34:09.354 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:34:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:Creating mon... 2024-05-27T09:34:10.668 INFO:teuthology.orchestra.run.smithi071.stdout:create mon.a on 2024-05-27T09:34:10.982 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-27T09:34:11.228 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-27T09:34:11.524 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968.target. 2024-05-27T09:34:11.524 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968.target. 2024-05-27T09:34:11.928 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a 2024-05-27T09:34:11.928 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to reset failed state of unit ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-05-27T09:34:12.223 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968.target.wants/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@.service. 2024-05-27T09:34:12.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:12 smithi071 podman[31074]: 2024-05-27 09:34:12.658350544 +0000 UTC m=+0.161320283 container create 6d349e07d9bb0ee321a176d1f1de1811c2b5933535ef3d8cd539497c6ea2d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240521) 2024-05-27T09:34:12.914 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:12 smithi071 podman[31074]: 2024-05-27 09:34:12.912485945 +0000 UTC m=+0.415455707 container init 6d349e07d9bb0ee321a176d1f1de1811c2b5933535ef3d8cd539497c6ea2d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-27T09:34:13.039 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-27T09:34:13.039 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-05-27T09:34:13.059 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-27T09:34:13.059 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-05-27T09:34:13.059 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-05-27T09:34:13.059 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to enable service . firewalld.service is not available 2024-05-27T09:34:13.060 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mon to start... 2024-05-27T09:34:13.060 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mon... 2024-05-27T09:34:13.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:12 smithi071 podman[31074]: 2024-05-27 09:34:12.92378817 +0000 UTC m=+0.426757921 container start 6d349e07d9bb0ee321a176d1f1de1811c2b5933535ef3d8cd539497c6ea2d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521) 2024-05-27T09:34:13.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:13 smithi071 bash[31074]: 6d349e07d9bb0ee321a176d1f1de1811c2b5933535ef3d8cd539497c6ea2d82b 2024-05-27T09:34:13.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:13 smithi071 systemd[1]: Started Ceph mon.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:34:13.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:13 smithi071 ceph-mon[31092]: mkfs 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:13.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:13 smithi071 ceph-mon[31092]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-27T09:34:14.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-27T09:34:14.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: monmap epoch 1 2024-05-27T09:34:14.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:14.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: last_changed 2024-05-27T09:34:08.663148+0000 2024-05-27T09:34:14.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:34:14.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: min_mon_release 19 (squid) 2024-05-27T09:34:14.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: election_strategy: 1 2024-05-27T09:34:14.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:34:14.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: fsmap 2024-05-27T09:34:14.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: osdmap e1: 0 total, 0 up, 0 in 2024-05-27T09:34:14.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: mgrmap e1: no daemons active 2024-05-27T09:34:14.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:14 smithi071 ceph-mon[31092]: from='client.? 172.21.15.71:0/314511363' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-27T09:34:14.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout cluster: 2024-05-27T09:34:14.487 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout id: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout services: 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.758523s) 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout data: 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-27T09:34:14.488 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout pgs: 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.743+0000 7f259b400700 1 Processor -- start 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.743+0000 7f259b400700 1 -- start start 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.743+0000 7f259b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259410a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.743+0000 7f259b400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f259410a670 con 0x7f2594109c70 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.744+0000 7f2598a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259410a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.744+0000 7f2598a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259410a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51322/0 (socket says 172.21.15.71:51322) 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.744+0000 7f2598a00700 1 -- 172.21.15.71:0/2027286036 learned_addr learned my addr 172.21.15.71:0/2027286036 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.745+0000 7f2598a00700 1 -- 172.21.15.71:0/2027286036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259410ae40 con 0x7f2594109c70 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.745+0000 7f2598a00700 1 --2- 172.21.15.71:0/2027286036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259410a080 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f25880098a0 tx=0x7f2588009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd09c019e23e7e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.746+0000 7f2593400700 1 -- 172.21.15.71:0/2027286036 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2588004160 con 0x7f2594109c70 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.746+0000 7f2593400700 1 -- 172.21.15.71:0/2027286036 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2588004300 con 0x7f2594109c70 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.746+0000 7f2593400700 1 -- 172.21.15.71:0/2027286036 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25880036a0 con 0x7f2594109c70 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.747+0000 7f259b400700 1 -- 172.21.15.71:0/2027286036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 msgr2=0x7f259410a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.747+0000 7f259b400700 1 --2- 172.21.15.71:0/2027286036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259410a080 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f25880098a0 tx=0x7f2588009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.747+0000 7f259b400700 1 -- 172.21.15.71:0/2027286036 shutdown_connections 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.747+0000 7f259b400700 1 --2- 172.21.15.71:0/2027286036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259410a080 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.747+0000 7f259b400700 1 -- 172.21.15.71:0/2027286036 >> 172.21.15.71:0/2027286036 conn(0x7f25941052d0 msgr2=0x7f2594107760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.747+0000 7f259b400700 1 -- 172.21.15.71:0/2027286036 shutdown_connections 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.747+0000 7f259b400700 1 -- 172.21.15.71:0/2027286036 wait complete. 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.748+0000 7f259b400700 1 Processor -- start 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.749+0000 7f259b400700 1 -- start start 2024-05-27T09:34:14.490 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.749+0000 7f259b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.749+0000 7f259b400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f259410b370 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.749+0000 7f2598a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.749+0000 7f2598a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259419fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51332/0 (socket says 172.21.15.71:51332) 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.749+0000 7f2598a00700 1 -- 172.21.15.71:0/314511363 learned_addr learned my addr 172.21.15.71:0/314511363 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.750+0000 7f2598a00700 1 -- 172.21.15.71:0/314511363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259419ff80 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.750+0000 7f2598a00700 1 --2- 172.21.15.71:0/314511363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259419fa40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.750+0000 7f2591600700 1 -- 172.21.15.71:0/314511363 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2588003db0 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.750+0000 7f2591600700 1 -- 172.21.15.71:0/314511363 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2588011630 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.750+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25941a0210 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.750+0000 7f2591600700 1 -- 172.21.15.71:0/314511363 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2588011950 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.751+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25941a2e20 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.751+0000 7f2591600700 1 -- 172.21.15.71:0/314511363 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f258801a460 con 0x7f2594109c70 2024-05-27T09:34:14.491 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.751+0000 7f2591600700 1 -- 172.21.15.71:0/314511363 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f258801b780 con 0x7f2594109c70 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.752+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2594064e10 con 0x7f2594109c70 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.756+0000 7f2591600700 1 -- 172.21.15.71:0/314511363 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f258801b980 con 0x7f2594109c70 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.838+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f25941a2ff0 con 0x7f2594109c70 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.839+0000 7f2591600700 1 -- 172.21.15.71:0/314511363 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f25941a2ff0 con 0x7f2594109c70 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.840+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 msgr2=0x7f259419fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.840+0000 7f259b400700 1 --2- 172.21.15.71:0/314511363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259419fa40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588004750 comp rx=0 tx=0).stop 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.840+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 shutdown_connections 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.840+0000 7f259b400700 1 --2- 172.21.15.71:0/314511363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2594109c70 0x7f259419fa40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.840+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 >> 172.21.15.71:0/314511363 conn(0x7f25941052d0 msgr2=0x7f259407e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.840+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 shutdown_connections 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:13.841+0000 7f259b400700 1 -- 172.21.15.71:0/314511363 wait complete. 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:mon is available 2024-05-27T09:34:14.492 INFO:teuthology.orchestra.run.smithi071.stdout:Assimilating anything we can from ceph.conf... 2024-05-27T09:34:15.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:15 smithi071 ceph-mon[31092]: from='client.? 172.21.15.71:0/2164914233' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-27T09:34:15.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:15 smithi071 ceph-mon[31092]: from='client.? 172.21.15.71:0/2164914233' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [global] 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout fsid = 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.71:3300,v1:172.21.15.71:6789] 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-27T09:34:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [osd] 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.156+0000 7fcead400700 1 Processor -- start 2024-05-27T09:34:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.156+0000 7fcead400700 1 -- start start 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.157+0000 7fcead400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.157+0000 7fcead400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcea8109570 con 0x7fcea8108b70 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.158+0000 7fcea6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.158+0000 7fcea6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea8108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40428/0 (socket says 172.21.15.71:40428) 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.158+0000 7fcea6800700 1 -- 172.21.15.71:0/3520030671 learned_addr learned my addr 172.21.15.71:0/3520030671 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.158+0000 7fcea6800700 1 -- 172.21.15.71:0/3520030671 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea8109d40 con 0x7fcea8108b70 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.158+0000 7fcea6800700 1 --2- 172.21.15.71:0/3520030671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea8108f80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fce980098a0 tx=0x7fce98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac8c849fc89271c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.159+0000 7fcea5400700 1 -- 172.21.15.71:0/3520030671 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce98004160 con 0x7fcea8108b70 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.159+0000 7fcea5400700 1 -- 172.21.15.71:0/3520030671 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98004300 con 0x7fcea8108b70 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.159+0000 7fcea5400700 1 -- 172.21.15.71:0/3520030671 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce980036a0 con 0x7fcea8108b70 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.160+0000 7fcead400700 1 -- 172.21.15.71:0/3520030671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 msgr2=0x7fcea8108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:15.908 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.160+0000 7fcead400700 1 --2- 172.21.15.71:0/3520030671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea8108f80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fce980098a0 tx=0x7fce98009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.160+0000 7fcead400700 1 -- 172.21.15.71:0/3520030671 shutdown_connections 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.160+0000 7fcead400700 1 --2- 172.21.15.71:0/3520030671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea8108f80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.160+0000 7fcead400700 1 -- 172.21.15.71:0/3520030671 >> 172.21.15.71:0/3520030671 conn(0x7fcea81042d0 msgr2=0x7fcea8106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.160+0000 7fcead400700 1 -- 172.21.15.71:0/3520030671 shutdown_connections 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.160+0000 7fcead400700 1 -- 172.21.15.71:0/3520030671 wait complete. 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.161+0000 7fcead400700 1 Processor -- start 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.162+0000 7fcead400700 1 -- start start 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.162+0000 7fcead400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.162+0000 7fcead400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcea810a270 con 0x7fcea8108b70 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.162+0000 7fcea6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.162+0000 7fcea6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea819d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40436/0 (socket says 172.21.15.71:40436) 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.162+0000 7fcea6800700 1 -- 172.21.15.71:0/2164914233 learned_addr learned my addr 172.21.15.71:0/2164914233 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.163+0000 7fcea6800700 1 -- 172.21.15.71:0/2164914233 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea819dce0 con 0x7fcea8108b70 2024-05-27T09:34:15.909 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.163+0000 7fcea6800700 1 --2- 172.21.15.71:0/2164914233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea819d7a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fce98000c00 tx=0x7fce98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.163+0000 7fce9f400700 1 -- 172.21.15.71:0/2164914233 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce98003db0 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.163+0000 7fce9f400700 1 -- 172.21.15.71:0/2164914233 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98011630 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.163+0000 7fce9f400700 1 -- 172.21.15.71:0/2164914233 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce98011950 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.163+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea819df70 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.164+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea81a0b80 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.164+0000 7fce9f400700 1 -- 172.21.15.71:0/2164914233 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce98011af0 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.164+0000 7fce9f400700 1 -- 172.21.15.71:0/2164914233 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fce9801c450 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.165+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea8064e10 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.168+0000 7fce9f400700 1 -- 172.21.15.71:0/2164914233 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fce98032020 con 0x7fcea8108b70 2024-05-27T09:34:15.910 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.243+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fcea802dc30 con 0x7fcea8108b70 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.254+0000 7fce9f400700 1 -- 172.21.15.71:0/2164914233 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+492 (secure 0 0 0) 0x7fce98004260 con 0x7fcea8108b70 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.255+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 msgr2=0x7fcea819d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.255+0000 7fcead400700 1 --2- 172.21.15.71:0/2164914233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea819d7a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fce98000c00 tx=0x7fce98004750 comp rx=0 tx=0).stop 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.255+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 shutdown_connections 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.255+0000 7fcead400700 1 --2- 172.21.15.71:0/2164914233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcea8108b70 0x7fcea819d7a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.255+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 >> 172.21.15.71:0/2164914233 conn(0x7fcea81042d0 msgr2=0x7fcea8193e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.256+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 shutdown_connections 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:15.256+0000 7fcead400700 1 -- 172.21.15.71:0/2164914233 wait complete. 2024-05-27T09:34:15.911 INFO:teuthology.orchestra.run.smithi071.stdout:Generating new minimal ceph.conf... 2024-05-27T09:34:16.948 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:16 smithi071 ceph-mon[31092]: from='client.? 172.21.15.71:0/1567930388' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:34:17.247 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.568+0000 7f05a8000700 1 Processor -- start 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.568+0000 7f05a8000700 1 -- start start 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.569+0000 7f05a8000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a010a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.569+0000 7f05a8000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05a010a620 con 0x7f05a0109c20 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.569+0000 7f05a5600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a010a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.569+0000 7f05a5600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a010a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40444/0 (socket says 172.21.15.71:40444) 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.569+0000 7f05a5600700 1 -- 172.21.15.71:0/1173390622 learned_addr learned my addr 172.21.15.71:0/1173390622 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.570+0000 7f05a5600700 1 -- 172.21.15.71:0/1173390622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a010adf0 con 0x7f05a0109c20 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.570+0000 7f05a5600700 1 --2- 172.21.15.71:0/1173390622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a010a030 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f05940098a0 tx=0x7f0594009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79160151430ada82 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.570+0000 7f059fe00700 1 -- 172.21.15.71:0/1173390622 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0594004160 con 0x7f05a0109c20 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.570+0000 7f059fe00700 1 -- 172.21.15.71:0/1173390622 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0594004300 con 0x7f05a0109c20 2024-05-27T09:34:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.570+0000 7f059fe00700 1 -- 172.21.15.71:0/1173390622 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0594011af0 con 0x7f05a0109c20 2024-05-27T09:34:17.249 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.571+0000 7f05a8000700 1 -- 172.21.15.71:0/1173390622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 msgr2=0x7f05a010a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:17.249 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.571+0000 7f05a8000700 1 --2- 172.21.15.71:0/1173390622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a010a030 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f05940098a0 tx=0x7f0594009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:17.249 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.571+0000 7f05a8000700 1 -- 172.21.15.71:0/1173390622 shutdown_connections 2024-05-27T09:34:17.249 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.571+0000 7f05a8000700 1 --2- 172.21.15.71:0/1173390622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a010a030 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.571+0000 7f05a8000700 1 -- 172.21.15.71:0/1173390622 >> 172.21.15.71:0/1173390622 conn(0x7f05a0105240 msgr2=0x7f05a0107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.571+0000 7f05a8000700 1 -- 172.21.15.71:0/1173390622 shutdown_connections 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.572+0000 7f05a8000700 1 -- 172.21.15.71:0/1173390622 wait complete. 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.573+0000 7f05a8000700 1 Processor -- start 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.573+0000 7f05a8000700 1 -- start start 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.573+0000 7f05a8000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a01a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.573+0000 7f05a8000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05a010e1a0 con 0x7f05a0109c20 2024-05-27T09:34:17.252 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.573+0000 7f05a5600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a01a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.573+0000 7f05a5600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a01a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40458/0 (socket says 172.21.15.71:40458) 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.573+0000 7f05a5600700 1 -- 172.21.15.71:0/1567930388 learned_addr learned my addr 172.21.15.71:0/1567930388 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.574+0000 7f05a5600700 1 -- 172.21.15.71:0/1567930388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a01a07e0 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.574+0000 7f05a5600700 1 --2- 172.21.15.71:0/1567930388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a01a02a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0594011890 tx=0x7f0594011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.574+0000 7f059e000700 1 -- 172.21.15.71:0/1567930388 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05940039e0 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.574+0000 7f059e000700 1 -- 172.21.15.71:0/1567930388 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0594003b80 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.574+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a01a0a70 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.574+0000 7f059e000700 1 -- 172.21.15.71:0/1567930388 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05940246e0 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.575+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a01a3680 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.575+0000 7f059e000700 1 -- 172.21.15.71:0/1567930388 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0594022020 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.575+0000 7f059e000700 1 -- 172.21.15.71:0/1567930388 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f059402dc40 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.576+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a0064e10 con 0x7f05a0109c20 2024-05-27T09:34:17.253 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.579+0000 7f059e000700 1 -- 172.21.15.71:0/1567930388 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f059401aa70 con 0x7f05a0109c20 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.656+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f05a01a3850 con 0x7f05a0109c20 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.656+0000 7f059e000700 1 -- 172.21.15.71:0/1567930388 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f0594024e20 con 0x7f05a0109c20 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.658+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 msgr2=0x7f05a01a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.658+0000 7f05a8000700 1 --2- 172.21.15.71:0/1567930388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a01a02a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0594011890 tx=0x7f0594011970 comp rx=0 tx=0).stop 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.658+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 shutdown_connections 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.658+0000 7f05a8000700 1 --2- 172.21.15.71:0/1567930388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a0109c20 0x7f05a01a02a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.658+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 >> 172.21.15.71:0/1567930388 conn(0x7f05a0105240 msgr2=0x7f05a0105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.658+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 shutdown_connections 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:16.658+0000 7f05a8000700 1 -- 172.21.15.71:0/1567930388 wait complete. 2024-05-27T09:34:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:Restarting the monitor... 2024-05-27T09:34:17.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:17 smithi071 systemd[1]: Stopping Ceph mon.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31088]: 2024-05-27T09:34:17.728+0000 7f68b1e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31088]: 2024-05-27T09:34:17.728+0000 7f68b1e00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-27T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:17 smithi071 podman[31331]: 2024-05-27 09:34:17.914084004 +0000 UTC m=+0.293153873 container died 6d349e07d9bb0ee321a176d1f1de1811c2b5933535ef3d8cd539497c6ea2d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0) 2024-05-27T09:34:18.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:18 smithi071 podman[31331]: 2024-05-27 09:34:18.313332411 +0000 UTC m=+0.692402290 container cleanup 6d349e07d9bb0ee321a176d1f1de1811c2b5933535ef3d8cd539497c6ea2d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T09:34:18.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:18 smithi071 bash[31331]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a 2024-05-27T09:34:18.809 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:18 smithi071 podman[31343]: 2024-05-27 09:34:18.613986381 +0000 UTC m=+0.690796911 container remove 6d349e07d9bb0ee321a176d1f1de1811c2b5933535ef3d8cd539497c6ea2d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-05-27T09:34:19.062 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 systemd[1]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-27T09:34:19.062 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 systemd[1]: Stopped Ceph mon.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:34:19.062 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 systemd[1]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a.service: Consumed 1.945s CPU time. 2024-05-27T09:34:19.062 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 systemd[1]: Starting Ceph mon.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:34:19.727 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 podman[31432]: 2024-05-27 09:34:19.32868876 +0000 UTC m=+0.033251176 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:34:19.727 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 podman[31432]: 2024-05-27 09:34:19.464815896 +0000 UTC m=+0.169378347 container create dc62176e2d2186dbfa31d471577020cd8edc7903ea4a9f669dfd269ef3075eaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-27T09:34:19.824 INFO:teuthology.orchestra.run.smithi071.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-27T09:34:19.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 podman[31432]: 2024-05-27 09:34:19.726729514 +0000 UTC m=+0.431291985 container init dc62176e2d2186dbfa31d471577020cd8edc7903ea4a9f669dfd269ef3075eaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T09:34:19.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 podman[31432]: 2024-05-27 09:34:19.737109049 +0000 UTC m=+0.441671507 container start dc62176e2d2186dbfa31d471577020cd8edc7903ea4a9f669dfd269ef3075eaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 bash[31432]: dc62176e2d2186dbfa31d471577020cd8edc7903ea4a9f669dfd269ef3075eaf 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 systemd[1]: Started Ceph mon.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: set uid:gid to 167:167 (ceph:ceph) 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: ceph version 19.0.0-3868-ga6507388 (a6507388dd5057528934822c0163b0c347ef1d5d) squid (dev), process ceph-mon, pid 2 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: pidfile_write: ignore empty --pid-file 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: load: jerasure load: lrc 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: RocksDB version: 7.9.2 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Git sha 0 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Compile date 2024-05-21 11:39:56 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: DB SUMMARY 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: DB Session ID: 7SH1XE0PNBJHEM5GEO7F 2024-05-27T09:34:19.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: CURRENT file: CURRENT 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: IDENTITY file: IDENTITY 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105468 ; 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.error_if_exists: 0 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.create_if_missing: 0 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.paranoid_checks: 1 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.env: 0x563b57d83500 2024-05-27T09:34:19.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.fs: PosixFileSystem 2024-05-27T09:34:19.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.info_log: 0x563b5ec56040 2024-05-27T09:34:19.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_file_opening_threads: 16 2024-05-27T09:34:19.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.statistics: (nil) 2024-05-27T09:34:19.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.use_fsync: 0 2024-05-27T09:34:19.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_log_file_size: 0 2024-05-27T09:34:19.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-27T09:34:19.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.keep_log_file_num: 1000 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.recycle_log_file_num: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.allow_fallocate: 1 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.allow_mmap_reads: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.allow_mmap_writes: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.use_direct_reads: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.create_missing_column_families: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.db_log_dir: 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.wal_dir: 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-27T09:34:19.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.advise_random_on_open: 1 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.db_write_buffer_size: 0 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.write_buffer_manager: 0x563b5eb208c0 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.rate_limiter: (nil) 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.wal_recovery_mode: 2 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.enable_thread_tracking: 0 2024-05-27T09:34:19.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.enable_pipelined_write: 0 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.unordered_write: 0 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.row_cache: None 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.wal_filter: None 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.allow_ingest_behind: 0 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.two_write_queues: 0 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.manual_wal_flush: 0 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.wal_compression: 0 2024-05-27T09:34:19.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.atomic_flush: 0 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.log_readahead_size: 0 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.best_efforts_recovery: 0 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.allow_data_in_errors: 0 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.db_host_id: __hostname__ 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_background_jobs: 2 2024-05-27T09:34:19.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_background_compactions: -1 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_subcompactions: 1 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_total_wal_size: 0 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_open_files: -1 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bytes_per_sync: 0 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-27T09:34:19.999 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_readahead_size: 0 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_background_flushes: -1 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Compression algorithms supported: 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kZSTD supported: 0 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kXpressCompression supported: 0 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kLZ4HCCompression supported: 1 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kZlibCompression supported: 1 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kSnappyCompression supported: 1 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kLZ4Compression supported: 1 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: kBZip2Compression supported: 0 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-27T09:34:20.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.merge_operator: 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_filter: None 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_filter_factory: None 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.sst_partitioner_factory: None 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563b5ec56200) 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-27T09:34:20.001 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_type: 0 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_index_type: 0 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_shortening: 1 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: checksum: 4 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: no_block_cache: 0 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache: 0x563b5eb531f0 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_options: 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: capacity : 536870912 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: num_shard_bits : 4 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: strict_capacity_limit : 0 2024-05-27T09:34:20.002 INFO:journalctl@ceph.mon.a.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_compressed: (nil) 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: persistent_cache: (nil) 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size: 4096 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size_deviation: 10 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_restart_interval: 16 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_block_restart_interval: 1 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: metadata_block_size: 4096 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: partition_filters: 0 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: use_delta_encoding: 1 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: filter_policy: bloomfilter 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: whole_key_filtering: 1 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: verify_compression: 0 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-05-27T09:34:20.003 INFO:journalctl@ceph.mon.a.smithi071.stdout: format_version: 5 2024-05-27T09:34:20.004 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_index_compression: 1 2024-05-27T09:34:20.004 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_align: 0 2024-05-27T09:34:20.004 INFO:journalctl@ceph.mon.a.smithi071.stdout: max_auto_readahead_size: 262144 2024-05-27T09:34:20.004 INFO:journalctl@ceph.mon.a.smithi071.stdout: prepopulate_block_cache: 0 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout: initial_auto_readahead_size: 8192 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout: num_file_reads_for_auto_readahead: 2 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.write_buffer_size: 33554432 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_write_buffer_number: 2 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression: NoCompression 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression: Disabled 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.prefix_extractor: nullptr 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.num_levels: 7 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-27T09:34:20.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.level: 32767 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.strategy: 0 2024-05-27T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.enabled: false 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.target_file_size_base: 67108864 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-27T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.arena_block_size: 1048576 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.disable_auto_compactions: 0 2024-05-27T09:34:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.inplace_update_support: 0 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-27T09:34:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.bloom_locality: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.max_successive_merges: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.paranoid_file_checks: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.force_consistency_checks: 1 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.report_bg_io_stats: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.ttl: 2592000 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.enable_blob_files: false 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.min_blob_size: 0 2024-05-27T09:34:20.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.blob_file_size: 268435456 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.blob_file_starting_level: 0 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1ec91b92-acf3-4e28-b668-671ae29f62dc 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716802459880722, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-27T09:34:20.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716802459883592, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100553, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98447, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14272, "raw_average_key_size": 49, "raw_value_size": 90711, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716802459, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1ec91b92-acf3-4e28-b668-671ae29f62dc", "db_session_id": "7SH1XE0PNBJHEM5GEO7F", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716802459883825, "job": 1, "event": "recovery_finished"} 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563b5eb37c00 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: DB pointer 0x563b6392a000 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** DB Stats ** 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-27T09:34:20.012 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: L0 2/0 100.06 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: Sum 2/0 100.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-27T09:34:20.013 INFO:journalctl@ceph.mon.a.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative compaction: 0.00 GB write, 9.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval compaction: 0.00 GB write, 9.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-27T09:34:20.014 INFO:journalctl@ceph.mon.a.smithi071.stdout: Block cache BinnedLRUCache@0x563b5eb531f0#2 capacity: 512.00 MB usage: 1.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.03 KB,0.000196695%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: starting mon.a rank 0 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???) e1 preinit fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???).mds e1 new map 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???).mds e1 print_map 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: e1 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: legacy client fscid: -1 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout: No filesystems configured 2024-05-27T09:34:20.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: monmap epoch 1 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: last_changed 2024-05-27T09:34:08.663148+0000 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: min_mon_release 19 (squid) 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: election_strategy: 1 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: fsmap 2024-05-27T09:34:20.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: osdmap e1: 0 total, 0 up, 0 in 2024-05-27T09:34:20.017 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:19 smithi071 ceph-mon[31451]: mgrmap e1: no daemons active 2024-05-27T09:34:21.303 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.595+0000 7fe91c800700 1 Processor -- start 2024-05-27T09:34:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.595+0000 7fe91c800700 1 -- start start 2024-05-27T09:34:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.596+0000 7fe91c800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe91407d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.596+0000 7fe91c800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe91407d760 con 0x7fe91407edf0 2024-05-27T09:34:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.596+0000 7fe919e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe91407d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.596+0000 7fe919e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe91407d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40460/0 (socket says 172.21.15.71:40460) 2024-05-27T09:34:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.596+0000 7fe919e00700 1 -- 172.21.15.71:0/720033052 learned_addr learned my addr 172.21.15.71:0/720033052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.597+0000 7fe919e00700 1 -- 172.21.15.71:0/720033052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91407d8e0 con 0x7fe91407edf0 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.597+0000 7fe919e00700 1 --2- 172.21.15.71:0/720033052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe91407d220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9080098a0 tx=0x7fe908009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb449e315ecc6fcd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.598+0000 7fe918a00700 1 -- 172.21.15.71:0/720033052 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe908004160 con 0x7fe91407edf0 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.598+0000 7fe918a00700 1 -- 172.21.15.71:0/720033052 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe908004300 con 0x7fe91407edf0 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.598+0000 7fe918a00700 1 -- 172.21.15.71:0/720033052 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe908011af0 con 0x7fe91407edf0 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.599+0000 7fe91c800700 1 -- 172.21.15.71:0/720033052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 msgr2=0x7fe91407d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.599+0000 7fe91c800700 1 --2- 172.21.15.71:0/720033052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe91407d220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9080098a0 tx=0x7fe908009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.599+0000 7fe91c800700 1 -- 172.21.15.71:0/720033052 shutdown_connections 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.599+0000 7fe91c800700 1 --2- 172.21.15.71:0/720033052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe91407d220 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:21.308 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.599+0000 7fe91c800700 1 -- 172.21.15.71:0/720033052 >> 172.21.15.71:0/720033052 conn(0x7fe9141052d0 msgr2=0x7fe914107760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.600+0000 7fe91c800700 1 -- 172.21.15.71:0/720033052 shutdown_connections 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.600+0000 7fe91c800700 1 -- 172.21.15.71:0/720033052 wait complete. 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.601+0000 7fe91c800700 1 Processor -- start 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.601+0000 7fe91c800700 1 -- start start 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.601+0000 7fe91c800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe9141a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.601+0000 7fe91c800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe914110250 con 0x7fe91407edf0 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.602+0000 7fe919e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe9141a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.602+0000 7fe919e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe9141a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40476/0 (socket says 172.21.15.71:40476) 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.602+0000 7fe919e00700 1 -- 172.21.15.71:0/1638292431 learned_addr learned my addr 172.21.15.71:0/1638292431 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.602+0000 7fe919e00700 1 -- 172.21.15.71:0/1638292431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9141a0850 con 0x7fe91407edf0 2024-05-27T09:34:21.309 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.603+0000 7fe919e00700 1 --2- 172.21.15.71:0/1638292431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe9141a0310 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe9080117b0 tx=0x7fe908011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.603+0000 7fe90ea00700 1 -- 172.21.15.71:0/1638292431 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9080039c0 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.603+0000 7fe90ea00700 1 -- 172.21.15.71:0/1638292431 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe908003b60 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.603+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9141a0ae0 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.603+0000 7fe90ea00700 1 -- 172.21.15.71:0/1638292431 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9080196a0 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.603+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141a36f0 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.603+0000 7fe90ea00700 1 -- 172.21.15.71:0/1638292431 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe908019cf0 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.604+0000 7fe90ea00700 1 -- 172.21.15.71:0/1638292431 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe908024730 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.604+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe914064e10 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.608+0000 7fe90ea00700 1 -- 172.21.15.71:0/1638292431 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe908043ec0 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.683+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fe9141a3a00 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.687+0000 7fe90ea00700 1 -- 172.21.15.71:0/1638292431 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fe908032020 con 0x7fe91407edf0 2024-05-27T09:34:21.310 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.688+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 msgr2=0x7fe9141a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:21.311 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.688+0000 7fe91c800700 1 --2- 172.21.15.71:0/1638292431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe9141a0310 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe9080117b0 tx=0x7fe908011b70 comp rx=0 tx=0).stop 2024-05-27T09:34:21.311 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.688+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 shutdown_connections 2024-05-27T09:34:21.311 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.688+0000 7fe91c800700 1 --2- 172.21.15.71:0/1638292431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe91407edf0 0x7fe9141a0310 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:21.312 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.688+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 >> 172.21.15.71:0/1638292431 conn(0x7fe9141052d0 msgr2=0x7fe914105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:21.312 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.689+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 shutdown_connections 2024-05-27T09:34:21.312 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:20.689+0000 7fe91c800700 1 -- 172.21.15.71:0/1638292431 wait complete. 2024-05-27T09:34:21.312 INFO:teuthology.orchestra.run.smithi071.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-27T09:34:21.331 INFO:teuthology.orchestra.run.smithi071.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-27T09:34:21.331 INFO:teuthology.orchestra.run.smithi071.stdout:Creating mgr... 2024-05-27T09:34:21.333 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-27T09:34:21.334 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-27T09:34:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.x 2024-05-27T09:34:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to reset failed state of unit ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-05-27T09:34:21.987 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968.target.wants/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@.service. 2024-05-27T09:34:22.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:21 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1638292431' entity='client.admin' 2024-05-27T09:34:22.364 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 systemd[1]: Starting Ceph mgr.x for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:34:22.623 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 podman[31664]: 2024-05-27 09:34:22.268204286 +0000 UTC m=+0.030688862 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:34:22.623 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 podman[31664]: 2024-05-27 09:34:22.366361936 +0000 UTC m=+0.128846508 container create aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD) 2024-05-27T09:34:22.624 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 podman[31664]: 2024-05-27 09:34:22.611929644 +0000 UTC m=+0.374414263 container init aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-27T09:34:22.624 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 podman[31664]: 2024-05-27 09:34:22.621779745 +0000 UTC m=+0.384264375 container start aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-27T09:34:22.739 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-27T09:34:22.739 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-05-27T09:34:22.757 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-27T09:34:22.757 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-05-27T09:34:22.757 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-05-27T09:34:22.757 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to enable service . firewalld.service is not available 2024-05-27T09:34:22.774 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-27T09:34:22.774 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-05-27T09:34:22.789 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-27T09:34:22.789 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-05-27T09:34:22.789 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-05-27T09:34:22.789 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-27T09:34:22.790 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr to start... 2024-05-27T09:34:22.790 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr... 2024-05-27T09:34:22.935 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 bash[31664]: aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 2024-05-27T09:34:22.935 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 systemd[1]: Started Ceph mgr.x for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:34:23.194 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:22 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:22.932+0000 7fe7b9b62200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:34:23.195 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:23.192+0000 7fe7b9b62200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:34:23.460 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:23.326+0000 7fe7b9b62200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:34:23.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:23 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2654735809' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-27T09:34:24.033 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:23.767+0000 7fe7b9b62200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:34:24.034 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:23.889+0000 7fe7b9b62200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "health": { 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 0 2024-05-27T09:34:24.372 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "a" 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-27T09:34:24.373 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-27T09:34:24.374 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-27T09:34:24.375 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:24.375 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-27T09:34:24.375 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:24.375 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-27T09:34:24.375 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-27T09:34:24.375 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:24.381 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-27T09:34:24.381 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-27T09:34:24.381 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-27T09:34:24.381 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-27T09:34:24.381 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-27T09:34:24.381 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "restful" 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modified": "2024-05-27T09:34:13.085487+0000", 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.458+0000 7f5ab6400700 1 Processor -- start 2024-05-27T09:34:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.458+0000 7f5ab6400700 1 -- start start 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.458+0000 7f5ab6400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab010a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.458+0000 7f5ab6400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab010a620 con 0x7f5ab0109c20 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.459+0000 7f5aaf400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab010a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.459+0000 7f5aaf400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab010a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40496/0 (socket says 172.21.15.71:40496) 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.459+0000 7f5aaf400700 1 -- 172.21.15.71:0/3610303666 learned_addr learned my addr 172.21.15.71:0/3610303666 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.459+0000 7f5aaf400700 1 -- 172.21.15.71:0/3610303666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab010adf0 con 0x7f5ab0109c20 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.460+0000 7f5aaf400700 1 --2- 172.21.15.71:0/3610303666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab010a030 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00098a0 tx=0x7f5aa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa75ac3c7d297b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.460+0000 7f5aae000700 1 -- 172.21.15.71:0/3610303666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa0004160 con 0x7f5ab0109c20 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.460+0000 7f5aae000700 1 -- 172.21.15.71:0/3610303666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5aa0004300 con 0x7f5ab0109c20 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.460+0000 7f5aae000700 1 -- 172.21.15.71:0/3610303666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa0011af0 con 0x7f5ab0109c20 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.461+0000 7f5ab6400700 1 -- 172.21.15.71:0/3610303666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 msgr2=0x7f5ab010a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.461+0000 7f5ab6400700 1 --2- 172.21.15.71:0/3610303666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab010a030 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00098a0 tx=0x7f5aa0009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.461+0000 7f5ab6400700 1 -- 172.21.15.71:0/3610303666 shutdown_connections 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.461+0000 7f5ab6400700 1 --2- 172.21.15.71:0/3610303666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab010a030 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.461+0000 7f5ab6400700 1 -- 172.21.15.71:0/3610303666 >> 172.21.15.71:0/3610303666 conn(0x7f5ab0105240 msgr2=0x7f5ab0107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.462+0000 7f5ab6400700 1 -- 172.21.15.71:0/3610303666 shutdown_connections 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.462+0000 7f5ab6400700 1 -- 172.21.15.71:0/3610303666 wait complete. 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.463+0000 7f5ab6400700 1 Processor -- start 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.463+0000 7f5ab6400700 1 -- start start 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.463+0000 7f5ab6400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab01a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.463+0000 7f5ab6400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab010e1a0 con 0x7f5ab0109c20 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.463+0000 7f5aaf400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab01a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.463+0000 7f5aaf400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab01a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40498/0 (socket says 172.21.15.71:40498) 2024-05-27T09:34:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.463+0000 7f5aaf400700 1 -- 172.21.15.71:0/2654735809 learned_addr learned my addr 172.21.15.71:0/2654735809 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.464+0000 7f5aaf400700 1 -- 172.21.15.71:0/2654735809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab01a0800 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.464+0000 7f5aaf400700 1 --2- 172.21.15.71:0/2654735809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab01a02c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0011890 tx=0x7f5aa0011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.464+0000 7f5aa7e00700 1 -- 172.21.15.71:0/2654735809 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa00039e0 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.464+0000 7f5aa7e00700 1 -- 172.21.15.71:0/2654735809 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5aa0003b80 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.465+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab01a0a90 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.465+0000 7f5aa7e00700 1 -- 172.21.15.71:0/2654735809 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa00246e0 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.465+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab01a36a0 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.465+0000 7f5aa7e00700 1 -- 172.21.15.71:0/2654735809 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5aa0022020 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.465+0000 7f5aa7e00700 1 -- 172.21.15.71:0/2654735809 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5aa002dc40 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.466+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab0064e10 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.469+0000 7f5aa7e00700 1 -- 172.21.15.71:0/2654735809 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5aa001aa70 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.547+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5ab01a3870 con 0x7f5ab0109c20 2024-05-27T09:34:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.548+0000 7f5aa7e00700 1 -- 172.21.15.71:0/2654735809 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f5aa002d3f0 con 0x7f5ab0109c20 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.549+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 msgr2=0x7f5ab01a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.549+0000 7f5ab6400700 1 --2- 172.21.15.71:0/2654735809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab01a02c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0011890 tx=0x7f5aa0011970 comp rx=0 tx=0).stop 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.549+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 shutdown_connections 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.549+0000 7f5ab6400700 1 --2- 172.21.15.71:0/2654735809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab0109c20 0x7f5ab01a02c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.549+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 >> 172.21.15.71:0/2654735809 conn(0x7f5ab0105240 msgr2=0x7f5ab007d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.550+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 shutdown_connections 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:23.550+0000 7f5ab6400700 1 -- 172.21.15.71:0/2654735809 wait complete. 2024-05-27T09:34:24.386 INFO:teuthology.orchestra.run.smithi071.stdout:mgr not available, waiting (1/15)... 2024-05-27T09:34:25.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:25.475+0000 7fe7b9b62200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:34:25.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:25.702+0000 7fe7b9b62200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:34:26.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:25.917+0000 7fe7b9b62200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:34:26.553 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:26.295+0000 7fe7b9b62200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:34:26.553 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:26.423+0000 7fe7b9b62200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:34:26.838 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:26.687+0000 7fe7b9b62200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:34:27.154 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:26.950+0000 7fe7b9b62200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:34:27.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:27 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/156558946' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-27T09:34:27.865 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:27 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:27.767+0000 7fe7b9b62200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "health": { 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:27.887 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 0 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "a" 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-27T09:34:27.889 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-27T09:34:27.890 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "restful" 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modified": "2024-05-27T09:34:13.085487+0000", 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.062+0000 7ff538a00700 1 Processor -- start 2024-05-27T09:34:27.891 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.062+0000 7ff538a00700 1 -- start start 2024-05-27T09:34:27.892 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.062+0000 7ff538a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff53407d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:27.892 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.062+0000 7ff538a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff53407d810 con 0x7ff53407ee10 2024-05-27T09:34:27.892 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.063+0000 7ff531e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff53407d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:27.892 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.063+0000 7ff531e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff53407d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55132/0 (socket says 172.21.15.71:55132) 2024-05-27T09:34:27.892 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.063+0000 7ff531e00700 1 -- 172.21.15.71:0/2354292886 learned_addr learned my addr 172.21.15.71:0/2354292886 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.063+0000 7ff531e00700 1 -- 172.21.15.71:0/2354292886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53407d990 con 0x7ff53407ee10 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.064+0000 7ff531e00700 1 --2- 172.21.15.71:0/2354292886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff53407d240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098a0 tx=0x7ff524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b6953175223c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.064+0000 7ff530a00700 1 -- 172.21.15.71:0/2354292886 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524004160 con 0x7ff53407ee10 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.064+0000 7ff530a00700 1 -- 172.21.15.71:0/2354292886 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff524004300 con 0x7ff53407ee10 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.064+0000 7ff530a00700 1 -- 172.21.15.71:0/2354292886 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524011af0 con 0x7ff53407ee10 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.065+0000 7ff538a00700 1 -- 172.21.15.71:0/2354292886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 msgr2=0x7ff53407d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.065+0000 7ff538a00700 1 --2- 172.21.15.71:0/2354292886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff53407d240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098a0 tx=0x7ff524009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.065+0000 7ff538a00700 1 -- 172.21.15.71:0/2354292886 shutdown_connections 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.065+0000 7ff538a00700 1 --2- 172.21.15.71:0/2354292886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff53407d240 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:27.896 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.065+0000 7ff538a00700 1 -- 172.21.15.71:0/2354292886 >> 172.21.15.71:0/2354292886 conn(0x7ff534105240 msgr2=0x7ff534107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.066+0000 7ff538a00700 1 -- 172.21.15.71:0/2354292886 shutdown_connections 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.066+0000 7ff538a00700 1 -- 172.21.15.71:0/2354292886 wait complete. 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.067+0000 7ff538a00700 1 Processor -- start 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.067+0000 7ff538a00700 1 -- start start 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.067+0000 7ff538a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff5341a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.067+0000 7ff538a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff534110230 con 0x7ff53407ee10 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.068+0000 7ff531e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff5341a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.068+0000 7ff531e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff5341a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55142/0 (socket says 172.21.15.71:55142) 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.068+0000 7ff531e00700 1 -- 172.21.15.71:0/156558946 learned_addr learned my addr 172.21.15.71:0/156558946 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.068+0000 7ff531e00700 1 -- 172.21.15.71:0/156558946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5341a0790 con 0x7ff53407ee10 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.068+0000 7ff531e00700 1 --2- 172.21.15.71:0/156558946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff5341a0250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5240117b0 tx=0x7ff524011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.069+0000 7ff52aa00700 1 -- 172.21.15.71:0/156558946 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524003af0 con 0x7ff53407ee10 2024-05-27T09:34:27.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.069+0000 7ff52aa00700 1 -- 172.21.15.71:0/156558946 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff524020070 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.069+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341a0a20 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.069+0000 7ff52aa00700 1 -- 172.21.15.71:0/156558946 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524019630 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.069+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a3630 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.069+0000 7ff52aa00700 1 -- 172.21.15.71:0/156558946 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff524019c30 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.069+0000 7ff52aa00700 1 -- 172.21.15.71:0/156558946 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff52400b720 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.070+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff534064e10 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.073+0000 7ff52aa00700 1 -- 172.21.15.71:0/156558946 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff52401a9c0 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.153+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff5341a3800 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.153+0000 7ff52aa00700 1 -- 172.21.15.71:0/156558946 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ff52401a430 con 0x7ff53407ee10 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.155+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 msgr2=0x7ff5341a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.155+0000 7ff538a00700 1 --2- 172.21.15.71:0/156558946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff5341a0250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5240117b0 tx=0x7ff524011b70 comp rx=0 tx=0).stop 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.155+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 shutdown_connections 2024-05-27T09:34:27.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.155+0000 7ff538a00700 1 --2- 172.21.15.71:0/156558946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff53407ee10 0x7ff5341a0250 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:27.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.155+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 >> 172.21.15.71:0/156558946 conn(0x7ff534105240 msgr2=0x7ff534105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:27.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.156+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 shutdown_connections 2024-05-27T09:34:27.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:27.156+0000 7ff538a00700 1 -- 172.21.15.71:0/156558946 wait complete. 2024-05-27T09:34:27.899 INFO:teuthology.orchestra.run.smithi071.stdout:mgr not available, waiting (2/15)... 2024-05-27T09:34:28.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:28.078+0000 7fe7b9b62200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:34:29.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:28.652+0000 7fe7b9b62200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:34:29.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:28.779+0000 7fe7b9b62200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:34:29.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:29.243+0000 7fe7b9b62200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:34:30.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:29.696+0000 7fe7b9b62200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:34:30.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:29.820+0000 7fe7b9b62200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:34:30.337 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:30.149+0000 7fe7b9b62200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:34:30.337 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:30.336+0000 7fe7b9b62200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:34:30.605 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:30.470+0000 7fe7b9b62200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:34:30.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:30 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1338669190' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-27T09:34:31.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:30.883+0000 7fe7b9b62200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:34:31.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:31.010+0000 7fe7b9b62200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:34:31.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:31.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:34:31.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:34:31.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "health": { 2024-05-27T09:34:31.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-27T09:34:31.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-27T09:34:31.387 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-27T09:34:31.387 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 0 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "a" 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-27T09:34:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-27T09:34:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-27T09:34:31.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-27T09:34:31.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-27T09:34:31.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-27T09:34:31.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-27T09:34:31.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-27T09:34:31.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:31.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-27T09:34:31.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "restful" 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:31.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modified": "2024-05-27T09:34:13.085487+0000", 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.603+0000 7f7467200700 1 Processor -- start 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.603+0000 7f7467200700 1 -- start start 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.603+0000 7f7467200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f746007d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.603+0000 7f7467200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f746007d760 con 0x7f746007edf0 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.604+0000 7f745fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f746007d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.604+0000 7f745fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f746007d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55148/0 (socket says 172.21.15.71:55148) 2024-05-27T09:34:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.604+0000 7f745fe00700 1 -- 172.21.15.71:0/948213549 learned_addr learned my addr 172.21.15.71:0/948213549 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.605+0000 7f745fe00700 1 -- 172.21.15.71:0/948213549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746007d8e0 con 0x7f746007edf0 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.605+0000 7f745fe00700 1 --2- 172.21.15.71:0/948213549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f746007d220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74500098a0 tx=0x7f7450009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1552e59b98162f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.605+0000 7f745ea00700 1 -- 172.21.15.71:0/948213549 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450004160 con 0x7f746007edf0 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.606+0000 7f745ea00700 1 -- 172.21.15.71:0/948213549 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7450004300 con 0x7f746007edf0 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.606+0000 7f745ea00700 1 -- 172.21.15.71:0/948213549 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450011af0 con 0x7f746007edf0 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.607+0000 7f7467200700 1 -- 172.21.15.71:0/948213549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 msgr2=0x7f746007d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.607+0000 7f7467200700 1 --2- 172.21.15.71:0/948213549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f746007d220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74500098a0 tx=0x7f7450009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.607+0000 7f7467200700 1 -- 172.21.15.71:0/948213549 shutdown_connections 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.607+0000 7f7467200700 1 --2- 172.21.15.71:0/948213549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f746007d220 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.607+0000 7f7467200700 1 -- 172.21.15.71:0/948213549 >> 172.21.15.71:0/948213549 conn(0x7f7460105240 msgr2=0x7f7460107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.607+0000 7f7467200700 1 -- 172.21.15.71:0/948213549 shutdown_connections 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.607+0000 7f7467200700 1 -- 172.21.15.71:0/948213549 wait complete. 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.608+0000 7f7467200700 1 Processor -- start 2024-05-27T09:34:31.399 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.608+0000 7f7467200700 1 -- start start 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.609+0000 7f7467200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f74601a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.609+0000 7f7467200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7460110200 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.609+0000 7f745fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f74601a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.609+0000 7f745fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f74601a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55164/0 (socket says 172.21.15.71:55164) 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.609+0000 7f745fe00700 1 -- 172.21.15.71:0/1338669190 learned_addr learned my addr 172.21.15.71:0/1338669190 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.609+0000 7f745fe00700 1 -- 172.21.15.71:0/1338669190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74601a0760 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.610+0000 7f745fe00700 1 --2- 172.21.15.71:0/1338669190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f74601a0220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7450009fb0 tx=0x7f7450011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.610+0000 7f745cc00700 1 -- 172.21.15.71:0/1338669190 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74500036a0 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.610+0000 7f745cc00700 1 -- 172.21.15.71:0/1338669190 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f745001a430 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.610+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74601a09f0 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.610+0000 7f745cc00700 1 -- 172.21.15.71:0/1338669190 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450019550 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.610+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74601a3600 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.610+0000 7f745cc00700 1 -- 172.21.15.71:0/1338669190 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7450019be0 con 0x7f746007edf0 2024-05-27T09:34:31.400 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.611+0000 7f745cc00700 1 -- 172.21.15.71:0/1338669190 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f74500248b0 con 0x7f746007edf0 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.611+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7460064e10 con 0x7f746007edf0 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.614+0000 7f745cc00700 1 -- 172.21.15.71:0/1338669190 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7450043ec0 con 0x7f746007edf0 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.695+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f74601a37d0 con 0x7f746007edf0 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.696+0000 7f745cc00700 1 -- 172.21.15.71:0/1338669190 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f7450032020 con 0x7f746007edf0 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.698+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 msgr2=0x7f74601a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.698+0000 7f7467200700 1 --2- 172.21.15.71:0/1338669190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f74601a0220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7450009fb0 tx=0x7f7450011940 comp rx=0 tx=0).stop 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.698+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 shutdown_connections 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.698+0000 7f7467200700 1 --2- 172.21.15.71:0/1338669190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f746007edf0 0x7f74601a0220 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.698+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 >> 172.21.15.71:0/1338669190 conn(0x7f7460105240 msgr2=0x7f7460105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.698+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 shutdown_connections 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:30.698+0000 7f7467200700 1 -- 172.21.15.71:0/1338669190 wait complete. 2024-05-27T09:34:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:mgr not available, waiting (3/15)... 2024-05-27T09:34:32.057 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:31.770+0000 7fe7b9b62200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:32 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:32.055+0000 7fe7b9b62200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: Activating manager daemon x 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: mgrmap e2: x(active, starting, since 0.0125211s) 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:34:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-27T09:34:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: Manager daemon x is now available 2024-05-27T09:34:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:32 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-27T09:34:33.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:33 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' 2024-05-27T09:34:33.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:33 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-27T09:34:33.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:33 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' 2024-05-27T09:34:33.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:33 smithi071 ceph-mon[31451]: from='mgr.14100 172.21.15.71:0/529298776' entity='mgr.x' 2024-05-27T09:34:33.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:33 smithi071 ceph-mon[31451]: mgrmap e3: x(active, since 1.0231s) 2024-05-27T09:34:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "health": { 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:35.172 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 0 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "a" 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:35.173 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-27T09:34:35.174 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-27T09:34:35.175 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "restful" 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modified": "2024-05-27T09:34:13.085487+0000", 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:34:35.176 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.087+0000 7f4032800700 1 Processor -- start 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.088+0000 7f4032800700 1 -- start start 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.088+0000 7f4032800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c07d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.088+0000 7f4032800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f402c07d830 con 0x7f402c07ee30 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.088+0000 7f402b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.089+0000 7f402b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c07d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35464/0 (socket says 172.21.15.71:35464) 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.089+0000 7f402b400700 1 -- 172.21.15.71:0/599239518 learned_addr learned my addr 172.21.15.71:0/599239518 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.089+0000 7f402b400700 1 -- 172.21.15.71:0/599239518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c07d9b0 con 0x7f402c07ee30 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.089+0000 7f402b400700 1 --2- 172.21.15.71:0/599239518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c07d260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f401c0098a0 tx=0x7f401c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9e2278875c5d8f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.090+0000 7f402a000700 1 -- 172.21.15.71:0/599239518 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401c004160 con 0x7f402c07ee30 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.090+0000 7f402a000700 1 -- 172.21.15.71:0/599239518 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f401c004300 con 0x7f402c07ee30 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.090+0000 7f402a000700 1 -- 172.21.15.71:0/599239518 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401c011af0 con 0x7f402c07ee30 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.091+0000 7f4032800700 1 -- 172.21.15.71:0/599239518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 msgr2=0x7f402c07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.091+0000 7f4032800700 1 --2- 172.21.15.71:0/599239518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c07d260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f401c0098a0 tx=0x7f401c009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.091+0000 7f4032800700 1 -- 172.21.15.71:0/599239518 shutdown_connections 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.091+0000 7f4032800700 1 --2- 172.21.15.71:0/599239518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c07d260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.091+0000 7f4032800700 1 -- 172.21.15.71:0/599239518 >> 172.21.15.71:0/599239518 conn(0x7f402c105240 msgr2=0x7f402c107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.091+0000 7f4032800700 1 -- 172.21.15.71:0/599239518 shutdown_connections 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.091+0000 7f4032800700 1 -- 172.21.15.71:0/599239518 wait complete. 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.092+0000 7f4032800700 1 Processor -- start 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.092+0000 7f4032800700 1 -- start start 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.093+0000 7f4032800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.093+0000 7f4032800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f402c110220 con 0x7f402c07ee30 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.093+0000 7f402b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.093+0000 7f402b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c1a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35474/0 (socket says 172.21.15.71:35474) 2024-05-27T09:34:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.093+0000 7f402b400700 1 -- 172.21.15.71:0/3252005767 learned_addr learned my addr 172.21.15.71:0/3252005767 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.093+0000 7f402b400700 1 -- 172.21.15.71:0/3252005767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c1a0770 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.094+0000 7f402b400700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c1a0230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f401c009fb0 tx=0x7f401c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.094+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401c0036a0 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.094+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f401c01a430 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.094+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401c019550 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.094+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402c1a0a00 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.094+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402c1a3610 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.096+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402c064e10 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.096+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7f401c003840 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.097+0000 7f4023e00700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7f401003e2f0 0x7f4010040800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.097+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f401c053590 con 0x7f402c07ee30 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.097+0000 7f402aa00700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7f401003e2f0 0x7f4010040800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.098+0000 7f402aa00700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7f401003e2f0 0x7f4010040800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4018006fd0 tx=0x7f4018006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:35.179 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.103+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f401c00b3e0 con 0x7f402c07ee30 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.121+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f401c00fb40 con 0x7f402c07ee30 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.428+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f402c1a3c90 con 0x7f402c07ee30 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.429+0000 7f4023e00700 1 -- 172.21.15.71:0/3252005767 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f401c018da0 con 0x7f402c07ee30 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.431+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7f401003e2f0 msgr2=0x7f4010040800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.431+0000 7f4032800700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7f401003e2f0 0x7f4010040800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4018006fd0 tx=0x7f4018006e40 comp rx=0 tx=0).stop 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.432+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 msgr2=0x7f402c1a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.432+0000 7f4032800700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c1a0230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f401c009fb0 tx=0x7f401c011940 comp rx=0 tx=0).stop 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.432+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 shutdown_connections 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.432+0000 7f4032800700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7f401003e2f0 0x7f4010040800 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.432+0000 7f4032800700 1 --2- 172.21.15.71:0/3252005767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f402c07ee30 0x7f402c1a0230 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.432+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 >> 172.21.15.71:0/3252005767 conn(0x7f402c105240 msgr2=0x7f402c105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.434+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 shutdown_connections 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:34.434+0000 7f4032800700 1 -- 172.21.15.71:0/3252005767 wait complete. 2024-05-27T09:34:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:mgr is available 2024-05-27T09:34:35.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:35 smithi071 ceph-mon[31451]: mgrmap e4: x(active, since 2s) 2024-05-27T09:34:35.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:35 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3252005767' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-27T09:34:36.476 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:36 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/605458986' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [global] 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout fsid = 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-27T09:34:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [osd] 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.857+0000 7fa19a600700 1 Processor -- start 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.857+0000 7fa19a600700 1 -- start start 2024-05-27T09:34:36.840 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.857+0000 7fa19a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19410cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.857+0000 7fa19a600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa19407ce20 con 0x7fa19410a730 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.858+0000 7fa193400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19410cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.858+0000 7fa193400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19410cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35478/0 (socket says 172.21.15.71:35478) 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.858+0000 7fa193400700 1 -- 172.21.15.71:0/2430676355 learned_addr learned my addr 172.21.15.71:0/2430676355 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.859+0000 7fa193400700 1 -- 172.21.15.71:0/2430676355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19410d090 con 0x7fa19410a730 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.859+0000 7fa193400700 1 --2- 172.21.15.71:0/2430676355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19410cb50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1840098a0 tx=0x7fa184009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c8065d5b16272c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.859+0000 7fa192a00700 1 -- 172.21.15.71:0/2430676355 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa184004160 con 0x7fa19410a730 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.859+0000 7fa192a00700 1 -- 172.21.15.71:0/2430676355 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa184004300 con 0x7fa19410a730 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.859+0000 7fa192a00700 1 -- 172.21.15.71:0/2430676355 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa184011af0 con 0x7fa19410a730 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.860+0000 7fa19a600700 1 -- 172.21.15.71:0/2430676355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 msgr2=0x7fa19410cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.860+0000 7fa19a600700 1 --2- 172.21.15.71:0/2430676355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19410cb50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1840098a0 tx=0x7fa184009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.860+0000 7fa19a600700 1 -- 172.21.15.71:0/2430676355 shutdown_connections 2024-05-27T09:34:36.841 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.860+0000 7fa19a600700 1 --2- 172.21.15.71:0/2430676355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19410cb50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.860+0000 7fa19a600700 1 -- 172.21.15.71:0/2430676355 >> 172.21.15.71:0/2430676355 conn(0x7fa1941041b0 msgr2=0x7fa194106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.860+0000 7fa19a600700 1 -- 172.21.15.71:0/2430676355 shutdown_connections 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.860+0000 7fa19a600700 1 -- 172.21.15.71:0/2430676355 wait complete. 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.862+0000 7fa19a600700 1 Processor -- start 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.862+0000 7fa19a600700 1 -- start start 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.862+0000 7fa19a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.862+0000 7fa19a600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa19410dff0 con 0x7fa19410a730 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.863+0000 7fa193400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.863+0000 7fa193400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35490/0 (socket says 172.21.15.71:35490) 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.863+0000 7fa193400700 1 -- 172.21.15.71:0/605458986 learned_addr learned my addr 172.21.15.71:0/605458986 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.863+0000 7fa193400700 1 -- 172.21.15.71:0/605458986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19419e580 con 0x7fa19410a730 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.863+0000 7fa193400700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19419e040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1840117b0 tx=0x7fa184011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.864+0000 7fa190c00700 1 -- 172.21.15.71:0/605458986 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa184003af0 con 0x7fa19410a730 2024-05-27T09:34:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.864+0000 7fa190c00700 1 -- 172.21.15.71:0/605458986 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa184020070 con 0x7fa19410a730 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.864+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19419e810 con 0x7fa19410a730 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.864+0000 7fa190c00700 1 -- 172.21.15.71:0/605458986 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa184019630 con 0x7fa19410a730 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.864+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1941a1420 con 0x7fa19410a730 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.865+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa194064e10 con 0x7fa19410a730 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.865+0000 7fa190c00700 1 -- 172.21.15.71:0/605458986 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fa1840198a0 con 0x7fa19410a730 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.865+0000 7fa190c00700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fa17803e470 0x7fa178040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.866+0000 7fa190c00700 1 -- 172.21.15.71:0/605458986 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa184053cb0 con 0x7fa19410a730 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.866+0000 7fa18be00700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fa17803e470 0x7fa178040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.867+0000 7fa18be00700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fa17803e470 0x7fa178040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa17c006fd0 tx=0x7fa17c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:35.871+0000 7fa190c00700 1 -- 172.21.15.71:0/605458986 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa18402bde0 con 0x7fa19410a730 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.098+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa1941a2c20 con 0x7fa19410a730 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.102+0000 7fa190c00700 1 -- 172.21.15.71:0/605458986 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+436 (secure 0 0 0) 0x7fa1840536d0 con 0x7fa19410a730 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.105+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fa17803e470 msgr2=0x7fa178040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.105+0000 7fa19a600700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fa17803e470 0x7fa178040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa17c006fd0 tx=0x7fa17c006e40 comp rx=0 tx=0).stop 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.105+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 msgr2=0x7fa19419e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.105+0000 7fa19a600700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19419e040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1840117b0 tx=0x7fa184011b70 comp rx=0 tx=0).stop 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.106+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 shutdown_connections 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.106+0000 7fa19a600700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fa17803e470 0x7fa178040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.106+0000 7fa19a600700 1 --2- 172.21.15.71:0/605458986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19410a730 0x7fa19419e040 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.106+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 >> 172.21.15.71:0/605458986 conn(0x7fa1941041b0 msgr2=0x7fa194104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.106+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 shutdown_connections 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:36.106+0000 7fa19a600700 1 -- 172.21.15.71:0/605458986 wait complete. 2024-05-27T09:34:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling cephadm module... 2024-05-27T09:34:38.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:37 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3220501803' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-27T09:34:38.474 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: ignoring --setuser ceph since I am not root 2024-05-27T09:34:38.474 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: ignoring --setgroup ceph since I am not root 2024-05-27T09:34:38.474 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:38.230+0000 7fc14ef9a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:34:38.600 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.495+0000 7ff2de800700 1 Processor -- start 2024-05-27T09:34:38.600 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.495+0000 7ff2de800700 1 -- start start 2024-05-27T09:34:38.600 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.496+0000 7ff2de800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d807d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:38.600 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.496+0000 7ff2de800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d807d810 con 0x7ff2d807ee10 2024-05-27T09:34:38.600 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.496+0000 7ff2dd400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d807d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.497+0000 7ff2dd400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d807d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35492/0 (socket says 172.21.15.71:35492) 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.497+0000 7ff2dd400700 1 -- 172.21.15.71:0/3828315118 learned_addr learned my addr 172.21.15.71:0/3828315118 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.497+0000 7ff2dd400700 1 -- 172.21.15.71:0/3828315118 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d807d990 con 0x7ff2d807ee10 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.497+0000 7ff2dd400700 1 --2- 172.21.15.71:0/3828315118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d807d240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009e80 tx=0x7ff2cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9deff8ff73cb25e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.498+0000 7ff2d7e00700 1 -- 172.21.15.71:0/3828315118 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc017070 con 0x7ff2d807ee10 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.498+0000 7ff2d7e00700 1 -- 172.21.15.71:0/3828315118 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff2cc00b8c0 con 0x7ff2d807ee10 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.498+0000 7ff2d7e00700 1 -- 172.21.15.71:0/3828315118 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc004490 con 0x7ff2d807ee10 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.499+0000 7ff2de800700 1 -- 172.21.15.71:0/3828315118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 msgr2=0x7ff2d807d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.499+0000 7ff2de800700 1 --2- 172.21.15.71:0/3828315118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d807d240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009e80 tx=0x7ff2cc00b330 comp rx=0 tx=0).stop 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.499+0000 7ff2de800700 1 -- 172.21.15.71:0/3828315118 shutdown_connections 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.499+0000 7ff2de800700 1 --2- 172.21.15.71:0/3828315118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d807d240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.499+0000 7ff2de800700 1 -- 172.21.15.71:0/3828315118 >> 172.21.15.71:0/3828315118 conn(0x7ff2d8105110 msgr2=0x7ff2d8107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.499+0000 7ff2de800700 1 -- 172.21.15.71:0/3828315118 shutdown_connections 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.499+0000 7ff2de800700 1 -- 172.21.15.71:0/3828315118 wait complete. 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.500+0000 7ff2de800700 1 Processor -- start 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.500+0000 7ff2de800700 1 -- start start 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.501+0000 7ff2de800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d81a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.501+0000 7ff2de800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81100a0 con 0x7ff2d807ee10 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.501+0000 7ff2dd400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d81a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.501+0000 7ff2dd400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d81a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35508/0 (socket says 172.21.15.71:35508) 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.501+0000 7ff2dd400700 1 -- 172.21.15.71:0/3220501803 learned_addr learned my addr 172.21.15.71:0/3220501803 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.501+0000 7ff2dd400700 1 -- 172.21.15.71:0/3220501803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d81a0650 con 0x7ff2d807ee10 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.502+0000 7ff2dd400700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d81a0110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b7b0 tx=0x7ff2cc00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.502+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc020020 con 0x7ff2d807ee10 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.502+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff2cc012430 con 0x7ff2d807ee10 2024-05-27T09:34:38.602 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.502+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc017040 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.502+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d81a08e0 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.502+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d81a34f0 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.503+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d8064e10 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.503+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7ff2cc023020 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.504+0000 7ff2d6000700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7ff2c003e470 0x7ff2c0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.504+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff2cc00f050 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.505+0000 7ff2dca00700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7ff2c003e470 0x7ff2c0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.505+0000 7ff2dca00700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7ff2c003e470 0x7ff2c0040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4006fd0 tx=0x7ff2c4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.510+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff2cc02a020 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.794+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff2d81a3bc0 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.848+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff2cc02ade0 con 0x7ff2d807ee10 2024-05-27T09:34:38.603 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.851+0000 7ff2d6000700 1 -- 172.21.15.71:0/3220501803 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7ff2cc012910 con 0x7ff2d807ee10 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7ff2c003e470 msgr2=0x7ff2c0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7ff2c003e470 0x7ff2c0040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4006fd0 tx=0x7ff2c4006e40 comp rx=0 tx=0).stop 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 msgr2=0x7ff2d81a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d81a0110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b7b0 tx=0x7ff2cc00bd50 comp rx=0 tx=0).stop 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 shutdown_connections 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7ff2c003e470 0x7ff2c0040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 --2- 172.21.15.71:0/3220501803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d807ee10 0x7ff2d81a0110 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.852+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 >> 172.21.15.71:0/3220501803 conn(0x7ff2d8105110 msgr2=0x7ff2d8105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.853+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 shutdown_connections 2024-05-27T09:34:38.604 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:37.853+0000 7ff2de800700 1 -- 172.21.15.71:0/3220501803 wait complete. 2024-05-27T09:34:38.747 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:38.473+0000 7fc14ef9a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:34:38.747 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:38.608+0000 7fc14ef9a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:34:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:38 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3220501803' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-27T09:34:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:38 smithi071 ceph-mon[31451]: mgrmap e5: x(active, since 5s) 2024-05-27T09:34:39.454 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:39.015+0000 7fc14ef9a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:34:39.454 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:39.134+0000 7fc14ef9a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:34:40.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:39 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/648306564' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-27T09:34:40.283 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:34:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-27T09:34:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-27T09:34:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-27T09:34:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-27T09:34:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:34:40.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.243+0000 7fe279c00700 1 Processor -- start 2024-05-27T09:34:40.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.243+0000 7fe279c00700 1 -- start start 2024-05-27T09:34:40.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.244+0000 7fe279c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe27407d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:40.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.244+0000 7fe279c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe27407d810 con 0x7fe27407ee10 2024-05-27T09:34:40.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.244+0000 7fe272a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe27407d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:40.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.244+0000 7fe272a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe27407d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35530/0 (socket says 172.21.15.71:35530) 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.244+0000 7fe272a00700 1 -- 172.21.15.71:0/2575161305 learned_addr learned my addr 172.21.15.71:0/2575161305 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.245+0000 7fe272a00700 1 -- 172.21.15.71:0/2575161305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27407d990 con 0x7fe27407ee10 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.245+0000 7fe272a00700 1 --2- 172.21.15.71:0/2575161305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe27407d240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2640098a0 tx=0x7fe264009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94915688514d40e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.245+0000 7fe271600700 1 -- 172.21.15.71:0/2575161305 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe264004160 con 0x7fe27407ee10 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.246+0000 7fe271600700 1 -- 172.21.15.71:0/2575161305 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe264004300 con 0x7fe27407ee10 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.246+0000 7fe271600700 1 -- 172.21.15.71:0/2575161305 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe264011af0 con 0x7fe27407ee10 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.247+0000 7fe279c00700 1 -- 172.21.15.71:0/2575161305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 msgr2=0x7fe27407d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.247+0000 7fe279c00700 1 --2- 172.21.15.71:0/2575161305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe27407d240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2640098a0 tx=0x7fe264009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.247+0000 7fe279c00700 1 -- 172.21.15.71:0/2575161305 shutdown_connections 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.247+0000 7fe279c00700 1 --2- 172.21.15.71:0/2575161305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe27407d240 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.247+0000 7fe279c00700 1 -- 172.21.15.71:0/2575161305 >> 172.21.15.71:0/2575161305 conn(0x7fe274105240 msgr2=0x7fe274107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.247+0000 7fe279c00700 1 -- 172.21.15.71:0/2575161305 shutdown_connections 2024-05-27T09:34:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.247+0000 7fe279c00700 1 -- 172.21.15.71:0/2575161305 wait complete. 2024-05-27T09:34:40.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.248+0000 7fe279c00700 1 Processor -- start 2024-05-27T09:34:40.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.248+0000 7fe279c00700 1 -- start start 2024-05-27T09:34:40.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.249+0000 7fe279c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe2741a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:40.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.249+0000 7fe279c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe274110230 con 0x7fe27407ee10 2024-05-27T09:34:40.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.249+0000 7fe272a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe2741a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.249+0000 7fe272a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe2741a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35542/0 (socket says 172.21.15.71:35542) 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.249+0000 7fe272a00700 1 -- 172.21.15.71:0/648306564 learned_addr learned my addr 172.21.15.71:0/648306564 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.249+0000 7fe272a00700 1 -- 172.21.15.71:0/648306564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2741a0790 con 0x7fe27407ee10 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.250+0000 7fe272a00700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe2741a0250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2640117b0 tx=0x7fe264011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.250+0000 7fe26b400700 1 -- 172.21.15.71:0/648306564 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe264003af0 con 0x7fe27407ee10 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.250+0000 7fe26b400700 1 -- 172.21.15.71:0/648306564 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe264020070 con 0x7fe27407ee10 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.250+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2741a0a20 con 0x7fe27407ee10 2024-05-27T09:34:40.292 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.250+0000 7fe26b400700 1 -- 172.21.15.71:0/648306564 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe264019630 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.250+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2741a3630 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.251+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe274064e10 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.252+0000 7fe26b400700 1 -- 172.21.15.71:0/648306564 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fe2640198f0 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.252+0000 7fe26b400700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 0x7fe258040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.252+0000 7fe26b400700 1 -- 172.21.15.71:0/648306564 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe264053c40 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.252+0000 7fe272000700 1 -- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 msgr2=0x7fe258040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.252+0000 7fe272000700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 0x7fe258040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.262+0000 7fe26b400700 1 -- 172.21.15.71:0/648306564 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2640042a0 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.453+0000 7fe272000700 1 -- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 msgr2=0x7fe258040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.453+0000 7fe272000700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 0x7fe258040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.555+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe2741a3cb0 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.556+0000 7fe26b400700 1 -- 172.21.15.71:0/648306564 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fe264053660 con 0x7fe27407ee10 2024-05-27T09:34:40.293 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 msgr2=0x7fe258040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 0x7fe258040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 msgr2=0x7fe2741a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe2741a0250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2640117b0 tx=0x7fe264011b70 comp rx=0 tx=0).stop 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 shutdown_connections 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fe25803e470 0x7fe258040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 --2- 172.21.15.71:0/648306564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe27407ee10 0x7fe2741a0250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.559+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 >> 172.21.15.71:0/648306564 conn(0x7fe274105240 msgr2=0x7fe274105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.560+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 shutdown_connections 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:39.560+0000 7fe279c00700 1 -- 172.21.15.71:0/648306564 wait complete. 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for the mgr to restart... 2024-05-27T09:34:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr epoch 5... 2024-05-27T09:34:40.952 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:40.724+0000 7fc14ef9a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:34:41.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:40.968+0000 7fc14ef9a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:34:41.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:41 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:41.181+0000 7fc14ef9a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:34:41.944 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:41 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:41.567+0000 7fc14ef9a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:34:41.944 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:41 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:41.690+0000 7fc14ef9a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:34:42.200 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:41 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:41.943+0000 7fc14ef9a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:34:42.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:42 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:42.199+0000 7fc14ef9a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:34:43.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:42 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:42.985+0000 7fc14ef9a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:34:43.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:43.271+0000 7fc14ef9a200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:34:44.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:43.826+0000 7fc14ef9a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:34:44.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:43.954+0000 7fc14ef9a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:34:44.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:44 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:44.418+0000 7fc14ef9a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:34:45.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:44 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:44.872+0000 7fc14ef9a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:34:45.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:44 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:44.997+0000 7fc14ef9a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:34:45.628 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:45.320+0000 7fc14ef9a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:34:45.628 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:45.500+0000 7fc14ef9a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:34:46.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:45.627+0000 7fc14ef9a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:34:46.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:46.024+0000 7fc14ef9a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:34:46.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:46.149+0000 7fc14ef9a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:34:47.170 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:46.908+0000 7fc14ef9a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:34:47.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:47 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:34:47.195+0000 7fc14ef9a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:34:47.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: Active manager daemon x restarted 2024-05-27T09:34:47.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: Activating manager daemon x 2024-05-27T09:34:47.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: osdmap e2: 0 total, 0 up, 0 in 2024-05-27T09:34:47.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: mgrmap e6: x(active, starting, since 0.00628719s) 2024-05-27T09:34:47.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:34:47.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-27T09:34:47.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-27T09:34:47.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-27T09:34:47.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-27T09:34:47.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:47 smithi071 ceph-mon[31451]: Manager daemon x is now available 2024-05-27T09:34:48.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: Found migration_current of "None". Setting to last migration. 2024-05-27T09:34:48.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:34:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:48 smithi071 ceph-mon[31451]: mgrmap e7: x(active, since 1.01977s) 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.952+0000 7fc7a1c00700 1 Processor -- start 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.952+0000 7fc7a1c00700 1 -- start start 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.952+0000 7fc7a1c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c109ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.953+0000 7fc7a1c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10a490 con 0x7fc79c109a90 2024-05-27T09:34:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.953+0000 7fc79be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c109ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.953+0000 7fc79be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c109ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35544/0 (socket says 172.21.15.71:35544) 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.953+0000 7fc79be00700 1 -- 172.21.15.71:0/3160227066 learned_addr learned my addr 172.21.15.71:0/3160227066 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.953+0000 7fc79be00700 1 -- 172.21.15.71:0/3160227066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c10ac60 con 0x7fc79c109a90 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.954+0000 7fc79be00700 1 --2- 172.21.15.71:0/3160227066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c109ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0098a0 tx=0x7fc78c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2ff73b8763a67c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.954+0000 7fc79b400700 1 -- 172.21.15.71:0/3160227066 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c004160 con 0x7fc79c109a90 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.954+0000 7fc79b400700 1 -- 172.21.15.71:0/3160227066 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc78c004300 con 0x7fc79c109a90 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.954+0000 7fc79b400700 1 -- 172.21.15.71:0/3160227066 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c011af0 con 0x7fc79c109a90 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.955+0000 7fc7a1c00700 1 -- 172.21.15.71:0/3160227066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 msgr2=0x7fc79c109ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.955+0000 7fc7a1c00700 1 --2- 172.21.15.71:0/3160227066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c109ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0098a0 tx=0x7fc78c009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.955+0000 7fc7a1c00700 1 -- 172.21.15.71:0/3160227066 shutdown_connections 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.955+0000 7fc7a1c00700 1 --2- 172.21.15.71:0/3160227066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c109ea0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.955+0000 7fc7a1c00700 1 -- 172.21.15.71:0/3160227066 >> 172.21.15.71:0/3160227066 conn(0x7fc79c105110 msgr2=0x7fc79c107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.955+0000 7fc7a1c00700 1 -- 172.21.15.71:0/3160227066 shutdown_connections 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.955+0000 7fc7a1c00700 1 -- 172.21.15.71:0/3160227066 wait complete. 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.956+0000 7fc7a1c00700 1 Processor -- start 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.956+0000 7fc7a1c00700 1 -- start start 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.957+0000 7fc7a1c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c07ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.957+0000 7fc7a1c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10e010 con 0x7fc79c109a90 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.957+0000 7fc79be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c07ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.957+0000 7fc79be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c07ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35558/0 (socket says 172.21.15.71:35558) 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.957+0000 7fc79be00700 1 -- 172.21.15.71:0/172474524 learned_addr learned my addr 172.21.15.71:0/172474524 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.958+0000 7fc79be00700 1 -- 172.21.15.71:0/172474524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c07ef90 con 0x7fc79c109a90 2024-05-27T09:34:49.196 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.958+0000 7fc79be00700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c07ea50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0090e0 tx=0x7fc78c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.958+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c0039e0 con 0x7fc79c109a90 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.958+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc78c003b80 con 0x7fc79c109a90 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.958+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c07d1e0 con 0x7fc79c109a90 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.958+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c024690 con 0x7fc79c109a90 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.958+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79c07d6c0 con 0x7fc79c109a90 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.960+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fc78c022020 con 0x7fc79c109a90 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.960+0000 7fc799600700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.960+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 --> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7800410e0 con 0x7fc78003e4c0 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.960+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc78c053450 con 0x7fc79c109a90 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.961+0000 7fc793400700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 msgr2=0x7fc7800409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:40.961+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:41.162+0000 7fc793400700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 msgr2=0x7fc7800409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:49.197 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:41.162+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:41.563+0000 7fc793400700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 msgr2=0x7fc7800409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:41.563+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:42.364+0000 7fc793400700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 msgr2=0x7fc7800409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:42.364+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:43.966+0000 7fc793400700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 msgr2=0x7fc7800409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:43.966+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:47.169+0000 7fc793400700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 msgr2=0x7fc7800409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1765745384 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:47.169+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:47.205+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7fc78c024990 con 0x7fc79c109a90 2024-05-27T09:34:49.198 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:47.205+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 msgr2=0x7fc7800409d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:47.205+0000 7fc799600700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.211+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7fc78c02d5c0 con 0x7fc79c109a90 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.212+0000 7fc799600700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fc780041e00 0x7fc780044220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.212+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7800410e0 con 0x7fc780041e00 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.214+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fc780041e00 0x7fc780044220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.216+0000 7fc793400700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fc780041e00 0x7fc780044220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc784003a10 tx=0x7fc7840092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.219+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fc7800410e0 con 0x7fc780041e00 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.233+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fc79c064e10 con 0x7fc780041e00 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.234+0000 7fc799600700 1 -- 172.21.15.71:0/172474524 <== mgr.14120 v2:172.21.15.71:6800/1853756508 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fc79c064e10 con 0x7fc780041e00 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fc780041e00 msgr2=0x7fc780044220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fc780041e00 0x7fc780044220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc784003a10 tx=0x7fc7840092b0 comp rx=0 tx=0).stop 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 msgr2=0x7fc79c07ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c07ea50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0090e0 tx=0x7fc78c011940 comp rx=0 tx=0).stop 2024-05-27T09:34:49.199 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 shutdown_connections 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fc780041e00 0x7fc780044220 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc79c109a90 0x7fc79c07ea50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 --2- 172.21.15.71:0/172474524 >> [v2:172.21.15.71:6800/1765745384,v1:172.21.15.71:6801/1765745384] conn(0x7fc78003e4c0 0x7fc7800409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 >> 172.21.15.71:0/172474524 conn(0x7fc79c105110 msgr2=0x7fc79c105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.235+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 shutdown_connections 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:48.236+0000 7fc7a1c00700 1 -- 172.21.15.71:0/172474524 wait complete. 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:mgr epoch 5 is available 2024-05-27T09:34:49.200 INFO:teuthology.orchestra.run.smithi071.stdout:Setting orchestrator backend to cephadm... 2024-05-27T09:34:49.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:49 smithi071 ceph-mon[31451]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-27T09:34:49.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:49 smithi071 ceph-mon[31451]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-27T09:34:49.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:49 smithi071 ceph-mon[31451]: [27/May/2024:09:34:48] ENGINE Bus STARTING 2024-05-27T09:34:49.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:49 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:34:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:50 smithi071 ceph-mon[31451]: [27/May/2024:09:34:49] ENGINE Serving on http://172.21.15.71:8765 2024-05-27T09:34:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:50 smithi071 ceph-mon[31451]: [27/May/2024:09:34:49] ENGINE Serving on https://172.21.15.71:7150 2024-05-27T09:34:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:50 smithi071 ceph-mon[31451]: [27/May/2024:09:34:49] ENGINE Bus STARTED 2024-05-27T09:34:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:50 smithi071 ceph-mon[31451]: mgrmap e8: x(active, since 2s) 2024-05-27T09:34:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:50 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:34:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:50 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:34:50.903 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.882+0000 7fae3ba00700 1 Processor -- start 2024-05-27T09:34:50.903 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.882+0000 7fae3ba00700 1 -- start start 2024-05-27T09:34:50.903 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.882+0000 7fae3ba00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae3410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.882+0000 7fae3ba00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae3410c7e0 con 0x7fae3410bda0 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.883+0000 7fae39000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae3410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.883+0000 7fae39000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae3410c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55570/0 (socket says 172.21.15.71:55570) 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.883+0000 7fae39000700 1 -- 172.21.15.71:0/359900918 learned_addr learned my addr 172.21.15.71:0/359900918 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.883+0000 7fae39000700 1 -- 172.21.15.71:0/359900918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3410cf90 con 0x7fae3410bda0 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.884+0000 7fae39000700 1 --2- 172.21.15.71:0/359900918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae3410c1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fae280098a0 tx=0x7fae28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ca7826720430b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.884+0000 7fae33400700 1 -- 172.21.15.71:0/359900918 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae28004160 con 0x7fae3410bda0 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.884+0000 7fae33400700 1 -- 172.21.15.71:0/359900918 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fae28004300 con 0x7fae3410bda0 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.884+0000 7fae33400700 1 -- 172.21.15.71:0/359900918 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae28011af0 con 0x7fae3410bda0 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.885+0000 7fae3ba00700 1 -- 172.21.15.71:0/359900918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 msgr2=0x7fae3410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.885+0000 7fae3ba00700 1 --2- 172.21.15.71:0/359900918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae3410c1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fae280098a0 tx=0x7fae28009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.885+0000 7fae3ba00700 1 -- 172.21.15.71:0/359900918 shutdown_connections 2024-05-27T09:34:50.904 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.885+0000 7fae3ba00700 1 --2- 172.21.15.71:0/359900918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae3410c1d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.885+0000 7fae3ba00700 1 -- 172.21.15.71:0/359900918 >> 172.21.15.71:0/359900918 conn(0x7fae34107670 msgr2=0x7fae34109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.886+0000 7fae3ba00700 1 -- 172.21.15.71:0/359900918 shutdown_connections 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.886+0000 7fae3ba00700 1 -- 172.21.15.71:0/359900918 wait complete. 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.887+0000 7fae3ba00700 1 Processor -- start 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.887+0000 7fae3ba00700 1 -- start start 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.887+0000 7fae3ba00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae341a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.887+0000 7fae3ba00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae341103d0 con 0x7fae3410bda0 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.887+0000 7fae39000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae341a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.887+0000 7fae39000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae341a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55578/0 (socket says 172.21.15.71:55578) 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.887+0000 7fae39000700 1 -- 172.21.15.71:0/3398257200 learned_addr learned my addr 172.21.15.71:0/3398257200 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.888+0000 7fae39000700 1 -- 172.21.15.71:0/3398257200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae341a0710 con 0x7fae3410bda0 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.888+0000 7fae39000700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae341a01d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fae28011890 tx=0x7fae28011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.888+0000 7fae31600700 1 -- 172.21.15.71:0/3398257200 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae280039e0 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.888+0000 7fae31600700 1 -- 172.21.15.71:0/3398257200 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fae28003b80 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.888+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae341a09a0 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.888+0000 7fae31600700 1 -- 172.21.15.71:0/3398257200 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae28024750 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.889+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae341a35b0 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.890+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae34064e10 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.890+0000 7fae31600700 1 -- 172.21.15.71:0/3398257200 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fae28022020 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.890+0000 7fae31600700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fae1c03e4c0 0x7fae1c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.890+0000 7fae31600700 1 -- 172.21.15.71:0/3398257200 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fae28053890 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.891+0000 7fae33e00700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fae1c03e4c0 0x7fae1c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.891+0000 7fae33e00700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fae1c03e4c0 0x7fae1c0409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae24006fd0 tx=0x7fae24006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:49.897+0000 7fae31600700 1 -- 172.21.15.71:0/3398257200 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fae2800b3e0 con 0x7fae3410bda0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.146+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fae341096a0 con 0x7fae1c03e4c0 2024-05-27T09:34:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.161+0000 7fae31600700 1 -- 172.21.15.71:0/3398257200 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fae341096a0 con 0x7fae1c03e4c0 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fae1c03e4c0 msgr2=0x7fae1c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fae1c03e4c0 0x7fae1c0409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae24006fd0 tx=0x7fae24006e40 comp rx=0 tx=0).stop 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 msgr2=0x7fae341a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae341a01d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fae28011890 tx=0x7fae28011970 comp rx=0 tx=0).stop 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 shutdown_connections 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fae1c03e4c0 0x7fae1c0409d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 --2- 172.21.15.71:0/3398257200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3410bda0 0x7fae341a01d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 >> 172.21.15.71:0/3398257200 conn(0x7fae34107670 msgr2=0x7fae34108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 shutdown_connections 2024-05-27T09:34:50.907 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:50.164+0000 7fae3ba00700 1 -- 172.21.15.71:0/3398257200 wait complete. 2024-05-27T09:34:51.443 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:51 smithi071 ceph-mon[31451]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:34:52.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:52 smithi071 ceph-mon[31451]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:34:52.571 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-27T09:34:52.572 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.586+0000 7f58faa00700 1 Processor -- start 2024-05-27T09:34:52.572 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.586+0000 7f58faa00700 1 -- start start 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.586+0000 7f58faa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.587+0000 7f58faa00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58f410c7e0 con 0x7f58f410bda0 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.587+0000 7f58f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.587+0000 7f58f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f410c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55580/0 (socket says 172.21.15.71:55580) 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.587+0000 7f58f3e00700 1 -- 172.21.15.71:0/323648684 learned_addr learned my addr 172.21.15.71:0/323648684 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.587+0000 7f58f3e00700 1 -- 172.21.15.71:0/323648684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f410cf90 con 0x7f58f410bda0 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.588+0000 7f58f3e00700 1 --2- 172.21.15.71:0/323648684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f410c1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f58e40098a0 tx=0x7f58e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c667b6766c5cbdc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.588+0000 7f58f2a00700 1 -- 172.21.15.71:0/323648684 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e4004160 con 0x7f58f410bda0 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.588+0000 7f58f2a00700 1 -- 172.21.15.71:0/323648684 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f58e4004300 con 0x7f58f410bda0 2024-05-27T09:34:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.588+0000 7f58f2a00700 1 -- 172.21.15.71:0/323648684 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e4011af0 con 0x7f58f410bda0 2024-05-27T09:34:52.577 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.589+0000 7f58faa00700 1 -- 172.21.15.71:0/323648684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 msgr2=0x7f58f410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:52.577 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.589+0000 7f58faa00700 1 --2- 172.21.15.71:0/323648684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f410c1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f58e40098a0 tx=0x7f58e4009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:52.577 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.589+0000 7f58faa00700 1 -- 172.21.15.71:0/323648684 shutdown_connections 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.589+0000 7f58faa00700 1 --2- 172.21.15.71:0/323648684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f410c1d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.589+0000 7f58faa00700 1 -- 172.21.15.71:0/323648684 >> 172.21.15.71:0/323648684 conn(0x7f58f4107670 msgr2=0x7f58f4109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.589+0000 7f58faa00700 1 -- 172.21.15.71:0/323648684 shutdown_connections 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.589+0000 7f58faa00700 1 -- 172.21.15.71:0/323648684 wait complete. 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.590+0000 7f58faa00700 1 Processor -- start 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.590+0000 7f58faa00700 1 -- start start 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.591+0000 7f58faa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f41a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.591+0000 7f58faa00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41103d0 con 0x7f58f410bda0 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.591+0000 7f58f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f41a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.591+0000 7f58f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f41a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55582/0 (socket says 172.21.15.71:55582) 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.591+0000 7f58f3e00700 1 -- 172.21.15.71:0/802711961 learned_addr learned my addr 172.21.15.71:0/802711961 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.591+0000 7f58f3e00700 1 -- 172.21.15.71:0/802711961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f41a0710 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.592+0000 7f58f3e00700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f41a01d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58e4011890 tx=0x7f58e4011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.592+0000 7f58f0c00700 1 -- 172.21.15.71:0/802711961 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e40039e0 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.592+0000 7f58f0c00700 1 -- 172.21.15.71:0/802711961 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f58e4003b80 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.592+0000 7f58f0c00700 1 -- 172.21.15.71:0/802711961 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e4024750 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.592+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f41a09a0 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.592+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f41a35b0 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.593+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f4064e10 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.594+0000 7f58f0c00700 1 -- 172.21.15.71:0/802711961 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f58e4022020 con 0x7f58f410bda0 2024-05-27T09:34:52.579 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.594+0000 7f58f0c00700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f58d803e4c0 0x7f58d80409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.594+0000 7f58f0c00700 1 -- 172.21.15.71:0/802711961 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f58e40537e0 con 0x7f58f410bda0 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.595+0000 7f58f3400700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f58d803e4c0 0x7f58d80409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.595+0000 7f58f3400700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f58d803e4c0 0x7f58d80409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58e0006fd0 tx=0x7f58e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.600+0000 7f58f0c00700 1 -- 172.21.15.71:0/802711961 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f58e400b3e0 con 0x7f58f410bda0 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.831+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f58f41096a0 con 0x7f58d803e4c0 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.832+0000 7f58f0c00700 1 -- 172.21.15.71:0/802711961 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f58f41096a0 con 0x7f58d803e4c0 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f58d803e4c0 msgr2=0x7f58d80409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f58d803e4c0 0x7f58d80409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58e0006fd0 tx=0x7f58e0006e40 comp rx=0 tx=0).stop 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 msgr2=0x7f58f41a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f41a01d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58e4011890 tx=0x7f58e4011970 comp rx=0 tx=0).stop 2024-05-27T09:34:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 shutdown_connections 2024-05-27T09:34:52.581 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f58d803e4c0 0x7f58d80409d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:52.581 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 --2- 172.21.15.71:0/802711961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f410bda0 0x7f58f41a01d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:52.581 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.835+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 >> 172.21.15.71:0/802711961 conn(0x7f58f4107670 msgr2=0x7f58f4108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:52.581 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.836+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 shutdown_connections 2024-05-27T09:34:52.581 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:51.836+0000 7f58faa00700 1 -- 172.21.15.71:0/802711961 wait complete. 2024-05-27T09:34:52.582 INFO:teuthology.orchestra.run.smithi071.stdout:Generating ssh key... 2024-05-27T09:34:54.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:54 smithi071 ceph-mon[31451]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:34:54.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:54 smithi071 ceph-mon[31451]: Generating ssh key... 2024-05-27T09:34:54.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: Generating public/private rsa key pair. 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: Your identification has been saved in /tmp/tmpb6xhfgn7/key. 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: Your public key has been saved in /tmp/tmpb6xhfgn7/key.pub. 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: The key fingerprint is: 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: SHA256:6qDJyvKGEQqI1Hoil9IZoo+2fULRtEtUvbnz6dBoXqA ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: The key's randomart image is: 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: +---[RSA 3072]----+ 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: | . ... | 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |.... o . | 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |=o.++ . o | 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |Oo=o + o | 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |+*o o . S.. | 2024-05-27T09:34:54.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |+... . ..o+ | 2024-05-27T09:34:54.510 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |.o+ . .E +oo. | 2024-05-27T09:34:54.510 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |+o.= + o oo | 2024-05-27T09:34:54.510 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: |o== o . ... | 2024-05-27T09:34:54.510 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:34:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: +----[SHA256]-----+ 2024-05-27T09:34:54.846 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.238+0000 7f0d92600700 1 Processor -- start 2024-05-27T09:34:54.846 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.238+0000 7f0d92600700 1 -- start start 2024-05-27T09:34:54.846 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.239+0000 7f0d92600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c10c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.239+0000 7f0d92600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c10c690 con 0x7f0d8c10bc90 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.239+0000 7f0d91200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c10c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.239+0000 7f0d91200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c10c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55594/0 (socket says 172.21.15.71:55594) 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.239+0000 7f0d91200700 1 -- 172.21.15.71:0/1207937164 learned_addr learned my addr 172.21.15.71:0/1207937164 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.240+0000 7f0d91200700 1 -- 172.21.15.71:0/1207937164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c10ce60 con 0x7f0d8c10bc90 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.240+0000 7f0d91200700 1 --2- 172.21.15.71:0/1207937164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c10c0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d800098a0 tx=0x7f0d80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1c3b89f0a13574 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.240+0000 7f0d8b400700 1 -- 172.21.15.71:0/1207937164 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d80004160 con 0x7f0d8c10bc90 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.240+0000 7f0d8b400700 1 -- 172.21.15.71:0/1207937164 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0d80004300 con 0x7f0d8c10bc90 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.240+0000 7f0d8b400700 1 -- 172.21.15.71:0/1207937164 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d80011af0 con 0x7f0d8c10bc90 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.241+0000 7f0d92600700 1 -- 172.21.15.71:0/1207937164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 msgr2=0x7f0d8c10c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.241+0000 7f0d92600700 1 --2- 172.21.15.71:0/1207937164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c10c0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d800098a0 tx=0x7f0d80009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.241+0000 7f0d92600700 1 -- 172.21.15.71:0/1207937164 shutdown_connections 2024-05-27T09:34:54.851 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.241+0000 7f0d92600700 1 --2- 172.21.15.71:0/1207937164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c10c0a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.241+0000 7f0d92600700 1 -- 172.21.15.71:0/1207937164 >> 172.21.15.71:0/1207937164 conn(0x7f0d8c1074a0 msgr2=0x7f0d8c1098c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.241+0000 7f0d92600700 1 -- 172.21.15.71:0/1207937164 shutdown_connections 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.242+0000 7f0d92600700 1 -- 172.21.15.71:0/1207937164 wait complete. 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.243+0000 7f0d92600700 1 Processor -- start 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.243+0000 7f0d92600700 1 -- start start 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.243+0000 7f0d92600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c1a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.243+0000 7f0d92600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c110210 con 0x7f0d8c10bc90 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.244+0000 7f0d91200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c1a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.244+0000 7f0d91200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c1a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55608/0 (socket says 172.21.15.71:55608) 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.244+0000 7f0d91200700 1 -- 172.21.15.71:0/2508119602 learned_addr learned my addr 172.21.15.71:0/2508119602 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.244+0000 7f0d91200700 1 -- 172.21.15.71:0/2508119602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c1a06e0 con 0x7f0d8c10bc90 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.244+0000 7f0d91200700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c1a01a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d800090e0 tx=0x7f0d80011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.245+0000 7f0d89600700 1 -- 172.21.15.71:0/2508119602 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d800039e0 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.245+0000 7f0d89600700 1 -- 172.21.15.71:0/2508119602 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0d80003b80 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.245+0000 7f0d89600700 1 -- 172.21.15.71:0/2508119602 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d80024690 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.245+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c1a0970 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.245+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c1a3580 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.246+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8c064e10 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.246+0000 7f0d89600700 1 -- 172.21.15.71:0/2508119602 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f0d80022020 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.247+0000 7f0d89600700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0d7403e4c0 0x7f0d740409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.247+0000 7f0d89600700 1 -- 172.21.15.71:0/2508119602 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0d80053720 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.247+0000 7f0d8be00700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0d7403e4c0 0x7f0d740409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.248+0000 7f0d8be00700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0d7403e4c0 0x7f0d740409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d78006fd0 tx=0x7f0d78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.252+0000 7f0d89600700 1 -- 172.21.15.71:0/2508119602 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0d80016260 con 0x7f0d8c10bc90 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:53.487+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f0d8c109520 con 0x7f0d7403e4c0 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.186+0000 7f0d89600700 1 -- 172.21.15.71:0/2508119602 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0d8c109520 con 0x7f0d7403e4c0 2024-05-27T09:34:54.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.189+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0d7403e4c0 msgr2=0x7f0d740409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.189+0000 7f0d92600700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0d7403e4c0 0x7f0d740409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d78006fd0 tx=0x7f0d78006e40 comp rx=0 tx=0).stop 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 msgr2=0x7f0d8c1a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c1a01a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d800090e0 tx=0x7f0d80011940 comp rx=0 tx=0).stop 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 shutdown_connections 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0d7403e4c0 0x7f0d740409d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 --2- 172.21.15.71:0/2508119602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d8c10bc90 0x7f0d8c1a01a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 >> 172.21.15.71:0/2508119602 conn(0x7f0d8c1074a0 msgr2=0x7f0d8c108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 shutdown_connections 2024-05-27T09:34:54.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:54.190+0000 7f0d92600700 1 -- 172.21.15.71:0/2508119602 wait complete. 2024-05-27T09:34:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:55 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:34:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:55 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:34:56.456 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:56 smithi071 ceph-mon[31451]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:34:56.477 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1BKEQRs5i7THpS1fca7Q2AAa4KYtY1xXLTPrT1rh6kjpaAUj3g3Zkm5V2y5Txtiges/XhJQMbffzwUcr25BGJnD16/MLS1mZGwsmcpEdrWKKWrLnCzwuZ14CdhB1ZvQUUPG8ooJ6J6amwmsV7j05a3qfN12YvFMPJBDB9oHk5W9yqB1ZzENS377fT2kHdO4ERT1fn4UhRfj4V88PAS1ZcFgDVbaq2qbyNm6iw06DXd8HtJWWjAf3G3KLtsTs/Vkr7+Whl/2vJ2fqG7fdKdceoZ9lf3v4nexOpYgKA/O8Vz92pFIhoiCNN7X6rc8O/SYyHjidT8mRDiSRb2u3KLaw79vSwMHzflZ92D+ZJGlxsyqdqES3EBDy3Aj1wu8ZlO4FGL0CC81j5fQzVsZ2fhx/uZav60WR9gnHhxHBPYSS4mQV0B2gnpOhlJYu6ePnOPQfYC0+pUUvI9FnTwRbfIAii13aVhlgFTC9fOM7Rn8cHvuXxeWo/4FPuTUQi61VkH48= ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:34:56.477 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.543+0000 7faa7a600700 1 Processor -- start 2024-05-27T09:34:56.478 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.543+0000 7faa7a600700 1 -- start start 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.543+0000 7faa7a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7410a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.543+0000 7faa7a600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa7410a660 con 0x7faa74109c60 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.544+0000 7faa73400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7410a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.544+0000 7faa73400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7410a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38604/0 (socket says 172.21.15.71:38604) 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.544+0000 7faa73400700 1 -- 172.21.15.71:0/94914431 learned_addr learned my addr 172.21.15.71:0/94914431 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.544+0000 7faa73400700 1 -- 172.21.15.71:0/94914431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7410ae30 con 0x7faa74109c60 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.545+0000 7faa73400700 1 --2- 172.21.15.71:0/94914431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7410a070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa640098a0 tx=0x7faa64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6177040a14335d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:56.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.545+0000 7faa72000700 1 -- 172.21.15.71:0/94914431 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa64004160 con 0x7faa74109c60 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.545+0000 7faa72000700 1 -- 172.21.15.71:0/94914431 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7faa64004300 con 0x7faa74109c60 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.545+0000 7faa72000700 1 -- 172.21.15.71:0/94914431 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa64011af0 con 0x7faa74109c60 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.546+0000 7faa7a600700 1 -- 172.21.15.71:0/94914431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 msgr2=0x7faa7410a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.546+0000 7faa7a600700 1 --2- 172.21.15.71:0/94914431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7410a070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa640098a0 tx=0x7faa64009bb0 comp rx=0 tx=0).stop 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.546+0000 7faa7a600700 1 -- 172.21.15.71:0/94914431 shutdown_connections 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.546+0000 7faa7a600700 1 --2- 172.21.15.71:0/94914431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7410a070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.546+0000 7faa7a600700 1 -- 172.21.15.71:0/94914431 >> 172.21.15.71:0/94914431 conn(0x7faa741052e0 msgr2=0x7faa74107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.546+0000 7faa7a600700 1 -- 172.21.15.71:0/94914431 shutdown_connections 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.546+0000 7faa7a600700 1 -- 172.21.15.71:0/94914431 wait complete. 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.547+0000 7faa7a600700 1 Processor -- start 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.547+0000 7faa7a600700 1 -- start start 2024-05-27T09:34:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.548+0000 7faa7a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7407ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.548+0000 7faa7a600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa7410e1e0 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.548+0000 7faa73400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7407ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.548+0000 7faa73400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7407ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38612/0 (socket says 172.21.15.71:38612) 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.548+0000 7faa73400700 1 -- 172.21.15.71:0/2993257342 learned_addr learned my addr 172.21.15.71:0/2993257342 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.549+0000 7faa73400700 1 -- 172.21.15.71:0/2993257342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7407ef90 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.549+0000 7faa73400700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7407ea50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa64011890 tx=0x7faa64011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.549+0000 7faa6be00700 1 -- 172.21.15.71:0/2993257342 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa640039e0 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.549+0000 7faa6be00700 1 -- 172.21.15.71:0/2993257342 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7faa64003b80 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.549+0000 7faa7a600700 1 -- 172.21.15.71:0/2993257342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7407d1e0 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.549+0000 7faa6be00700 1 -- 172.21.15.71:0/2993257342 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa640246e0 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.549+0000 7faa7a600700 1 -- 172.21.15.71:0/2993257342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7407d6c0 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.550+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4c005330 con 0x7faa74109c60 2024-05-27T09:34:56.485 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.551+0000 7faa6be00700 1 -- 172.21.15.71:0/2993257342 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7faa64022020 con 0x7faa74109c60 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.551+0000 7faa6be00700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7faa5803e4c0 0x7faa580409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.551+0000 7faa6be00700 1 -- 172.21.15.71:0/2993257342 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faa640538f0 con 0x7faa74109c60 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.551+0000 7faa72a00700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7faa5803e4c0 0x7faa580409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.552+0000 7faa72a00700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7faa5803e4c0 0x7faa580409d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faa60006fd0 tx=0x7faa60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.558+0000 7faa6be00700 1 -- 172.21.15.71:0/2993257342 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faa64053240 con 0x7faa74109c60 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.790+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7faa4c000bc0 con 0x7faa5803e4c0 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.792+0000 7faa6be00700 1 -- 172.21.15.71:0/2993257342 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7faa4c000bc0 con 0x7faa5803e4c0 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7faa5803e4c0 msgr2=0x7faa580409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7faa5803e4c0 0x7faa580409d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faa60006fd0 tx=0x7faa60006e40 comp rx=0 tx=0).stop 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 msgr2=0x7faa7407ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7407ea50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa64011890 tx=0x7faa64011970 comp rx=0 tx=0).stop 2024-05-27T09:34:56.486 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 shutdown_connections 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7faa5803e4c0 0x7faa580409d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 --2- 172.21.15.71:0/2993257342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa74109c60 0x7faa7407ea50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 >> 172.21.15.71:0/2993257342 conn(0x7faa741052e0 msgr2=0x7faa74105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 shutdown_connections 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:55.795+0000 7faa69600700 1 -- 172.21.15.71:0/2993257342 wait complete. 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:Adding key to root@localhost authorized_keys... 2024-05-27T09:34:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:Adding host smithi071... 2024-05-27T09:34:58.385 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:58 smithi071 ceph-mon[31451]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "addr": "172.21.15.71", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:34:59.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:34:59 smithi071 ceph-mon[31451]: Deploying cephadm binary to smithi071 2024-05-27T09:35:03.967 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Added host 'smithi071' with addr '172.21.15.71' 2024-05-27T09:35:03.968 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.176+0000 7fee43c00700 1 Processor -- start 2024-05-27T09:35:03.968 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.176+0000 7fee43c00700 1 -- start start 2024-05-27T09:35:03.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.177+0000 7fee43c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c07d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.177+0000 7fee43c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c07d760 con 0x7fee3c07edf0 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.177+0000 7fee41200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c07d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.177+0000 7fee41200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c07d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38626/0 (socket says 172.21.15.71:38626) 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.177+0000 7fee41200700 1 -- 172.21.15.71:0/3665852789 learned_addr learned my addr 172.21.15.71:0/3665852789 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.178+0000 7fee41200700 1 -- 172.21.15.71:0/3665852789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c07d8e0 con 0x7fee3c07edf0 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.178+0000 7fee41200700 1 --2- 172.21.15.71:0/3665852789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c07d220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009e80 tx=0x7fee2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beac6168d3afb420 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.178+0000 7fee3be00700 1 -- 172.21.15.71:0/3665852789 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee2c017070 con 0x7fee3c07edf0 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.178+0000 7fee3be00700 1 -- 172.21.15.71:0/3665852789 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fee2c00b8c0 con 0x7fee3c07edf0 2024-05-27T09:35:03.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.179+0000 7fee3be00700 1 -- 172.21.15.71:0/3665852789 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee2c004490 con 0x7fee3c07edf0 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.179+0000 7fee43c00700 1 -- 172.21.15.71:0/3665852789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 msgr2=0x7fee3c07d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.179+0000 7fee43c00700 1 --2- 172.21.15.71:0/3665852789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c07d220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009e80 tx=0x7fee2c00b330 comp rx=0 tx=0).stop 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.179+0000 7fee43c00700 1 -- 172.21.15.71:0/3665852789 shutdown_connections 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.179+0000 7fee43c00700 1 --2- 172.21.15.71:0/3665852789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c07d220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.179+0000 7fee43c00700 1 -- 172.21.15.71:0/3665852789 >> 172.21.15.71:0/3665852789 conn(0x7fee3c105240 msgr2=0x7fee3c107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.180+0000 7fee43c00700 1 -- 172.21.15.71:0/3665852789 shutdown_connections 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.180+0000 7fee43c00700 1 -- 172.21.15.71:0/3665852789 wait complete. 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.181+0000 7fee43c00700 1 Processor -- start 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.181+0000 7fee43c00700 1 -- start start 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.181+0000 7fee43c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c1a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.181+0000 7fee43c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c110200 con 0x7fee3c07edf0 2024-05-27T09:35:03.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.181+0000 7fee41200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c1a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.181+0000 7fee41200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c1a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38642/0 (socket says 172.21.15.71:38642) 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.181+0000 7fee41200700 1 -- 172.21.15.71:0/3044758853 learned_addr learned my addr 172.21.15.71:0/3044758853 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.182+0000 7fee41200700 1 -- 172.21.15.71:0/3044758853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c1a0700 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.182+0000 7fee41200700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c1a01c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00b7b0 tx=0x7fee2c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.182+0000 7fee3a000700 1 -- 172.21.15.71:0/3044758853 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee2c020020 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.182+0000 7fee3a000700 1 -- 172.21.15.71:0/3044758853 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fee2c012430 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.182+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3c1a0990 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.182+0000 7fee3a000700 1 -- 172.21.15.71:0/3044758853 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee2c017040 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.183+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3c1a35a0 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.184+0000 7fee3a000700 1 -- 172.21.15.71:0/3044758853 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fee2c023020 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.184+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3c064e10 con 0x7fee3c07edf0 2024-05-27T09:35:03.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.184+0000 7fee3a000700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fee1c03e4c0 0x7fee1c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.184+0000 7fee3a000700 1 -- 172.21.15.71:0/3044758853 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fee2c00f050 con 0x7fee3c07edf0 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.185+0000 7fee2be00700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fee1c03e4c0 0x7fee1c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.185+0000 7fee2be00700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fee1c03e4c0 0x7fee1c0409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee24006fd0 tx=0x7fee24006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.190+0000 7fee3a000700 1 -- 172.21.15.71:0/3044758853 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee2c02a020 con 0x7fee3c07edf0 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:34:57.425+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi071", "addr": "172.21.15.71", "target": ["mon-mgr", ""]}) -- 0x7fee3c1062a0 con 0x7fee1c03e4c0 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.244+0000 7fee3a000700 1 -- 172.21.15.71:0/3044758853 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fee3c1062a0 con 0x7fee1c03e4c0 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fee1c03e4c0 msgr2=0x7fee1c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fee1c03e4c0 0x7fee1c0409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee24006fd0 tx=0x7fee24006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 msgr2=0x7fee3c1a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c1a01c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00b7b0 tx=0x7fee2c00bd50 comp rx=0 tx=0).stop 2024-05-27T09:35:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 shutdown_connections 2024-05-27T09:35:03.978 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fee1c03e4c0 0x7fee1c0409d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:03.978 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 --2- 172.21.15.71:0/3044758853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee3c07edf0 0x7fee3c1a01c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:03.978 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 >> 172.21.15.71:0/3044758853 conn(0x7fee3c105240 msgr2=0x7fee3c105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:03.978 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 shutdown_connections 2024-05-27T09:35:03.978 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:03.249+0000 7fee43c00700 1 -- 172.21.15.71:0/3044758853 wait complete. 2024-05-27T09:35:03.978 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying unmanaged mon service... 2024-05-27T09:35:04.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:04 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:35:04.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:04 smithi071 ceph-mon[31451]: Added host smithi071 2024-05-27T09:35:04.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:04 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:35:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-27T09:35:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.910+0000 7f0abf000700 1 Processor -- start 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.910+0000 7f0abf000700 1 -- start start 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.910+0000 7f0abf000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab807d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.910+0000 7f0abf000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab807d850 con 0x7f0ab807ee50 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.912+0000 7f0ab7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab807d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.912+0000 7f0ab7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab807d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33332/0 (socket says 172.21.15.71:33332) 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.912+0000 7f0ab7e00700 1 -- 172.21.15.71:0/3665533571 learned_addr learned my addr 172.21.15.71:0/3665533571 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.912+0000 7f0ab7e00700 1 -- 172.21.15.71:0/3665533571 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab807d9d0 con 0x7f0ab807ee50 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.913+0000 7f0ab7e00700 1 --2- 172.21.15.71:0/3665533571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab807d280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098a0 tx=0x7f0aa8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cb7f6c9707b6f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.913+0000 7f0ab6a00700 1 -- 172.21.15.71:0/3665533571 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa8004160 con 0x7f0ab807ee50 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.913+0000 7f0ab6a00700 1 -- 172.21.15.71:0/3665533571 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0aa8004300 con 0x7f0ab807ee50 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.913+0000 7f0ab6a00700 1 -- 172.21.15.71:0/3665533571 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa8011af0 con 0x7f0ab807ee50 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.914+0000 7f0abf000700 1 -- 172.21.15.71:0/3665533571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 msgr2=0x7f0ab807d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.914+0000 7f0abf000700 1 --2- 172.21.15.71:0/3665533571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab807d280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098a0 tx=0x7f0aa8009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.914+0000 7f0abf000700 1 -- 172.21.15.71:0/3665533571 shutdown_connections 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.914+0000 7f0abf000700 1 --2- 172.21.15.71:0/3665533571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab807d280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.914+0000 7f0abf000700 1 -- 172.21.15.71:0/3665533571 >> 172.21.15.71:0/3665533571 conn(0x7f0ab81052e0 msgr2=0x7f0ab8107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.914+0000 7f0abf000700 1 -- 172.21.15.71:0/3665533571 shutdown_connections 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.914+0000 7f0abf000700 1 -- 172.21.15.71:0/3665533571 wait complete. 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.915+0000 7f0abf000700 1 Processor -- start 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.916+0000 7f0abf000700 1 -- start start 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.916+0000 7f0abf000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab81a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.916+0000 7f0abf000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab810be80 con 0x7f0ab807ee50 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.916+0000 7f0ab7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab81a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.916+0000 7f0ab7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab81a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33342/0 (socket says 172.21.15.71:33342) 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.916+0000 7f0ab7e00700 1 -- 172.21.15.71:0/1809213208 learned_addr learned my addr 172.21.15.71:0/1809213208 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.917+0000 7f0ab7e00700 1 -- 172.21.15.71:0/1809213208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab81a4bd0 con 0x7f0ab807ee50 2024-05-27T09:35:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.917+0000 7f0ab7e00700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab81a4690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80117b0 tx=0x7f0aa8011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.917+0000 7f0ab4c00700 1 -- 172.21.15.71:0/1809213208 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa8003af0 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.917+0000 7f0ab4c00700 1 -- 172.21.15.71:0/1809213208 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0aa8020070 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.917+0000 7f0ab4c00700 1 -- 172.21.15.71:0/1809213208 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa8019630 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.917+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab81a4e60 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.918+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab81a7a70 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.919+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab8064e10 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.920+0000 7f0ab4c00700 1 -- 172.21.15.71:0/1809213208 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f0aa801a9c0 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.920+0000 7f0ab4c00700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0a9c03e4c0 0x7f0a9c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.920+0000 7f0ab4c00700 1 -- 172.21.15.71:0/1809213208 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0aa8053b40 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.921+0000 7f0ab7400700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0a9c03e4c0 0x7f0a9c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.921+0000 7f0ab7400700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0a9c03e4c0 0x7f0a9c0409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006fd0 tx=0x7f0aa4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:04.927+0000 7f0ab4c00700 1 -- 172.21.15.71:0/1809213208 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0aa80042a0 con 0x7f0ab807ee50 2024-05-27T09:35:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.178+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f0ab8063bf0 con 0x7f0a9c03e4c0 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.190+0000 7f0ab4c00700 1 -- 172.21.15.71:0/1809213208 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0ab8063bf0 con 0x7f0a9c03e4c0 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0a9c03e4c0 msgr2=0x7f0a9c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0a9c03e4c0 0x7f0a9c0409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006fd0 tx=0x7f0aa4006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 msgr2=0x7f0ab81a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab81a4690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80117b0 tx=0x7f0aa8011b70 comp rx=0 tx=0).stop 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 shutdown_connections 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0a9c03e4c0 0x7f0a9c0409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 --2- 172.21.15.71:0/1809213208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab807ee50 0x7f0ab81a4690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.193+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 >> 172.21.15.71:0/1809213208 conn(0x7f0ab81052e0 msgr2=0x7f0ab819afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.194+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 shutdown_connections 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:05.194+0000 7f0abf000700 1 -- 172.21.15.71:0/1809213208 wait complete. 2024-05-27T09:35:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying unmanaged mgr service... 2024-05-27T09:35:06.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:06 smithi071 ceph-mon[31451]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:35:06.466 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:06 smithi071 ceph-mon[31451]: Saving service mon spec with placement count:5 2024-05-27T09:35:06.466 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:06 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:35:08.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:07 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:35:08.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:07 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:35:08.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:07 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:35:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.460+0000 7fbd72200700 1 Processor -- start 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.460+0000 7fbd72200700 1 -- start start 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.461+0000 7fbd72200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c07d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.461+0000 7fbd72200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c07d760 con 0x7fbd6c07edf0 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.461+0000 7fbd6b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c07d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.461+0000 7fbd6b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c07d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33350/0 (socket says 172.21.15.71:33350) 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.461+0000 7fbd6b400700 1 -- 172.21.15.71:0/2918443934 learned_addr learned my addr 172.21.15.71:0/2918443934 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.462+0000 7fbd6b400700 1 -- 172.21.15.71:0/2918443934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c07d8e0 con 0x7fbd6c07edf0 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.462+0000 7fbd6b400700 1 --2- 172.21.15.71:0/2918443934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c07d220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0098a0 tx=0x7fbd5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc3013aa403627d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.462+0000 7fbd6a000700 1 -- 172.21.15.71:0/2918443934 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c004160 con 0x7fbd6c07edf0 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.462+0000 7fbd6a000700 1 -- 172.21.15.71:0/2918443934 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd5c004300 con 0x7fbd6c07edf0 2024-05-27T09:35:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.462+0000 7fbd6a000700 1 -- 172.21.15.71:0/2918443934 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c011a20 con 0x7fbd6c07edf0 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.463+0000 7fbd72200700 1 -- 172.21.15.71:0/2918443934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 msgr2=0x7fbd6c07d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.463+0000 7fbd72200700 1 --2- 172.21.15.71:0/2918443934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c07d220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0098a0 tx=0x7fbd5c009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.464+0000 7fbd72200700 1 -- 172.21.15.71:0/2918443934 shutdown_connections 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.464+0000 7fbd72200700 1 --2- 172.21.15.71:0/2918443934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c07d220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.464+0000 7fbd72200700 1 -- 172.21.15.71:0/2918443934 >> 172.21.15.71:0/2918443934 conn(0x7fbd6c105240 msgr2=0x7fbd6c107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.464+0000 7fbd72200700 1 -- 172.21.15.71:0/2918443934 shutdown_connections 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.464+0000 7fbd72200700 1 -- 172.21.15.71:0/2918443934 wait complete. 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.465+0000 7fbd72200700 1 Processor -- start 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.465+0000 7fbd72200700 1 -- start start 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.465+0000 7fbd72200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.465+0000 7fbd72200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c110240 con 0x7fbd6c07edf0 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.466+0000 7fbd6b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.466+0000 7fbd6b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c1a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33362/0 (socket says 172.21.15.71:33362) 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.466+0000 7fbd6b400700 1 -- 172.21.15.71:0/3285891489 learned_addr learned my addr 172.21.15.71:0/3285891489 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.466+0000 7fbd6b400700 1 -- 172.21.15.71:0/3285891489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c1a0720 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.466+0000 7fbd6b400700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c1a01e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000c00 tx=0x7fbd5c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.467+0000 7fbd63e00700 1 -- 172.21.15.71:0/3285891489 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c003aa0 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.467+0000 7fbd63e00700 1 -- 172.21.15.71:0/3285891489 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd5c01b8f0 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.467+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c1a09b0 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.467+0000 7fbd63e00700 1 -- 172.21.15.71:0/3285891489 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c023890 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.467+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c1a35c0 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.468+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c064e10 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.469+0000 7fbd63e00700 1 -- 172.21.15.71:0/3285891489 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fbd5c01b440 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.469+0000 7fbd63e00700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fbd5003e470 0x7fbd50040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.469+0000 7fbd63e00700 1 -- 172.21.15.71:0/3285891489 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbd5c053fa0 con 0x7fbd6c07edf0 2024-05-27T09:35:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.470+0000 7fbd6aa00700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fbd5003e470 0x7fbd50040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.470+0000 7fbd6aa00700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fbd5003e470 0x7fbd50040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd58006fd0 tx=0x7fbd58006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.474+0000 7fbd63e00700 1 -- 172.21.15.71:0/3285891489 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbd5c01f030 con 0x7fbd6c07edf0 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.721+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbd6c1061d0 con 0x7fbd5003e470 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.729+0000 7fbd63e00700 1 -- 172.21.15.71:0/3285891489 <== mgr.14120 v2:172.21.15.71:6800/1853756508 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbd6c1061d0 con 0x7fbd5003e470 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fbd5003e470 msgr2=0x7fbd50040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fbd5003e470 0x7fbd50040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd58006fd0 tx=0x7fbd58006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 msgr2=0x7fbd6c1a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c1a01e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000c00 tx=0x7fbd5c011aa0 comp rx=0 tx=0).stop 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 shutdown_connections 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7fbd5003e470 0x7fbd50040980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 --2- 172.21.15.71:0/3285891489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd6c07edf0 0x7fbd6c1a01e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 >> 172.21.15.71:0/3285891489 conn(0x7fbd6c105240 msgr2=0x7fbd6c105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 shutdown_connections 2024-05-27T09:35:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:07.732+0000 7fbd72200700 1 -- 172.21.15.71:0/3285891489 wait complete. 2024-05-27T09:35:09.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:08 smithi071 ceph-mon[31451]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:09.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:08 smithi071 ceph-mon[31451]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:35:09.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:08 smithi071 ceph-mon[31451]: Saving service mgr spec with placement count:2 2024-05-27T09:35:10.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:10 smithi071 ceph-mon[31451]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:10.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:10 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1634225162' entity='client.admin' 2024-05-27T09:35:10.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:10 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:35:10.515 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.141+0000 7f7523600700 1 Processor -- start 2024-05-27T09:35:10.520 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.141+0000 7f7523600700 1 -- start start 2024-05-27T09:35:10.520 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.142+0000 7f7523600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c07d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:10.520 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.142+0000 7f7523600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f751c07d810 con 0x7f751c07ee10 2024-05-27T09:35:10.520 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.142+0000 7f7520c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c07d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:10.520 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.142+0000 7f7520c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c07d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33370/0 (socket says 172.21.15.71:33370) 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.142+0000 7f7520c00700 1 -- 172.21.15.71:0/3295750963 learned_addr learned my addr 172.21.15.71:0/3295750963 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.143+0000 7f7520c00700 1 -- 172.21.15.71:0/3295750963 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c07d990 con 0x7f751c07ee10 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.143+0000 7f7520c00700 1 --2- 172.21.15.71:0/3295750963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c07d240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75100098a0 tx=0x7f7510009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e584cf3e4e745f7c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.143+0000 7f751b400700 1 -- 172.21.15.71:0/3295750963 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7510004160 con 0x7f751c07ee10 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.143+0000 7f751b400700 1 -- 172.21.15.71:0/3295750963 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7510004300 con 0x7f751c07ee10 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.143+0000 7f751b400700 1 -- 172.21.15.71:0/3295750963 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7510011a20 con 0x7f751c07ee10 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.144+0000 7f7523600700 1 -- 172.21.15.71:0/3295750963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 msgr2=0x7f751c07d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.144+0000 7f7523600700 1 --2- 172.21.15.71:0/3295750963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c07d240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75100098a0 tx=0x7f7510009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.144+0000 7f7523600700 1 -- 172.21.15.71:0/3295750963 shutdown_connections 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.144+0000 7f7523600700 1 --2- 172.21.15.71:0/3295750963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c07d240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.144+0000 7f7523600700 1 -- 172.21.15.71:0/3295750963 >> 172.21.15.71:0/3295750963 conn(0x7f751c105240 msgr2=0x7f751c107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.144+0000 7f7523600700 1 -- 172.21.15.71:0/3295750963 shutdown_connections 2024-05-27T09:35:10.521 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.145+0000 7f7523600700 1 -- 172.21.15.71:0/3295750963 wait complete. 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.146+0000 7f7523600700 1 Processor -- start 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.146+0000 7f7523600700 1 -- start start 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.146+0000 7f7523600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c1a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.146+0000 7f7523600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f751c110280 con 0x7f751c07ee10 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.146+0000 7f7520c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c1a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.146+0000 7f7520c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c1a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33386/0 (socket says 172.21.15.71:33386) 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.146+0000 7f7520c00700 1 -- 172.21.15.71:0/1634225162 learned_addr learned my addr 172.21.15.71:0/1634225162 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.147+0000 7f7520c00700 1 -- 172.21.15.71:0/1634225162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c1a0750 con 0x7f751c07ee10 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.147+0000 7f7520c00700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c1a0210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75100119f0 tx=0x7f7510011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.147+0000 7f7519600700 1 -- 172.21.15.71:0/1634225162 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75100039e0 con 0x7f751c07ee10 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.147+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c1a09e0 con 0x7f751c07ee10 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.147+0000 7f7519600700 1 -- 172.21.15.71:0/1634225162 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f751001b8f0 con 0x7f751c07ee10 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.148+0000 7f7519600700 1 -- 172.21.15.71:0/1634225162 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75100237a0 con 0x7f751c07ee10 2024-05-27T09:35:10.522 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.148+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c1a35f0 con 0x7f751c07ee10 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.149+0000 7f7519600700 1 -- 172.21.15.71:0/1634225162 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f751002c3f0 con 0x7f751c07ee10 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.149+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751c064e10 con 0x7f751c07ee10 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.149+0000 7f7519600700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f750403e420 0x7f7504040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.150+0000 7f7519600700 1 -- 172.21.15.71:0/1634225162 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7510053f60 con 0x7f751c07ee10 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.150+0000 7f751be00700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f750403e420 0x7f7504040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.151+0000 7f751be00700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f750403e420 0x7f7504040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7508006fd0 tx=0x7f7508006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.156+0000 7f7519600700 1 -- 172.21.15.71:0/1634225162 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f751001f030 con 0x7f751c07ee10 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.398+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f751c1a3bf0 con 0x7f751c07ee10 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.406+0000 7f7519600700 1 -- 172.21.15.71:0/1634225162 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f751000f2e0 con 0x7f751c07ee10 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f750403e420 msgr2=0x7f7504040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f750403e420 0x7f7504040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7508006fd0 tx=0x7f7508006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 msgr2=0x7f751c1a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:10.523 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c1a0210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75100119f0 tx=0x7f7510011ad0 comp rx=0 tx=0).stop 2024-05-27T09:35:10.524 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 shutdown_connections 2024-05-27T09:35:10.524 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f750403e420 0x7f7504040930 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:10.524 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 --2- 172.21.15.71:0/1634225162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f751c07ee10 0x7f751c1a0210 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:10.524 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 >> 172.21.15.71:0/1634225162 conn(0x7f751c105240 msgr2=0x7f751c105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:10.524 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 shutdown_connections 2024-05-27T09:35:10.524 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:09.410+0000 7f7523600700 1 -- 172.21.15.71:0/1634225162 wait complete. 2024-05-27T09:35:12.087 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.163+0000 7f27cae00700 1 Processor -- start 2024-05-27T09:35:12.087 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.163+0000 7f27cae00700 1 -- start start 2024-05-27T09:35:12.087 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.164+0000 7f27cae00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:12.087 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.164+0000 7f27cae00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27c407ce20 con 0x7f27c410a5a0 2024-05-27T09:35:12.087 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.164+0000 7f27c9a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:12.087 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.164+0000 7f27c9a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c410c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33400/0 (socket says 172.21.15.71:33400) 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.164+0000 7f27c9a00700 1 -- 172.21.15.71:0/1897783779 learned_addr learned my addr 172.21.15.71:0/1897783779 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.165+0000 7f27c9a00700 1 -- 172.21.15.71:0/1897783779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c410cf00 con 0x7f27c410a5a0 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.165+0000 7f27c9a00700 1 --2- 172.21.15.71:0/1897783779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c410c9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27b80098a0 tx=0x7f27b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f0bf9d73a7b475 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.166+0000 7f27c3e00700 1 -- 172.21.15.71:0/1897783779 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27b8004160 con 0x7f27c410a5a0 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.166+0000 7f27c3e00700 1 -- 172.21.15.71:0/1897783779 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b8004300 con 0x7f27c410a5a0 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.166+0000 7f27c3e00700 1 -- 172.21.15.71:0/1897783779 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27b8011a20 con 0x7f27c410a5a0 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.167+0000 7f27cae00700 1 -- 172.21.15.71:0/1897783779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 msgr2=0x7f27c410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.167+0000 7f27cae00700 1 --2- 172.21.15.71:0/1897783779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c410c9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27b80098a0 tx=0x7f27b8009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.167+0000 7f27cae00700 1 -- 172.21.15.71:0/1897783779 shutdown_connections 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.167+0000 7f27cae00700 1 --2- 172.21.15.71:0/1897783779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c410c9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.167+0000 7f27cae00700 1 -- 172.21.15.71:0/1897783779 >> 172.21.15.71:0/1897783779 conn(0x7f27c4104000 msgr2=0x7f27c4106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.167+0000 7f27cae00700 1 -- 172.21.15.71:0/1897783779 shutdown_connections 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.167+0000 7f27cae00700 1 -- 172.21.15.71:0/1897783779 wait complete. 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.168+0000 7f27cae00700 1 Processor -- start 2024-05-27T09:35:12.088 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.169+0000 7f27cae00700 1 -- start start 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.169+0000 7f27cae00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c41a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.169+0000 7f27cae00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27c410dea0 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.169+0000 7f27c9a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c41a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.169+0000 7f27c9a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c41a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33410/0 (socket says 172.21.15.71:33410) 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.169+0000 7f27c9a00700 1 -- 172.21.15.71:0/2741460641 learned_addr learned my addr 172.21.15.71:0/2741460641 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.170+0000 7f27c9a00700 1 -- 172.21.15.71:0/2741460641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c41a0650 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.170+0000 7f27c9a00700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c41a0110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009520 tx=0x7f27b8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.170+0000 7f27c2000700 1 -- 172.21.15.71:0/2741460641 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27b80039e0 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.170+0000 7f27c2000700 1 -- 172.21.15.71:0/2741460641 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b801b8f0 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.170+0000 7f27c2000700 1 -- 172.21.15.71:0/2741460641 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27b80197d0 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.170+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c41a08e0 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.170+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c41a34f0 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.172+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c4064e10 con 0x7f27c410a5a0 2024-05-27T09:35:12.089 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.172+0000 7f27c2000700 1 -- 172.21.15.71:0/2741460641 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f27b801b440 con 0x7f27c410a5a0 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.172+0000 7f27c2000700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f27ac03e4c0 0x7f27ac0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.173+0000 7f27c2000700 1 -- 172.21.15.71:0/2741460641 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f27b8053fe0 con 0x7f27c410a5a0 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.173+0000 7f27c9000700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f27ac03e4c0 0x7f27ac0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.174+0000 7f27c9000700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f27ac03e4c0 0x7f27ac0409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f27b0006fd0 tx=0x7f27b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.178+0000 7f27c2000700 1 -- 172.21.15.71:0/2741460641 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f27b801f030 con 0x7f27c410a5a0 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.403+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f27c402e890 con 0x7f27c410a5a0 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.407+0000 7f27c2000700 1 -- 172.21.15.71:0/2741460641 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f27b8017e90 con 0x7f27c410a5a0 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f27ac03e4c0 msgr2=0x7f27ac0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f27ac03e4c0 0x7f27ac0409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f27b0006fd0 tx=0x7f27b0006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 msgr2=0x7f27c41a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c41a0110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009520 tx=0x7f27b8011aa0 comp rx=0 tx=0).stop 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 shutdown_connections 2024-05-27T09:35:12.090 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f27ac03e4c0 0x7f27ac0409d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 --2- 172.21.15.71:0/2741460641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27c410a5a0 0x7f27c41a0110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.410+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 >> 172.21.15.71:0/2741460641 conn(0x7f27c4104000 msgr2=0x7f27c4108520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.411+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 shutdown_connections 2024-05-27T09:35:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:11.411+0000 7f27cae00700 1 -- 172.21.15.71:0/2741460641 wait complete. 2024-05-27T09:35:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling the dashboard module... 2024-05-27T09:35:12.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:12 smithi071 ceph-mon[31451]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:12.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:12 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2741460641' entity='client.admin' 2024-05-27T09:35:13.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:13 smithi071 ceph-mon[31451]: from='mgr.14120 172.21.15.71:0/2529026684' entity='mgr.x' 2024-05-27T09:35:13.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:13 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4028462116' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-27T09:35:13.883 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: ignoring --setuser ceph since I am not root 2024-05-27T09:35:13.883 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: ignoring --setgroup ceph since I am not root 2024-05-27T09:35:13.883 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:13.868+0000 7f219413f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:35:14.252 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:14.116+0000 7f219413f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:35:14.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:14 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4028462116' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-27T09:35:14.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:14 smithi071 ceph-mon[31451]: mgrmap e9: x(active, since 26s) 2024-05-27T09:35:14.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:14.250+0000 7f219413f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:35:15.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:14.653+0000 7f219413f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:35:15.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:14.780+0000 7f219413f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:35:15.154 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.807+0000 7f0be4e00700 1 Processor -- start 2024-05-27T09:35:15.154 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.807+0000 7f0be4e00700 1 -- start start 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.808+0000 7f0be4e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be007d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.808+0000 7f0be4e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0be007d760 con 0x7f0be007edf0 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.808+0000 7f0bdde00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be007d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.808+0000 7f0bdde00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be007d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33414/0 (socket says 172.21.15.71:33414) 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.808+0000 7f0bdde00700 1 -- 172.21.15.71:0/3308060491 learned_addr learned my addr 172.21.15.71:0/3308060491 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.808+0000 7f0bdde00700 1 -- 172.21.15.71:0/3308060491 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be007d8e0 con 0x7f0be007edf0 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.809+0000 7f0bdde00700 1 --2- 172.21.15.71:0/3308060491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be007d220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00098a0 tx=0x7f0bd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8782b86b11fcdd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:15.155 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.809+0000 7f0bdca00700 1 -- 172.21.15.71:0/3308060491 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd0004160 con 0x7f0be007edf0 2024-05-27T09:35:15.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.809+0000 7f0bdca00700 1 -- 172.21.15.71:0/3308060491 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd0004300 con 0x7f0be007edf0 2024-05-27T09:35:15.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.809+0000 7f0bdca00700 1 -- 172.21.15.71:0/3308060491 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd0011a20 con 0x7f0be007edf0 2024-05-27T09:35:15.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.810+0000 7f0be4e00700 1 -- 172.21.15.71:0/3308060491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 msgr2=0x7f0be007d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:15.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.810+0000 7f0be4e00700 1 --2- 172.21.15.71:0/3308060491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be007d220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00098a0 tx=0x7f0bd0009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.810+0000 7f0be4e00700 1 -- 172.21.15.71:0/3308060491 shutdown_connections 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.810+0000 7f0be4e00700 1 --2- 172.21.15.71:0/3308060491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be007d220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.810+0000 7f0be4e00700 1 -- 172.21.15.71:0/3308060491 >> 172.21.15.71:0/3308060491 conn(0x7f0be0105240 msgr2=0x7f0be0107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.811+0000 7f0be4e00700 1 -- 172.21.15.71:0/3308060491 shutdown_connections 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.811+0000 7f0be4e00700 1 -- 172.21.15.71:0/3308060491 wait complete. 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.812+0000 7f0be4e00700 1 Processor -- start 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.812+0000 7f0be4e00700 1 -- start start 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.812+0000 7f0be4e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be01a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.812+0000 7f0be4e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0110240 con 0x7f0be007edf0 2024-05-27T09:35:15.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.812+0000 7f0bdde00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be01a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.812+0000 7f0bdde00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be01a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33416/0 (socket says 172.21.15.71:33416) 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.812+0000 7f0bdde00700 1 -- 172.21.15.71:0/4028462116 learned_addr learned my addr 172.21.15.71:0/4028462116 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.813+0000 7f0bdde00700 1 -- 172.21.15.71:0/4028462116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be01a0720 con 0x7f0be007edf0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.813+0000 7f0bdde00700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be01a01e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00119f0 tx=0x7f0bd0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.813+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd00039e0 con 0x7f0be007edf0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.813+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be01a09b0 con 0x7f0be007edf0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.813+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be01a35c0 con 0x7f0be007edf0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.814+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd001b8f0 con 0x7f0be007edf0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.814+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd00237a0 con 0x7f0be007edf0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.815+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc0005360 con 0x7f0be007edf0 2024-05-27T09:35:15.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.815+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f0bd002c3f0 con 0x7f0be007edf0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.816+0000 7f0bd6a00700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0bc403e470 0x7f0bc4040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.816+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0bd0053e20 con 0x7f0be007edf0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.816+0000 7f0bdd400700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0bc403e470 0x7f0bc4040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.817+0000 7f0bdd400700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0bc403e470 0x7f0bc4040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc006fd0 tx=0x7f0bcc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:12.822+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0bd001f030 con 0x7f0be007edf0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.115+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f0bc0005650 con 0x7f0be007edf0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.482+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f0bd00292a0 con 0x7f0be007edf0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0bd6a00700 1 -- 172.21.15.71:0/4028462116 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f0bd002ca60 con 0x7f0be007edf0 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0bc403e470 msgr2=0x7f0bc4040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0bc403e470 0x7f0bc4040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc006fd0 tx=0x7f0bcc006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 msgr2=0x7f0be01a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be01a01e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00119f0 tx=0x7f0bd0011ad0 comp rx=0 tx=0).stop 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 shutdown_connections 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7f0bc403e470 0x7f0bc4040980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 --2- 172.21.15.71:0/4028462116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be007edf0 0x7f0be01a01e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.487+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 >> 172.21.15.71:0/4028462116 conn(0x7f0be0105240 msgr2=0x7f0be0105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.488+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 shutdown_connections 2024-05-27T09:35:15.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:13.488+0000 7f0be4e00700 1 -- 172.21.15.71:0/4028462116 wait complete. 2024-05-27T09:35:16.369 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:16 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/906121590' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-27T09:35:16.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:16 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:16.367+0000 7f219413f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:35:16.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:16 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:16.602+0000 7f219413f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.798+0000 7ff9a7e00700 1 Processor -- start 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.798+0000 7ff9a7e00700 1 -- start start 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.798+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a807d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.798+0000 7ff9a7e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a807d810 con 0x7ff9a807ee10 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.799+0000 7ff9a6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a807d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.799+0000 7ff9a6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a807d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41916/0 (socket says 172.21.15.71:41916) 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.799+0000 7ff9a6a00700 1 -- 172.21.15.71:0/471820478 learned_addr learned my addr 172.21.15.71:0/471820478 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.799+0000 7ff9a6a00700 1 -- 172.21.15.71:0/471820478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a807d990 con 0x7ff9a807ee10 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.800+0000 7ff9a6a00700 1 --2- 172.21.15.71:0/471820478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a807d240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9980098a0 tx=0x7ff998009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df6c19aee66a831 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.800+0000 7ff9a5600700 1 -- 172.21.15.71:0/471820478 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff998004160 con 0x7ff9a807ee10 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.800+0000 7ff9a5600700 1 -- 172.21.15.71:0/471820478 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff998004300 con 0x7ff9a807ee10 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.800+0000 7ff9a5600700 1 -- 172.21.15.71:0/471820478 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff998011a20 con 0x7ff9a807ee10 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.801+0000 7ff9a7e00700 1 -- 172.21.15.71:0/471820478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 msgr2=0x7ff9a807d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.801+0000 7ff9a7e00700 1 --2- 172.21.15.71:0/471820478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a807d240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9980098a0 tx=0x7ff998009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.801+0000 7ff9a7e00700 1 -- 172.21.15.71:0/471820478 shutdown_connections 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.801+0000 7ff9a7e00700 1 --2- 172.21.15.71:0/471820478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a807d240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:16.866 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.801+0000 7ff9a7e00700 1 -- 172.21.15.71:0/471820478 >> 172.21.15.71:0/471820478 conn(0x7ff9a8105110 msgr2=0x7ff9a8107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.801+0000 7ff9a7e00700 1 -- 172.21.15.71:0/471820478 shutdown_connections 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.801+0000 7ff9a7e00700 1 -- 172.21.15.71:0/471820478 wait complete. 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.802+0000 7ff9a7e00700 1 Processor -- start 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.802+0000 7ff9a7e00700 1 -- start start 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.803+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a81a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.803+0000 7ff9a7e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81100f0 con 0x7ff9a807ee10 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.803+0000 7ff9a6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a81a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.803+0000 7ff9a6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a81a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41924/0 (socket says 172.21.15.71:41924) 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.803+0000 7ff9a6a00700 1 -- 172.21.15.71:0/906121590 learned_addr learned my addr 172.21.15.71:0/906121590 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.803+0000 7ff9a6a00700 1 -- 172.21.15.71:0/906121590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a81a0630 con 0x7ff9a807ee10 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.804+0000 7ff9a6a00700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a81a00f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff998009520 tx=0x7ff998011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.804+0000 7ff9aca00700 1 -- 172.21.15.71:0/906121590 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9980039e0 con 0x7ff9a807ee10 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.804+0000 7ff9aca00700 1 -- 172.21.15.71:0/906121590 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff99801b8f0 con 0x7ff9a807ee10 2024-05-27T09:35:16.867 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.804+0000 7ff9aca00700 1 -- 172.21.15.71:0/906121590 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9980197d0 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.804+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a81a08c0 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.804+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a81a34d0 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.805+0000 7ff9aca00700 1 -- 172.21.15.71:0/906121590 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7ff998019a40 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.805+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a8064e10 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.806+0000 7ff9aca00700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 0x7ff98c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.806+0000 7ff9aca00700 1 -- 172.21.15.71:0/906121590 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff998054050 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.806+0000 7ff9a6000700 1 -- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 msgr2=0x7ff98c040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1853756508 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.806+0000 7ff9a6000700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 0x7ff98c040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:15.812+0000 7ff9aca00700 1 -- 172.21.15.71:0/906121590 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff99801f030 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.007+0000 7ff9a6000700 1 -- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 msgr2=0x7ff98c040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1853756508 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.007+0000 7ff9a6000700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 0x7ff98c040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.097+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff9a81a36a0 con 0x7ff9a807ee10 2024-05-27T09:35:16.868 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.098+0000 7ff9aca00700 1 -- 172.21.15.71:0/906121590 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ff998016260 con 0x7ff9a807ee10 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 msgr2=0x7ff98c040a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 0x7ff98c040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 msgr2=0x7ff9a81a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a81a00f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff998009520 tx=0x7ff998011aa0 comp rx=0 tx=0).stop 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 shutdown_connections 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff98c03e520 0x7ff98c040a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 --2- 172.21.15.71:0/906121590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a807ee10 0x7ff9a81a00f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.101+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 >> 172.21.15.71:0/906121590 conn(0x7ff9a8105110 msgr2=0x7ff9a81059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.102+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 shutdown_connections 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:16.102+0000 7ff9a7e00700 1 -- 172.21.15.71:0/906121590 wait complete. 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for the mgr to restart... 2024-05-27T09:35:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr epoch 9... 2024-05-27T09:35:17.131 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:16 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:16.821+0000 7f219413f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:35:17.494 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:17.219+0000 7f219413f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:35:17.495 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:17.346+0000 7f219413f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:35:17.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:17.606+0000 7f219413f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:35:18.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:17.867+0000 7f219413f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:35:18.953 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:18 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:18.657+0000 7f219413f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:35:18.954 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:18 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:18.951+0000 7f219413f200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:35:20.007 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:19.540+0000 7f219413f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:35:20.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:19.679+0000 7f219413f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:35:20.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:20.147+0000 7f219413f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:35:21.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:20.600+0000 7f219413f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:35:21.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:20.727+0000 7f219413f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:35:21.371 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:21.055+0000 7f219413f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:35:21.371 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:21.235+0000 7f219413f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:35:21.371 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:21.368+0000 7f219413f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:35:22.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:21.770+0000 7f219413f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:35:22.258 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:21.906+0000 7f219413f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:35:22.971 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:22 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:22.676+0000 7f219413f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:35:23.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:35:22 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:35:22.969+0000 7f219413f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: Active manager daemon x restarted 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: Activating manager daemon x 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: osdmap e3: 0 total, 0 up, 0 in 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: mgrmap e10: x(active, starting, since 0.00941368s) 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-27T09:35:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:23 smithi071 ceph-mon[31451]: Manager daemon x is now available 2024-05-27T09:35:24.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:35:24.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-27T09:35:24.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-27T09:35:24.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:24 smithi071 ceph-mon[31451]: mgrmap e11: x(active, since 1.01288s) 2024-05-27T09:35:25.375 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:25 smithi071 ceph-mon[31451]: [27/May/2024:09:35:24] ENGINE Bus STARTING 2024-05-27T09:35:25.375 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:25 smithi071 ceph-mon[31451]: [27/May/2024:09:35:24] ENGINE Serving on https://172.21.15.71:7150 2024-05-27T09:35:25.375 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:25 smithi071 ceph-mon[31451]: [27/May/2024:09:35:24] ENGINE Serving on http://172.21.15.71:8765 2024-05-27T09:35:25.375 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:25 smithi071 ceph-mon[31451]: [27/May/2024:09:35:24] ENGINE Bus STARTED 2024-05-27T09:35:25.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-05-27T09:35:25.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-27T09:35:25.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-27T09:35:25.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-05-27T09:35:25.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.492+0000 7ff441800700 1 Processor -- start 2024-05-27T09:35:25.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.492+0000 7ff441800700 1 -- start start 2024-05-27T09:35:25.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.493+0000 7ff441800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c07d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:25.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.493+0000 7ff441800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c07d810 con 0x7ff43c07ee10 2024-05-27T09:35:25.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.493+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c07d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:25.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.493+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c07d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41940/0 (socket says 172.21.15.71:41940) 2024-05-27T09:35:25.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.494+0000 7ff43aa00700 1 -- 172.21.15.71:0/617591017 learned_addr learned my addr 172.21.15.71:0/617591017 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:25.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.494+0000 7ff43aa00700 1 -- 172.21.15.71:0/617591017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c07d990 con 0x7ff43c07ee10 2024-05-27T09:35:25.389 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.494+0000 7ff43aa00700 1 --2- 172.21.15.71:0/617591017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c07d240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0098a0 tx=0x7ff42c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb12931394a48cdd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.495+0000 7ff439600700 1 -- 172.21.15.71:0/617591017 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff42c004160 con 0x7ff43c07ee10 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.495+0000 7ff439600700 1 -- 172.21.15.71:0/617591017 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff42c004300 con 0x7ff43c07ee10 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.495+0000 7ff439600700 1 -- 172.21.15.71:0/617591017 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff42c011a20 con 0x7ff43c07ee10 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.496+0000 7ff441800700 1 -- 172.21.15.71:0/617591017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 msgr2=0x7ff43c07d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.496+0000 7ff441800700 1 --2- 172.21.15.71:0/617591017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c07d240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0098a0 tx=0x7ff42c009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.496+0000 7ff441800700 1 -- 172.21.15.71:0/617591017 shutdown_connections 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.496+0000 7ff441800700 1 --2- 172.21.15.71:0/617591017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c07d240 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.496+0000 7ff441800700 1 -- 172.21.15.71:0/617591017 >> 172.21.15.71:0/617591017 conn(0x7ff43c105240 msgr2=0x7ff43c107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.496+0000 7ff441800700 1 -- 172.21.15.71:0/617591017 shutdown_connections 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.496+0000 7ff441800700 1 -- 172.21.15.71:0/617591017 wait complete. 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.497+0000 7ff441800700 1 Processor -- start 2024-05-27T09:35:25.390 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.498+0000 7ff441800700 1 -- start start 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.498+0000 7ff441800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.498+0000 7ff441800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c110280 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.498+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.498+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c1a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41954/0 (socket says 172.21.15.71:41954) 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.498+0000 7ff43aa00700 1 -- 172.21.15.71:0/1207259591 learned_addr learned my addr 172.21.15.71:0/1207259591 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.499+0000 7ff43aa00700 1 -- 172.21.15.71:0/1207259591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c1a0730 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.499+0000 7ff43aa00700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c1a01f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff42c000c00 tx=0x7ff42c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.499+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff42c003aa0 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.499+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff42c01b8f0 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.499+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c1a09c0 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.499+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff42c023890 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.500+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c1a35d0 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.501+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7ff42c02c3f0 con 0x7ff43c07ee10 2024-05-27T09:35:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.502+0000 7ff433400700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.502+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 --> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4200410e0 con 0x7ff42003e4c0 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.502+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff42c053f10 con 0x7ff43c07ee10 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.502+0000 7ff43a000700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 msgr2=0x7ff4200409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1853756508 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.502+0000 7ff43a000700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.703+0000 7ff43a000700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 msgr2=0x7ff4200409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1853756508 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:17.703+0000 7ff43a000700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:18.104+0000 7ff43a000700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 msgr2=0x7ff4200409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1853756508 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:18.104+0000 7ff43a000700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:18.905+0000 7ff43a000700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 msgr2=0x7ff4200409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1853756508 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:18.905+0000 7ff43a000700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:20.507+0000 7ff43a000700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 msgr2=0x7ff4200409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1853756508 2024-05-27T09:35:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:20.507+0000 7ff43a000700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-27T09:35:25.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:22.982+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7ff42c02c780 con 0x7ff43c07ee10 2024-05-27T09:35:25.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:22.983+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 msgr2=0x7ff4200409d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:35:25.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:22.983+0000 7ff433400700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:23.982+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7ff42c0558f0 con 0x7ff43c07ee10 2024-05-27T09:35:25.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:23.982+0000 7ff433400700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff42c053aa0 0x7ff420043fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:23.983+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4200410e0 con 0x7ff42c053aa0 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:23.984+0000 7ff43a000700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff42c053aa0 0x7ff420043fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:23.987+0000 7ff43a000700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff42c053aa0 0x7ff420043fc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff428003a10 tx=0x7ff4280092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:23.989+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff4200410e0 con 0x7ff42c053aa0 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.005+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff43c064e10 con 0x7ff42c053aa0 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.005+0000 7ff433400700 1 -- 172.21.15.71:0/1207259591 <== mgr.14152 v2:172.21.15.71:6800/1797397372 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff43c064e10 con 0x7ff42c053aa0 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.005+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff42c053aa0 msgr2=0x7ff420043fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.005+0000 7ff441800700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff42c053aa0 0x7ff420043fc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff428003a10 tx=0x7ff4280092b0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.005+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 msgr2=0x7ff43c1a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.005+0000 7ff441800700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c1a01f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff42c000c00 tx=0x7ff42c011aa0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.006+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 shutdown_connections 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.006+0000 7ff441800700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff42c053aa0 0x7ff420043fc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.006+0000 7ff441800700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff43c07ee10 0x7ff43c1a01f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.006+0000 7ff441800700 1 --2- 172.21.15.71:0/1207259591 >> [v2:172.21.15.71:6800/1853756508,v1:172.21.15.71:6801/1853756508] conn(0x7ff42003e4c0 0x7ff4200409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.006+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 >> 172.21.15.71:0/1207259591 conn(0x7ff43c105240 msgr2=0x7ff43c105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.006+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 shutdown_connections 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:24.006+0000 7ff441800700 1 -- 172.21.15.71:0/1207259591 wait complete. 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:mgr epoch 9 is available 2024-05-27T09:35:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:Generating a dashboard self-signed certificate... 2024-05-27T09:35:26.368 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:26 smithi071 ceph-mon[31451]: mgrmap e12: x(active, since 2s) 2024-05-27T09:35:26.368 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:27.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.116+0000 7f7034800700 1 Processor -- start 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.116+0000 7f7034800700 1 -- start start 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.117+0000 7f7034800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c07d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.117+0000 7f7034800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f702c07d760 con 0x7f702c07edf0 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.117+0000 7f7031e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c07d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.117+0000 7f7031e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c07d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54092/0 (socket says 172.21.15.71:54092) 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.117+0000 7f7031e00700 1 -- 172.21.15.71:0/1094448356 learned_addr learned my addr 172.21.15.71:0/1094448356 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.118+0000 7f7031e00700 1 -- 172.21.15.71:0/1094448356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c07d8e0 con 0x7f702c07edf0 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.118+0000 7f7031e00700 1 --2- 172.21.15.71:0/1094448356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c07d220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70200098a0 tx=0x7f7020009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe29079bf6c4ddef server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.118+0000 7f7030a00700 1 -- 172.21.15.71:0/1094448356 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7020004160 con 0x7f702c07edf0 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.118+0000 7f7030a00700 1 -- 172.21.15.71:0/1094448356 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7020004300 con 0x7f702c07edf0 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.118+0000 7f7030a00700 1 -- 172.21.15.71:0/1094448356 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7020011a20 con 0x7f702c07edf0 2024-05-27T09:35:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.119+0000 7f7034800700 1 -- 172.21.15.71:0/1094448356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 msgr2=0x7f702c07d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.119+0000 7f7034800700 1 --2- 172.21.15.71:0/1094448356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c07d220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70200098a0 tx=0x7f7020009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.120+0000 7f7034800700 1 -- 172.21.15.71:0/1094448356 shutdown_connections 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.120+0000 7f7034800700 1 --2- 172.21.15.71:0/1094448356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c07d220 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.120+0000 7f7034800700 1 -- 172.21.15.71:0/1094448356 >> 172.21.15.71:0/1094448356 conn(0x7f702c105240 msgr2=0x7f702c107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.120+0000 7f7034800700 1 -- 172.21.15.71:0/1094448356 shutdown_connections 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.120+0000 7f7034800700 1 -- 172.21.15.71:0/1094448356 wait complete. 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.121+0000 7f7034800700 1 Processor -- start 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.121+0000 7f7034800700 1 -- start start 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.122+0000 7f7034800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.122+0000 7f7034800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f702c110240 con 0x7f702c07edf0 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.122+0000 7f7031e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.122+0000 7f7031e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c1a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54098/0 (socket says 172.21.15.71:54098) 2024-05-27T09:35:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.122+0000 7f7031e00700 1 -- 172.21.15.71:0/177661148 learned_addr learned my addr 172.21.15.71:0/177661148 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.122+0000 7f7031e00700 1 -- 172.21.15.71:0/177661148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c1a0720 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.123+0000 7f7031e00700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c1a01e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.123+0000 7f7026a00700 1 -- 172.21.15.71:0/177661148 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7020003aa0 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.123+0000 7f7026a00700 1 -- 172.21.15.71:0/177661148 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f702001b8f0 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.123+0000 7f7026a00700 1 -- 172.21.15.71:0/177661148 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7020023890 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.123+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c1a09b0 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.123+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c1a35c0 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.125+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702c064e10 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.125+0000 7f7026a00700 1 -- 172.21.15.71:0/177661148 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f702002c3f0 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.125+0000 7f7026a00700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f701403e4c0 0x7f70140409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.125+0000 7f7026a00700 1 -- 172.21.15.71:0/177661148 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7020053fd0 con 0x7f702c07edf0 2024-05-27T09:35:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.126+0000 7f7031400700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f701403e4c0 0x7f70140409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.126+0000 7f7031400700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f701403e4c0 0x7f70140409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f701c006fd0 tx=0x7f701c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.132+0000 7f7026a00700 1 -- 172.21.15.71:0/177661148 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f702001f030 con 0x7f702c07edf0 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.367+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f702c1061d0 con 0x7f701403e4c0 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.573+0000 7f7026a00700 1 -- 172.21.15.71:0/177661148 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f702c1061d0 con 0x7f701403e4c0 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f701403e4c0 msgr2=0x7f70140409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f701403e4c0 0x7f70140409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f701c006fd0 tx=0x7f701c006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 msgr2=0x7f702c1a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c1a01e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020011aa0 comp rx=0 tx=0).stop 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 shutdown_connections 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f701403e4c0 0x7f70140409d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 --2- 172.21.15.71:0/177661148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f702c07edf0 0x7f702c1a01e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 >> 172.21.15.71:0/177661148 conn(0x7f702c105240 msgr2=0x7f702c105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.576+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 shutdown_connections 2024-05-27T09:35:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:26.577+0000 7f7034800700 1 -- 172.21.15.71:0/177661148 wait complete. 2024-05-27T09:35:27.349 INFO:teuthology.orchestra.run.smithi071.stdout:Creating initial admin user... 2024-05-27T09:35:27.669 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:27 smithi071 ceph-mon[31451]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:35:27.669 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:27.670 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:27.670 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:29.674 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:29 smithi071 ceph-mon[31451]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:35:29.674 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:29 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:29.684 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$J2cMnzFQwKjEao4jbP.BgO5nPrOr8j4rJbuXIDOG3ooWtykQBFZji", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1716802528, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-27T09:35:29.684 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.043+0000 7fc8e4800700 1 Processor -- start 2024-05-27T09:35:29.684 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.043+0000 7fc8e4800700 1 -- start start 2024-05-27T09:35:29.685 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.044+0000 7fc8e4800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc10a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:29.685 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.044+0000 7fc8e4800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10a620 con 0x7fc8dc109c20 2024-05-27T09:35:29.685 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.044+0000 7fc8e1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc10a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:29.685 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.044+0000 7fc8e1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc10a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54104/0 (socket says 172.21.15.71:54104) 2024-05-27T09:35:29.685 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.044+0000 7fc8e1e00700 1 -- 172.21.15.71:0/1517460775 learned_addr learned my addr 172.21.15.71:0/1517460775 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:29.686 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.045+0000 7fc8e1e00700 1 -- 172.21.15.71:0/1517460775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc10adf0 con 0x7fc8dc109c20 2024-05-27T09:35:29.686 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.045+0000 7fc8e1e00700 1 --2- 172.21.15.71:0/1517460775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc10a030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00098a0 tx=0x7fc8d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ad0ba2c6fd933b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:29.686 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.045+0000 7fc8e0a00700 1 -- 172.21.15.71:0/1517460775 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8d0004160 con 0x7fc8dc109c20 2024-05-27T09:35:29.686 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.045+0000 7fc8e0a00700 1 -- 172.21.15.71:0/1517460775 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8d0004300 con 0x7fc8dc109c20 2024-05-27T09:35:29.686 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.045+0000 7fc8e0a00700 1 -- 172.21.15.71:0/1517460775 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8d0011a20 con 0x7fc8dc109c20 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.046+0000 7fc8e4800700 1 -- 172.21.15.71:0/1517460775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 msgr2=0x7fc8dc10a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.046+0000 7fc8e4800700 1 --2- 172.21.15.71:0/1517460775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc10a030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00098a0 tx=0x7fc8d0009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.046+0000 7fc8e4800700 1 -- 172.21.15.71:0/1517460775 shutdown_connections 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.046+0000 7fc8e4800700 1 --2- 172.21.15.71:0/1517460775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc10a030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.046+0000 7fc8e4800700 1 -- 172.21.15.71:0/1517460775 >> 172.21.15.71:0/1517460775 conn(0x7fc8dc105240 msgr2=0x7fc8dc107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.046+0000 7fc8e4800700 1 -- 172.21.15.71:0/1517460775 shutdown_connections 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.046+0000 7fc8e4800700 1 -- 172.21.15.71:0/1517460775 wait complete. 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.047+0000 7fc8e4800700 1 Processor -- start 2024-05-27T09:35:29.688 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.048+0000 7fc8e4800700 1 -- start start 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.048+0000 7fc8e4800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc1a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.048+0000 7fc8e4800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10e1a0 con 0x7fc8dc109c20 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.048+0000 7fc8e1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc1a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.048+0000 7fc8e1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc1a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54120/0 (socket says 172.21.15.71:54120) 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.048+0000 7fc8e1e00700 1 -- 172.21.15.71:0/501921298 learned_addr learned my addr 172.21.15.71:0/501921298 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.049+0000 7fc8e1e00700 1 -- 172.21.15.71:0/501921298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc1a07c0 con 0x7fc8dc109c20 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.049+0000 7fc8e1e00700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc1a0280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0003e70 tx=0x7fc8d0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.050+0000 7fc8d6a00700 1 -- 172.21.15.71:0/501921298 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8d0003aa0 con 0x7fc8dc109c20 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.050+0000 7fc8d6a00700 1 -- 172.21.15.71:0/501921298 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8d001a8e0 con 0x7fc8dc109c20 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.050+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc1a0a50 con 0x7fc8dc109c20 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.050+0000 7fc8d6a00700 1 -- 172.21.15.71:0/501921298 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8d0024870 con 0x7fc8dc109c20 2024-05-27T09:35:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.050+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc1a3660 con 0x7fc8dc109c20 2024-05-27T09:35:29.692 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.051+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8dc064e10 con 0x7fc8dc109c20 2024-05-27T09:35:29.692 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.052+0000 7fc8d6a00700 1 -- 172.21.15.71:0/501921298 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fc8d0022020 con 0x7fc8dc109c20 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.052+0000 7fc8d6a00700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc8c403e4c0 0x7fc8c40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.052+0000 7fc8d6a00700 1 -- 172.21.15.71:0/501921298 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc8d0053bb0 con 0x7fc8dc109c20 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.053+0000 7fc8e1400700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc8c403e4c0 0x7fc8c40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.053+0000 7fc8e1400700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc8c403e4c0 0x7fc8c40409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8006fd0 tx=0x7fc8c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.058+0000 7fc8d6a00700 1 -- 172.21.15.71:0/501921298 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc8d001aa90 con 0x7fc8dc109c20 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.322+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fc8dc199fb0 con 0x7fc8c403e4c0 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.561+0000 7fc8d6a00700 1 -- 172.21.15.71:0/501921298 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fc8dc199fb0 con 0x7fc8c403e4c0 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.564+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc8c403e4c0 msgr2=0x7fc8c40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.564+0000 7fc8e4800700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc8c403e4c0 0x7fc8c40409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8006fd0 tx=0x7fc8c8006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.564+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 msgr2=0x7fc8dc1a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.564+0000 7fc8e4800700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc1a0280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0003e70 tx=0x7fc8d0011aa0 comp rx=0 tx=0).stop 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.565+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 shutdown_connections 2024-05-27T09:35:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.565+0000 7fc8e4800700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc8c403e4c0 0x7fc8c40409d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:29.694 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.565+0000 7fc8e4800700 1 --2- 172.21.15.71:0/501921298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8dc109c20 0x7fc8dc1a0280 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:29.694 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.565+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 >> 172.21.15.71:0/501921298 conn(0x7fc8dc105240 msgr2=0x7fc8dc07d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:29.694 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.565+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 shutdown_connections 2024-05-27T09:35:29.694 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:28.565+0000 7fc8e4800700 1 -- 172.21.15.71:0/501921298 wait complete. 2024-05-27T09:35:29.694 INFO:teuthology.orchestra.run.smithi071.stdout:Fetching dashboard port number... 2024-05-27T09:35:30.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:30 smithi071 ceph-mon[31451]: mgrmap e13: x(active, since 6s) 2024-05-27T09:35:31.740 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:31 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4243647279' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-27T09:35:31.750 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 8443 2024-05-27T09:35:31.751 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.814+0000 7f32f3200700 1 Processor -- start 2024-05-27T09:35:31.751 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.814+0000 7f32f3200700 1 -- start start 2024-05-27T09:35:31.751 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.814+0000 7f32f3200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec10c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:31.751 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.814+0000 7f32f3200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec10c7e0 con 0x7f32ec10bda0 2024-05-27T09:35:31.754 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.814+0000 7f32ebe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec10c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:31.754 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.815+0000 7f32ebe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec10c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54128/0 (socket says 172.21.15.71:54128) 2024-05-27T09:35:31.754 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.815+0000 7f32ebe00700 1 -- 172.21.15.71:0/210853403 learned_addr learned my addr 172.21.15.71:0/210853403 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.815+0000 7f32ebe00700 1 -- 172.21.15.71:0/210853403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec10cf90 con 0x7f32ec10bda0 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.815+0000 7f32ebe00700 1 --2- 172.21.15.71:0/210853403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec10c1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0098a0 tx=0x7f32dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5332f21f1edc311 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.815+0000 7f32eb400700 1 -- 172.21.15.71:0/210853403 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc004160 con 0x7f32ec10bda0 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.816+0000 7f32eb400700 1 -- 172.21.15.71:0/210853403 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32dc004300 con 0x7f32ec10bda0 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.816+0000 7f32eb400700 1 -- 172.21.15.71:0/210853403 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc011a20 con 0x7f32ec10bda0 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.816+0000 7f32f3200700 1 -- 172.21.15.71:0/210853403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 msgr2=0x7f32ec10c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.816+0000 7f32f3200700 1 --2- 172.21.15.71:0/210853403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec10c1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0098a0 tx=0x7f32dc009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.817+0000 7f32f3200700 1 -- 172.21.15.71:0/210853403 shutdown_connections 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.817+0000 7f32f3200700 1 --2- 172.21.15.71:0/210853403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec10c1d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.817+0000 7f32f3200700 1 -- 172.21.15.71:0/210853403 >> 172.21.15.71:0/210853403 conn(0x7f32ec107670 msgr2=0x7f32ec109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.817+0000 7f32f3200700 1 -- 172.21.15.71:0/210853403 shutdown_connections 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.817+0000 7f32f3200700 1 -- 172.21.15.71:0/210853403 wait complete. 2024-05-27T09:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.818+0000 7f32f3200700 1 Processor -- start 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.818+0000 7f32f3200700 1 -- start start 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.818+0000 7f32f3200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.818+0000 7f32f3200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1103d0 con 0x7f32ec10bda0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.819+0000 7f32ebe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.819+0000 7f32ebe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec1a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54140/0 (socket says 172.21.15.71:54140) 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.819+0000 7f32ebe00700 1 -- 172.21.15.71:0/4243647279 learned_addr learned my addr 172.21.15.71:0/4243647279 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.819+0000 7f32ebe00700 1 -- 172.21.15.71:0/4243647279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec1a0710 con 0x7f32ec10bda0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.819+0000 7f32ebe00700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec1a01d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32dc011a20 tx=0x7f32dc011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.820+0000 7f32e9600700 1 -- 172.21.15.71:0/4243647279 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc003af0 con 0x7f32ec10bda0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.820+0000 7f32e9600700 1 -- 172.21.15.71:0/4243647279 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32dc01b8f0 con 0x7f32ec10bda0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.820+0000 7f32e9600700 1 -- 172.21.15.71:0/4243647279 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc023890 con 0x7f32ec10bda0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.820+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec1a09a0 con 0x7f32ec10bda0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.820+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1a35b0 con 0x7f32ec10bda0 2024-05-27T09:35:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.821+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec064e10 con 0x7f32ec10bda0 2024-05-27T09:35:31.757 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.822+0000 7f32e9600700 1 -- 172.21.15.71:0/4243647279 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f32dc01b440 con 0x7f32ec10bda0 2024-05-27T09:35:31.757 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.823+0000 7f32e9600700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f32d003e570 0x7f32d0040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:31.758 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.823+0000 7f32e9600700 1 -- 172.21.15.71:0/4243647279 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f32dc0541e0 con 0x7f32ec10bda0 2024-05-27T09:35:31.758 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.823+0000 7f32e3e00700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f32d003e570 0x7f32d0040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:31.758 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.824+0000 7f32e3e00700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f32d003e570 0x7f32d0040a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f32d4006fd0 tx=0x7f32d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:30.829+0000 7f32e9600700 1 -- 172.21.15.71:0/4243647279 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f32dc01f030 con 0x7f32ec10bda0 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.059+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f32ec1a3ba0 con 0x7f32ec10bda0 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.060+0000 7f32e9600700 1 -- 172.21.15.71:0/4243647279 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f32dc00f2e0 con 0x7f32ec10bda0 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.063+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f32d003e570 msgr2=0x7f32d0040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.063+0000 7f32f3200700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f32d003e570 0x7f32d0040a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f32d4006fd0 tx=0x7f32d4006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.063+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 msgr2=0x7f32ec1a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.063+0000 7f32f3200700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec1a01d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32dc011a20 tx=0x7f32dc011b00 comp rx=0 tx=0).stop 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.064+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 shutdown_connections 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.064+0000 7f32f3200700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f32d003e570 0x7f32d0040a80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.064+0000 7f32f3200700 1 --2- 172.21.15.71:0/4243647279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32ec10bda0 0x7f32ec1a01d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.064+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 >> 172.21.15.71:0/4243647279 conn(0x7f32ec107670 msgr2=0x7f32ec108e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.064+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 shutdown_connections 2024-05-27T09:35:31.759 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:31.064+0000 7f32f3200700 1 -- 172.21.15.71:0/4243647279 wait complete. 2024-05-27T09:35:31.784 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-27T09:35:31.784 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-05-27T09:35:31.807 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-27T09:35:31.807 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-05-27T09:35:31.808 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-05-27T09:35:31.808 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-27T09:35:31.815 INFO:teuthology.orchestra.run.smithi071.stdout:Ceph Dashboard is now available at: 2024-05-27T09:35:31.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:31.815 INFO:teuthology.orchestra.run.smithi071.stdout: URL: https://smithi071.front.sepia.ceph.com:8443/ 2024-05-27T09:35:31.815 INFO:teuthology.orchestra.run.smithi071.stdout: User: admin 2024-05-27T09:35:31.815 INFO:teuthology.orchestra.run.smithi071.stdout: Password: yojmx0ylzj 2024-05-27T09:35:31.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:31.816 INFO:teuthology.orchestra.run.smithi071.stdout:Saving cluster configuration to /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config directory 2024-05-27T09:35:31.818 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling autotune for osd_memory_target 2024-05-27T09:35:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.510+0000 7ff49ee00700 1 Processor -- start 2024-05-27T09:35:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.510+0000 7ff49ee00700 1 -- start start 2024-05-27T09:35:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.511+0000 7ff49ee00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff49807d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.511+0000 7ff49ee00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff49807d760 con 0x7ff49807edf0 2024-05-27T09:35:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.511+0000 7ff497e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff49807d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.511+0000 7ff497e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff49807d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54146/0 (socket says 172.21.15.71:54146) 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.511+0000 7ff497e00700 1 -- 172.21.15.71:0/3175374415 learned_addr learned my addr 172.21.15.71:0/3175374415 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.512+0000 7ff497e00700 1 -- 172.21.15.71:0/3175374415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49807d8e0 con 0x7ff49807edf0 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.512+0000 7ff497e00700 1 --2- 172.21.15.71:0/3175374415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff49807d220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4880098a0 tx=0x7ff488009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a500f4653323ec server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.512+0000 7ff496a00700 1 -- 172.21.15.71:0/3175374415 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488004160 con 0x7ff49807edf0 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.512+0000 7ff496a00700 1 -- 172.21.15.71:0/3175374415 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff488004300 con 0x7ff49807edf0 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.512+0000 7ff496a00700 1 -- 172.21.15.71:0/3175374415 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488011a20 con 0x7ff49807edf0 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.513+0000 7ff49ee00700 1 -- 172.21.15.71:0/3175374415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 msgr2=0x7ff49807d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.513+0000 7ff49ee00700 1 --2- 172.21.15.71:0/3175374415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff49807d220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4880098a0 tx=0x7ff488009bb0 comp rx=0 tx=0).stop 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.513+0000 7ff49ee00700 1 -- 172.21.15.71:0/3175374415 shutdown_connections 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.513+0000 7ff49ee00700 1 --2- 172.21.15.71:0/3175374415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff49807d220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.513+0000 7ff49ee00700 1 -- 172.21.15.71:0/3175374415 >> 172.21.15.71:0/3175374415 conn(0x7ff498105240 msgr2=0x7ff498107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.513+0000 7ff49ee00700 1 -- 172.21.15.71:0/3175374415 shutdown_connections 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.513+0000 7ff49ee00700 1 -- 172.21.15.71:0/3175374415 wait complete. 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.514+0000 7ff49ee00700 1 Processor -- start 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.515+0000 7ff49ee00700 1 -- start start 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.515+0000 7ff49ee00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff4981a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.515+0000 7ff49ee00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff498110240 con 0x7ff49807edf0 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.515+0000 7ff497e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff4981a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.515+0000 7ff497e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff4981a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54150/0 (socket says 172.21.15.71:54150) 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.515+0000 7ff497e00700 1 -- 172.21.15.71:0/935499945 learned_addr learned my addr 172.21.15.71:0/935499945 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.516+0000 7ff497e00700 1 -- 172.21.15.71:0/935499945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4981a0720 con 0x7ff49807edf0 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.516+0000 7ff497e00700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff4981a01e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff488000c00 tx=0x7ff488011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.516+0000 7ff494c00700 1 -- 172.21.15.71:0/935499945 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488003aa0 con 0x7ff49807edf0 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.516+0000 7ff494c00700 1 -- 172.21.15.71:0/935499945 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff48801b8f0 con 0x7ff49807edf0 2024-05-27T09:35:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.516+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4981a09b0 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.516+0000 7ff494c00700 1 -- 172.21.15.71:0/935499945 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488023890 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.516+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4981a35c0 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.517+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff498064e10 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.518+0000 7ff494c00700 1 -- 172.21.15.71:0/935499945 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff48801b440 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.518+0000 7ff494c00700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff47c03e5c0 0x7ff47c040ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.518+0000 7ff494c00700 1 -- 172.21.15.71:0/935499945 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff4880540c0 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.519+0000 7ff497400700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff47c03e5c0 0x7ff47c040ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.519+0000 7ff497400700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff47c03e5c0 0x7ff47c040ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff484006fd0 tx=0x7ff484006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.524+0000 7ff494c00700 1 -- 172.21.15.71:0/935499945 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff48801f030 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.750+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7ff4981a3790 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.751+0000 7ff494c00700 1 -- 172.21.15.71:0/935499945 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7ff4981a3790 con 0x7ff49807edf0 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.754+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff47c03e5c0 msgr2=0x7ff47c040ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:33.510 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.754+0000 7ff49ee00700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff47c03e5c0 0x7ff47c040ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff484006fd0 tx=0x7ff484006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.754+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 msgr2=0x7ff4981a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.754+0000 7ff49ee00700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff4981a01e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff488000c00 tx=0x7ff488011aa0 comp rx=0 tx=0).stop 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.755+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 shutdown_connections 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.755+0000 7ff49ee00700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff47c03e5c0 0x7ff47c040ad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.755+0000 7ff49ee00700 1 --2- 172.21.15.71:0/935499945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff49807edf0 0x7ff4981a01e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.755+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 >> 172.21.15.71:0/935499945 conn(0x7ff498105240 msgr2=0x7ff498105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.755+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 shutdown_connections 2024-05-27T09:35:33.511 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:32.755+0000 7ff49ee00700 1 -- 172.21.15.71:0/935499945 wait complete. 2024-05-27T09:35:35.278 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.180+0000 7fec56400700 1 Processor -- start 2024-05-27T09:35:35.280 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.180+0000 7fec56400700 1 -- start start 2024-05-27T09:35:35.280 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.181+0000 7fec56400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec5007d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.181+0000 7fec56400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec5007d760 con 0x7fec5007edf0 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.181+0000 7fec4f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec5007d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.181+0000 7fec4f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec5007d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60590/0 (socket says 172.21.15.71:60590) 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.181+0000 7fec4f400700 1 -- 172.21.15.71:0/3919109925 learned_addr learned my addr 172.21.15.71:0/3919109925 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.182+0000 7fec4f400700 1 -- 172.21.15.71:0/3919109925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5007d8e0 con 0x7fec5007edf0 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.182+0000 7fec4f400700 1 --2- 172.21.15.71:0/3919109925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec5007d220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec40009e80 tx=0x7fec4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5895acffb2cc6377 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.182+0000 7fec4ea00700 1 -- 172.21.15.71:0/3919109925 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40017070 con 0x7fec5007edf0 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.183+0000 7fec4ea00700 1 -- 172.21.15.71:0/3919109925 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec4000b8c0 con 0x7fec5007edf0 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.183+0000 7fec4ea00700 1 -- 172.21.15.71:0/3919109925 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40004490 con 0x7fec5007edf0 2024-05-27T09:35:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.183+0000 7fec56400700 1 -- 172.21.15.71:0/3919109925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 msgr2=0x7fec5007d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:35.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.183+0000 7fec56400700 1 --2- 172.21.15.71:0/3919109925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec5007d220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec40009e80 tx=0x7fec4000b330 comp rx=0 tx=0).stop 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.184+0000 7fec56400700 1 -- 172.21.15.71:0/3919109925 shutdown_connections 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.184+0000 7fec56400700 1 --2- 172.21.15.71:0/3919109925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec5007d220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.184+0000 7fec56400700 1 -- 172.21.15.71:0/3919109925 >> 172.21.15.71:0/3919109925 conn(0x7fec50105240 msgr2=0x7fec50107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.184+0000 7fec56400700 1 -- 172.21.15.71:0/3919109925 shutdown_connections 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.184+0000 7fec56400700 1 -- 172.21.15.71:0/3919109925 wait complete. 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.185+0000 7fec56400700 1 Processor -- start 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.185+0000 7fec56400700 1 -- start start 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.185+0000 7fec56400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec501a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.185+0000 7fec56400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec50110240 con 0x7fec5007edf0 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.186+0000 7fec4f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec501a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.186+0000 7fec4f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec501a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60602/0 (socket says 172.21.15.71:60602) 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.186+0000 7fec4f400700 1 -- 172.21.15.71:0/613576809 learned_addr learned my addr 172.21.15.71:0/613576809 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.186+0000 7fec4f400700 1 -- 172.21.15.71:0/613576809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec501a0740 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.186+0000 7fec4f400700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec501a0200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec4000bca0 tx=0x7fec4000bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.187+0000 7fec4cc00700 1 -- 172.21.15.71:0/613576809 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40020020 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.187+0000 7fec4cc00700 1 -- 172.21.15.71:0/613576809 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec40003b50 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.187+0000 7fec4cc00700 1 -- 172.21.15.71:0/613576809 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40017040 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.187+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec501a09d0 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.187+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501a35e0 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.188+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50064e10 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.188+0000 7fec4cc00700 1 -- 172.21.15.71:0/613576809 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fec40023020 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.189+0000 7fec4cc00700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec3403e5c0 0x7fec34040ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.189+0000 7fec4cc00700 1 -- 172.21.15.71:0/613576809 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fec4000f050 con 0x7fec5007edf0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.189+0000 7fec46a00700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec3403e5c0 0x7fec34040ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:35.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.190+0000 7fec46a00700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec3403e5c0 0x7fec34040ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec38006fd0 tx=0x7fec38006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.194+0000 7fec4cc00700 1 -- 172.21.15.71:0/613576809 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fec4002a020 con 0x7fec5007edf0 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.547+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fec501a37b0 con 0x7fec5007edf0 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.551+0000 7fec4cc00700 1 -- 172.21.15.71:0/613576809 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fec4001bb80 con 0x7fec5007edf0 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.554+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec3403e5c0 msgr2=0x7fec34040ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.554+0000 7fec56400700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec3403e5c0 0x7fec34040ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec38006fd0 tx=0x7fec38006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.554+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 msgr2=0x7fec501a0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.554+0000 7fec56400700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec501a0200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec4000bca0 tx=0x7fec4000bd80 comp rx=0 tx=0).stop 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.555+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 shutdown_connections 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.555+0000 7fec56400700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec3403e5c0 0x7fec34040ad0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.555+0000 7fec56400700 1 --2- 172.21.15.71:0/613576809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5007edf0 0x7fec501a0200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.555+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 >> 172.21.15.71:0/613576809 conn(0x7fec50105240 msgr2=0x7fec50105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.555+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 shutdown_connections 2024-05-27T09:35:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-05-27T09:35:34.555+0000 7fec56400700 1 -- 172.21.15.71:0/613576809 wait complete. 2024-05-27T09:35:35.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-27T09:35:35.289 INFO:teuthology.orchestra.run.smithi071.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-27T09:35:35.289 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout:Or, if you are only running a single cluster on this host: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: ceph telemetry on 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout:For more information see: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-27T09:35:35.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:35.291 INFO:teuthology.orchestra.run.smithi071.stdout:Bootstrap complete. 2024-05-27T09:35:35.391 INFO:tasks.cephadm:Fetching config... 2024-05-27T09:35:35.391 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:35:35.391 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-27T09:35:35.433 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-27T09:35:35.434 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:35:35.434 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-27T09:35:35.511 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-27T09:35:35.511 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:35:35.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-27T09:35:35.620 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-27T09:35:35.620 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:35:35.620 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-27T09:35:35.709 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-27T09:35:35.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1BKEQRs5i7THpS1fca7Q2AAa4KYtY1xXLTPrT1rh6kjpaAUj3g3Zkm5V2y5Txtiges/XhJQMbffzwUcr25BGJnD16/MLS1mZGwsmcpEdrWKKWrLnCzwuZ14CdhB1ZvQUUPG8ooJ6J6amwmsV7j05a3qfN12YvFMPJBDB9oHk5W9yqB1ZzENS377fT2kHdO4ERT1fn4UhRfj4V88PAS1ZcFgDVbaq2qbyNm6iw06DXd8HtJWWjAf3G3KLtsTs/Vkr7+Whl/2vJ2fqG7fdKdceoZ9lf3v4nexOpYgKA/O8Vz92pFIhoiCNN7X6rc8O/SYyHjidT8mRDiSRb2u3KLaw79vSwMHzflZ92D+ZJGlxsyqdqES3EBDy3Aj1wu8ZlO4FGL0CC81j5fQzVsZ2fhx/uZav60WR9gnHhxHBPYSS4mQV0B2gnpOhlJYu6ePnOPQfYC0+pUUvI9FnTwRbfIAii13aVhlgFTC9fOM7Rn8cHvuXxeWo/4FPuTUQi61VkH48= ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-27T09:35:35.807 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:35 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/613576809' entity='client.admin' 2024-05-27T09:35:35.842 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1BKEQRs5i7THpS1fca7Q2AAa4KYtY1xXLTPrT1rh6kjpaAUj3g3Zkm5V2y5Txtiges/XhJQMbffzwUcr25BGJnD16/MLS1mZGwsmcpEdrWKKWrLnCzwuZ14CdhB1ZvQUUPG8ooJ6J6amwmsV7j05a3qfN12YvFMPJBDB9oHk5W9yqB1ZzENS377fT2kHdO4ERT1fn4UhRfj4V88PAS1ZcFgDVbaq2qbyNm6iw06DXd8HtJWWjAf3G3KLtsTs/Vkr7+Whl/2vJ2fqG7fdKdceoZ9lf3v4nexOpYgKA/O8Vz92pFIhoiCNN7X6rc8O/SYyHjidT8mRDiSRb2u3KLaw79vSwMHzflZ92D+ZJGlxsyqdqES3EBDy3Aj1wu8ZlO4FGL0CC81j5fQzVsZ2fhx/uZav60WR9gnHhxHBPYSS4mQV0B2gnpOhlJYu6ePnOPQfYC0+pUUvI9FnTwRbfIAii13aVhlgFTC9fOM7Rn8cHvuXxeWo/4FPuTUQi61VkH48= ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:35:35.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1BKEQRs5i7THpS1fca7Q2AAa4KYtY1xXLTPrT1rh6kjpaAUj3g3Zkm5V2y5Txtiges/XhJQMbffzwUcr25BGJnD16/MLS1mZGwsmcpEdrWKKWrLnCzwuZ14CdhB1ZvQUUPG8ooJ6J6amwmsV7j05a3qfN12YvFMPJBDB9oHk5W9yqB1ZzENS377fT2kHdO4ERT1fn4UhRfj4V88PAS1ZcFgDVbaq2qbyNm6iw06DXd8HtJWWjAf3G3KLtsTs/Vkr7+Whl/2vJ2fqG7fdKdceoZ9lf3v4nexOpYgKA/O8Vz92pFIhoiCNN7X6rc8O/SYyHjidT8mRDiSRb2u3KLaw79vSwMHzflZ92D+ZJGlxsyqdqES3EBDy3Aj1wu8ZlO4FGL0CC81j5fQzVsZ2fhx/uZav60WR9gnHhxHBPYSS4mQV0B2gnpOhlJYu6ePnOPQfYC0+pUUvI9FnTwRbfIAii13aVhlgFTC9fOM7Rn8cHvuXxeWo/4FPuTUQi61VkH48= ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-27T09:35:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1BKEQRs5i7THpS1fca7Q2AAa4KYtY1xXLTPrT1rh6kjpaAUj3g3Zkm5V2y5Txtiges/XhJQMbffzwUcr25BGJnD16/MLS1mZGwsmcpEdrWKKWrLnCzwuZ14CdhB1ZvQUUPG8ooJ6J6amwmsV7j05a3qfN12YvFMPJBDB9oHk5W9yqB1ZzENS377fT2kHdO4ERT1fn4UhRfj4V88PAS1ZcFgDVbaq2qbyNm6iw06DXd8HtJWWjAf3G3KLtsTs/Vkr7+Whl/2vJ2fqG7fdKdceoZ9lf3v4nexOpYgKA/O8Vz92pFIhoiCNN7X6rc8O/SYyHjidT8mRDiSRb2u3KLaw79vSwMHzflZ92D+ZJGlxsyqdqES3EBDy3Aj1wu8ZlO4FGL0CC81j5fQzVsZ2fhx/uZav60WR9gnHhxHBPYSS4mQV0B2gnpOhlJYu6ePnOPQfYC0+pUUvI9FnTwRbfIAii13aVhlgFTC9fOM7Rn8cHvuXxeWo/4FPuTUQi61VkH48= ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:35:35.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1BKEQRs5i7THpS1fca7Q2AAa4KYtY1xXLTPrT1rh6kjpaAUj3g3Zkm5V2y5Txtiges/XhJQMbffzwUcr25BGJnD16/MLS1mZGwsmcpEdrWKKWrLnCzwuZ14CdhB1ZvQUUPG8ooJ6J6amwmsV7j05a3qfN12YvFMPJBDB9oHk5W9yqB1ZzENS377fT2kHdO4ERT1fn4UhRfj4V88PAS1ZcFgDVbaq2qbyNm6iw06DXd8HtJWWjAf3G3KLtsTs/Vkr7+Whl/2vJ2fqG7fdKdceoZ9lf3v4nexOpYgKA/O8Vz92pFIhoiCNN7X6rc8O/SYyHjidT8mRDiSRb2u3KLaw79vSwMHzflZ92D+ZJGlxsyqdqES3EBDy3Aj1wu8ZlO4FGL0CC81j5fQzVsZ2fhx/uZav60WR9gnHhxHBPYSS4mQV0B2gnpOhlJYu6ePnOPQfYC0+pUUvI9FnTwRbfIAii13aVhlgFTC9fOM7Rn8cHvuXxeWo/4FPuTUQi61VkH48= ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-27T09:35:35.965 INFO:teuthology.orchestra.run.smithi122.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1BKEQRs5i7THpS1fca7Q2AAa4KYtY1xXLTPrT1rh6kjpaAUj3g3Zkm5V2y5Txtiges/XhJQMbffzwUcr25BGJnD16/MLS1mZGwsmcpEdrWKKWrLnCzwuZ14CdhB1ZvQUUPG8ooJ6J6amwmsV7j05a3qfN12YvFMPJBDB9oHk5W9yqB1ZzENS377fT2kHdO4ERT1fn4UhRfj4V88PAS1ZcFgDVbaq2qbyNm6iw06DXd8HtJWWjAf3G3KLtsTs/Vkr7+Whl/2vJ2fqG7fdKdceoZ9lf3v4nexOpYgKA/O8Vz92pFIhoiCNN7X6rc8O/SYyHjidT8mRDiSRb2u3KLaw79vSwMHzflZ92D+ZJGlxsyqdqES3EBDy3Aj1wu8ZlO4FGL0CC81j5fQzVsZ2fhx/uZav60WR9gnHhxHBPYSS4mQV0B2gnpOhlJYu6ePnOPQfYC0+pUUvI9FnTwRbfIAii13aVhlgFTC9fOM7Rn8cHvuXxeWo/4FPuTUQi61VkH48= ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:35:35.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-27T09:35:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:35:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.497+0000 7f92a6200700 1 -- 172.21.15.71:0/193131374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 msgr2=0x7f92a010a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.497+0000 7f92a6200700 1 --2- 172.21.15.71:0/193131374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a010a5e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9290009910 tx=0x7f9290009c20 comp rx=0 tx=0).stop 2024-05-27T09:35:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.497+0000 7f92a6200700 1 -- 172.21.15.71:0/193131374 shutdown_connections 2024-05-27T09:35:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.497+0000 7f92a6200700 1 --2- 172.21.15.71:0/193131374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a010a5e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.497+0000 7f92a6200700 1 -- 172.21.15.71:0/193131374 >> 172.21.15.71:0/193131374 conn(0x7f92a0079240 msgr2=0x7f92a007b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.498+0000 7f92a6200700 1 -- 172.21.15.71:0/193131374 shutdown_connections 2024-05-27T09:35:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.498+0000 7f92a6200700 1 -- 172.21.15.71:0/193131374 wait complete. 2024-05-27T09:35:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.499+0000 7f92a6200700 1 Processor -- start 2024-05-27T09:35:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.499+0000 7f92a6200700 1 -- start start 2024-05-27T09:35:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.499+0000 7f92a6200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.499+0000 7f92a6200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92a0110190 con 0x7f92a010a1d0 2024-05-27T09:35:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.500+0000 7f929f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.500+0000 7f929f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a019fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60618/0 (socket says 172.21.15.71:60618) 2024-05-27T09:35:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.500+0000 7f929f400700 1 -- 172.21.15.71:0/2256638544 learned_addr learned my addr 172.21.15.71:0/2256638544 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.500+0000 7f929f400700 1 -- 172.21.15.71:0/2256638544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a01a0250 con 0x7f92a010a1d0 2024-05-27T09:35:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.501+0000 7f929f400700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a019fd10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9290006010 tx=0x7f9290004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.501+0000 7f9297e00700 1 -- 172.21.15.71:0/2256638544 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9290026070 con 0x7f92a010a1d0 2024-05-27T09:35:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.501+0000 7f9297e00700 1 -- 172.21.15.71:0/2256638544 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f929000bc00 con 0x7f92a010a1d0 2024-05-27T09:35:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.501+0000 7f9297e00700 1 -- 172.21.15.71:0/2256638544 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9290003970 con 0x7f92a010a1d0 2024-05-27T09:35:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.501+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a01a04e0 con 0x7f92a010a1d0 2024-05-27T09:35:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.501+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a01a30e0 con 0x7f92a010a1d0 2024-05-27T09:35:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.502+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a0110910 con 0x7f92a010a1d0 2024-05-27T09:35:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.503+0000 7f9297e00700 1 -- 172.21.15.71:0/2256638544 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9290029070 con 0x7f92a010a1d0 2024-05-27T09:35:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.503+0000 7f9297e00700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f928403e570 0x7f9284040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.503+0000 7f9297e00700 1 -- 172.21.15.71:0/2256638544 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f929001e070 con 0x7f92a010a1d0 2024-05-27T09:35:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.504+0000 7f929ea00700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f928403e570 0x7f9284040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.504+0000 7f929ea00700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f928403e570 0x7f9284040a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f928c006fd0 tx=0x7f928c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:39.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.509+0000 7f9297e00700 1 -- 172.21.15.71:0/2256638544 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9290013070 con 0x7f92a010a1d0 2024-05-27T09:35:39.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.742+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f92a002e6f0 con 0x7f92a010a1d0 2024-05-27T09:35:39.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.746+0000 7f9297e00700 1 -- 172.21.15.71:0/2256638544 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f9290027260 con 0x7f92a010a1d0 2024-05-27T09:35:39.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f928403e570 msgr2=0x7f9284040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f928403e570 0x7f9284040a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f928c006fd0 tx=0x7f928c006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 msgr2=0x7f92a019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a019fd10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9290006010 tx=0x7f9290004fa0 comp rx=0 tx=0).stop 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 shutdown_connections 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f928403e570 0x7f9284040a80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 --2- 172.21.15.71:0/2256638544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92a010a1d0 0x7f92a019fd10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 >> 172.21.15.71:0/2256638544 conn(0x7f92a0079240 msgr2=0x7f92a0079fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 shutdown_connections 2024-05-27T09:35:39.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:39.749+0000 7f92a6200700 1 -- 172.21.15.71:0/2256638544 wait complete. 2024-05-27T09:35:40.742 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-27T09:35:40.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-27T09:35:40.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:40 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2256638544' entity='client.admin' 2024-05-27T09:35:41.489 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:35:42.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:42.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:42.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:35:42.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:42.710 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:35:42.710 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:43.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.563+0000 7f5b8a800700 1 -- 172.21.15.71:0/2078653586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 msgr2=0x7f5b841061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:43.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.563+0000 7f5b8a800700 1 --2- 172.21.15.71:0/2078653586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b841061e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009910 tx=0x7f5b74009c20 comp rx=0 tx=0).stop 2024-05-27T09:35:43.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.563+0000 7f5b8a800700 1 -- 172.21.15.71:0/2078653586 shutdown_connections 2024-05-27T09:35:43.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.563+0000 7f5b8a800700 1 --2- 172.21.15.71:0/2078653586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b841061e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:43.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.563+0000 7f5b8a800700 1 -- 172.21.15.71:0/2078653586 >> 172.21.15.71:0/2078653586 conn(0x7f5b84101410 msgr2=0x7f5b841038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:43.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.563+0000 7f5b8a800700 1 -- 172.21.15.71:0/2078653586 shutdown_connections 2024-05-27T09:35:43.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.563+0000 7f5b8a800700 1 -- 172.21.15.71:0/2078653586 wait complete. 2024-05-27T09:35:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.564+0000 7f5b8a800700 1 Processor -- start 2024-05-27T09:35:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.564+0000 7f5b8a800700 1 -- start start 2024-05-27T09:35:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.565+0000 7f5b8a800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b8419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.565+0000 7f5b8a800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8410bd90 con 0x7f5b84105dd0 2024-05-27T09:35:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.565+0000 7f5b83400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b8419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.565+0000 7f5b83400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b8419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60648/0 (socket says 172.21.15.71:60648) 2024-05-27T09:35:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.565+0000 7f5b83400700 1 -- 172.21.15.71:0/2726730145 learned_addr learned my addr 172.21.15.71:0/2726730145 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.566+0000 7f5b83400700 1 -- 172.21.15.71:0/2726730145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8419be50 con 0x7f5b84105dd0 2024-05-27T09:35:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.566+0000 7f5b83400700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b8419b910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5b74006010 tx=0x7f5b74004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.566+0000 7f5b7be00700 1 -- 172.21.15.71:0/2726730145 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b74026070 con 0x7f5b84105dd0 2024-05-27T09:35:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.566+0000 7f5b7be00700 1 -- 172.21.15.71:0/2726730145 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b7400bc00 con 0x7f5b84105dd0 2024-05-27T09:35:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.566+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8419c0e0 con 0x7f5b84105dd0 2024-05-27T09:35:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.566+0000 7f5b7be00700 1 -- 172.21.15.71:0/2726730145 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b74003970 con 0x7f5b84105dd0 2024-05-27T09:35:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.566+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8419ecf0 con 0x7f5b84105dd0 2024-05-27T09:35:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.568+0000 7f5b7be00700 1 -- 172.21.15.71:0/2726730145 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5b74029070 con 0x7f5b84105dd0 2024-05-27T09:35:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.568+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8410c510 con 0x7f5b84105dd0 2024-05-27T09:35:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.568+0000 7f5b7be00700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5b6803e570 0x7f5b68040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.568+0000 7f5b7be00700 1 -- 172.21.15.71:0/2726730145 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5b7401e070 con 0x7f5b84105dd0 2024-05-27T09:35:43.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.569+0000 7f5b82a00700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5b6803e570 0x7f5b68040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:43.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.569+0000 7f5b82a00700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5b6803e570 0x7f5b68040a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5b70006fd0 tx=0x7f5b70006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:43.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.574+0000 7f5b7be00700 1 -- 172.21.15.71:0/2726730145 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5b74013070 con 0x7f5b84105dd0 2024-05-27T09:35:43.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.809+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f5b8402e6f0 con 0x7f5b6803e570 2024-05-27T09:35:43.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.819+0000 7f5b7be00700 1 -- 172.21.15.71:0/2726730145 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5b8402e6f0 con 0x7f5b6803e570 2024-05-27T09:35:43.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.823+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5b6803e570 msgr2=0x7f5b68040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:43.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.823+0000 7f5b8a800700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5b6803e570 0x7f5b68040a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5b70006fd0 tx=0x7f5b70006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:43.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.823+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 msgr2=0x7f5b8419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:43.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.823+0000 7f5b8a800700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b8419b910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5b74006010 tx=0x7f5b74004fa0 comp rx=0 tx=0).stop 2024-05-27T09:35:43.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.824+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 shutdown_connections 2024-05-27T09:35:43.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.824+0000 7f5b8a800700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5b6803e570 0x7f5b68040a80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:43.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.824+0000 7f5b8a800700 1 --2- 172.21.15.71:0/2726730145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b84105dd0 0x7f5b8419b910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:43.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.824+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 >> 172.21.15.71:0/2726730145 conn(0x7f5b84101410 msgr2=0x7f5b841020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:43.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.824+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 shutdown_connections 2024-05-27T09:35:43.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:43.824+0000 7f5b8a800700 1 -- 172.21.15.71:0/2726730145 wait complete. 2024-05-27T09:35:44.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:44 smithi071 ceph-mon[31451]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:44.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:35:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:35:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:35:44.599 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi072 2024-05-27T09:35:44.599 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:35:44.599 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/etc/ceph/ceph.conf 2024-05-27T09:35:44.617 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:35:44.617 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:35:44.674 INFO:tasks.cephadm:Adding host smithi072 to orchestrator... 2024-05-27T09:35:44.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch host add smithi072 2024-05-27T09:35:45.096 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:35:45.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:45 smithi071 ceph-mon[31451]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:35:45.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:45 smithi071 ceph-mon[31451]: Updating smithi071:/etc/ceph/ceph.conf 2024-05-27T09:35:45.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:45 smithi071 ceph-mon[31451]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:35:46.638 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:46 smithi071 ceph-mon[31451]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:46.638 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:46 smithi071 ceph-mon[31451]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:35:46.638 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:46.639 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:47.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.227+0000 7f9bdb200700 1 -- 172.21.15.71:0/3545474571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 msgr2=0x7f9bdc106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:47.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.227+0000 7f9bdb200700 1 --2- 172.21.15.71:0/3545474571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc106230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009910 tx=0x7f9bcc009c20 comp rx=0 tx=0).stop 2024-05-27T09:35:47.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.227+0000 7f9bdb200700 1 -- 172.21.15.71:0/3545474571 shutdown_connections 2024-05-27T09:35:47.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.227+0000 7f9bdb200700 1 --2- 172.21.15.71:0/3545474571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc106230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:47.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.227+0000 7f9bdb200700 1 -- 172.21.15.71:0/3545474571 >> 172.21.15.71:0/3545474571 conn(0x7f9bdc1016b0 msgr2=0x7f9bdc103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:47.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.228+0000 7f9bdb200700 1 -- 172.21.15.71:0/3545474571 shutdown_connections 2024-05-27T09:35:47.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.228+0000 7f9bdb200700 1 -- 172.21.15.71:0/3545474571 wait complete. 2024-05-27T09:35:47.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.229+0000 7f9bdb200700 1 Processor -- start 2024-05-27T09:35:47.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.229+0000 7f9bdb200700 1 -- start start 2024-05-27T09:35:47.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.229+0000 7f9bdb200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc077cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:47.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.229+0000 7f9bdb200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc110110 con 0x7f9bdc105e20 2024-05-27T09:35:47.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.230+0000 7f9bd9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc077cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:47.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.230+0000 7f9bd9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc077cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52376/0 (socket says 172.21.15.71:52376) 2024-05-27T09:35:47.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.230+0000 7f9bd9e00700 1 -- 172.21.15.71:0/2898632620 learned_addr learned my addr 172.21.15.71:0/2898632620 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:47.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.230+0000 7f9bd9e00700 1 -- 172.21.15.71:0/2898632620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc07bb80 con 0x7f9bdc105e20 2024-05-27T09:35:47.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.230+0000 7f9bd9e00700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc077cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc006010 tx=0x7f9bcc005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:47.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.231+0000 7f9bd2a00700 1 -- 172.21.15.71:0/2898632620 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bcc026070 con 0x7f9bdc105e20 2024-05-27T09:35:47.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.231+0000 7f9bd2a00700 1 -- 172.21.15.71:0/2898632620 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bcc00bba0 con 0x7f9bdc105e20 2024-05-27T09:35:47.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.231+0000 7f9bd2a00700 1 -- 172.21.15.71:0/2898632620 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bcc003910 con 0x7f9bdc105e20 2024-05-27T09:35:47.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.231+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc078200 con 0x7f9bdc105e20 2024-05-27T09:35:47.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.231+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc0786c0 con 0x7f9bdc105e20 2024-05-27T09:35:47.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.232+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bdc1072d0 con 0x7f9bdc105e20 2024-05-27T09:35:47.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.232+0000 7f9bd2a00700 1 -- 172.21.15.71:0/2898632620 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9bcc029070 con 0x7f9bdc105e20 2024-05-27T09:35:47.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.233+0000 7f9bd2a00700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9bc003e570 0x7f9bc0040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:47.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.233+0000 7f9bd2a00700 1 -- 172.21.15.71:0/2898632620 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9bcc01e070 con 0x7f9bdc105e20 2024-05-27T09:35:47.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.233+0000 7f9bd9400700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9bc003e570 0x7f9bc0040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:47.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.234+0000 7f9bd9400700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9bc003e570 0x7f9bc0040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:47.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.239+0000 7f9bd2a00700 1 -- 172.21.15.71:0/2898632620 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9bcc013070 con 0x7f9bdc105e20 2024-05-27T09:35:47.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:47.481+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi072", "target": ["mon-mgr", ""]}) -- 0x7f9bdc07bdb0 con 0x7f9bc003e570 2024-05-27T09:35:47.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:47 smithi071 ceph-mon[31451]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:35:47.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:47 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:48.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:48 smithi071 ceph-mon[31451]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:48.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:48 smithi071 ceph-mon[31451]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi072", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:35:49.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:49 smithi071 ceph-mon[31451]: Deploying cephadm binary to smithi072 2024-05-27T09:35:50.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:50 smithi071 ceph-mon[31451]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.095+0000 7f9bd2a00700 1 -- 172.21.15.71:0/2898632620 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f9bdc07bdb0 con 0x7f9bc003e570 2024-05-27T09:35:52.096 INFO:teuthology.orchestra.run.smithi071.stdout:Added host 'smithi072' with addr '172.21.15.72' 2024-05-27T09:35:52.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9bc003e570 msgr2=0x7f9bc0040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9bc003e570 0x7f9bc0040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 msgr2=0x7f9bdc077cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc077cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc006010 tx=0x7f9bcc005780 comp rx=0 tx=0).stop 2024-05-27T09:35:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 shutdown_connections 2024-05-27T09:35:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9bc003e570 0x7f9bc0040a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 --2- 172.21.15.71:0/2898632620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bdc105e20 0x7f9bdc077cc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:52.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.100+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 >> 172.21.15.71:0/2898632620 conn(0x7f9bdc1016b0 msgr2=0x7f9bdc10b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:52.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.101+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 shutdown_connections 2024-05-27T09:35:52.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:52.101+0000 7f9bdb200700 1 -- 172.21.15.71:0/2898632620 wait complete. 2024-05-27T09:35:52.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:52 smithi071 ceph-mon[31451]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:52.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:52.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:35:52.833 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-05-27T09:35:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:35:53.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:53 smithi071 ceph-mon[31451]: Added host smithi072 2024-05-27T09:35:53.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:53.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:54.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:54 smithi071 ceph-mon[31451]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:55.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.455+0000 7f3e1b800700 1 -- 172.21.15.71:0/1778720495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 msgr2=0x7f3e14076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:55.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.455+0000 7f3e1b800700 1 --2- 172.21.15.71:0/1778720495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e14076130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009910 tx=0x7f3e04009c20 comp rx=0 tx=0).stop 2024-05-27T09:35:55.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.455+0000 7f3e1b800700 1 -- 172.21.15.71:0/1778720495 shutdown_connections 2024-05-27T09:35:55.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.455+0000 7f3e1b800700 1 --2- 172.21.15.71:0/1778720495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e14076130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:55.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.455+0000 7f3e1b800700 1 -- 172.21.15.71:0/1778720495 >> 172.21.15.71:0/1778720495 conn(0x7f3e140ff690 msgr2=0x7f3e14101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:55.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.455+0000 7f3e1b800700 1 -- 172.21.15.71:0/1778720495 shutdown_connections 2024-05-27T09:35:55.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.455+0000 7f3e1b800700 1 -- 172.21.15.71:0/1778720495 wait complete. 2024-05-27T09:35:55.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.456+0000 7f3e1b800700 1 Processor -- start 2024-05-27T09:35:55.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.456+0000 7f3e1b800700 1 -- start start 2024-05-27T09:35:55.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.457+0000 7f3e1b800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e141a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.457+0000 7f3e1b800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14110330 con 0x7f3e14075d20 2024-05-27T09:35:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.457+0000 7f3e18e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e141a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.457+0000 7f3e18e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e141a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58388/0 (socket says 172.21.15.71:58388) 2024-05-27T09:35:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.457+0000 7f3e18e00700 1 -- 172.21.15.71:0/2594532514 learned_addr learned my addr 172.21.15.71:0/2594532514 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.458+0000 7f3e18e00700 1 -- 172.21.15.71:0/2594532514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e141a1cb0 con 0x7f3e14075d20 2024-05-27T09:35:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.458+0000 7f3e18e00700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e141a1770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e04006010 tx=0x7f3e04005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.458+0000 7f3e12000700 1 -- 172.21.15.71:0/2594532514 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e04026070 con 0x7f3e14075d20 2024-05-27T09:35:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.458+0000 7f3e12000700 1 -- 172.21.15.71:0/2594532514 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0400bc00 con 0x7f3e14075d20 2024-05-27T09:35:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.458+0000 7f3e12000700 1 -- 172.21.15.71:0/2594532514 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e04003910 con 0x7f3e14075d20 2024-05-27T09:35:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.458+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e141a1f40 con 0x7f3e14075d20 2024-05-27T09:35:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.458+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1419b990 con 0x7f3e14075d20 2024-05-27T09:35:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.459+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e14077290 con 0x7f3e14075d20 2024-05-27T09:35:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.460+0000 7f3e12000700 1 -- 172.21.15.71:0/2594532514 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f3e04029070 con 0x7f3e14075d20 2024-05-27T09:35:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.460+0000 7f3e12000700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f3df803e570 0x7f3df8040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.460+0000 7f3e12000700 1 -- 172.21.15.71:0/2594532514 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3e0401e070 con 0x7f3e14075d20 2024-05-27T09:35:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.461+0000 7f3e0be00700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f3df803e570 0x7f3df8040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.461+0000 7f3e0be00700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f3df803e570 0x7f3df8040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc006fd0 tx=0x7f3dfc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:55.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.466+0000 7f3e12000700 1 -- 172.21.15.71:0/2594532514 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3e04013070 con 0x7f3e14075d20 2024-05-27T09:35:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.702+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e1419cec0 con 0x7f3df803e570 2024-05-27T09:35:55.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.705+0000 7f3e12000700 1 -- 172.21.15.71:0/2594532514 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f3e1419cec0 con 0x7f3df803e570 2024-05-27T09:35:55.705 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:35:55.705 INFO:teuthology.orchestra.run.smithi071.stdout:[{"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}, {"addr": "172.21.15.72", "hostname": "smithi072", "labels": [], "status": ""}] 2024-05-27T09:35:55.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f3df803e570 msgr2=0x7f3df8040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:55.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f3df803e570 0x7f3df8040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc006fd0 tx=0x7f3dfc006e40 comp rx=0 tx=0).stop 2024-05-27T09:35:55.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 msgr2=0x7f3e141a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:55.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e141a1770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e04006010 tx=0x7f3e04005780 comp rx=0 tx=0).stop 2024-05-27T09:35:55.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 shutdown_connections 2024-05-27T09:35:55.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f3df803e570 0x7f3df8040a80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:55.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 --2- 172.21.15.71:0/2594532514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14075d20 0x7f3e141a1770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:55.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.708+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 >> 172.21.15.71:0/2594532514 conn(0x7f3e140ff690 msgr2=0x7f3e14107df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:55.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.709+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 shutdown_connections 2024-05-27T09:35:55.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:55.709+0000 7f3e1b800700 1 -- 172.21.15.71:0/2594532514 wait complete. 2024-05-27T09:35:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:55 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:55 smithi071 ceph-mon[31451]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:55 smithi071 ceph-mon[31451]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:35:56.388 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi122 2024-05-27T09:35:56.388 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:35:56.388 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.conf 2024-05-27T09:35:56.406 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:35:56.406 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:35:56.464 INFO:tasks.cephadm:Adding host smithi122 to orchestrator... 2024-05-27T09:35:56.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch host add smithi122 2024-05-27T09:35:56.885 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:35:58.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:35:58.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:58.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:58.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:58.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:35:58.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:35:58.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:35:58.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:35:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.088+0000 7f8d3a600700 1 -- 172.21.15.71:0/1575925845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 msgr2=0x7f8d34102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:35:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.088+0000 7f8d3a600700 1 --2- 172.21.15.71:0/1575925845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d34102d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400b0a0 tx=0x7f8d2400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:35:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.088+0000 7f8d3a600700 1 -- 172.21.15.71:0/1575925845 shutdown_connections 2024-05-27T09:35:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.088+0000 7f8d3a600700 1 --2- 172.21.15.71:0/1575925845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d34102d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:35:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.088+0000 7f8d3a600700 1 -- 172.21.15.71:0/1575925845 >> 172.21.15.71:0/1575925845 conn(0x7f8d340785a0 msgr2=0x7f8d34078a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:35:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.088+0000 7f8d3a600700 1 -- 172.21.15.71:0/1575925845 shutdown_connections 2024-05-27T09:35:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.088+0000 7f8d3a600700 1 -- 172.21.15.71:0/1575925845 wait complete. 2024-05-27T09:35:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.089+0000 7f8d3a600700 1 Processor -- start 2024-05-27T09:35:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.089+0000 7f8d3a600700 1 -- start start 2024-05-27T09:35:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.090+0000 7f8d3a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d341a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.090+0000 7f8d3a600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8d34110350 con 0x7f8d34102920 2024-05-27T09:35:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.090+0000 7f8d33400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d341a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.090+0000 7f8d33400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d341a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58412/0 (socket says 172.21.15.71:58412) 2024-05-27T09:35:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.090+0000 7f8d33400700 1 -- 172.21.15.71:0/2314381205 learned_addr learned my addr 172.21.15.71:0/2314381205 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:35:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.091+0000 7f8d33400700 1 -- 172.21.15.71:0/2314381205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d341a1c20 con 0x7f8d34102920 2024-05-27T09:35:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.091+0000 7f8d33400700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d341a16e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d24015040 tx=0x7f8d24009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.091+0000 7f8d30c00700 1 -- 172.21.15.71:0/2314381205 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d24021020 con 0x7f8d34102920 2024-05-27T09:35:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.092+0000 7f8d3a600700 1 -- 172.21.15.71:0/2314381205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d341a1eb0 con 0x7f8d34102920 2024-05-27T09:35:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.092+0000 7f8d30c00700 1 -- 172.21.15.71:0/2314381205 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d24007970 con 0x7f8d34102920 2024-05-27T09:35:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.092+0000 7f8d30c00700 1 -- 172.21.15.71:0/2314381205 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d24017040 con 0x7f8d34102920 2024-05-27T09:35:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.092+0000 7f8d3a600700 1 -- 172.21.15.71:0/2314381205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3419b900 con 0x7f8d34102920 2024-05-27T09:35:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:59 smithi071 ceph-mon[31451]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:35:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:59 smithi071 ceph-mon[31451]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:35:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:35:59 smithi071 ceph-mon[31451]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:35:59.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.093+0000 7f8d30c00700 1 -- 172.21.15.71:0/2314381205 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8d24024020 con 0x7f8d34102920 2024-05-27T09:35:59.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.093+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d0c005330 con 0x7f8d34102920 2024-05-27T09:35:59.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.094+0000 7f8d30c00700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8d1803e510 0x7f8d18040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:35:59.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.094+0000 7f8d30c00700 1 -- 172.21.15.71:0/2314381205 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8d2400f050 con 0x7f8d34102920 2024-05-27T09:35:59.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.095+0000 7f8d2aa00700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8d1803e510 0x7f8d18040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:35:59.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.096+0000 7f8d2aa00700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8d1803e510 0x7f8d18040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006fd0 tx=0x7f8d1c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:35:59.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.100+0000 7f8d30c00700 1 -- 172.21.15.71:0/2314381205 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8d2402b020 con 0x7f8d34102920 2024-05-27T09:35:59.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:35:59.350+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}) -- 0x7f8d0c000bc0 con 0x7f8d1803e510 2024-05-27T09:36:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:00 smithi071 ceph-mon[31451]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:00 smithi071 ceph-mon[31451]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:00.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:00.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:00.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:00.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:00 smithi071 ceph-mon[31451]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:01.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:01 smithi071 ceph-mon[31451]: Deploying cephadm binary to smithi122 2024-05-27T09:36:02.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:02 smithi071 ceph-mon[31451]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.128+0000 7f8d30c00700 1 -- 172.21.15.71:0/2314381205 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8d0c000bc0 con 0x7f8d1803e510 2024-05-27T09:36:04.130 INFO:teuthology.orchestra.run.smithi071.stdout:Added host 'smithi122' with addr '172.21.15.122' 2024-05-27T09:36:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8d1803e510 msgr2=0x7f8d18040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8d1803e510 0x7f8d18040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006fd0 tx=0x7f8d1c006e40 comp rx=0 tx=0).stop 2024-05-27T09:36:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 msgr2=0x7f8d341a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d341a16e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d24015040 tx=0x7f8d24009790 comp rx=0 tx=0).stop 2024-05-27T09:36:04.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 shutdown_connections 2024-05-27T09:36:04.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8d1803e510 0x7f8d18040a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:04.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 --2- 172.21.15.71:0/2314381205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d34102920 0x7f8d341a16e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:04.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.133+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 >> 172.21.15.71:0/2314381205 conn(0x7f8d340785a0 msgr2=0x7f8d341007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:04.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.134+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 shutdown_connections 2024-05-27T09:36:04.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:04.134+0000 7f8d29600700 1 -- 172.21.15.71:0/2314381205 wait complete. 2024-05-27T09:36:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:04 smithi071 ceph-mon[31451]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:04.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-05-27T09:36:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:36:05.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:05 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:05.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:05 smithi071 ceph-mon[31451]: Added host smithi122 2024-05-27T09:36:05.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:05 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:05.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:05 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:06.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:06 smithi071 ceph-mon[31451]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:06.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:07.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.573+0000 7f1ecb400700 1 -- 172.21.15.71:0/3546989071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 msgr2=0x7f1ec41041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:07.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.573+0000 7f1ecb400700 1 --2- 172.21.15.71:0/3546989071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41041f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009910 tx=0x7f1eb8009c20 comp rx=0 tx=0).stop 2024-05-27T09:36:07.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.573+0000 7f1ecb400700 1 -- 172.21.15.71:0/3546989071 shutdown_connections 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.573+0000 7f1ecb400700 1 --2- 172.21.15.71:0/3546989071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41041f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.573+0000 7f1ecb400700 1 -- 172.21.15.71:0/3546989071 >> 172.21.15.71:0/3546989071 conn(0x7f1ec40ff690 msgr2=0x7f1ec4101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.573+0000 7f1ecb400700 1 -- 172.21.15.71:0/3546989071 shutdown_connections 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.573+0000 7f1ecb400700 1 -- 172.21.15.71:0/3546989071 wait complete. 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.575+0000 7f1ecb400700 1 Processor -- start 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.575+0000 7f1ecb400700 1 -- start start 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.575+0000 7f1ecb400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:07.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.575+0000 7f1ecb400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec410e0d0 con 0x7f1ec4103de0 2024-05-27T09:36:07.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.575+0000 7f1ec8a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:07.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.575+0000 7f1ec8a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52728/0 (socket says 172.21.15.71:52728) 2024-05-27T09:36:07.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.575+0000 7f1ec8a00700 1 -- 172.21.15.71:0/1177681380 learned_addr learned my addr 172.21.15.71:0/1177681380 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:36:07.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.576+0000 7f1ec8a00700 1 -- 172.21.15.71:0/1177681380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec41a1c80 con 0x7f1ec4103de0 2024-05-27T09:36:07.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.576+0000 7f1ec8a00700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41a1740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8006010 tx=0x7f1eb8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:07.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.576+0000 7f1ec1600700 1 -- 172.21.15.71:0/1177681380 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb8026070 con 0x7f1ec4103de0 2024-05-27T09:36:07.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.577+0000 7f1ec1600700 1 -- 172.21.15.71:0/1177681380 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb800bba0 con 0x7f1ec4103de0 2024-05-27T09:36:07.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.577+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec41a1f70 con 0x7f1ec4103de0 2024-05-27T09:36:07.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.577+0000 7f1ec1600700 1 -- 172.21.15.71:0/1177681380 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb8003910 con 0x7f1ec4103de0 2024-05-27T09:36:07.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.577+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec419b960 con 0x7f1ec4103de0 2024-05-27T09:36:07.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.578+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec4105290 con 0x7f1ec4103de0 2024-05-27T09:36:07.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.578+0000 7f1ec1600700 1 -- 172.21.15.71:0/1177681380 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f1eb8029070 con 0x7f1ec4103de0 2024-05-27T09:36:07.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.579+0000 7f1ec1600700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1eac03e570 0x7f1eac040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:07.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.579+0000 7f1ec1600700 1 -- 172.21.15.71:0/1177681380 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1eb801e070 con 0x7f1ec4103de0 2024-05-27T09:36:07.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.579+0000 7f1ec3e00700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1eac03e570 0x7f1eac040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:07.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.580+0000 7f1ec3e00700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1eac03e570 0x7f1eac040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0006fd0 tx=0x7f1eb0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:07.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.585+0000 7f1ec1600700 1 -- 172.21.15.71:0/1177681380 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1eb8013070 con 0x7f1ec4103de0 2024-05-27T09:36:07.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.824+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ec419ce90 con 0x7f1eac03e570 2024-05-27T09:36:07.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.826+0000 7f1ec1600700 1 -- 172.21.15.71:0/1177681380 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f1ec419ce90 con 0x7f1eac03e570 2024-05-27T09:36:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:36:07.827 INFO:teuthology.orchestra.run.smithi071.stdout:[{"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}, {"addr": "172.21.15.72", "hostname": "smithi072", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}] 2024-05-27T09:36:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1eac03e570 msgr2=0x7f1eac040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1eac03e570 0x7f1eac040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0006fd0 tx=0x7f1eb0006e40 comp rx=0 tx=0).stop 2024-05-27T09:36:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 msgr2=0x7f1ec41a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41a1740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8006010 tx=0x7f1eb8005780 comp rx=0 tx=0).stop 2024-05-27T09:36:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 shutdown_connections 2024-05-27T09:36:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1eac03e570 0x7f1eac040a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 --2- 172.21.15.71:0/1177681380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec4103de0 0x7f1ec41a1740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 >> 172.21.15.71:0/1177681380 conn(0x7f1ec40ff690 msgr2=0x7f1ec4075b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 shutdown_connections 2024-05-27T09:36:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:07.829+0000 7f1ecb400700 1 -- 172.21.15.71:0/1177681380 wait complete. 2024-05-27T09:36:08.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:07 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:08.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:07 smithi071 ceph-mon[31451]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:08.586 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-27T09:36:08.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-05-27T09:36:09.009 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:36:09.177 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:08 smithi071 ceph-mon[31451]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:36:10.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:09 smithi071 ceph-mon[31451]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:11.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.125+0000 7f4f2b400700 1 -- 172.21.15.71:0/2929131804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 msgr2=0x7f4f241041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:11.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.125+0000 7f4f2b400700 1 --2- 172.21.15.71:0/2929131804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f241041f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009910 tx=0x7f4f18009c20 comp rx=0 tx=0).stop 2024-05-27T09:36:11.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.125+0000 7f4f2b400700 1 -- 172.21.15.71:0/2929131804 shutdown_connections 2024-05-27T09:36:11.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.125+0000 7f4f2b400700 1 --2- 172.21.15.71:0/2929131804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f241041f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:11.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.125+0000 7f4f2b400700 1 -- 172.21.15.71:0/2929131804 >> 172.21.15.71:0/2929131804 conn(0x7f4f240ff690 msgr2=0x7f4f24101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:11.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.125+0000 7f4f2b400700 1 -- 172.21.15.71:0/2929131804 shutdown_connections 2024-05-27T09:36:11.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.126+0000 7f4f2b400700 1 -- 172.21.15.71:0/2929131804 wait complete. 2024-05-27T09:36:11.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.127+0000 7f4f2b400700 1 Processor -- start 2024-05-27T09:36:11.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.127+0000 7f4f2b400700 1 -- start start 2024-05-27T09:36:11.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.128+0000 7f4f2b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f24075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:11.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.128+0000 7f4f2b400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2410e0d0 con 0x7f4f24103de0 2024-05-27T09:36:11.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.128+0000 7f4f28a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f24075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:11.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.128+0000 7f4f28a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f24075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52732/0 (socket says 172.21.15.71:52732) 2024-05-27T09:36:11.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.128+0000 7f4f28a00700 1 -- 172.21.15.71:0/384526467 learned_addr learned my addr 172.21.15.71:0/384526467 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:36:11.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.128+0000 7f4f28a00700 1 -- 172.21.15.71:0/384526467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f24077900 con 0x7f4f24103de0 2024-05-27T09:36:11.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.129+0000 7f4f28a00700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f24075ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f180056d0 tx=0x7f4f180057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:11.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.129+0000 7f4f21600700 1 -- 172.21.15.71:0/384526467 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f18026070 con 0x7f4f24103de0 2024-05-27T09:36:11.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.129+0000 7f4f2b400700 1 -- 172.21.15.71:0/384526467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f24075ff0 con 0x7f4f24103de0 2024-05-27T09:36:11.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.129+0000 7f4f2b400700 1 -- 172.21.15.71:0/384526467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f240764b0 con 0x7f4f24103de0 2024-05-27T09:36:11.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.129+0000 7f4f21600700 1 -- 172.21.15.71:0/384526467 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f1800bba0 con 0x7f4f24103de0 2024-05-27T09:36:11.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.129+0000 7f4f21600700 1 -- 172.21.15.71:0/384526467 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f180037f0 con 0x7f4f24103de0 2024-05-27T09:36:11.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.131+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f24105290 con 0x7f4f24103de0 2024-05-27T09:36:11.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.131+0000 7f4f21600700 1 -- 172.21.15.71:0/384526467 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f4f18029070 con 0x7f4f24103de0 2024-05-27T09:36:11.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.132+0000 7f4f21600700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f4f0c03e570 0x7f4f0c040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:11.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.132+0000 7f4f21600700 1 -- 172.21.15.71:0/384526467 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4f1801e070 con 0x7f4f24103de0 2024-05-27T09:36:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.132+0000 7f4f23e00700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f4f0c03e570 0x7f4f0c040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.133+0000 7f4f23e00700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f4f0c03e570 0x7f4f0c040a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4f10006fd0 tx=0x7f4f10006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:11.134 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:11.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:11 smithi071 ceph-mon[31451]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:11.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.140+0000 7f4f21600700 1 -- 172.21.15.71:0/384526467 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4f18013070 con 0x7f4f24103de0 2024-05-27T09:36:11.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:11.386+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4f24064e10 con 0x7f4f24103de0 2024-05-27T09:36:12.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.319+0000 7f4f21600700 1 -- 172.21.15.71:0/384526467 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f4f1802a3b0 con 0x7f4f24103de0 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f4f0c03e570 msgr2=0x7f4f0c040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f4f0c03e570 0x7f4f0c040a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4f10006fd0 tx=0x7f4f10006e40 comp rx=0 tx=0).stop 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 msgr2=0x7f4f24075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f24075ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f180056d0 tx=0x7f4f180057b0 comp rx=0 tx=0).stop 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 shutdown_connections 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f4f0c03e570 0x7f4f0c040a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 --2- 172.21.15.71:0/384526467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f24103de0 0x7f4f24075ab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.323+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 >> 172.21.15.71:0/384526467 conn(0x7f4f240ff690 msgr2=0x7f4f24101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:12.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.324+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 shutdown_connections 2024-05-27T09:36:12.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:12.324+0000 7f4f16a00700 1 -- 172.21.15.71:0/384526467 wait complete. 2024-05-27T09:36:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-05-27T09:36:12.717 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:12 smithi071 ceph-mon[31451]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:12.717 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:12 smithi071 ceph-mon[31451]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:12.717 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:12.717 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:12.717 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:12.717 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:12 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/384526467' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-27T09:36:13.096 INFO:tasks.cephadm:Adding mon.a on smithi071 2024-05-27T09:36:13.096 INFO:tasks.cephadm:Adding mon.b on smithi072 2024-05-27T09:36:13.096 INFO:tasks.cephadm:Adding mon.c on smithi122 2024-05-27T09:36:13.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c' 2024-05-27T09:36:13.330 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:13.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:13 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/384526467' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-27T09:36:13.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:13 smithi071 ceph-mon[31451]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:14.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:14 smithi071 ceph-mon[31451]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:14.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.781+0000 7f4464825700 1 -- 172.21.15.122:0/2230184643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 msgr2=0x7f4460108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.781+0000 7f4464825700 1 --2- 172.21.15.122:0/2230184643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f4460108e90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4454009910 tx=0x7f4454009c20 comp rx=0 tx=0).stop 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.781+0000 7f4464825700 1 -- 172.21.15.122:0/2230184643 shutdown_connections 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.781+0000 7f4464825700 1 --2- 172.21.15.122:0/2230184643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f4460108e90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.781+0000 7f4464825700 1 -- 172.21.15.122:0/2230184643 >> 172.21.15.122:0/2230184643 conn(0x7f44600785a0 msgr2=0x7f4460078a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.781+0000 7f4464825700 1 -- 172.21.15.122:0/2230184643 shutdown_connections 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.781+0000 7f4464825700 1 -- 172.21.15.122:0/2230184643 wait complete. 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.782+0000 7f4464825700 1 Processor -- start 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.782+0000 7f4464825700 1 -- start start 2024-05-27T09:36:14.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.782+0000 7f4464825700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f446019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:14.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.782+0000 7f4464825700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f446010cfd0 con 0x7f4460108a80 2024-05-27T09:36:14.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.783+0000 7f445e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f446019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:14.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.783+0000 7f445e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f446019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.122:36534/0 (socket says 172.21.15.122:36534) 2024-05-27T09:36:14.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.783+0000 7f445e59c700 1 -- 172.21.15.122:0/991308924 learned_addr learned my addr 172.21.15.122:0/991308924 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:36:14.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.784+0000 7f445e59c700 1 -- 172.21.15.122:0/991308924 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446019ac70 con 0x7f4460108a80 2024-05-27T09:36:14.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.784+0000 7f445e59c700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f446019a730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f44540092e0 tx=0x7f4454005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:14.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.784+0000 7f444f7fe700 1 -- 172.21.15.122:0/991308924 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4454026070 con 0x7f4460108a80 2024-05-27T09:36:14.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.784+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446019af60 con 0x7f4460108a80 2024-05-27T09:36:14.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.784+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446019b420 con 0x7f4460108a80 2024-05-27T09:36:14.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.784+0000 7f444f7fe700 1 -- 172.21.15.122:0/991308924 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f445400b6f0 con 0x7f4460108a80 2024-05-27T09:36:14.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.784+0000 7f444f7fe700 1 -- 172.21.15.122:0/991308924 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44540037f0 con 0x7f4460108a80 2024-05-27T09:36:14.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.785+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4460104190 con 0x7f4460108a80 2024-05-27T09:36:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.786+0000 7f444f7fe700 1 -- 172.21.15.122:0/991308924 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f4454029070 con 0x7f4460108a80 2024-05-27T09:36:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.786+0000 7f444f7fe700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f444803e510 0x7f4448040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.786+0000 7f444f7fe700 1 -- 172.21.15.122:0/991308924 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f445401e070 con 0x7f4460108a80 2024-05-27T09:36:14.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.787+0000 7f445dd9b700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f444803e510 0x7f4448040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.788+0000 7f445dd9b700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f444803e510 0x7f4448040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4450006fd0 tx=0x7f4450006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:14.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:14.802+0000 7f444f7fe700 1 -- 172.21.15.122:0/991308924 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4454013070 con 0x7f4460108a80 2024-05-27T09:36:15.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.015+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}) -- 0x7f446006bd50 con 0x7f444803e510 2024-05-27T09:36:15.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.031+0000 7f444f7fe700 1 -- 172.21.15.122:0/991308924 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f446006bd50 con 0x7f444803e510 2024-05-27T09:36:15.033 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mon update... 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f444803e510 msgr2=0x7f4448040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f444803e510 0x7f4448040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4450006fd0 tx=0x7f4450006e40 comp rx=0 tx=0).stop 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 msgr2=0x7f446019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f446019a730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f44540092e0 tx=0x7f4454005780 comp rx=0 tx=0).stop 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 shutdown_connections 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f444803e510 0x7f4448040a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 --2- 172.21.15.122:0/991308924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4460108a80 0x7f446019a730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 >> 172.21.15.122:0/991308924 conn(0x7f44600785a0 msgr2=0x7f44600ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 shutdown_connections 2024-05-27T09:36:15.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:15.034+0000 7f4464825700 1 -- 172.21.15.122:0/991308924 wait complete. 2024-05-27T09:36:15.650 DEBUG:teuthology.orchestra.run.smithi072:mon.b> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.b.service 2024-05-27T09:36:15.653 DEBUG:teuthology.orchestra.run.smithi122:mon.c> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.c.service 2024-05-27T09:36:15.655 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-27T09:36:15.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-05-27T09:36:16.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: Saving service mon spec with placement smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c;count:3 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:16.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:16 smithi071 ceph-mon[31451]: Deploying daemon mon.c on smithi122 2024-05-27T09:36:17.516 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:36:18.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:18 smithi071 ceph-mon[31451]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:18.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:18 smithi122 systemd[1]: Starting Ceph mon.c for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:36:19.356 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 podman[36391]: 2024-05-27 09:36:18.99469765 +0000 UTC m=+0.151924788 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:36:19.356 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 podman[36391]: 2024-05-27 09:36:19.095464501 +0000 UTC m=+0.252691676 container create 385673cfaac7acfc1c11ab00a5b2e22c890bf0afa52d4a99f38c85e42a88f31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521) 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.392+0000 7f80c75b7700 1 -- 172.21.15.122:0/528926053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 msgr2=0x7f80c0102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.392+0000 7f80c75b7700 1 --2- 172.21.15.122:0/528926053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c0102950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009910 tx=0x7f80b0009c20 comp rx=0 tx=0).stop 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.393+0000 7f80c75b7700 1 -- 172.21.15.122:0/528926053 shutdown_connections 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.393+0000 7f80c75b7700 1 --2- 172.21.15.122:0/528926053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c0102950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.393+0000 7f80c75b7700 1 -- 172.21.15.122:0/528926053 >> 172.21.15.122:0/528926053 conn(0x7f80c0077e00 msgr2=0x7f80c0078260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.393+0000 7f80c75b7700 1 -- 172.21.15.122:0/528926053 shutdown_connections 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.393+0000 7f80c75b7700 1 -- 172.21.15.122:0/528926053 wait complete. 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.393+0000 7f80c75b7700 1 Processor -- start 2024-05-27T09:36:19.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.393+0000 7f80c75b7700 1 -- start start 2024-05-27T09:36:19.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.394+0000 7f80c75b7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:19.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.394+0000 7f80c75b7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80c010c830 con 0x7f80c0102540 2024-05-27T09:36:19.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.394+0000 7f80c5353700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.394+0000 7f80c5353700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c019a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.122:36542/0 (socket says 172.21.15.122:36542) 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.394+0000 7f80c5353700 1 -- 172.21.15.122:0/345273053 learned_addr learned my addr 172.21.15.122:0/345273053 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.395+0000 7f80c5353700 1 -- 172.21.15.122:0/345273053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c010dec0 con 0x7f80c0102540 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.395+0000 7f80c5353700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c019a980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80b00056d0 tx=0x7f80b00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.395+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b0026070 con 0x7f80c0102540 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.395+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c019af80 con 0x7f80c0102540 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.395+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c019b440 con 0x7f80c0102540 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.395+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80b000bba0 con 0x7f80c0102540 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.396+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b0030060 con 0x7f80c0102540 2024-05-27T09:36:19.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.396+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a4005330 con 0x7f80c0102540 2024-05-27T09:36:19.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.397+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f80b0029070 con 0x7f80c0102540 2024-05-27T09:36:19.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.397+0000 7f80b67fc700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80ac03e4c0 0x7f80ac0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:19.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.397+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f80b001e070 con 0x7f80c0102540 2024-05-27T09:36:19.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.398+0000 7f80c4b52700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80ac03e4c0 0x7f80ac0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:19.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.399+0000 7f80c4b52700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80ac03e4c0 0x7f80ac0409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f80bc006fd0 tx=0x7f80bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:19.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.414+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f80b0013070 con 0x7f80c0102540 2024-05-27T09:36:19.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.551+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f80b00142b0 con 0x7f80c0102540 2024-05-27T09:36:19.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:19.711+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f80a40058f0 con 0x7f80c0102540 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 podman[36391]: 2024-05-27 09:36:19.465491876 +0000 UTC m=+0.622719006 container init 385673cfaac7acfc1c11ab00a5b2e22c890bf0afa52d4a99f38c85e42a88f31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 podman[36391]: 2024-05-27 09:36:19.469428903 +0000 UTC m=+0.626656036 container start 385673cfaac7acfc1c11ab00a5b2e22c890bf0afa52d4a99f38c85e42a88f31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD) 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: set uid:gid to 167:167 (ceph:ceph) 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: ceph version 19.0.0-3868-ga6507388 (a6507388dd5057528934822c0163b0c347ef1d5d) squid (dev), process ceph-mon, pid 2 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pidfile_write: ignore empty --pid-file 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: load: jerasure load: lrc 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: RocksDB version: 7.9.2 2024-05-27T09:36:19.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Git sha 0 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Compile date 2024-05-21 11:39:56 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: DB SUMMARY 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: DB Session ID: TDKTT094L6N1LOE31J2C 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: CURRENT file: CURRENT 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: IDENTITY file: IDENTITY 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.error_if_exists: 0 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.create_if_missing: 0 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.paranoid_checks: 1 2024-05-27T09:36:19.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-27T09:36:19.715 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-27T09:36:19.715 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-27T09:36:19.715 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.env: 0x55c7d53e9500 2024-05-27T09:36:19.715 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.fs: PosixFileSystem 2024-05-27T09:36:19.715 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.info_log: 0x55c7d799ffe0 2024-05-27T09:36:19.715 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_file_opening_threads: 16 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.statistics: (nil) 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.use_fsync: 0 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_log_file_size: 0 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.keep_log_file_num: 1000 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.recycle_log_file_num: 0 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.allow_fallocate: 1 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.allow_mmap_reads: 0 2024-05-27T09:36:19.717 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.allow_mmap_writes: 0 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.use_direct_reads: 0 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.create_missing_column_families: 0 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.db_log_dir: 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.wal_dir: 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.advise_random_on_open: 1 2024-05-27T09:36:19.718 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.db_write_buffer_size: 0 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.write_buffer_manager: 0x55c7d79708c0 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.rate_limiter: (nil) 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.wal_recovery_mode: 2 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.enable_thread_tracking: 0 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.enable_pipelined_write: 0 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.unordered_write: 0 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-27T09:36:19.719 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.row_cache: None 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.wal_filter: None 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.allow_ingest_behind: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.two_write_queues: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.manual_wal_flush: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.wal_compression: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.atomic_flush: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-27T09:36:19.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.log_readahead_size: 0 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.best_efforts_recovery: 0 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.allow_data_in_errors: 0 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.db_host_id: __hostname__ 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_background_jobs: 2 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_background_compactions: -1 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_subcompactions: 1 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-27T09:36:19.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_total_wal_size: 0 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_open_files: -1 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bytes_per_sync: 0 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_readahead_size: 0 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_background_flushes: -1 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Compression algorithms supported: 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-27T09:36:19.722 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kZSTD supported: 0 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kXpressCompression supported: 0 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kLZ4HCCompression supported: 1 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kZlibCompression supported: 1 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kSnappyCompression supported: 1 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kLZ4Compression supported: 1 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: kBZip2Compression supported: 0 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-27T09:36:19.723 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.merge_operator: 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_filter: None 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_filter_factory: None 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.sst_partitioner_factory: None 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c7d7aa61c0) 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: cache_index_and_filter_blocks: 1 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: pin_top_level_index_and_filter: 1 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: index_type: 0 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: data_block_index_type: 0 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: index_shortening: 1 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: checksum: 4 2024-05-27T09:36:19.724 INFO:journalctl@ceph.mon.c.smithi122.stdout: no_block_cache: 0 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache: 0x55c7d79a31f0 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache_name: BinnedLRUCache 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache_options: 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: capacity : 536870912 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: num_shard_bits : 4 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: strict_capacity_limit : 0 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: high_pri_pool_ratio: 0.000 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache_compressed: (nil) 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: persistent_cache: (nil) 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_size: 4096 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_size_deviation: 10 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_restart_interval: 16 2024-05-27T09:36:19.725 INFO:journalctl@ceph.mon.c.smithi122.stdout: index_block_restart_interval: 1 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: metadata_block_size: 4096 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: partition_filters: 0 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: use_delta_encoding: 1 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: filter_policy: bloomfilter 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: whole_key_filtering: 1 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: verify_compression: 0 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: read_amp_bytes_per_bit: 0 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: format_version: 5 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: enable_index_compression: 1 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_align: 0 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: max_auto_readahead_size: 262144 2024-05-27T09:36:19.726 INFO:journalctl@ceph.mon.c.smithi122.stdout: prepopulate_block_cache: 0 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout: initial_auto_readahead_size: 8192 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout: num_file_reads_for_auto_readahead: 2 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.write_buffer_size: 33554432 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_write_buffer_number: 2 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression: NoCompression 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression: Disabled 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.prefix_extractor: nullptr 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.num_levels: 7 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-27T09:36:19.727 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.level: 32767 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.strategy: 0 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-27T09:36:19.728 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.enabled: false 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.target_file_size_base: 67108864 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-27T09:36:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.arena_block_size: 1048576 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.disable_auto_compactions: 0 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-27T09:36:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.inplace_update_support: 0 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-27T09:36:19.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.bloom_locality: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.max_successive_merges: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.paranoid_file_checks: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.force_consistency_checks: 1 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.report_bg_io_stats: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.ttl: 2592000 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.enable_blob_files: false 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.min_blob_size: 0 2024-05-27T09:36:19.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.blob_file_size: 268435456 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.blob_file_starting_level: 0 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a26d75f3-14ed-4f10-b19a-80c56c7e959e 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716802579509710, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716802579510127, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716802579, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a26d75f3-14ed-4f10-b19a-80c56c7e959e", "db_session_id": "TDKTT094L6N1LOE31J2C", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-27T09:36:19.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716802579510211, "job": 1, "event": "recovery_finished"} 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c7d7987c00 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: DB pointer 0x55c7dc77a000 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** DB Stats ** 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-27T09:36:19.734 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** Compaction Stats [default] ** 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** Compaction Stats [default] ** 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-27T09:36:19.735 INFO:journalctl@ceph.mon.c.smithi122.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Block cache BinnedLRUCache@0x55c7d79a31f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-27T09:36:19.736 INFO:journalctl@ceph.mon.c.smithi122.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: using public_addr v2:172.21.15.122:0/0 -> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: starting mon.c rank -1 at public addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] at bind addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(???) e0 preinit fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 bash[36391]: 385673cfaac7acfc1c11ab00a5b2e22c890bf0afa52d4a99f38c85e42a88f31c 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 systemd[1]: Started Ceph mon.c for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).mds e1 new map 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout: e1 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-27T09:36:19.737 INFO:journalctl@ceph.mon.c.smithi122.stdout: legacy client fscid: -1 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout: No filesystems configured 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:36:19.738 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi072", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Deploying cephadm binary to smithi072 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Added host smithi072 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.739 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:19.740 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Deploying cephadm binary to smithi122 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Added host smithi122 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.741 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:36:19.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/384526467' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/384526467' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:19.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Saving service mon spec with placement smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c;count:3 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: Deploying daemon mon.c on smithi122 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:19.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:19 smithi122 ceph-mon[36436]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-27T09:36:24.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.579+0000 7f80b67fc700 1 -- 172.21.15.122:0/345273053 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f80b001f310 con 0x7f80c0102540 2024-05-27T09:36:24.579 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:36:24.579 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","modified":"2024-05-27T09:36:19.550152Z","created":"2024-05-27T09:34:08.663148Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.581+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80ac03e4c0 msgr2=0x7f80ac0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80ac03e4c0 0x7f80ac0409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f80bc006fd0 tx=0x7f80bc006e40 comp rx=0 tx=0).stop 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 msgr2=0x7f80c019a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c019a980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80b00056d0 tx=0x7f80b00057b0 comp rx=0 tx=0).stop 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 shutdown_connections 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80ac03e4c0 0x7f80ac0409d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 --2- 172.21.15.122:0/345273053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c0102540 0x7f80c019a980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 >> 172.21.15.122:0/345273053 conn(0x7f80c0077e00 msgr2=0x7f80c0100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:24.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 shutdown_connections 2024-05-27T09:36:24.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:24.582+0000 7f80c75b7700 1 -- 172.21.15.122:0/345273053 wait complete. 2024-05-27T09:36:24.583 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 2 2024-05-27T09:36:24.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:24.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:36:24.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: mon.a calling monitor election 2024-05-27T09:36:24.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/345273053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: mon.c calling monitor election 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: monmap epoch 2 2024-05-27T09:36:24.836 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: last_changed 2024-05-27T09:36:19.550152+0000 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: min_mon_release 19 (squid) 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: election_strategy: 1 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: fsmap 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: mgrmap e13: x(active, since 61s) 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: overall HEALTH_OK 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:24.837 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:24.838 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:25.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:25.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:36:25.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: mon.a calling monitor election 2024-05-27T09:36:25.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:25.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/345273053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-27T09:36:25.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:25.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: mon.c calling monitor election 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: monmap epoch 2 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: last_changed 2024-05-27T09:36:19.550152+0000 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: min_mon_release 19 (squid) 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: election_strategy: 1 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:36:25.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: fsmap 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: mgrmap e13: x(active, since 61s) 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: overall HEALTH_OK 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:25.012 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:25.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:25 smithi122 ceph-mon[36436]: Deploying daemon mon.b on smithi072 2024-05-27T09:36:25.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:25 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:26.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:25 smithi071 ceph-mon[31451]: Deploying daemon mon.b on smithi072 2024-05-27T09:36:26.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:25 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:26.095 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-27T09:36:26.095 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-05-27T09:36:26.335 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:36:26.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:26 smithi122 ceph-mon[36436]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:26 smithi071 ceph-mon[31451]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:27.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:36:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:36:26.549+0000 7f2158e00700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-27T09:36:27.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.690+0000 7f5bed8d7700 1 -- 172.21.15.122:0/837886942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 msgr2=0x7f5be8105220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:27.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.690+0000 7f5bed8d7700 1 --2- 172.21.15.122:0/837886942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 0x7f5be8105220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009910 tx=0x7f5bd8009c20 comp rx=0 tx=0).stop 2024-05-27T09:36:27.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.690+0000 7f5bed8d7700 1 -- 172.21.15.122:0/837886942 shutdown_connections 2024-05-27T09:36:27.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.690+0000 7f5bed8d7700 1 --2- 172.21.15.122:0/837886942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 0x7f5be8105220 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:27.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.690+0000 7f5bed8d7700 1 -- 172.21.15.122:0/837886942 >> 172.21.15.122:0/837886942 conn(0x7f5be80fe660 msgr2=0x7f5be8100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:27.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.691+0000 7f5bed8d7700 1 -- 172.21.15.122:0/837886942 shutdown_connections 2024-05-27T09:36:27.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.691+0000 7f5bed8d7700 1 -- 172.21.15.122:0/837886942 wait complete. 2024-05-27T09:36:27.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.691+0000 7f5bed8d7700 1 Processor -- start 2024-05-27T09:36:27.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.691+0000 7f5bed8d7700 1 -- start start 2024-05-27T09:36:27.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bed8d7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 0x7f5be819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:27.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bed8d7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 0x7f5be8199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:27.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bed8d7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5be810e200 con 0x7f5be8104e10 2024-05-27T09:36:27.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bed8d7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5be810e080 con 0x7f5be819fd50 2024-05-27T09:36:27.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bde7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 0x7f5be8199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:27.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bde7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 0x7f5be8199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55436/0 (socket says 172.21.15.122:55436) 2024-05-27T09:36:27.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bde7fc700 1 -- 172.21.15.122:0/3768337197 learned_addr learned my addr 172.21.15.122:0/3768337197 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bde7fc700 1 -- 172.21.15.122:0/3768337197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 msgr2=0x7f5be8199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bde7fc700 1 -- 172.21.15.122:0/3768337197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 msgr2=0x7f5be8199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bde7fc700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 0x7f5be8199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5bde7fc700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 0x7f5be8199a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.692+0000 7f5be6ffd700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 0x7f5be819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.693+0000 7f5be6ffd700 1 -- 172.21.15.122:0/3768337197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 msgr2=0x7f5be8199a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.693+0000 7f5be6ffd700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 0x7f5be8199a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:27.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.693+0000 7f5be6ffd700 1 -- 172.21.15.122:0/3768337197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be81a0320 con 0x7f5be8104e10 2024-05-27T09:36:27.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.693+0000 7f5be6ffd700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 0x7f5be819f810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8014000 tx=0x7f5bd8005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:27.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.694+0000 7f5bec8d5700 1 -- 172.21.15.122:0/3768337197 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5bd8005dc0 con 0x7f5be8104e10 2024-05-27T09:36:27.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.694+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be8199f70 con 0x7f5be8104e10 2024-05-27T09:36:27.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.694+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be819a500 con 0x7f5be8104e10 2024-05-27T09:36:27.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.694+0000 7f5bec8d5700 1 -- 172.21.15.122:0/3768337197 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd80047d0 con 0x7f5be8104e10 2024-05-27T09:36:27.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.694+0000 7f5bec8d5700 1 -- 172.21.15.122:0/3768337197 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5bd800fb80 con 0x7f5be8104e10 2024-05-27T09:36:27.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.695+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc8005330 con 0x7f5be8104e10 2024-05-27T09:36:27.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.695+0000 7f5bec8d5700 1 -- 172.21.15.122:0/3768337197 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5bd802a070 con 0x7f5be8104e10 2024-05-27T09:36:27.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.695+0000 7f5bec8d5700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5bd403e2b0 0x7f5bd40407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:27.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.695+0000 7f5bec8d5700 1 -- 172.21.15.122:0/3768337197 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5bd801e030 con 0x7f5be8104e10 2024-05-27T09:36:27.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.696+0000 7f5bde7fc700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5bd403e2b0 0x7f5bd40407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:27.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.697+0000 7f5bde7fc700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5bd403e2b0 0x7f5bd40407c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5be8106fb0 tx=0x7f5bd0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:27.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:27.712+0000 7f5bec8d5700 1 -- 172.21.15.122:0/3768337197 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5bd8013070 con 0x7f5be8104e10 2024-05-27T09:36:28.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.000+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5bc8005620 con 0x7f5be8104e10 2024-05-27T09:36:28.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.001+0000 7f5bec8d5700 1 -- 172.21.15.122:0/3768337197 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5bd8031070 con 0x7f5be8104e10 2024-05-27T09:36:28.001 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:36:28.002 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","modified":"2024-05-27T09:36:19.550152Z","created":"2024-05-27T09:34:08.663148Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5bd403e2b0 msgr2=0x7f5bd40407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5bd403e2b0 0x7f5bd40407c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5be8106fb0 tx=0x7f5bd0008040 comp rx=0 tx=0).stop 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 msgr2=0x7f5be819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 0x7f5be819f810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8014000 tx=0x7f5bd8005030 comp rx=0 tx=0).stop 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 shutdown_connections 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5bd403e2b0 0x7f5bd40407c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5be8104e10 0x7f5be819f810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:28.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 --2- 172.21.15.122:0/3768337197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be819fd50 0x7f5be8199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:28.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 >> 172.21.15.122:0/3768337197 conn(0x7f5be80fe660 msgr2=0x7f5be810a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:28.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 shutdown_connections 2024-05-27T09:36:28.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:28.004+0000 7f5bed8d7700 1 -- 172.21.15.122:0/3768337197 wait complete. 2024-05-27T09:36:28.005 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 2 2024-05-27T09:36:28.470 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(???) e0 preinit fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).mds e1 new map 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout: e1 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout: legacy client fscid: -1 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout: 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout: No filesystems configured 2024-05-27T09:36:28.471 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-27T09:36:28.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-27T09:36:28.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-27T09:36:28.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-27T09:36:28.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-27T09:36:28.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-27T09:36:28.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi072", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Deploying cephadm binary to smithi072 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Added host smithi072 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:36:28.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Deploying cephadm binary to smithi122 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Added host smithi122 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:28.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.782 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/384526467' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/384526467' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Saving service mon spec with placement smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c;count:3 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:28.783 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Deploying daemon mon.c on smithi122 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.a calling monitor election 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/345273053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.c calling monitor election 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:28.784 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: monmap epoch 2 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: last_changed 2024-05-27T09:36:19.550152+0000 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: min_mon_release 19 (squid) 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: election_strategy: 1 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: fsmap 2024-05-27T09:36:28.785 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mgrmap e13: x(active, since 61s) 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: overall HEALTH_OK 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: Deploying daemon mon.b on smithi072 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 ceph-mon[35951]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 bash[35932]: 21c841bd7e4cf76c460eb3413aabd6092772447f83103a7830147357adca3cf7 2024-05-27T09:36:28.786 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:28 smithi072 systemd[1]: Started Ceph mon.b for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:36:29.576 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-27T09:36:29.576 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-05-27T09:36:29.815 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:36:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:36:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: mon.a calling monitor election 2024-05-27T09:36:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: mon.c calling monitor election 2024-05-27T09:36:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: mon.b calling monitor election 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: monmap epoch 3 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: last_changed 2024-05-27T09:36:28.477683+0000 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: min_mon_release 19 (squid) 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: election_strategy: 1 2024-05-27T09:36:33.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: 2: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: fsmap 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: mgrmap e13: x(active, since 70s) 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: overall HEALTH_OK 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:33.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: mon.a calling monitor election 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: mon.c calling monitor election 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: mon.b calling monitor election 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: monmap epoch 3 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: last_changed 2024-05-27T09:36:28.477683+0000 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: min_mon_release 19 (squid) 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: election_strategy: 1 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:36:34.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-05-27T09:36:34.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: 2: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2024-05-27T09:36:34.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: fsmap 2024-05-27T09:36:34.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:34.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: mgrmap e13: x(active, since 70s) 2024-05-27T09:36:34.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: overall HEALTH_OK 2024-05-27T09:36:34.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: mon.a calling monitor election 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: mon.c calling monitor election 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: mon.b calling monitor election 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: monmap epoch 3 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: last_changed 2024-05-27T09:36:28.477683+0000 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: created 2024-05-27T09:34:08.663148+0000 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: min_mon_release 19 (squid) 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: election_strategy: 1 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: 2: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: fsmap 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: osdmap e4: 0 total, 0 up, 0 in 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: mgrmap e13: x(active, since 70s) 2024-05-27T09:36:34.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: overall HEALTH_OK 2024-05-27T09:36:34.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.265+0000 7f9047792700 1 -- 172.21.15.122:0/509767395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 msgr2=0x7f902c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:34.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.265+0000 7f9047792700 1 --2- 172.21.15.122:0/509767395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 0x7f902c005610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9030005fa0 tx=0x7f903000ffc0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.266+0000 7f9047792700 1 -- 172.21.15.122:0/509767395 shutdown_connections 2024-05-27T09:36:34.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.266+0000 7f9047792700 1 --2- 172.21.15.122:0/509767395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 0x7f902c005610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.266+0000 7f9047792700 1 -- 172.21.15.122:0/509767395 >> 172.21.15.122:0/509767395 conn(0x7f90400ff790 msgr2=0x7f9040101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:34.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.266+0000 7f9047792700 1 -- 172.21.15.122:0/509767395 shutdown_connections 2024-05-27T09:36:34.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.266+0000 7f9047792700 1 -- 172.21.15.122:0/509767395 wait complete. 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 Processor -- start 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 -- start start 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 0x7f904019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 0x7f90401a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 0x7f90401a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f904010bbb0 con 0x7f9040103ec0 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f904010ba30 con 0x7f904019c2f0 2024-05-27T09:36:34.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9047792700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f904010bd30 con 0x7f90401a0b20 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9045d2f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 0x7f90401a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9045d2f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 0x7f90401a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55442/0 (socket says 172.21.15.122:55442) 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9045d2f700 1 -- 172.21.15.122:0/354384752 learned_addr learned my addr 172.21.15.122:0/354384752 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9044d2d700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 0x7f90401a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f904552e700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 0x7f904019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9045d2f700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 msgr2=0x7f90401a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9045d2f700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 msgr2=0x7f90401a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9045d2f700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 0x7f90401a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9044d2d700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 msgr2=0x7f90401a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9045d2f700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 0x7f90401a0f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9044d2d700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 msgr2=0x7f90401a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-27T09:36:34.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9044d2d700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 0x7f90401a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.267+0000 7f9044d2d700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 0x7f90401a05e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.268+0000 7f904552e700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 msgr2=0x7f90401a0f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.268+0000 7f904552e700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 0x7f90401a0f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.268+0000 7f904552e700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 msgr2=0x7f90401a05e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.268+0000 7f904552e700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 0x7f90401a05e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.268+0000 7f904552e700 1 -- 172.21.15.122:0/354384752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90401a8890 con 0x7f9040103ec0 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.268+0000 7f904552e700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 0x7f904019bdb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9030005fa0 tx=0x7f9030005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.268+0000 7f90367fc700 1 -- 172.21.15.122:0/354384752 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903001b630 con 0x7f9040103ec0 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.269+0000 7f90367fc700 1 -- 172.21.15.122:0/354384752 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f903001bc80 con 0x7f9040103ec0 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.269+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90401a8ac0 con 0x7f9040103ec0 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.269+0000 7f90367fc700 1 -- 172.21.15.122:0/354384752 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030011710 con 0x7f9040103ec0 2024-05-27T09:36:34.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.269+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90401a9050 con 0x7f9040103ec0 2024-05-27T09:36:34.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.270+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9040064e10 con 0x7f9040103ec0 2024-05-27T09:36:34.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.270+0000 7f90367fc700 1 -- 172.21.15.122:0/354384752 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9030011930 con 0x7f9040103ec0 2024-05-27T09:36:34.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.270+0000 7f90367fc700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f902403e9a0 0x7f9024040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:34.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.270+0000 7f90367fc700 1 -- 172.21.15.122:0/354384752 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f90300550b0 con 0x7f9040103ec0 2024-05-27T09:36:34.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.271+0000 7f9044d2d700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f902403e9a0 0x7f9024040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:34.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.271+0000 7f9044d2d700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f902403e9a0 0x7f9024040eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9040075db0 tx=0x7f903c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:34.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.281+0000 7f90367fc700 1 -- 172.21.15.122:0/354384752 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9030022070 con 0x7f9040103ec0 2024-05-27T09:36:34.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.590+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f90401a9280 con 0x7f9040103ec0 2024-05-27T09:36:34.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.591+0000 7f90367fc700 1 -- 172.21.15.122:0/354384752 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7f9030019e20 con 0x7f9040103ec0 2024-05-27T09:36:34.592 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-27T09:36:34.592 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":3,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","modified":"2024-05-27T09:36:28.477683Z","created":"2024-05-27T09:34:08.663148Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-27T09:36:34.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f902403e9a0 msgr2=0x7f9024040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:34.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f902403e9a0 0x7f9024040eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9040075db0 tx=0x7f903c008040 comp rx=0 tx=0).stop 2024-05-27T09:36:34.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 msgr2=0x7f904019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:34.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 0x7f904019bdb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9030005fa0 tx=0x7f9030005300 comp rx=0 tx=0).stop 2024-05-27T09:36:34.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 shutdown_connections 2024-05-27T09:36:34.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90401a0b20 0x7f90401a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f902403e9a0 0x7f9024040eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9040103ec0 0x7f904019bdb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 --2- 172.21.15.122:0/354384752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f904019c2f0 0x7f90401a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:34.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 >> 172.21.15.122:0/354384752 conn(0x7f90400ff790 msgr2=0x7f9040077110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:34.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 shutdown_connections 2024-05-27T09:36:34.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:34.593+0000 7f9047792700 1 -- 172.21.15.122:0/354384752 wait complete. 2024-05-27T09:36:34.595 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 3 2024-05-27T09:36:34.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:34 smithi071 ceph-mon[31451]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:34.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:34.715 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:34 smithi122 ceph-mon[36436]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:34 smithi072 ceph-mon[35951]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:36:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:35 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/354384752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-27T09:36:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:35 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:35 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:35 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:35 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:35 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:35 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:35.800 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-27T09:36:35.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-05-27T09:36:35.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:35 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/354384752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-27T09:36:35.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:35 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:35 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:35 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:35 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:35.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:35 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:35.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:35 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:36.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:35 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/354384752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-27T09:36:36.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:35 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:36.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:35 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:36.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:35 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:36.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:35 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:36.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:35 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:36.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:35 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:36.185 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: Updating smithi071:/etc/ceph/ceph.conf 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: Updating smithi071:/etc/ceph/ceph.conf 2024-05-27T09:36:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:36:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:36:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: Updating smithi071:/etc/ceph/ceph.conf 2024-05-27T09:36:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:36:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:36:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.629 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:37.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:37.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:37.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:37.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:37.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:37.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:38.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:38.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.320+0000 7f7a2a800700 1 -- 172.21.15.71:0/3822007219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 msgr2=0x7f7a24109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.320+0000 7f7a2a800700 1 --2- 172.21.15.71:0/3822007219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a24109dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009910 tx=0x7f7a18009c20 comp rx=0 tx=0).stop 2024-05-27T09:36:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.320+0000 7f7a2a800700 1 -- 172.21.15.71:0/3822007219 shutdown_connections 2024-05-27T09:36:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.320+0000 7f7a2a800700 1 --2- 172.21.15.71:0/3822007219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a24109dc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.320+0000 7f7a2a800700 1 -- 172.21.15.71:0/3822007219 >> 172.21.15.71:0/3822007219 conn(0x7f7a240ff4a0 msgr2=0x7f7a241018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.320+0000 7f7a2a800700 1 -- 172.21.15.71:0/3822007219 shutdown_connections 2024-05-27T09:36:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.320+0000 7f7a2a800700 1 -- 172.21.15.71:0/3822007219 wait complete. 2024-05-27T09:36:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 Processor -- start 2024-05-27T09:36:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 -- start start 2024-05-27T09:36:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a2419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a2419fc00 0x7f7a241998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a24199e20 0x7f7a2419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2410df00 con 0x7f7a241099b0 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2410dd80 con 0x7f7a24199e20 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a2a800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2410e080 con 0x7f7a2419fc00 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a29400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a2419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a29400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a2419f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32910/0 (socket says 172.21.15.71:32910) 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.322+0000 7f7a29400700 1 -- 172.21.15.71:0/261599230 learned_addr learned my addr 172.21.15.71:0/261599230 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a28a00700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a2419fc00 0x7f7a241998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29e00700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a24199e20 0x7f7a2419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29400700 1 -- 172.21.15.71:0/261599230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a2419fc00 msgr2=0x7f7a241998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29400700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a2419fc00 0x7f7a241998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29400700 1 -- 172.21.15.71:0/261599230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a24199e20 msgr2=0x7f7a2419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29400700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a24199e20 0x7f7a2419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29400700 1 -- 172.21.15.71:0/261599230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a241a6550 con 0x7f7a241099b0 2024-05-27T09:36:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29e00700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a24199e20 0x7f7a2419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:36:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.323+0000 7f7a29400700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a2419f6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a18004f80 tx=0x7f7a18004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.324+0000 7f7a22000700 1 -- 172.21.15.71:0/261599230 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18026070 con 0x7f7a241099b0 2024-05-27T09:36:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.324+0000 7f7a22000700 1 -- 172.21.15.71:0/261599230 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a1800b6f0 con 0x7f7a241099b0 2024-05-27T09:36:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.324+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a241a67e0 con 0x7f7a241099b0 2024-05-27T09:36:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.324+0000 7f7a22000700 1 -- 172.21.15.71:0/261599230 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a180038c0 con 0x7f7a241099b0 2024-05-27T09:36:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.324+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a241a6d40 con 0x7f7a241099b0 2024-05-27T09:36:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.325+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a24064e10 con 0x7f7a241099b0 2024-05-27T09:36:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.325+0000 7f7a22000700 1 -- 172.21.15.71:0/261599230 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f7a18029070 con 0x7f7a241099b0 2024-05-27T09:36:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.326+0000 7f7a22000700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7a0c03e9a0 0x7f7a0c040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.326+0000 7f7a22000700 1 -- 172.21.15.71:0/261599230 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7a180534e0 con 0x7f7a241099b0 2024-05-27T09:36:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.326+0000 7f7a28a00700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7a0c03e9a0 0x7f7a0c040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.327+0000 7f7a28a00700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7a0c03e9a0 0x7f7a0c040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a24102cf0 tx=0x7f7a10009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.332+0000 7f7a22000700 1 -- 172.21.15.71:0/261599230 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7a18013070 con 0x7f7a241099b0 2024-05-27T09:36:38.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.574+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f7a241a6fa0 con 0x7f7a241099b0 2024-05-27T09:36:38.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.574+0000 7f7a22000700 1 -- 172.21.15.71:0/261599230 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f7a1800bbe0 con 0x7f7a241099b0 2024-05-27T09:36:38.575 INFO:teuthology.orchestra.run.smithi071.stdout:# minimal ceph.conf for 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:38.575 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-05-27T09:36:38.575 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:36:38.575 INFO:teuthology.orchestra.run.smithi071.stdout: mon_host = [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2024-05-27T09:36:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.577+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7a0c03e9a0 msgr2=0x7f7a0c040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.577+0000 7f7a2a800700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7a0c03e9a0 0x7f7a0c040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a24102cf0 tx=0x7f7a10009210 comp rx=0 tx=0).stop 2024-05-27T09:36:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.577+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 msgr2=0x7f7a2419f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.577+0000 7f7a2a800700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a2419f6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a18004f80 tx=0x7f7a18004fb0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 shutdown_connections 2024-05-27T09:36:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a24199e20 0x7f7a2419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7a0c03e9a0 0x7f7a0c040eb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241099b0 0x7f7a2419f6c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 --2- 172.21.15.71:0/261599230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a2419fc00 0x7f7a241998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 >> 172.21.15.71:0/261599230 conn(0x7f7a240ff4a0 msgr2=0x7f7a24100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 shutdown_connections 2024-05-27T09:36:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:38.578+0000 7f7a2a800700 1 -- 172.21.15.71:0/261599230 wait complete. 2024-05-27T09:36:38.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:38 smithi071 ceph-mon[31451]: Reconfiguring mon.a (unknown last config time)... 2024-05-27T09:36:38.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:38 smithi071 ceph-mon[31451]: Reconfiguring daemon mon.a on smithi071 2024-05-27T09:36:38.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:38 smithi071 ceph-mon[31451]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:38.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:38 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/261599230' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:38 smithi122 ceph-mon[36436]: Reconfiguring mon.a (unknown last config time)... 2024-05-27T09:36:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:38 smithi122 ceph-mon[36436]: Reconfiguring daemon mon.a on smithi071 2024-05-27T09:36:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:38 smithi122 ceph-mon[36436]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:38 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/261599230' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:38 smithi072 ceph-mon[35951]: Reconfiguring mon.a (unknown last config time)... 2024-05-27T09:36:39.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:38 smithi072 ceph-mon[35951]: Reconfiguring daemon mon.a on smithi071 2024-05-27T09:36:39.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:38 smithi072 ceph-mon[35951]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:39.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:39.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:38 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/261599230' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:39.956 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-27T09:36:39.957 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:36:39.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-05-27T09:36:40.031 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:36:40.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:40.159 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:36:40.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.conf 2024-05-27T09:36:40.187 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:36:40.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:40.250 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:36:40.250 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.conf 2024-05-27T09:36:40.281 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:36:40.282 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:36:40.349 INFO:tasks.cephadm:Adding mgr.x on smithi071 2024-05-27T09:36:40.349 INFO:tasks.cephadm:Adding mgr.y on smithi072 2024-05-27T09:36:40.349 INFO:tasks.cephadm:Adding mgr.z on smithi122 2024-05-27T09:36:40.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi071=x;smithi072=y;smithi122=z' 2024-05-27T09:36:40.621 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:36:40.772 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:40 smithi072 ceph-mon[35951]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:40.772 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:40.772 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:40.772 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:40.772 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:40.772 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:40.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:40 smithi122 ceph-mon[36436]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:40.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:40.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:40.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:40.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:40.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:40 smithi071 ceph-mon[31451]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:41.779 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:41 smithi122 ceph-mon[36436]: Reconfiguring mon.b (monmap changed)... 2024-05-27T09:36:41.779 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:41 smithi122 ceph-mon[36436]: Reconfiguring daemon mon.b on smithi072 2024-05-27T09:36:41.779 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:41.779 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:41.779 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:41.779 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:41.779 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.001+0000 7f1e64536700 1 -- 172.21.15.122:0/3873224731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c1047d0 msgr2=0x7f1e5c106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.001+0000 7f1e64536700 1 --2- 172.21.15.122:0/3873224731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c1047d0 0x7f1e5c106bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009910 tx=0x7f1e58009c20 comp rx=0 tx=0).stop 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.001+0000 7f1e64536700 1 -- 172.21.15.122:0/3873224731 shutdown_connections 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.001+0000 7f1e64536700 1 --2- 172.21.15.122:0/3873224731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c1047d0 0x7f1e5c106bf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.001+0000 7f1e64536700 1 -- 172.21.15.122:0/3873224731 >> 172.21.15.122:0/3873224731 conn(0x7f1e5c0fe210 msgr2=0x7f1e5c1006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.001+0000 7f1e64536700 1 -- 172.21.15.122:0/3873224731 shutdown_connections 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.001+0000 7f1e64536700 1 -- 172.21.15.122:0/3873224731 wait complete. 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 Processor -- start 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 -- start start 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e5c1047d0 0x7f1e5c199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e5c199ec0 0x7f1e5c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:42.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c19f390 0x7f1e5c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c109c90 con 0x7f1e5c19f390 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c109b10 con 0x7f1e5c1047d0 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.002+0000 7f1e64536700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c109e10 con 0x7f1e5c199ec0 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e5c199ec0 0x7f1e5c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e5c199ec0 0x7f1e5c19ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47374/0 (socket says 172.21.15.122:47374) 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 -- 172.21.15.122:0/3650901665 learned_addr learned my addr 172.21.15.122:0/3650901665 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e622d2700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e5c1047d0 0x7f1e5c199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e62ad3700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c19f390 0x7f1e5c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 -- 172.21.15.122:0/3650901665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e5c1047d0 msgr2=0x7f1e5c199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e5c1047d0 0x7f1e5c199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 -- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c19f390 msgr2=0x7f1e5c1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c19f390 0x7f1e5c1a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:42.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 -- 172.21.15.122:0/3650901665 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c1a1d20 con 0x7f1e5c199ec0 2024-05-27T09:36:42.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e61ad1700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e5c199ec0 0x7f1e5c19ee50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00b780 tx=0x7f1e4c00ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:42.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e537fe700 1 -- 172.21.15.122:0/3650901665 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c004230 con 0x7f1e5c199ec0 2024-05-27T09:36:42.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e537fe700 1 -- 172.21.15.122:0/3650901665 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4c0043d0 con 0x7f1e5c199ec0 2024-05-27T09:36:42.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e537fe700 1 -- 172.21.15.122:0/3650901665 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011b20 con 0x7f1e5c199ec0 2024-05-27T09:36:42.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c1a1fb0 con 0x7f1e5c199ec0 2024-05-27T09:36:42.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.003+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c1a24c0 con 0x7f1e5c199ec0 2024-05-27T09:36:42.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.004+0000 7f1e537fe700 1 -- 172.21.15.122:0/3650901665 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f1e4c011cc0 con 0x7f1e5c199ec0 2024-05-27T09:36:42.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.004+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c064e10 con 0x7f1e5c199ec0 2024-05-27T09:36:42.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.005+0000 7f1e537fe700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1e4803e9a0 0x7f1e48040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:42.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.005+0000 7f1e537fe700 1 -- 172.21.15.122:0/3650901665 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1e4c052400 con 0x7f1e5c199ec0 2024-05-27T09:36:42.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.005+0000 7f1e622d2700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1e4803e9a0 0x7f1e48040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:42.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.006+0000 7f1e622d2700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1e4803e9a0 0x7f1e48040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800b5c0 tx=0x7f1e5801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:42.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:41 smithi071 ceph-mon[31451]: Reconfiguring mon.b (monmap changed)... 2024-05-27T09:36:42.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:41 smithi071 ceph-mon[31451]: Reconfiguring daemon mon.b on smithi072 2024-05-27T09:36:42.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:42.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:42.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:42.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:42.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:42.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.010+0000 7f1e537fe700 1 -- 172.21.15.122:0/3650901665 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1e4c020740 con 0x7f1e5c199ec0 2024-05-27T09:36:42.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:41 smithi072 ceph-mon[35951]: Reconfiguring mon.b (monmap changed)... 2024-05-27T09:36:42.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:41 smithi072 ceph-mon[35951]: Reconfiguring daemon mon.b on smithi072 2024-05-27T09:36:42.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:42.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:42.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-27T09:36:42.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-27T09:36:42.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:42.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.230+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi071=x;smithi072=y;smithi122=z", "target": ["mon-mgr", ""]}) -- 0x7f1e5c100080 con 0x7f1e4803e9a0 2024-05-27T09:36:42.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.245+0000 7f1e537fe700 1 -- 172.21.15.122:0/3650901665 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1e5c100080 con 0x7f1e4803e9a0 2024-05-27T09:36:42.247 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mgr update... 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.247+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1e4803e9a0 msgr2=0x7f1e48040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.247+0000 7f1e64536700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1e4803e9a0 0x7f1e48040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800b5c0 tx=0x7f1e5801a040 comp rx=0 tx=0).stop 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.247+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e5c199ec0 msgr2=0x7f1e5c19ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.247+0000 7f1e64536700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e5c199ec0 0x7f1e5c19ee50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00b780 tx=0x7f1e4c00ba90 comp rx=0 tx=0).stop 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 shutdown_connections 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1e4803e9a0 0x7f1e48040eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e5c19f390 0x7f1e5c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e5c1047d0 0x7f1e5c199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 --2- 172.21.15.122:0/3650901665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e5c199ec0 0x7f1e5c19ee50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 >> 172.21.15.122:0/3650901665 conn(0x7f1e5c0fe210 msgr2=0x7f1e5c0ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 shutdown_connections 2024-05-27T09:36:42.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:36:42.248+0000 7f1e64536700 1 -- 172.21.15.122:0/3650901665 wait complete. 2024-05-27T09:36:42.857 DEBUG:teuthology.orchestra.run.smithi072:mgr.y> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.y.service 2024-05-27T09:36:42.860 DEBUG:teuthology.orchestra.run.smithi122:mgr.z> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.z.service 2024-05-27T09:36:42.862 INFO:tasks.cephadm:Deploying OSDs... 2024-05-27T09:36:42.862 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:36:42.863 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T09:36:42.920 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T09:36:42.920 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-05-27T09:36:42.940 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:42 smithi122 ceph-mon[36436]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:42.940 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:42 smithi122 ceph-mon[36436]: Reconfiguring mon.c (monmap changed)... 2024-05-27T09:36:42.940 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:42 smithi122 ceph-mon[36436]: Reconfiguring daemon mon.c on smithi122 2024-05-27T09:36:42.940 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:42.974 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T09:36:42.974 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:42.974 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-05-27T09:36:42.975 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:42.975 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:42.975 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-05-27 09:35:39.831315395 +0000 2024-05-27T09:36:42.975 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-05-27 09:29:40.208960516 +0000 2024-05-27T09:36:42.975 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-05-27 09:29:40.208960516 +0000 2024-05-27T09:36:42.975 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-05-27 09:29:40.208960516 +0000 2024-05-27T09:36:42.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T09:36:43.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:42 smithi071 ceph-mon[31451]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:43.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:42 smithi071 ceph-mon[31451]: Reconfiguring mon.c (monmap changed)... 2024-05-27T09:36:43.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:42 smithi071 ceph-mon[31451]: Reconfiguring daemon mon.c on smithi122 2024-05-27T09:36:43.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:42 smithi072 ceph-mon[35951]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:42 smithi072 ceph-mon[35951]: Reconfiguring mon.c (monmap changed)... 2024-05-27T09:36:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:42 smithi072 ceph-mon[35951]: Reconfiguring daemon mon.c on smithi122 2024-05-27T09:36:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.057 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-05-27T09:36:43.057 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-05-27T09:36:43.057 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000400999 s, 1.3 MB/s 2024-05-27T09:36:43.061 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T09:36:43.161 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-05-27T09:36:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-05-27 09:35:39.882314513 +0000 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-05-27 09:29:40.802950260 +0000 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-05-27 09:29:40.802950260 +0000 2024-05-27T09:36:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-05-27 09:29:40.802950260 +0000 2024-05-27T09:36:43.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T09:36:43.289 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-05-27T09:36:43.289 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-05-27T09:36:43.289 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000307147 s, 1.7 MB/s 2024-05-27T09:36:43.293 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T09:36:43.347 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-05-27 09:35:39.933313630 +0000 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-05-27 09:29:41.424939520 +0000 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-05-27 09:29:41.424939520 +0000 2024-05-27T09:36:43.396 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-05-27 09:29:41.424939520 +0000 2024-05-27T09:36:43.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T09:36:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-05-27T09:36:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-05-27T09:36:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000561837 s, 911 kB/s 2024-05-27T09:36:43.481 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T09:36:43.534 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-05-27T09:36:43.583 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T09:36:43.583 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:43.584 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-27T09:36:43.584 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:43.584 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:43.584 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-05-27 09:35:39.985312730 +0000 2024-05-27T09:36:43.584 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-05-27 09:29:42.015929316 +0000 2024-05-27T09:36:43.584 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-05-27 09:29:42.015929316 +0000 2024-05-27T09:36:43.584 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-05-27 09:29:42.015929316 +0000 2024-05-27T09:36:43.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T09:36:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-05-27T09:36:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-05-27T09:36:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00033201 s, 1.5 MB/s 2024-05-27T09:36:43.659 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T09:36:43.707 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T09:36:43.707 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T09:36:43.726 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T09:36:43.726 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-05-27T09:36:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi071=x;smithi072=y;smithi122=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: Saving service mgr spec with placement smithi071=x;smithi072=y;smithi122=z;count:3 2024-05-27T09:36:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:43.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:43.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-27T09:36:43.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:43.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 662 Links: 1 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 09:36:27.930489297 +0000 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 09:28:11.642167208 +0000 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 09:28:11.642167208 +0000 2024-05-27T09:36:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 09:28:11.642167208 +0000 2024-05-27T09:36:43.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T09:36:43.849 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T09:36:43.849 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T09:36:43.849 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000297788 s, 1.7 MB/s 2024-05-27T09:36:43.850 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T09:36:43.907 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-05-27T09:36:43.963 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T09:36:43.963 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:43.963 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-05-27T09:36:43.963 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:43.963 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:43.964 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 09:36:27.931489277 +0000 2024-05-27T09:36:43.964 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 09:28:11.981160083 +0000 2024-05-27T09:36:43.964 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 09:28:11.981160083 +0000 2024-05-27T09:36:43.964 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 09:28:11.981160083 +0000 2024-05-27T09:36:43.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi071=x;smithi072=y;smithi122=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: Saving service mgr spec with placement smithi071=x;smithi072=y;smithi122=z;count:3 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:44.025 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi071=x;smithi072=y;smithi122=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:44.025 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: Saving service mgr spec with placement smithi071=x;smithi072=y;smithi122=z;count:3 2024-05-27T09:36:44.025 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:44.025 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:44.028 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T09:36:44.028 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T09:36:44.028 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000229179 s, 2.2 MB/s 2024-05-27T09:36:44.029 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T09:36:44.086 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 700 Links: 1 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 09:36:27.931489277 +0000 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 09:28:12.317153020 +0000 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 09:28:12.317153020 +0000 2024-05-27T09:36:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 09:28:12.317153020 +0000 2024-05-27T09:36:44.143 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T09:36:44.205 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T09:36:44.205 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T09:36:44.205 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000175644 s, 2.9 MB/s 2024-05-27T09:36:44.207 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T09:36:44.262 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 09:36:27.931489277 +0000 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 09:28:12.628146507 +0000 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 09:28:12.628146507 +0000 2024-05-27T09:36:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 09:28:12.628146507 +0000 2024-05-27T09:36:44.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T09:36:44.379 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T09:36:44.380 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T09:36:44.380 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000233735 s, 2.2 MB/s 2024-05-27T09:36:44.381 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T09:36:44.437 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-27T09:36:44.437 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T09:36:44.453 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T09:36:44.453 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-27 09:36:18.526342099 +0000 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-27 09:28:10.885409950 +0000 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-27 09:28:10.885409950 +0000 2024-05-27T09:36:44.508 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-27 09:28:10.885409950 +0000 2024-05-27T09:36:44.508 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T09:36:44.571 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-27T09:36:44.571 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-27T09:36:44.571 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000210757 s, 2.4 MB/s 2024-05-27T09:36:44.572 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T09:36:44.628 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-05-27T09:36:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-27 09:36:18.526342099 +0000 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-27 09:28:11.219402185 +0000 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-27 09:28:11.219402185 +0000 2024-05-27T09:36:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-27 09:28:11.219402185 +0000 2024-05-27T09:36:44.683 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T09:36:44.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:44 smithi122 ceph-mon[36436]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:44.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:44 smithi122 ceph-mon[36436]: Deploying daemon mgr.z on smithi122 2024-05-27T09:36:44.745 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-27T09:36:44.745 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-27T09:36:44.745 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000234559 s, 2.2 MB/s 2024-05-27T09:36:44.746 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T09:36:44.801 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-27 09:36:18.526342099 +0000 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-27 09:28:11.557394328 +0000 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-27 09:28:11.557394328 +0000 2024-05-27T09:36:44.855 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-27 09:28:11.557394328 +0000 2024-05-27T09:36:44.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T09:36:44.916 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-27T09:36:44.917 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-27T09:36:44.917 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000179235 s, 2.9 MB/s 2024-05-27T09:36:44.918 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T09:36:44.973 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-05-27T09:36:45.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:44 smithi071 ceph-mon[31451]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:44 smithi071 ceph-mon[31451]: Deploying daemon mgr.z on smithi122 2024-05-27T09:36:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:44 smithi072 ceph-mon[35951]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:44 smithi072 ceph-mon[35951]: Deploying daemon mgr.z on smithi122 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-27 09:36:18.527342077 +0000 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-27 09:28:11.887386656 +0000 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-27 09:28:11.887386656 +0000 2024-05-27T09:36:45.028 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-27 09:28:11.887386656 +0000 2024-05-27T09:36:45.029 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T09:36:45.222 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-27T09:36:45.222 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-27T09:36:45.222 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000201254 s, 2.5 MB/s 2024-05-27T09:36:45.223 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T09:36:45.238 INFO:tasks.cephadm:Deploying osd.0 on smithi071 with /dev/vg_nvme/lv_4... 2024-05-27T09:36:45.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-27T09:36:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:36:45.975 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:45 smithi122 podman[38279]: 2024-05-27 09:36:45.941093136 +0000 UTC m=+0.435302647 container start c4ba584c3e785aba10c1e35c030966f8691aa7fe58b7abf3509d0ca5b8e59051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-27T09:36:46.230 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:45 smithi122 ceph-mgr[38298]: -- 172.21.15.122:0/2775794148 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4181765a0 con 0x55a41cf00000 2024-05-27T09:36:46.230 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:46 smithi122 bash[38279]: c4ba584c3e785aba10c1e35c030966f8691aa7fe58b7abf3509d0ca5b8e59051 2024-05-27T09:36:46.230 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:46 smithi122 systemd[1]: Started Ceph mgr.z for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:36:46.230 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:46.104+0000 7f4f4fd00200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:36:46.660 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:46.288+0000 7f4f4fd00200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:36:46.660 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:46.389+0000 7f4f4fd00200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:36:46.918 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:46.694+0000 7f4f4fd00200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:36:46.918 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:46.779+0000 7f4f4fd00200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:36:46.918 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:46.918 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.918 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.918 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:46.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-27T09:36:46.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:46.919 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:46.931 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:46.931 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.931 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.932 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.932 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:46.932 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-27T09:36:46.932 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:46.932 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:46.953 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:47.764 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:47 smithi122 ceph-mon[36436]: Deploying daemon mgr.y on smithi072 2024-05-27T09:36:47.846 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:47 smithi072 ceph-mon[35951]: Deploying daemon mgr.y on smithi072 2024-05-27T09:36:48.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:47 smithi071 ceph-mon[31451]: Deploying daemon mgr.y on smithi072 2024-05-27T09:36:48.215 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 systemd[1]: Starting Ceph mgr.y for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:36:48.366 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:48.021+0000 7f4f4fd00200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:36:48.366 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:48.193+0000 7f4f4fd00200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:36:48.366 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:48.365+0000 7f4f4fd00200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:36:48.402 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-27T09:36:48.403 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-27T09:36:48.403 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-05-27T09:36:48.403 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-05-27T09:36:48.403 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0358767 s, 292 MB/s 2024-05-27T09:36:48.403 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-05-27T09:36:48.496 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 podman[37305]: 2024-05-27 09:36:48.215043574 +0000 UTC m=+0.109165931 container create 2bd69f4d1afbb5427f1144e680c1bdf5720b58b6b3ad8242f14a511ec351415e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521) 2024-05-27T09:36:48.496 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 podman[37305]: 2024-05-27 09:36:48.123229032 +0000 UTC m=+0.017351361 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:36:48.497 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 podman[37305]: 2024-05-27 09:36:48.419288755 +0000 UTC m=+0.313411069 container init 2bd69f4d1afbb5427f1144e680c1bdf5720b58b6b3ad8242f14a511ec351415e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T09:36:48.497 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 podman[37305]: 2024-05-27 09:36:48.421873296 +0000 UTC m=+0.315995612 container start 2bd69f4d1afbb5427f1144e680c1bdf5720b58b6b3ad8242f14a511ec351415e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True) 2024-05-27T09:36:48.497 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 ceph-mgr[37324]: -- 172.21.15.72:0/1126406174 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd37bc25a0 con 0x55dd3c94c900 2024-05-27T09:36:48.497 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 bash[37305]: 2bd69f4d1afbb5427f1144e680c1bdf5720b58b6b3ad8242f14a511ec351415e 2024-05-27T09:36:48.774 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 systemd[1]: Started Ceph mgr.y for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:36:48.774 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:48.585+0000 7fddb0daf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:36:48.774 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:48.773+0000 7fddb0daf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:36:48.774 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:48 smithi072 ceph-mon[35951]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:48.775 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:48.775 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:48.775 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:48.775 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:48.960 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:48.657+0000 7f4f4fd00200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:36:48.960 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:48.752+0000 7f4f4fd00200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:36:48.960 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:48.959+0000 7f4f4fd00200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:36:48.960 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:48 smithi122 ceph-mon[36436]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:48.961 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:48.961 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:48.961 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:48.961 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:49.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:48 smithi071 ceph-mon[31451]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:49.026 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:48.875+0000 7fddb0daf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:36:49.230 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:49.157+0000 7f4f4fd00200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:36:49.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-05-27T09:36:49.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:49 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:49.196+0000 7fddb0daf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:36:49.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:49 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:49.283+0000 7fddb0daf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:36:49.649 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:36:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:49 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:49.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:49.786+0000 7f4f4fd00200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:36:49.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:49 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:50.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:49 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:50.437 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:50.010+0000 7f4f4fd00200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:36:50.730 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:50.436+0000 7f4f4fd00200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:36:50.730 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:50.530+0000 7f4f4fd00200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:36:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:50.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:50.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:50.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:50.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:50.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:50 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:50.508+0000 7fddb0daf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:36:50.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:50 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:50.673+0000 7fddb0daf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:50.852 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:50.853 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-27T09:36:50.853 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-27T09:36:50.853 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:51.126 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:50 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:50.841+0000 7fddb0daf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:36:51.126 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:51 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:51.125+0000 7fddb0daf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:36:51.230 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:50.893+0000 7f4f4fd00200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:36:51.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:51 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:51.216+0000 7fddb0daf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:36:51.565 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:51.239+0000 7f4f4fd00200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:36:51.566 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:51.328+0000 7f4f4fd00200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:36:51.687 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:51 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:51.415+0000 7fddb0daf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:36:51.687 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:51 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:51.606+0000 7fddb0daf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:36:51.769 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:51 smithi071 ceph-mon[31451]: Reconfiguring mgr.x (unknown last config time)... 2024-05-27T09:36:51.769 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:51 smithi071 ceph-mon[31451]: Reconfiguring daemon mgr.x on smithi071 2024-05-27T09:36:51.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 -- 172.21.15.71:0/2640095123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04076080 msgr2=0x7f1f040764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:51.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2640095123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04076080 0x7f1f040764b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009990 tx=0x7f1ef0009ca0 comp rx=0 tx=0).stop 2024-05-27T09:36:51.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 -- 172.21.15.71:0/2640095123 shutdown_connections 2024-05-27T09:36:51.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2640095123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f0410c020 0x7f1f0410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2640095123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04077670 0x7f1f04075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2640095123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04076080 0x7f1f040764b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 -- 172.21.15.71:0/2640095123 >> 172.21.15.71:0/2640095123 conn(0x7f1f040ff7a0 msgr2=0x7f1f04101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:36:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 -- 172.21.15.71:0/2640095123 shutdown_connections 2024-05-27T09:36:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.768+0000 7f1f08c00700 1 -- 172.21.15.71:0/2640095123 wait complete. 2024-05-27T09:36:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.769+0000 7f1f08c00700 1 Processor -- start 2024-05-27T09:36:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f08c00700 1 -- start start 2024-05-27T09:36:51.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f08c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04076080 0x7f1f04107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:51.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f08c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04077670 0x7f1f04107960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f08c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f0410c020 0x7f1f04103fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f08c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04111e30 con 0x7f1f0410c020 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f08c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04111cb0 con 0x7f1f04077670 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f08c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04111fb0 con 0x7f1f04076080 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f03400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04076080 0x7f1f04107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f02a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04077670 0x7f1f04107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f03400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04076080 0x7f1f04107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:43750/0 (socket says 172.21.15.71:43750) 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f03400700 1 -- 172.21.15.71:0/2136978816 learned_addr learned my addr 172.21.15.71:0/2136978816 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.770+0000 7f1f03e00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f0410c020 0x7f1f04103fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f03400700 1 -- 172.21.15.71:0/2136978816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04077670 msgr2=0x7f1f04107960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f03400700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04077670 0x7f1f04107960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f03400700 1 -- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f0410c020 msgr2=0x7f1f04103fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:36:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f03400700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f0410c020 0x7f1f04103fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:36:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f03400700 1 -- 172.21.15.71:0/2136978816 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f041047d0 con 0x7f1f04076080 2024-05-27T09:36:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f02a00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04077670 0x7f1f04107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:36:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f03e00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f0410c020 0x7f1f04103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:36:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.771+0000 7f1f03400700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04076080 0x7f1f04107420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e9f0 tx=0x7f1ef400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.772+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400cbd0 con 0x7f1f04076080 2024-05-27T09:36:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.772+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ef400cd70 con 0x7f1f04076080 2024-05-27T09:36:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.772+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4005650 con 0x7f1f04076080 2024-05-27T09:36:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.772+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f04104ac0 con 0x7f1f04076080 2024-05-27T09:36:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.772+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f041a9150 con 0x7f1f04076080 2024-05-27T09:36:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.773+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f040512b0 con 0x7f1f04076080 2024-05-27T09:36:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.774+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f1ef4004830 con 0x7f1f04076080 2024-05-27T09:36:51.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.774+0000 7f1efbe00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1ee803e750 0x7f1ee8040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:36:51.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.774+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1ef4052d00 con 0x7f1f04076080 2024-05-27T09:36:51.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.774+0000 7f1f02a00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1ee803e750 0x7f1ee8040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:36:51.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.775+0000 7f1f02a00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1ee803e750 0x7f1ee8040c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000b2e0 tx=0x7f1ef0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:36:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:51.780+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1ef4016570 con 0x7f1f04076080 2024-05-27T09:36:51.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:51 smithi122 ceph-mon[36436]: Reconfiguring mgr.x (unknown last config time)... 2024-05-27T09:36:51.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:51 smithi122 ceph-mon[36436]: Reconfiguring daemon mgr.x on smithi071 2024-05-27T09:36:51.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:51.564+0000 7f4f4fd00200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:36:51.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:51.696+0000 7f4f4fd00200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:36:51.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:51.790+0000 7f4f4fd00200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:36:52.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:51 smithi072 ceph-mon[35951]: Reconfiguring mgr.x (unknown last config time)... 2024-05-27T09:36:52.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:51 smithi072 ceph-mon[35951]: Reconfiguring daemon mgr.x on smithi071 2024-05-27T09:36:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:52.033+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1f04063bf0 con 0x7f1ee803e750 2024-05-27T09:36:52.480 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:52.109+0000 7f4f4fd00200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:36:52.480 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:52.198+0000 7f4f4fd00200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:36:52.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:52 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:52.201+0000 7fddb0daf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:36:52.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:52 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:52.416+0000 7fddb0daf200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:36:52.942 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:52 smithi071 ceph-mon[31451]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:52.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:36:52.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:36:52.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:52.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:52 smithi122 ceph-mon[36436]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:52 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:36:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:52 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:36:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:52 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:52.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:52.789+0000 7f4f4fd00200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:36:53.026 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:52 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:52.836+0000 7fddb0daf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:36:53.026 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:52 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:52.931+0000 7fddb0daf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:36:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:52 smithi072 ceph-mon[35951]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:52 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:36:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:52 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:36:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:52 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:53.479 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:36:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:36:53.004+0000 7f4f4fd00200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:36:53.650 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:53 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:53.299+0000 7fddb0daf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:36:53.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:53.802+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7f1ef401f520 con 0x7f1f04076080 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-27T09:36:53.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: Standby manager daemon z started 2024-05-27T09:36:53.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:36:53.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-27T09:36:53.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:36:53.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.983 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:53 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:53.649+0000 7fddb0daf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:36:53.983 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:53 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:53.741+0000 7fddb0daf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: Standby manager daemon z started 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:36:53.984 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-27T09:36:53.985 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:36:53.985 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:36:53.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:36:53.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: Standby manager daemon z started 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/600891236' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:36:53.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:36:54.276 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:53 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:53.982+0000 7fddb0daf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:36:54.277 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:54.114+0000 7fddb0daf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:36:54.277 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:54.209+0000 7fddb0daf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:36:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:54 smithi122 ceph-mon[36436]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:54 smithi122 ceph-mon[36436]: mgrmap e14: x(active, since 90s), standbys: z 2024-05-27T09:36:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:54 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-27T09:36:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:54 smithi071 ceph-mon[31451]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:54 smithi071 ceph-mon[31451]: mgrmap e14: x(active, since 90s), standbys: z 2024-05-27T09:36:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:54 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-27T09:36:55.026 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:54.538+0000 7fddb0daf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:36:55.026 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:54.628+0000 7fddb0daf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:36:55.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:54 smithi072 ceph-mon[35951]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:55.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:54 smithi072 ceph-mon[35951]: mgrmap e14: x(active, since 90s), standbys: z 2024-05-27T09:36:55.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:54 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-27T09:36:55.296 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:55 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:55.235+0000 7fddb0daf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:36:55.711 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:36:55 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:36:55.473+0000 7fddb0daf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:36:55.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:36:55.723+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mon.1 v2:172.21.15.122:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f1ef401fb10 con 0x7f1f04076080 2024-05-27T09:36:55.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:55 smithi122 ceph-mon[36436]: Standby manager daemon y started 2024-05-27T09:36:55.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:55 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-27T09:36:55.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:55 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:36:55.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:55 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-27T09:36:55.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:55 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:36:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:55 smithi071 ceph-mon[31451]: Standby manager daemon y started 2024-05-27T09:36:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:55 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-27T09:36:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:55 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:36:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:55 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-27T09:36:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:55 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:36:56.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:55 smithi072 ceph-mon[35951]: Standby manager daemon y started 2024-05-27T09:36:56.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:55 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-27T09:36:56.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:55 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:36:56.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:55 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-27T09:36:56.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:55 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2854838509' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2976820297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]: dispatch 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]: dispatch 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]': finished 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: osdmap e5: 1 total, 0 up, 1 in 2024-05-27T09:36:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:56 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2976820297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]: dispatch 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]: dispatch 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]': finished 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: osdmap e5: 1 total, 0 up, 1 in 2024-05-27T09:36:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:56 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:36:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-05-27T09:36:57.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-27T09:36:57.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2976820297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]: dispatch 2024-05-27T09:36:57.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]: dispatch 2024-05-27T09:36:57.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0188f94-bc15-4782-acb2-e6934d1f09b4"}]': finished 2024-05-27T09:36:57.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: osdmap e5: 1 total, 0 up, 1 in 2024-05-27T09:36:57.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:56 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:36:58.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:57 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4123990221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:36:58.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:57 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4123990221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:36:58.219 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:57 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4123990221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:36:59.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:58 smithi071 ceph-mon[31451]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:58 smithi072 ceph-mon[35951]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:36:59.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:58 smithi122 ceph-mon[36436]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:00.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:36:59 smithi071 ceph-mon[31451]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:00.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:36:59 smithi072 ceph-mon[35951]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:00.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:36:59 smithi122 ceph-mon[36436]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:02.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:02 smithi071 ceph-mon[31451]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:02.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:02 smithi122 ceph-mon[36436]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:02.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:02 smithi072 ceph-mon[35951]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:04.385 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:04 smithi071 ceph-mon[31451]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:04.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:04 smithi122 ceph-mon[36436]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:04.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:04 smithi072 ceph-mon[35951]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:06.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:06 smithi071 ceph-mon[31451]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:06.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-27T09:37:06.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:06 smithi122 ceph-mon[36436]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-27T09:37:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:06.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:06 smithi072 ceph-mon[35951]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:06.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-27T09:37:06.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:07.477 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:07 smithi122 ceph-mon[36436]: Deploying daemon osd.0 on smithi071 2024-05-27T09:37:07.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:07 smithi071 ceph-mon[31451]: Deploying daemon osd.0 on smithi071 2024-05-27T09:37:07.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:07 smithi072 ceph-mon[35951]: Deploying daemon osd.0 on smithi071 2024-05-27T09:37:08.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:08 smithi071 ceph-mon[31451]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:08.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:08 smithi122 ceph-mon[36436]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:08 smithi072 ceph-mon[35951]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:10 smithi122 ceph-mon[36436]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:10.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:10 smithi071 ceph-mon[31451]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:10.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:10 smithi072 ceph-mon[35951]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:12 smithi122 ceph-mon[36436]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:12 smithi071 ceph-mon[31451]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:12.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:12 smithi072 ceph-mon[35951]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:14.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:14 smithi071 ceph-mon[31451]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:14.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:14 smithi122 ceph-mon[36436]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:14.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:14 smithi072 ceph-mon[35951]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:16.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:16.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:16.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:16.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:15 smithi071 ceph-mon[31451]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:16.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:16.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:16.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:16.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:15 smithi072 ceph-mon[35951]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:16.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:16.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:16.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:16.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:15 smithi122 ceph-mon[36436]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:18.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:18 smithi071 ceph-mon[31451]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:18 smithi122 ceph-mon[36436]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:18 smithi072 ceph-mon[35951]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:19.355 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.355 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.355 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:19.356 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:19.356 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.356 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:19 smithi071 ceph-mon[31451]: from='osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-27T09:37:19.356 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:19 smithi071 ceph-mon[31451]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-27T09:37:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:19 smithi122 ceph-mon[36436]: from='osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-27T09:37:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:19 smithi122 ceph-mon[36436]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-27T09:37:19.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:19.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:19.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:19.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:19 smithi072 ceph-mon[35951]: from='osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-27T09:37:19.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:19 smithi072 ceph-mon[35951]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-27T09:37:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.329+0000 7f1efbe00700 1 -- 172.21.15.71:0/2136978816 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f04063bf0 con 0x7f1ee803e750 2024-05-27T09:37:20.331 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 0 on host 'smithi071' 2024-05-27T09:37:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1ee803e750 msgr2=0x7f1ee8040c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1ee803e750 0x7f1ee8040c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000b2e0 tx=0x7f1ef0005fb0 comp rx=0 tx=0).stop 2024-05-27T09:37:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04076080 msgr2=0x7f1f04107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04076080 0x7f1f04107420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e9f0 tx=0x7f1ef400ed00 comp rx=0 tx=0).stop 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 shutdown_connections 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1ee803e750 0x7f1ee8040c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f0410c020 0x7f1f04103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f04076080 0x7f1f04107420 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 --2- 172.21.15.71:0/2136978816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f04077670 0x7f1f04107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 >> 172.21.15.71:0/2136978816 conn(0x7f1f040ff7a0 msgr2=0x7f1f04108000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 shutdown_connections 2024-05-27T09:37:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:37:20.333+0000 7f1f08c00700 1 -- 172.21.15.71:0/2136978816 wait complete. 2024-05-27T09:37:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:20 smithi122 ceph-mon[36436]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:20 smithi122 ceph-mon[36436]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-27T09:37:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:20 smithi122 ceph-mon[36436]: from='osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:37:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:20 smithi122 ceph-mon[36436]: osdmap e6: 1 total, 0 up, 1 in 2024-05-27T09:37:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:20 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:20 smithi122 ceph-mon[36436]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:37:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:20 smithi071 ceph-mon[31451]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:20 smithi071 ceph-mon[31451]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-27T09:37:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:20 smithi071 ceph-mon[31451]: from='osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:37:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:20 smithi071 ceph-mon[31451]: osdmap e6: 1 total, 0 up, 1 in 2024-05-27T09:37:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:20 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:20 smithi071 ceph-mon[31451]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:37:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:20 smithi072 ceph-mon[35951]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:20 smithi072 ceph-mon[35951]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-27T09:37:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:20 smithi072 ceph-mon[35951]: from='osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:37:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:20 smithi072 ceph-mon[35951]: osdmap e6: 1 total, 0 up, 1 in 2024-05-27T09:37:20.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:20 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:20.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:20 smithi072 ceph-mon[35951]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:37:21.150 DEBUG:teuthology.orchestra.run.smithi071:osd.0> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.0.service 2024-05-27T09:37:21.156 INFO:tasks.cephadm:Deploying osd.1 on smithi072 with /dev/vg_nvme/lv_4... 2024-05-27T09:37:21.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-27T09:37:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:37:21.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:21 smithi071 ceph-mon[31451]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:37:21.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:21 smithi071 ceph-mon[31451]: osdmap e7: 1 total, 0 up, 1 in 2024-05-27T09:37:21.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:21 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:21.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:21 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:21.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:21 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:21.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:21 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:21.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:21 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:21.416 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:37:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0[46530]: 2024-05-27T09:37:21.290+0000 7feb99a00700 -1 osd.0 0 waiting for initial osdmap 2024-05-27T09:37:21.416 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:37:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0[46530]: 2024-05-27T09:37:21.319+0000 7feb8f800700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:37:21.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:21 smithi122 ceph-mon[36436]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:37:21.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:21 smithi122 ceph-mon[36436]: osdmap e7: 1 total, 0 up, 1 in 2024-05-27T09:37:21.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:21 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:21.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:21 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:21.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:21 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:21.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:21 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:21.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:21 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:21.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:21 smithi072 ceph-mon[35951]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:37:21.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:21 smithi072 ceph-mon[35951]: osdmap e7: 1 total, 0 up, 1 in 2024-05-27T09:37:21.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:21 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:21.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:21 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:21.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:21 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:21.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:21 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:21.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:21 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:22.311 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:22 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:37:22.312 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:22 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:37:22.312 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:22 smithi072 ceph-mon[35951]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:22.312 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:22.312 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:22 smithi072 ceph-mon[35951]: from='osd.0 ' entity='osd.0' 2024-05-27T09:37:22.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:22 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:37:22.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:22 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:37:22.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:22 smithi122 ceph-mon[36436]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:22.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:22.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:22 smithi122 ceph-mon[36436]: from='osd.0 ' entity='osd.0' 2024-05-27T09:37:22.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:22 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:37:22.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:22 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:37:22.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:22 smithi071 ceph-mon[31451]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:22.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:22.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:22 smithi071 ceph-mon[31451]: from='osd.0 ' entity='osd.0' 2024-05-27T09:37:23.128 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-27T09:37:23.128 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-27T09:37:23.128 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-05-27T09:37:23.128 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-05-27T09:37:23.128 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114877 s, 913 MB/s 2024-05-27T09:37:23.129 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-05-27T09:37:23.234 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:23.234 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:23 smithi071 ceph-mon[31451]: osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] boot 2024-05-27T09:37:23.234 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:23 smithi071 ceph-mon[31451]: osdmap e8: 1 total, 1 up, 1 in 2024-05-27T09:37:23.234 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:23.399 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:23.400 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:23 smithi072 ceph-mon[35951]: osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] boot 2024-05-27T09:37:23.400 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:23 smithi072 ceph-mon[35951]: osdmap e8: 1 total, 1 up, 1 in 2024-05-27T09:37:23.400 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:23.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:23.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:23 smithi122 ceph-mon[36436]: osd.0 [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] boot 2024-05-27T09:37:23.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:23 smithi122 ceph-mon[36436]: osdmap e8: 1 total, 1 up, 1 in 2024-05-27T09:37:23.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:37:23.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi072:vg_nvme/lv_4 2024-05-27T09:37:23.952 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:37:24.351 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:24 smithi072 ceph-mon[35951]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:24.351 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:24 smithi072 ceph-mon[35951]: osdmap e9: 1 total, 1 up, 1 in 2024-05-27T09:37:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:24 smithi122 ceph-mon[36436]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:24 smithi122 ceph-mon[36436]: osdmap e9: 1 total, 1 up, 1 in 2024-05-27T09:37:24.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:24 smithi071 ceph-mon[31451]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-27T09:37:24.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:24 smithi071 ceph-mon[31451]: osdmap e9: 1 total, 1 up, 1 in 2024-05-27T09:37:25.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 -- 172.21.15.72:0/771478667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458104370 msgr2=0x7f2458104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 --2- 172.21.15.72:0/771478667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458104370 0x7f2458104780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f244c009990 tx=0x7f244c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 -- 172.21.15.72:0/771478667 shutdown_connections 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 --2- 172.21.15.72:0/771478667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2458104d10 0x7f245810b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 --2- 172.21.15.72:0/771478667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2458103240 0x7f2458103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 --2- 172.21.15.72:0/771478667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458104370 0x7f2458104780 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 -- 172.21.15.72:0/771478667 >> 172.21.15.72:0/771478667 conn(0x7f24580fe880 msgr2=0x7f2458100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 -- 172.21.15.72:0/771478667 shutdown_connections 2024-05-27T09:37:25.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.352+0000 7f245cc8d700 1 -- 172.21.15.72:0/771478667 wait complete. 2024-05-27T09:37:25.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.353+0000 7f245cc8d700 1 Processor -- start 2024-05-27T09:37:25.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.353+0000 7f245cc8d700 1 -- start start 2024-05-27T09:37:25.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.353+0000 7f245cc8d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458103240 0x7f245819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:25.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.353+0000 7f245cc8d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2458104370 0x7f245819af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:25.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.353+0000 7f245cc8d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2458104d10 0x7f24581a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245cc8d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f245810ed90 con 0x7f2458104370 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245cc8d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f245810ec10 con 0x7f2458103240 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245cc8d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f245810ef10 con 0x7f2458104d10 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458103240 0x7f245819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458103240 0x7f245819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55490/0 (socket says 172.21.15.72:55490) 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 -- 172.21.15.72:0/2553522402 learned_addr learned my addr 172.21.15.72:0/2553522402 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f2456d9d700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2458104d10 0x7f24581a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 -- 172.21.15.72:0/2553522402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2458104d10 msgr2=0x7f24581a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2458104d10 0x7f24581a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 -- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2458104370 msgr2=0x7f245819af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2458104370 0x7f245819af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 -- 172.21.15.72:0/2553522402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24581a2580 con 0x7f2458103240 2024-05-27T09:37:25.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245659c700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458103240 0x7f245819aa20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f244800d950 tx=0x7f244800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:37:25.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f24477fe700 1 -- 172.21.15.72:0/2553522402 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448017070 con 0x7f2458103240 2024-05-27T09:37:25.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f24477fe700 1 -- 172.21.15.72:0/2553522402 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244800de30 con 0x7f2458103240 2024-05-27T09:37:25.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24581a2870 con 0x7f2458103240 2024-05-27T09:37:25.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f24477fe700 1 -- 172.21.15.72:0/2553522402 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244800f3c0 con 0x7f2458103240 2024-05-27T09:37:25.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.354+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24581a2de0 con 0x7f2458103240 2024-05-27T09:37:25.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.355+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24580512b0 con 0x7f2458103240 2024-05-27T09:37:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.357+0000 7f24477fe700 1 -- 172.21.15.72:0/2553522402 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f244801a070 con 0x7f2458103240 2024-05-27T09:37:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.357+0000 7f24477fe700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f24400b27f0 0x7f24400b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.358+0000 7f24477fe700 1 -- 172.21.15.72:0/2553522402 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f24480e0090 con 0x7f2458103240 2024-05-27T09:37:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.358+0000 7f2455d9b700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f24400b27f0 0x7f24400b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:37:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.359+0000 7f2455d9b700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f24400b27f0 0x7f24400b4d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f244c0098e0 tx=0x7f244c003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:37:25.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.361+0000 7f24477fe700 1 -- 172.21.15.72:0/2553522402 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2448010460 con 0x7f2458103240 2024-05-27T09:37:25.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:25.574+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f24581008b0 con 0x7f24400b27f0 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:26.422 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:26.423 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:37:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:37:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:37:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:37:26.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:26.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:26.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:26.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:37:26.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:37:26.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:26.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:27.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:27 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi071 2024-05-27T09:37:27.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:27 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi071 to 17089M 2024-05-27T09:37:27.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:27 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi071 2024-05-27T09:37:27.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:27 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi071 to 17089M 2024-05-27T09:37:27.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:27 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi071 2024-05-27T09:37:27.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:27 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi071 to 17089M 2024-05-27T09:37:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:28 smithi122 ceph-mon[36436]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:28 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/1280907252' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]: dispatch 2024-05-27T09:37:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:28 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]: dispatch 2024-05-27T09:37:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:28 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]': finished 2024-05-27T09:37:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:28 smithi122 ceph-mon[36436]: osdmap e10: 2 total, 1 up, 2 in 2024-05-27T09:37:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:28 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:28.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:28 smithi071 ceph-mon[31451]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:28.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:28 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/1280907252' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]: dispatch 2024-05-27T09:37:28.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:28 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]: dispatch 2024-05-27T09:37:28.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:28 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]': finished 2024-05-27T09:37:28.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:28 smithi071 ceph-mon[31451]: osdmap e10: 2 total, 1 up, 2 in 2024-05-27T09:37:28.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:28 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:28 smithi072 ceph-mon[35951]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:28 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/1280907252' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]: dispatch 2024-05-27T09:37:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:28 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]: dispatch 2024-05-27T09:37:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:28 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cc3fd0a-077b-4a70-9463-2793467d8a99"}]': finished 2024-05-27T09:37:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:28 smithi072 ceph-mon[35951]: osdmap e10: 2 total, 1 up, 2 in 2024-05-27T09:37:28.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:29.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:29 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/1719913652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:37:29.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:29 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/1719913652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:37:29.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:29 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/1719913652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:37:30.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:30 smithi122 ceph-mon[36436]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:30.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:30 smithi071 ceph-mon[31451]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:30.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:30 smithi072 ceph-mon[35951]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:32.429 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:32 smithi072 ceph-mon[35951]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:32.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:32 smithi122 ceph-mon[36436]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:32.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:32 smithi071 ceph-mon[31451]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:34.553 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:34 smithi072 ceph-mon[35951]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:34.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:34 smithi122 ceph-mon[36436]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:34.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:34 smithi071 ceph-mon[31451]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:36.382 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:36 smithi072 ceph-mon[35951]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:36.383 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-27T09:37:36.383 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:36.383 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:36 smithi072 ceph-mon[35951]: Deploying daemon osd.1 on smithi072 2024-05-27T09:37:36.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:36 smithi071 ceph-mon[31451]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:36.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-27T09:37:36.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:36.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:36 smithi071 ceph-mon[31451]: Deploying daemon osd.1 on smithi072 2024-05-27T09:37:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:36 smithi122 ceph-mon[36436]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-27T09:37:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:36 smithi122 ceph-mon[36436]: Deploying daemon osd.1 on smithi072 2024-05-27T09:37:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:38 smithi122 ceph-mon[36436]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:38.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:38 smithi071 ceph-mon[31451]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:38.761 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:38 smithi072 ceph-mon[35951]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:40.618 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:40 smithi072 ceph-mon[35951]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:40.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:40 smithi122 ceph-mon[36436]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:40.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:40 smithi071 ceph-mon[31451]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:42.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:42.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:42.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:41 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:42.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:41 smithi122 ceph-mon[36436]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:42.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:42.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:42.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:41 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:42.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:41 smithi071 ceph-mon[31451]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:42.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:42.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:42.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:41 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:42.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:41 smithi072 ceph-mon[35951]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:44.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.364+0000 7f24477fe700 1 -- 172.21.15.72:0/2553522402 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24581008b0 con 0x7f24400b27f0 2024-05-27T09:37:44.366 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 1 on host 'smithi072' 2024-05-27T09:37:44.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f24400b27f0 msgr2=0x7f24400b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:44.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f24400b27f0 0x7f24400b4d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f244c0098e0 tx=0x7f244c003860 comp rx=0 tx=0).stop 2024-05-27T09:37:44.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458103240 msgr2=0x7f245819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:44.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458103240 0x7f245819aa20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f244800d950 tx=0x7f244800dd10 comp rx=0 tx=0).stop 2024-05-27T09:37:44.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 shutdown_connections 2024-05-27T09:37:44.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2458104d10 0x7f24581a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:44.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2458103240 0x7f245819aa20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:44.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f24400b27f0 0x7f24400b4d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:44.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 --2- 172.21.15.72:0/2553522402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2458104370 0x7f245819af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:44.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 >> 172.21.15.72:0/2553522402 conn(0x7f24580fe880 msgr2=0x7f24581001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:37:44.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 shutdown_connections 2024-05-27T09:37:44.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:37:44.366+0000 7f245cc8d700 1 -- 172.21.15.72:0/2553522402 wait complete. 2024-05-27T09:37:44.664 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:44.664 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.664 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.664 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:44.665 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:44.665 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.665 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.665 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.665 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:44.993 DEBUG:teuthology.orchestra.run.smithi072:osd.1> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.1.service 2024-05-27T09:37:44.995 INFO:tasks.cephadm:Deploying osd.2 on smithi122 with /dev/vg_nvme/lv_4... 2024-05-27T09:37:44.996 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:37:45.241 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:37:45.633 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:45 smithi122 ceph-mon[36436]: from='osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-27T09:37:45.634 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:45 smithi122 ceph-mon[36436]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-27T09:37:45.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:45 smithi072 ceph-mon[35951]: from='osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-27T09:37:45.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:45 smithi072 ceph-mon[35951]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-27T09:37:46.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:45 smithi071 ceph-mon[31451]: from='osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-27T09:37:46.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:45 smithi071 ceph-mon[31451]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-27T09:37:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:46 smithi122 ceph-mon[36436]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:46 smithi122 ceph-mon[36436]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-27T09:37:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:46 smithi122 ceph-mon[36436]: from='osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:37:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:46 smithi122 ceph-mon[36436]: osdmap e11: 2 total, 1 up, 2 in 2024-05-27T09:37:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:46.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:46 smithi122 ceph-mon[36436]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:37:47.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:46 smithi071 ceph-mon[31451]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:47.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:46 smithi071 ceph-mon[31451]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-27T09:37:47.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:46 smithi071 ceph-mon[31451]: from='osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:37:47.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:46 smithi071 ceph-mon[31451]: osdmap e11: 2 total, 1 up, 2 in 2024-05-27T09:37:47.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:46 smithi071 ceph-mon[31451]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:37:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:46 smithi072 ceph-mon[35951]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:46 smithi072 ceph-mon[35951]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-27T09:37:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:46 smithi072 ceph-mon[35951]: from='osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:37:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:46 smithi072 ceph-mon[35951]: osdmap e11: 2 total, 1 up, 2 in 2024-05-27T09:37:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:46 smithi072 ceph-mon[35951]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:37:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-27T09:37:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-27T09:37:47.116 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-05-27T09:37:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-05-27T09:37:47.116 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111186 s, 943 MB/s 2024-05-27T09:37:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-05-27T09:37:47.644 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:47 smithi072 ceph-mon[35951]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:37:47.644 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:47 smithi072 ceph-mon[35951]: osdmap e12: 2 total, 1 up, 2 in 2024-05-27T09:37:47.644 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:47 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.645 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:47 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.645 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:47 smithi072 ceph-mon[35951]: from='osd.1 ' entity='osd.1' 2024-05-27T09:37:47.645 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:47 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.645 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:37:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1[40520]: 2024-05-27T09:37:47.468+0000 7fce125fc700 -1 osd.1 0 waiting for initial osdmap 2024-05-27T09:37:47.645 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:37:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1[40520]: 2024-05-27T09:37:47.540+0000 7fce0a3a9700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:37:47.677 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:47 smithi122 ceph-mon[36436]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:37:47.677 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:47 smithi122 ceph-mon[36436]: osdmap e12: 2 total, 1 up, 2 in 2024-05-27T09:37:47.677 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:47 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.677 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:47 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.677 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:47 smithi122 ceph-mon[36436]: from='osd.1 ' entity='osd.1' 2024-05-27T09:37:47.677 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:47 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.704 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_4 2024-05-27T09:37:47.919 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:47 smithi071 ceph-mon[31451]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:37:47.919 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:47 smithi071 ceph-mon[31451]: osdmap e12: 2 total, 1 up, 2 in 2024-05-27T09:37:47.919 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:47 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.919 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:47 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.919 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:47 smithi071 ceph-mon[31451]: from='osd.1 ' entity='osd.1' 2024-05-27T09:37:47.919 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:47 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:47.933 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:37:48.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:48.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:37:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:37:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:37:49.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:49.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:49.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:37:49.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:49.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 -- 172.21.15.122:0/1433646686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf01025d0 msgr2=0x7facf0102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:49.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1433646686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf01025d0 0x7facf0102a20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7facec009990 tx=0x7facec009ca0 comp rx=0 tx=0).stop 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 -- 172.21.15.122:0/1433646686 shutdown_connections 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1433646686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facf0103b90 0x7facf01085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1433646686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf01025d0 0x7facf0102a20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1433646686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facf0103030 0x7facf0103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 -- 172.21.15.122:0/1433646686 >> 172.21.15.122:0/1433646686 conn(0x7facf00fdff0 msgr2=0x7facf01004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 -- 172.21.15.122:0/1433646686 shutdown_connections 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.465+0000 7facf7bcc700 1 -- 172.21.15.122:0/1433646686 wait complete. 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 Processor -- start 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 -- start start 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facf01025d0 0x7facf01a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf0103030 0x7facf01a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:49.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facf0103b90 0x7facf01a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facf0116460 con 0x7facf0103b90 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7facf01162e0 con 0x7facf01025d0 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf7bcc700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facf01165e0 con 0x7facf0103030 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf5167700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf0103030 0x7facf01a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf5167700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf0103030 0x7facf01a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49274/0 (socket says 172.21.15.122:49274) 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf5167700 1 -- 172.21.15.122:0/1192368183 learned_addr learned my addr 172.21.15.122:0/1192368183 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.466+0000 7facf5968700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facf01025d0 0x7facf01a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf5167700 1 -- 172.21.15.122:0/1192368183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facf01025d0 msgr2=0x7facf01a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf5167700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facf01025d0 0x7facf01a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf5167700 1 -- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facf0103b90 msgr2=0x7facf01a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf5167700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facf0103b90 0x7facf01a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:37:49.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf5167700 1 -- 172.21.15.122:0/1192368183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf01a8ae0 con 0x7facf0103030 2024-05-27T09:37:49.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf5167700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf0103030 0x7facf01a14c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7face000d980 tx=0x7face000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:37:49.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7face6ffd700 1 -- 172.21.15.122:0/1192368183 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face0017070 con 0x7facf0103030 2024-05-27T09:37:49.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7face6ffd700 1 -- 172.21.15.122:0/1192368183 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7face0005020 con 0x7facf0103030 2024-05-27T09:37:49.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf01a8dd0 con 0x7facf0103030 2024-05-27T09:37:49.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7face6ffd700 1 -- 172.21.15.122:0/1192368183 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face0009b50 con 0x7facf0103030 2024-05-27T09:37:49.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.467+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf01a92b0 con 0x7facf0103030 2024-05-27T09:37:49.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.468+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf00512b0 con 0x7facf0103030 2024-05-27T09:37:49.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.469+0000 7face6ffd700 1 -- 172.21.15.122:0/1192368183 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7face00051d0 con 0x7facf0103030 2024-05-27T09:37:49.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.470+0000 7face6ffd700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7facdc0b2870 0x7facdc0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:37:49.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.470+0000 7face6ffd700 1 -- 172.21.15.122:0/1192368183 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7face00e0c80 con 0x7facf0103030 2024-05-27T09:37:49.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.471+0000 7facf5968700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7facdc0b2870 0x7facdc0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:37:49.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.472+0000 7facf5968700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7facdc0b2870 0x7facdc0b4d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facec0038a0 tx=0x7facec01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:37:49.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.474+0000 7face6ffd700 1 -- 172.21.15.122:0/1192368183 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7face0020020 con 0x7facf0103030 2024-05-27T09:37:49.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:37:49.687+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7facf0063bf0 con 0x7facdc0b2870 2024-05-27T09:37:49.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:49 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi072 2024-05-27T09:37:49.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:49 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi072 to 17088M 2024-05-27T09:37:49.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:49 smithi122 ceph-mon[36436]: osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] boot 2024-05-27T09:37:49.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:49 smithi122 ceph-mon[36436]: osdmap e13: 2 total, 2 up, 2 in 2024-05-27T09:37:49.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:49 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:50.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:49 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi072 2024-05-27T09:37:50.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:49 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi072 to 17088M 2024-05-27T09:37:50.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:49 smithi071 ceph-mon[31451]: osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] boot 2024-05-27T09:37:50.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:49 smithi071 ceph-mon[31451]: osdmap e13: 2 total, 2 up, 2 in 2024-05-27T09:37:50.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:49 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:49 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi072 2024-05-27T09:37:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:49 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi072 to 17088M 2024-05-27T09:37:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:49 smithi072 ceph-mon[35951]: osd.1 [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] boot 2024-05-27T09:37:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:49 smithi072 ceph-mon[35951]: osdmap e13: 2 total, 2 up, 2 in 2024-05-27T09:37:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:49 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:37:50.942 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:50 smithi122 ceph-mon[36436]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:50.942 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:50 smithi122 ceph-mon[36436]: osdmap e14: 2 total, 2 up, 2 in 2024-05-27T09:37:50.943 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:50 smithi122 ceph-mon[36436]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:37:50.943 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:37:50.943 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:37:50.943 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:50 smithi071 ceph-mon[31451]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:50 smithi071 ceph-mon[31451]: osdmap e14: 2 total, 2 up, 2 in 2024-05-27T09:37:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:50 smithi071 ceph-mon[31451]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:37:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:37:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:37:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:50 smithi072 ceph-mon[35951]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-27T09:37:51.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:50 smithi072 ceph-mon[35951]: osdmap e14: 2 total, 2 up, 2 in 2024-05-27T09:37:51.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:50 smithi072 ceph-mon[35951]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:37:51.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:37:51.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:37:51.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:37:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:52 smithi122 ceph-mon[36436]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:52 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/2961914403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]: dispatch 2024-05-27T09:37:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:52 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]: dispatch 2024-05-27T09:37:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:52 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]': finished 2024-05-27T09:37:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:52 smithi122 ceph-mon[36436]: osdmap e15: 3 total, 2 up, 3 in 2024-05-27T09:37:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:52 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:37:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:52 smithi071 ceph-mon[31451]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:52 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/2961914403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]: dispatch 2024-05-27T09:37:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:52 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]: dispatch 2024-05-27T09:37:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:52 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]': finished 2024-05-27T09:37:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:52 smithi071 ceph-mon[31451]: osdmap e15: 3 total, 2 up, 3 in 2024-05-27T09:37:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:37:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:52 smithi072 ceph-mon[35951]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:52 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/2961914403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]: dispatch 2024-05-27T09:37:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:52 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]: dispatch 2024-05-27T09:37:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:52 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e67be5c-649c-4120-8108-deed9131b2fd"}]': finished 2024-05-27T09:37:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:52 smithi072 ceph-mon[35951]: osdmap e15: 3 total, 2 up, 3 in 2024-05-27T09:37:53.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:52 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:37:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:53 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/3927809132' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:37:54.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:53 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/3927809132' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:37:54.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:53 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/3927809132' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:37:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:54 smithi122 ceph-mon[36436]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:54 smithi071 ceph-mon[31451]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:54 smithi072 ceph-mon[35951]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:56 smithi122 ceph-mon[36436]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:57.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:56 smithi071 ceph-mon[31451]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:56 smithi072 ceph-mon[35951]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:58.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:37:58 smithi122 ceph-mon[36436]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:59.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:37:58 smithi071 ceph-mon[31451]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:37:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:37:58 smithi072 ceph-mon[35951]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:00.812 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:00 smithi122 ceph-mon[36436]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:00.812 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-27T09:38:00.812 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:00.812 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:00 smithi122 ceph-mon[36436]: Deploying daemon osd.2 on smithi122 2024-05-27T09:38:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:00 smithi071 ceph-mon[31451]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-27T09:38:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:00 smithi071 ceph-mon[31451]: Deploying daemon osd.2 on smithi122 2024-05-27T09:38:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:00 smithi072 ceph-mon[35951]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-27T09:38:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:00 smithi072 ceph-mon[35951]: Deploying daemon osd.2 on smithi122 2024-05-27T09:38:02.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:02 smithi122 ceph-mon[36436]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:03.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:02 smithi071 ceph-mon[31451]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:02 smithi072 ceph-mon[35951]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:04.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:04 smithi122 ceph-mon[36436]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:04 smithi071 ceph-mon[31451]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:04 smithi072 ceph-mon[35951]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:06.217 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:05 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:06.217 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:05 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:06.217 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:05 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:06.217 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:05 smithi122 ceph-mon[36436]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:05 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:06.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:05 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:06.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:05 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:06.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:05 smithi071 ceph-mon[31451]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:05 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:05 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:05 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:05 smithi072 ceph-mon[35951]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:08 smithi122 ceph-mon[36436]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:08 smithi071 ceph-mon[31451]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:08.510 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:08 smithi072 ceph-mon[35951]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:08.620 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 2 on host 'smithi122' 2024-05-27T09:38:08.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.618+0000 7face6ffd700 1 -- 172.21.15.122:0/1192368183 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7facf0063bf0 con 0x7facdc0b2870 2024-05-27T09:38:08.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7facdc0b2870 msgr2=0x7facdc0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:08.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7facdc0b2870 0x7facdc0b4d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facec0038a0 tx=0x7facec01a040 comp rx=0 tx=0).stop 2024-05-27T09:38:08.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf0103030 msgr2=0x7facf01a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:08.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf0103030 0x7facf01a14c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7face000d980 tx=0x7face000dc90 comp rx=0 tx=0).stop 2024-05-27T09:38:08.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 shutdown_connections 2024-05-27T09:38:08.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7facdc0b2870 0x7facdc0b4d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:08.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facf0103b90 0x7facf01a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:08.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facf01025d0 0x7facf01a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:08.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 --2- 172.21.15.122:0/1192368183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facf0103030 0x7facf01a14c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:08.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 >> 172.21.15.122:0/1192368183 conn(0x7facf00fdff0 msgr2=0x7facf00fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:38:08.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 shutdown_connections 2024-05-27T09:38:08.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:38:08.621+0000 7facf7bcc700 1 -- 172.21.15.122:0/1192368183 wait complete. 2024-05-27T09:38:09.307 DEBUG:teuthology.orchestra.run.smithi122:osd.2> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.2.service 2024-05-27T09:38:09.310 INFO:tasks.cephadm:Deploying osd.3 on smithi071 with /dev/vg_nvme/lv_3... 2024-05-27T09:38:09.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-27T09:38:09.749 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:38:09.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:09.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:09.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:09.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:09 smithi071 ceph-mon[31451]: from='osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-27T09:38:09.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:09 smithi071 ceph-mon[31451]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-27T09:38:09.859 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:09.859 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:09.859 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:09.859 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:09 smithi122 ceph-mon[36436]: from='osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-27T09:38:09.859 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:09 smithi122 ceph-mon[36436]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-27T09:38:10.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:10.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:10.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:10.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:09 smithi072 ceph-mon[35951]: from='osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-27T09:38:10.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:09 smithi072 ceph-mon[35951]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-27T09:38:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:10 smithi122 ceph-mon[36436]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:10 smithi122 ceph-mon[36436]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-27T09:38:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:10 smithi122 ceph-mon[36436]: from='osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:38:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:10 smithi122 ceph-mon[36436]: osdmap e16: 3 total, 2 up, 3 in 2024-05-27T09:38:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:10 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:10 smithi122 ceph-mon[36436]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:38:10.731 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2[41593]: 2024-05-27T09:38:10.600+0000 7f3e8b5a1700 -1 osd.2 0 waiting for initial osdmap 2024-05-27T09:38:10.731 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2[41593]: 2024-05-27T09:38:10.604+0000 7f3e87356700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:38:10.921 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:10 smithi071 ceph-mon[31451]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:10.921 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:10 smithi071 ceph-mon[31451]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-27T09:38:10.921 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:10 smithi071 ceph-mon[31451]: from='osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:38:10.921 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:10 smithi071 ceph-mon[31451]: osdmap e16: 3 total, 2 up, 3 in 2024-05-27T09:38:10.921 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:10 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:10.922 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:10 smithi071 ceph-mon[31451]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:38:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:10 smithi072 ceph-mon[35951]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:10 smithi072 ceph-mon[35951]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-27T09:38:11.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:10 smithi072 ceph-mon[35951]: from='osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:38:11.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:10 smithi072 ceph-mon[35951]: osdmap e16: 3 total, 2 up, 3 in 2024-05-27T09:38:11.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:10 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:11.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:10 smithi072 ceph-mon[35951]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:38:11.819 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:11 smithi122 ceph-mon[36436]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:38:11.819 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:11 smithi122 ceph-mon[36436]: osdmap e17: 3 total, 2 up, 3 in 2024-05-27T09:38:11.819 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:11.819 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:11 smithi071 ceph-mon[31451]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:11 smithi071 ceph-mon[31451]: osdmap e17: 3 total, 2 up, 3 in 2024-05-27T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:11 smithi072 ceph-mon[35951]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:38:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:11 smithi072 ceph-mon[35951]: osdmap e17: 3 total, 2 up, 3 in 2024-05-27T09:38:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-27T09:38:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-27T09:38:12.498 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-05-27T09:38:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-05-27T09:38:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0329691 s, 318 MB/s 2024-05-27T09:38:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-05-27T09:38:12.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] boot 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: osdmap e18: 3 total, 3 up, 3 in 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:12.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:12.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:38:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:38:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] boot 2024-05-27T09:38:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: osdmap e18: 3 total, 3 up, 3 in 2024-05-27T09:38:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:12.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:12.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:12.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:12.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:12.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:12.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: osd.2 [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] boot 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: osdmap e18: 3 total, 3 up, 3 in 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:13.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:13.350 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-05-27T09:38:13.781 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:38:13.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:13 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi122 2024-05-27T09:38:13.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:13 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi122 to 17088M 2024-05-27T09:38:13.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:13 smithi071 ceph-mon[31451]: osdmap e19: 3 total, 3 up, 3 in 2024-05-27T09:38:13.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-27T09:38:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:13 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi122 2024-05-27T09:38:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:13 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi122 to 17088M 2024-05-27T09:38:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:13 smithi122 ceph-mon[36436]: osdmap e19: 3 total, 3 up, 3 in 2024-05-27T09:38:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-27T09:38:14.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:13 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi122 2024-05-27T09:38:14.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:13 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi122 to 17088M 2024-05-27T09:38:14.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:13 smithi072 ceph-mon[35951]: osdmap e19: 3 total, 3 up, 3 in 2024-05-27T09:38:14.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-27T09:38:14.955 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:14 smithi071 ceph-mon[31451]: pgmap v94: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:14.955 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-27T09:38:14.955 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:14 smithi071 ceph-mon[31451]: osdmap e20: 3 total, 3 up, 3 in 2024-05-27T09:38:14.955 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T09:38:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:14 smithi122 ceph-mon[36436]: pgmap v94: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-27T09:38:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:14 smithi122 ceph-mon[36436]: osdmap e20: 3 total, 3 up, 3 in 2024-05-27T09:38:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T09:38:15.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:14 smithi072 ceph-mon[35951]: pgmap v94: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:15.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-27T09:38:15.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:14 smithi072 ceph-mon[35951]: osdmap e20: 3 total, 3 up, 3 in 2024-05-27T09:38:15.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T09:38:15.246 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51178]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-27T09:38:15.247 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51178]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.247 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51178]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.247 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51178]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.247 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51195]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-27T09:38:15.247 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51195]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.247 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51195]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.247 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51195]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51199]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-27T09:38:15.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51199]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51199]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44510]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44510]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44510]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44513]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44513]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44513]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.527 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44513]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45667]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-27T09:38:15.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45667]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45667]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45667]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45670]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-27T09:38:15.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45670]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45670]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45670]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.684 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-27T09:38:15.684 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.684 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45661]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.684 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45661]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.684 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45664]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-27T09:38:15.684 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.685 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45664]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.685 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 09:38:15 smithi122 sudo[45664]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.772 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51205]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-27T09:38:15.772 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51205]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:15.772 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51205]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:15.773 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 sudo[51205]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:15.773 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-27T09:38:15.773 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: osdmap e21: 3 total, 3 up, 3 in 2024-05-27T09:38:15.773 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:15.773 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:15.773 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:15.774 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:15.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:15.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:15.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:15.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:15.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:15.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:15.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:15 smithi071 ceph-mon[31451]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:15.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 -- 172.21.15.71:0/3371756950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c105460 msgr2=0x7fab5c105870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 --2- 172.21.15.71:0/3371756950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c105460 0x7fab5c105870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab48009990 tx=0x7fab48009ca0 comp rx=0 tx=0).stop 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 -- 172.21.15.71:0/3371756950 shutdown_connections 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 --2- 172.21.15.71:0/3371756950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab5c105e00 0x7fab5c10c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 --2- 172.21.15.71:0/3371756950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c104330 0x7fab5c104740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 --2- 172.21.15.71:0/3371756950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c105460 0x7fab5c105870 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 -- 172.21.15.71:0/3371756950 >> 172.21.15.71:0/3371756950 conn(0x7fab5c0ff970 msgr2=0x7fab5c101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 -- 172.21.15.71:0/3371756950 shutdown_connections 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.916+0000 7fab62800700 1 -- 172.21.15.71:0/3371756950 wait complete. 2024-05-27T09:38:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 Processor -- start 2024-05-27T09:38:15.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 -- start start 2024-05-27T09:38:15.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c104330 0x7fab5c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:15.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab5c105460 0x7fab5c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:15.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c105e00 0x7fab5c1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:15.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c10fda0 con 0x7fab5c105460 2024-05-27T09:38:15.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c10fc20 con 0x7fab5c104330 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.918+0000 7fab62800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c10ff20 con 0x7fab5c105e00 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5aa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab5c105460 0x7fab5c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c105e00 0x7fab5c1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c104330 0x7fab5c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c105e00 0x7fab5c1a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:52124/0 (socket says 172.21.15.71:52124) 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c104330 0x7fab5c19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:48802/0 (socket says 172.21.15.71:48802) 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 -- 172.21.15.71:0/3471067961 learned_addr learned my addr 172.21.15.71:0/3471067961 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 -- 172.21.15.71:0/3471067961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c104330 msgr2=0x7fab5c19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c104330 0x7fab5c19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 -- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab5c105460 msgr2=0x7fab5c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab5c105460 0x7fab5c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:15.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 -- 172.21.15.71:0/3471067961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c1a2410 con 0x7fab5c105e00 2024-05-27T09:38:15.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.919+0000 7fab5be00700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c105e00 0x7fab5c1a1d90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fab5400ef30 tx=0x7fab5400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:38:15.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.920+0000 7fab53e00700 1 -- 172.21.15.71:0/3471067961 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab540092e0 con 0x7fab5c105e00 2024-05-27T09:38:15.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.920+0000 7fab53e00700 1 -- 172.21.15.71:0/3471067961 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab54004bb0 con 0x7fab5c105e00 2024-05-27T09:38:15.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.920+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c1a26a0 con 0x7fab5c105e00 2024-05-27T09:38:15.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.920+0000 7fab53e00700 1 -- 172.21.15.71:0/3471067961 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54004020 con 0x7fab5c105e00 2024-05-27T09:38:15.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.920+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c1a2be0 con 0x7fab5c105e00 2024-05-27T09:38:15.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.921+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5c0512b0 con 0x7fab5c105e00 2024-05-27T09:38:15.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.923+0000 7fab53e00700 1 -- 172.21.15.71:0/3471067961 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fab5401b030 con 0x7fab5c105e00 2024-05-27T09:38:15.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.925+0000 7fab53e00700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fab400b2900 0x7fab400b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:15.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.925+0000 7fab53e00700 1 -- 172.21.15.71:0/3471067961 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3237+0+0 (secure 0 0 0) 0x7fab540e0950 con 0x7fab5c105e00 2024-05-27T09:38:15.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.925+0000 7fab5b400700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fab400b2900 0x7fab400b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:38:15.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.926+0000 7fab5b400700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fab400b2900 0x7fab400b4e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab5c105360 tx=0x7fab4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:38:15.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:15.929+0000 7fab53e00700 1 -- 172.21.15.71:0/3471067961 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fab54022020 con 0x7fab5c105e00 2024-05-27T09:38:15.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-27T09:38:15.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: osdmap e21: 3 total, 3 up, 3 in 2024-05-27T09:38:15.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:15.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:15.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:15.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:15 smithi122 ceph-mon[36436]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:16.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44516]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-27T09:38:16.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44516]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:16.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44516]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:16.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44516]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44519]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 sudo[44519]: pam_unix(sudo:session): session closed for user root 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: osdmap e21: 3 total, 3 up, 3 in 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:16.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:16.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-27T09:38:16.030 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:38:16.030 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:38:16.030 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:38:16.030 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:15 smithi072 ceph-mon[35951]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-27T09:38:16.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:16.172+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fab5c063bf0 con 0x7fab400b2900 2024-05-27T09:38:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:16 smithi071 ceph-mon[31451]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:16 smithi071 ceph-mon[31451]: osdmap e22: 3 total, 3 up, 3 in 2024-05-27T09:38:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:16 smithi071 ceph-mon[31451]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-27T09:38:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:38:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:38:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:16 smithi122 ceph-mon[36436]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:16 smithi122 ceph-mon[36436]: osdmap e22: 3 total, 3 up, 3 in 2024-05-27T09:38:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:16 smithi122 ceph-mon[36436]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-27T09:38:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:38:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:38:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:17.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:16 smithi072 ceph-mon[35951]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:16 smithi072 ceph-mon[35951]: osdmap e22: 3 total, 3 up, 3 in 2024-05-27T09:38:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:16 smithi072 ceph-mon[35951]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-27T09:38:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:38:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:38:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:17.949 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:17 smithi071 ceph-mon[31451]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:38:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:17 smithi122 ceph-mon[36436]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:38:18.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:17 smithi072 ceph-mon[35951]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:38:18.916 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:18 smithi071 ceph-mon[31451]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:18.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:18 smithi122 ceph-mon[36436]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:18 smithi072 ceph-mon[35951]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:20.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:20 smithi071 ceph-mon[31451]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:20.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:20 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/284044949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a813baa5-456d-4d6c-9c1f-3ff8f850ecba"}]: dispatch 2024-05-27T09:38:20.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:20 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/284044949' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a813baa5-456d-4d6c-9c1f-3ff8f850ecba"}]': finished 2024-05-27T09:38:20.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:20 smithi071 ceph-mon[31451]: osdmap e23: 4 total, 3 up, 4 in 2024-05-27T09:38:20.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:20 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:20 smithi122 ceph-mon[36436]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:20 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/284044949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a813baa5-456d-4d6c-9c1f-3ff8f850ecba"}]: dispatch 2024-05-27T09:38:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:20 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/284044949' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a813baa5-456d-4d6c-9c1f-3ff8f850ecba"}]': finished 2024-05-27T09:38:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:20 smithi122 ceph-mon[36436]: osdmap e23: 4 total, 3 up, 4 in 2024-05-27T09:38:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:20 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:20 smithi072 ceph-mon[35951]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:20 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/284044949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a813baa5-456d-4d6c-9c1f-3ff8f850ecba"}]: dispatch 2024-05-27T09:38:21.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:20 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/284044949' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a813baa5-456d-4d6c-9c1f-3ff8f850ecba"}]': finished 2024-05-27T09:38:21.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:20 smithi072 ceph-mon[35951]: osdmap e23: 4 total, 3 up, 4 in 2024-05-27T09:38:21.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:20 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:22.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:21 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1385704833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:38:22.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:21 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1385704833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:38:22.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:21 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1385704833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:38:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:22 smithi122 ceph-mon[36436]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:23.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:22 smithi071 ceph-mon[31451]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:22 smithi072 ceph-mon[35951]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:23 smithi122 ceph-mon[36436]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:24.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:23 smithi071 ceph-mon[31451]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:24.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:23 smithi072 ceph-mon[35951]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:26.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:26 smithi071 ceph-mon[31451]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:26.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:26 smithi122 ceph-mon[36436]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:26.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:26 smithi072 ceph-mon[35951]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:28.370 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:28 smithi071 ceph-mon[31451]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:28.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:28 smithi122 ceph-mon[36436]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:28.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:28 smithi072 ceph-mon[35951]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:30.380 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:30 smithi071 ceph-mon[31451]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:30.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:30 smithi122 ceph-mon[36436]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:30.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:30 smithi072 ceph-mon[35951]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:31.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:31 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-27T09:38:31.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:31 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:31.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:31 smithi071 ceph-mon[31451]: Deploying daemon osd.3 on smithi071 2024-05-27T09:38:31.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:31 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-27T09:38:31.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:31 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:31.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:31 smithi122 ceph-mon[36436]: Deploying daemon osd.3 on smithi071 2024-05-27T09:38:31.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:31 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-27T09:38:31.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:31 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:31.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:31 smithi072 ceph-mon[35951]: Deploying daemon osd.3 on smithi071 2024-05-27T09:38:32.446 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:32 smithi071 ceph-mon[31451]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:32.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:32 smithi122 ceph-mon[36436]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:32.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:32 smithi072 ceph-mon[35951]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:34.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:34 smithi122 ceph-mon[36436]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:34.493 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:34 smithi071 ceph-mon[31451]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:34.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:34 smithi072 ceph-mon[35951]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:36.223 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:36 smithi071 ceph-mon[31451]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:36.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:36 smithi122 ceph-mon[36436]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:36.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:36 smithi072 ceph-mon[35951]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:38.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:38 smithi071 ceph-mon[31451]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:38.469 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:38 smithi122 ceph-mon[36436]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:38.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:38 smithi072 ceph-mon[35951]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:40.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:40 smithi071 ceph-mon[31451]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:40.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:40.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:40.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:40 smithi122 ceph-mon[36436]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:40.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:41.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:40 smithi072 ceph-mon[35951]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:41.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:41.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:41.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:42.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:42 smithi071 ceph-mon[31451]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:42 smithi122 ceph-mon[36436]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:42 smithi072 ceph-mon[35951]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:44 smithi122 ceph-mon[36436]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:44 smithi122 ceph-mon[36436]: from='osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-27T09:38:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:44 smithi122 ceph-mon[36436]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-27T09:38:44.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:44 smithi071 ceph-mon[31451]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:44 smithi071 ceph-mon[31451]: from='osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-27T09:38:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:44 smithi071 ceph-mon[31451]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-27T09:38:44.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:44 smithi072 ceph-mon[35951]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:44.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:44.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:44.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:44 smithi072 ceph-mon[35951]: from='osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-27T09:38:44.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:44 smithi072 ceph-mon[35951]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-27T09:38:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.280+0000 7fab53e00700 1 -- 172.21.15.71:0/3471067961 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fab5c063bf0 con 0x7fab400b2900 2024-05-27T09:38:45.281 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 3 on host 'smithi071' 2024-05-27T09:38:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fab400b2900 msgr2=0x7fab400b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fab400b2900 0x7fab400b4e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab5c105360 tx=0x7fab4c009260 comp rx=0 tx=0).stop 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c105e00 msgr2=0x7fab5c1a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c105e00 0x7fab5c1a1d90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fab5400ef30 tx=0x7fab5400c3a0 comp rx=0 tx=0).stop 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 shutdown_connections 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c105e00 0x7fab5c1a1d90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab5c104330 0x7fab5c19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fab400b2900 0x7fab400b4e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 --2- 172.21.15.71:0/3471067961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab5c105460 0x7fab5c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 >> 172.21.15.71:0/3471067961 conn(0x7fab5c0ff970 msgr2=0x7fab5c108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 shutdown_connections 2024-05-27T09:38:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:38:45.284+0000 7fab62800700 1 -- 172.21.15.71:0/3471067961 wait complete. 2024-05-27T09:38:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-27T09:38:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: from='osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:38:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: osdmap e24: 4 total, 3 up, 4 in 2024-05-27T09:38:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:45.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:45 smithi071 ceph-mon[31451]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:38:45.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:45.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:45.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:45.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-27T09:38:45.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: from='osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:38:45.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: osdmap e24: 4 total, 3 up, 4 in 2024-05-27T09:38:45.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:45.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:45 smithi072 ceph-mon[35951]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:38:45.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:45.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:45.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:45.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-27T09:38:45.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: from='osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:38:45.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: osdmap e24: 4 total, 3 up, 4 in 2024-05-27T09:38:45.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:45.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:45 smithi122 ceph-mon[36436]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:38:46.015 DEBUG:teuthology.orchestra.run.smithi071:osd.3> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.3.service 2024-05-27T09:38:46.019 INFO:tasks.cephadm:Deploying osd.4 on smithi072 with /dev/vg_nvme/lv_3... 2024-05-27T09:38:46.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-27T09:38:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: osdmap e25: 4 total, 3 up, 4 in 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:46.380 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:46.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:46.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:38:46.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: osdmap e25: 4 total, 3 up, 4 in 2024-05-27T09:38:46.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:46.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:46.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-27T09:38:46.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:38:46.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:46.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:46.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:38:46.742 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: osdmap e25: 4 total, 3 up, 4 in 2024-05-27T09:38:46.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:46.743 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:47.743 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:47 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:38:47.743 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:47 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:38:47.743 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:47 smithi071 ceph-mon[31451]: osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] boot 2024-05-27T09:38:47.743 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:47 smithi071 ceph-mon[31451]: osdmap e26: 4 total, 4 up, 4 in 2024-05-27T09:38:47.743 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:47 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:47 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:38:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:47 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:38:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:47 smithi122 ceph-mon[36436]: osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] boot 2024-05-27T09:38:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:47 smithi122 ceph-mon[36436]: osdmap e26: 4 total, 4 up, 4 in 2024-05-27T09:38:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:47 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:48.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:47 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:38:48.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:47 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:38:48.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:47 smithi072 ceph-mon[35951]: osd.3 [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] boot 2024-05-27T09:38:48.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:47 smithi072 ceph-mon[35951]: osdmap e26: 4 total, 4 up, 4 in 2024-05-27T09:38:48.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:47 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:38:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-27T09:38:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-27T09:38:48.078 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-05-27T09:38:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-05-27T09:38:48.078 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113929 s, 920 MB/s 2024-05-27T09:38:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-05-27T09:38:48.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi072:vg_nvme/lv_3 2024-05-27T09:38:48.939 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:38:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:48 smithi122 ceph-mon[36436]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:38:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:48 smithi122 ceph-mon[36436]: osdmap e27: 4 total, 4 up, 4 in 2024-05-27T09:38:49.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:48 smithi071 ceph-mon[31451]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:38:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:48 smithi071 ceph-mon[31451]: osdmap e27: 4 total, 4 up, 4 in 2024-05-27T09:38:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:48 smithi072 ceph-mon[35951]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:38:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:48 smithi072 ceph-mon[35951]: osdmap e27: 4 total, 4 up, 4 in 2024-05-27T09:38:49.912 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:49 smithi072 ceph-mon[35951]: osdmap e28: 4 total, 4 up, 4 in 2024-05-27T09:38:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:49 smithi122 ceph-mon[36436]: osdmap e28: 4 total, 4 up, 4 in 2024-05-27T09:38:50.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:49 smithi071 ceph-mon[31451]: osdmap e28: 4 total, 4 up, 4 in 2024-05-27T09:38:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 -- 172.21.15.72:0/3249387967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 msgr2=0x7f5428102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 --2- 172.21.15.72:0/3249387967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f5428102de0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5418009990 tx=0x7f5418009ca0 comp rx=0 tx=0).stop 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 -- 172.21.15.72:0/3249387967 shutdown_connections 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 --2- 172.21.15.72:0/3249387967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54281044a0 0x7f542810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 --2- 172.21.15.72:0/3249387967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f5428102de0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 --2- 172.21.15.72:0/3249387967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5428103b00 0x7f5428103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 -- 172.21.15.72:0/3249387967 >> 172.21.15.72:0/3249387967 conn(0x7f54280fe010 msgr2=0x7f54281004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 -- 172.21.15.72:0/3249387967 shutdown_connections 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 -- 172.21.15.72:0/3249387967 wait complete. 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.392+0000 7f542dde1700 1 Processor -- start 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f542dde1700 1 -- start start 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f542dde1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f542819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f542dde1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5428103b00 0x7f542819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f542dde1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54281044a0 0x7f54281a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f542dde1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f542810fe60 con 0x7f5428103b00 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f542dde1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f542810fce0 con 0x7f54281029d0 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f542dde1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f542810ffe0 con 0x7f54281044a0 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f542819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f542819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54368/0 (socket says 172.21.15.72:54368) 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 -- 172.21.15.72:0/1095586030 learned_addr learned my addr 172.21.15.72:0/1095586030 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f5427fff700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54281044a0 0x7f54281a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 -- 172.21.15.72:0/1095586030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54281044a0 msgr2=0x7f54281a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54281044a0 0x7f54281a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 -- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5428103b00 msgr2=0x7f542819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5428103b00 0x7f542819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.393+0000 7f54277fe700 1 -- 172.21.15.72:0/1095586030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54281a2520 con 0x7f54281029d0 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.394+0000 7f54277fe700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f542819a9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f54180057c0 tx=0x7f54180057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.394+0000 7f5424ff9700 1 -- 172.21.15.72:0/1095586030 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418027070 con 0x7f54281029d0 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.394+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54281a27b0 con 0x7f54281029d0 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.394+0000 7f5424ff9700 1 -- 172.21.15.72:0/1095586030 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5418004000 con 0x7f54281029d0 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.394+0000 7f5424ff9700 1 -- 172.21.15.72:0/1095586030 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418022c30 con 0x7f54281029d0 2024-05-27T09:38:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.394+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281a2c00 con 0x7f54281029d0 2024-05-27T09:38:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.395+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54280512b0 con 0x7f54281029d0 2024-05-27T09:38:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.396+0000 7f5424ff9700 1 -- 172.21.15.72:0/1095586030 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f541802a070 con 0x7f54281029d0 2024-05-27T09:38:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.397+0000 7f5424ff9700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f54100b2880 0x7f54100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:38:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.397+0000 7f5424ff9700 1 -- 172.21.15.72:0/1095586030 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f54180e22f0 con 0x7f54281029d0 2024-05-27T09:38:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.398+0000 7f5426ffd700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f54100b2880 0x7f54100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:38:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.398+0000 7f5426ffd700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f54100b2880 0x7f54100b4d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f542819ba70 tx=0x7f541c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:38:50.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.401+0000 7f5424ff9700 1 -- 172.21.15.72:0/1095586030 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5418013070 con 0x7f54281029d0 2024-05-27T09:38:50.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:38:50.610+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5428063bf0 con 0x7f54100b2880 2024-05-27T09:38:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:50 smithi122 ceph-mon[36436]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:38:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:38:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:38:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:50 smithi071 ceph-mon[31451]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:38:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:38:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:38:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:50 smithi072 ceph-mon[35951]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:38:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:38:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:38:51.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi071 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi071 to 8544M 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:51.907 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:51 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:51.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi071 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi071 to 8544M 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:51.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:51 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:52.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:38:52.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi071 2024-05-27T09:38:52.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:52.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:52.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:52.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:38:52.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi071 to 8544M 2024-05-27T09:38:52.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:52.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:38:52.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:38:52.011 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:51 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:38:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:52 smithi071 ceph-mon[31451]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-27T09:38:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:52 smithi072 ceph-mon[35951]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-27T09:38:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:52 smithi122 ceph-mon[36436]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-27T09:38:54.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:53 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/2369524982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]: dispatch 2024-05-27T09:38:54.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:53 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]: dispatch 2024-05-27T09:38:54.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:53 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]': finished 2024-05-27T09:38:54.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:53 smithi071 ceph-mon[31451]: osdmap e29: 5 total, 4 up, 5 in 2024-05-27T09:38:54.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:38:54.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:53 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/2369524982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]: dispatch 2024-05-27T09:38:54.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:53 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]: dispatch 2024-05-27T09:38:54.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:53 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]': finished 2024-05-27T09:38:54.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:53 smithi072 ceph-mon[35951]: osdmap e29: 5 total, 4 up, 5 in 2024-05-27T09:38:54.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:38:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:53 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/2369524982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]: dispatch 2024-05-27T09:38:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:53 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]: dispatch 2024-05-27T09:38:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:53 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48ad0f18-5577-4ed4-b5d7-ee731834d30c"}]': finished 2024-05-27T09:38:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:53 smithi122 ceph-mon[36436]: osdmap e29: 5 total, 4 up, 5 in 2024-05-27T09:38:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:38:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:54 smithi071 ceph-mon[31451]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-27T09:38:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:54 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/889823706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:38:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:54 smithi072 ceph-mon[35951]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-27T09:38:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:54 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/889823706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:38:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:54 smithi122 ceph-mon[36436]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-27T09:38:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:54 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/889823706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:38:57.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:56 smithi071 ceph-mon[31451]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-27T09:38:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:56 smithi072 ceph-mon[35951]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-27T09:38:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:56 smithi122 ceph-mon[36436]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-27T09:38:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:58 smithi072 ceph-mon[35951]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-27T09:38:59.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:58 smithi122 ceph-mon[36436]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-27T09:38:59.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:58 smithi071 ceph-mon[31451]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-27T09:39:00.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:38:59 smithi072 ceph-mon[35951]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:00.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:38:59 smithi122 ceph-mon[36436]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:00.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:38:59 smithi071 ceph-mon[31451]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:01.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-27T09:39:01.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:01.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:00 smithi072 ceph-mon[35951]: Deploying daemon osd.4 on smithi072 2024-05-27T09:39:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-27T09:39:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:00 smithi122 ceph-mon[36436]: Deploying daemon osd.4 on smithi072 2024-05-27T09:39:01.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-27T09:39:01.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:01.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:00 smithi071 ceph-mon[31451]: Deploying daemon osd.4 on smithi072 2024-05-27T09:39:02.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:01 smithi072 ceph-mon[35951]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:01 smithi122 ceph-mon[36436]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:02.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:01 smithi071 ceph-mon[31451]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:04.397 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:04 smithi072 ceph-mon[35951]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:04.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:04 smithi122 ceph-mon[36436]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:04.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:04 smithi071 ceph-mon[31451]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:06 smithi072 ceph-mon[35951]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:06.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:06.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:06 smithi122 ceph-mon[36436]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:06 smithi071 ceph-mon[31451]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:07.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:07 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:07.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:07 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:07.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:07 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:08.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:08 smithi122 ceph-mon[36436]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:08.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:08 smithi071 ceph-mon[31451]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:08 smithi072 ceph-mon[35951]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.793+0000 7f5424ff9700 1 -- 172.21.15.72:0/1095586030 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5428063bf0 con 0x7f54100b2880 2024-05-27T09:39:09.795 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 4 on host 'smithi072' 2024-05-27T09:39:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.795+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f54100b2880 msgr2=0x7f54100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.795+0000 7f542dde1700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f54100b2880 0x7f54100b4d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f542819ba70 tx=0x7f541c006d20 comp rx=0 tx=0).stop 2024-05-27T09:39:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.795+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 msgr2=0x7f542819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.795+0000 7f542dde1700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f542819a9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f54180057c0 tx=0x7f54180057f0 comp rx=0 tx=0).stop 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 shutdown_connections 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54281044a0 0x7f54281a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54281029d0 0x7f542819a9c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f54100b2880 0x7f54100b4d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 --2- 172.21.15.72:0/1095586030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5428103b00 0x7f542819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 >> 172.21.15.72:0/1095586030 conn(0x7f54280fe010 msgr2=0x7f5428106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 shutdown_connections 2024-05-27T09:39:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:39:09.796+0000 7f542dde1700 1 -- 172.21.15.72:0/1095586030 wait complete. 2024-05-27T09:39:09.992 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:09.993 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:09.993 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:09.993 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:09.993 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:09.993 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:09.993 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:09.993 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:10.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:10.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:10.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:10.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:10.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:10.384 DEBUG:teuthology.orchestra.run.smithi072:osd.4> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.4.service 2024-05-27T09:39:10.386 INFO:tasks.cephadm:Deploying osd.5 on smithi122 with /dev/vg_nvme/lv_3... 2024-05-27T09:39:10.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-27T09:39:10.628 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:39:11.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:10 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:11.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:10 smithi072 ceph-mon[35951]: from='osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-27T09:39:11.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:10 smithi072 ceph-mon[35951]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-27T09:39:11.028 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:10 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:11.028 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:10 smithi122 ceph-mon[36436]: from='osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-27T09:39:11.028 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:10 smithi122 ceph-mon[36436]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-27T09:39:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:10 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:10 smithi071 ceph-mon[31451]: from='osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-27T09:39:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:10 smithi071 ceph-mon[31451]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-27T09:39:11.919 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:11 smithi072 ceph-mon[35951]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-27T09:39:11.920 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:11 smithi072 ceph-mon[35951]: osdmap e30: 5 total, 4 up, 5 in 2024-05-27T09:39:11.920 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:11.920 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:11 smithi072 ceph-mon[35951]: from='osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:39:11.920 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:11 smithi072 ceph-mon[35951]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:39:11.920 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:11 smithi072 ceph-mon[35951]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:11.920 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 09:39:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T09:39:11.832+0000 7f04fb3d6700 -1 osd.4 0 waiting for initial osdmap 2024-05-27T09:39:11.921 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 09:39:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T09:39:11.839+0000 7f04f718b700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:39:12.041 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:11 smithi122 ceph-mon[36436]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-27T09:39:12.041 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:11 smithi122 ceph-mon[36436]: osdmap e30: 5 total, 4 up, 5 in 2024-05-27T09:39:12.041 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:12.041 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:11 smithi122 ceph-mon[36436]: from='osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:39:12.042 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:11 smithi122 ceph-mon[36436]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:39:12.042 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:11 smithi122 ceph-mon[36436]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:12.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:11 smithi071 ceph-mon[31451]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-27T09:39:12.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:11 smithi071 ceph-mon[31451]: osdmap e30: 5 total, 4 up, 5 in 2024-05-27T09:39:12.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:12.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:11 smithi071 ceph-mon[31451]: from='osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:39:12.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:11 smithi071 ceph-mon[31451]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:39:12.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:11 smithi071 ceph-mon[31451]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:12.573 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-27T09:39:12.573 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-27T09:39:12.573 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-05-27T09:39:12.573 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-05-27T09:39:12.573 INFO:teuthology.orchestra.run.smithi122.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110362 s, 950 MB/s 2024-05-27T09:39:12.573 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 2024-05-27T09:39:12.573 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-05-27T09:39:13.119 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:12 smithi072 ceph-mon[35951]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:39:13.119 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:12 smithi072 ceph-mon[35951]: osdmap e31: 5 total, 4 up, 5 in 2024-05-27T09:39:13.119 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:13.119 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:13.138 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:12 smithi122 ceph-mon[36436]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:39:13.138 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:12 smithi122 ceph-mon[36436]: osdmap e31: 5 total, 4 up, 5 in 2024-05-27T09:39:13.138 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:13.138 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:13.164 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_3 2024-05-27T09:39:13.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:12 smithi071 ceph-mon[31451]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:39:13.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:12 smithi071 ceph-mon[31451]: osdmap e31: 5 total, 4 up, 5 in 2024-05-27T09:39:13.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:13.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:13.398 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:39:14.194 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] boot 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: osdmap e32: 5 total, 5 up, 5 in 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi072 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:14.195 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:14.196 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi072 to 8544M 2024-05-27T09:39:14.196 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.196 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:14.196 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:14.196 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] boot 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: osdmap e32: 5 total, 5 up, 5 in 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi072 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:14.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:14.261 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi072 to 8544M 2024-05-27T09:39:14.261 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.261 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:14.261 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:14.261 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: osd.4 [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] boot 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: osdmap e32: 5 total, 5 up, 5 in 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-27T09:39:14.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi072 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi072 to 8544M 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:14.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 -- 172.21.15.122:0/2759586342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105e10 msgr2=0x7fc0c410c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 --2- 172.21.15.122:0/2759586342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105e10 0x7fc0c410c6c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009990 tx=0x7fc0b4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 -- 172.21.15.122:0/2759586342 shutdown_connections 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 --2- 172.21.15.122:0/2759586342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105e10 0x7fc0c410c6c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 --2- 172.21.15.122:0/2759586342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0c4104340 0x7fc0c4104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 --2- 172.21.15.122:0/2759586342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0c4105470 0x7fc0c4105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 -- 172.21.15.122:0/2759586342 >> 172.21.15.122:0/2759586342 conn(0x7fc0c40ff980 msgr2=0x7fc0c4101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 -- 172.21.15.122:0/2759586342 shutdown_connections 2024-05-27T09:39:15.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.001+0000 7fc0caea4700 1 -- 172.21.15.122:0/2759586342 wait complete. 2024-05-27T09:39:15.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 Processor -- start 2024-05-27T09:39:15.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 -- start start 2024-05-27T09:39:15.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0c4104340 0x7fc0c419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:15.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105470 0x7fc0c419af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:15.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0c4105e10 0x7fc0c41a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:15.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c410fea0 con 0x7fc0c4105e10 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c410fd20 con 0x7fc0c4104340 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0caea4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4110020 con 0x7fc0c4105470 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0c3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105470 0x7fc0c419af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0c3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105470 0x7fc0c419af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40936/0 (socket says 172.21.15.122:40936) 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.002+0000 7fc0c3fff700 1 -- 172.21.15.122:0/1204120955 learned_addr learned my addr 172.21.15.122:0/1204120955 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c8c40700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0c4104340 0x7fc0c419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c3fff700 1 -- 172.21.15.122:0/1204120955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0c4104340 msgr2=0x7fc0c419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c3fff700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0c4104340 0x7fc0c419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c3fff700 1 -- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0c4105e10 msgr2=0x7fc0c41a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c3fff700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0c4105e10 0x7fc0c41a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c3fff700 1 -- 172.21.15.122:0/1204120955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c41a2520 con 0x7fc0c4105470 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c3fff700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105470 0x7fc0c419af00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b530 tx=0x7fc0b800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:39:15.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c1ffb700 1 -- 172.21.15.122:0/1204120955 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8015020 con 0x7fc0c4105470 2024-05-27T09:39:15.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c1ffb700 1 -- 172.21.15.122:0/1204120955 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b8011ce0 con 0x7fc0c4105470 2024-05-27T09:39:15.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c41a2810 con 0x7fc0c4105470 2024-05-27T09:39:15.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0c1ffb700 1 -- 172.21.15.122:0/1204120955 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8010d20 con 0x7fc0c4105470 2024-05-27T09:39:15.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.003+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c41a2dd0 con 0x7fc0c4105470 2024-05-27T09:39:15.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.004+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c40512b0 con 0x7fc0c4105470 2024-05-27T09:39:15.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.006+0000 7fc0c1ffb700 1 -- 172.21.15.122:0/1204120955 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc0b8018020 con 0x7fc0c4105470 2024-05-27T09:39:15.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.006+0000 7fc0c1ffb700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc0ac0b2880 0x7fc0ac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:15.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.006+0000 7fc0c1ffb700 1 -- 172.21.15.122:0/1204120955 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7fc0b80e09e0 con 0x7fc0c4105470 2024-05-27T09:39:15.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.007+0000 7fc0c8c40700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc0ac0b2880 0x7fc0ac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:39:15.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.008+0000 7fc0c8c40700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc0ac0b2880 0x7fc0ac0b4d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4105370 tx=0x7fc0bc0094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:39:15.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.011+0000 7fc0c1ffb700 1 -- 172.21.15.122:0/1204120955 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc0b801f020 con 0x7fc0c4105470 2024-05-27T09:39:15.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:15.224+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc0c4063bf0 con 0x7fc0ac0b2880 2024-05-27T09:39:15.226 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:14 smithi122 ceph-mon[36436]: osdmap e33: 5 total, 5 up, 5 in 2024-05-27T09:39:15.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:14 smithi071 ceph-mon[31451]: osdmap e33: 5 total, 5 up, 5 in 2024-05-27T09:39:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:14 smithi072 ceph-mon[35951]: osdmap e33: 5 total, 5 up, 5 in 2024-05-27T09:39:16.167 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:15 smithi122 ceph-mon[36436]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:16.167 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:15 smithi122 ceph-mon[36436]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:39:16.167 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:39:16.168 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:39:16.168 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:15 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:16.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:15 smithi071 ceph-mon[31451]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:16.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:15 smithi071 ceph-mon[31451]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:39:16.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:39:16.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:39:16.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:15 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:16.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:15 smithi072 ceph-mon[35951]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:16.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:15 smithi072 ceph-mon[35951]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:39:16.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:39:16.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:39:16.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:15 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:18 smithi122 ceph-mon[36436]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:18 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/1787545429' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]: dispatch 2024-05-27T09:39:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:18 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]: dispatch 2024-05-27T09:39:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:18 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]': finished 2024-05-27T09:39:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:18 smithi122 ceph-mon[36436]: osdmap e34: 6 total, 5 up, 6 in 2024-05-27T09:39:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:18 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:18.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:18 smithi071 ceph-mon[31451]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:18.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:18 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/1787545429' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]: dispatch 2024-05-27T09:39:18.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:18 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]: dispatch 2024-05-27T09:39:18.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:18 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]': finished 2024-05-27T09:39:18.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:18 smithi071 ceph-mon[31451]: osdmap e34: 6 total, 5 up, 6 in 2024-05-27T09:39:18.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:18 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:18 smithi072 ceph-mon[35951]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:18 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/1787545429' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]: dispatch 2024-05-27T09:39:18.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:18 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]: dispatch 2024-05-27T09:39:18.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:18 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d87f6a2-4ba3-46be-8f09-2e33f90b49dc"}]': finished 2024-05-27T09:39:18.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:18 smithi072 ceph-mon[35951]: osdmap e34: 6 total, 5 up, 6 in 2024-05-27T09:39:18.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:18 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:19.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:19 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/2168924232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:39:19.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:19 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/2168924232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:39:19.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:19 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/2168924232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:39:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:20 smithi122 ceph-mon[36436]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:20 smithi071 ceph-mon[31451]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:20 smithi072 ceph-mon[35951]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:22.403 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:22 smithi122 ceph-mon[36436]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:22.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:22 smithi071 ceph-mon[31451]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:22.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:22 smithi072 ceph-mon[35951]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:24.467 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:24 smithi122 ceph-mon[36436]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:24.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:24 smithi071 ceph-mon[31451]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:24.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:24 smithi072 ceph-mon[35951]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:25.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:25 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-27T09:39:25.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:25 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:25.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:25 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-27T09:39:25.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:25 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:25.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:25 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-27T09:39:25.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:25 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:26.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:26 smithi122 ceph-mon[36436]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:26.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:26 smithi122 ceph-mon[36436]: Deploying daemon osd.5 on smithi122 2024-05-27T09:39:26.428 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:26 smithi072 ceph-mon[35951]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:26.428 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:26 smithi072 ceph-mon[35951]: Deploying daemon osd.5 on smithi122 2024-05-27T09:39:26.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:26 smithi071 ceph-mon[31451]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:26.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:26 smithi071 ceph-mon[31451]: Deploying daemon osd.5 on smithi122 2024-05-27T09:39:28.330 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:28 smithi122 ceph-mon[36436]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:28.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:28 smithi071 ceph-mon[31451]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:28.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:28 smithi072 ceph-mon[35951]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:30.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:30 smithi122 ceph-mon[36436]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:30.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:30 smithi071 ceph-mon[31451]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:30.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:30 smithi072 ceph-mon[35951]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:31.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:31 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:31.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:31 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:31.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:31 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:31.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:31 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:31.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:31 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:31.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:31 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:32.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:31 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:32.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:31 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:32.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:31 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:32.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:32 smithi122 ceph-mon[36436]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:33.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:32 smithi071 ceph-mon[31451]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:33.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:32 smithi072 ceph-mon[35951]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:33.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.912+0000 7fc0c1ffb700 1 -- 172.21.15.122:0/1204120955 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc0c4063bf0 con 0x7fc0ac0b2880 2024-05-27T09:39:33.913 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 5 on host 'smithi122' 2024-05-27T09:39:33.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc0ac0b2880 msgr2=0x7fc0ac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:33.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc0ac0b2880 0x7fc0ac0b4d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4105370 tx=0x7fc0bc0094f0 comp rx=0 tx=0).stop 2024-05-27T09:39:33.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105470 msgr2=0x7fc0c419af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105470 0x7fc0c419af00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b530 tx=0x7fc0b800b8f0 comp rx=0 tx=0).stop 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 shutdown_connections 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc0ac0b2880 0x7fc0ac0b4d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0c4105e10 0x7fc0c41a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0c4104340 0x7fc0c419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 --2- 172.21.15.122:0/1204120955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0c4105470 0x7fc0c419af00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.914+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 >> 172.21.15.122:0/1204120955 conn(0x7fc0c40ff980 msgr2=0x7fc0c41086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.915+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 shutdown_connections 2024-05-27T09:39:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:39:33.915+0000 7fc0caea4700 1 -- 172.21.15.122:0/1204120955 wait complete. 2024-05-27T09:39:34.515 DEBUG:teuthology.orchestra.run.smithi122:osd.5> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.5.service 2024-05-27T09:39:34.517 INFO:tasks.cephadm:Deploying osd.6 on smithi071 with /dev/vg_nvme/lv_2... 2024-05-27T09:39:34.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-27T09:39:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:34 smithi071 ceph-mon[31451]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:34 smithi071 ceph-mon[31451]: from='osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-27T09:39:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:34 smithi071 ceph-mon[31451]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-27T09:39:34.828 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:34 smithi122 ceph-mon[36436]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:34.828 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.828 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.828 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.828 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:34.829 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:34 smithi122 ceph-mon[36436]: from='osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-27T09:39:34.829 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:34 smithi122 ceph-mon[36436]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-27T09:39:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:39:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:34 smithi072 ceph-mon[35951]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:34 smithi072 ceph-mon[35951]: from='osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-27T09:39:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:34 smithi072 ceph-mon[35951]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-27T09:39:36.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:35 smithi071 ceph-mon[31451]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-27T09:39:36.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:35 smithi071 ceph-mon[31451]: from='osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:39:36.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:35 smithi071 ceph-mon[31451]: osdmap e35: 6 total, 5 up, 6 in 2024-05-27T09:39:36.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:35 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:36.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:35 smithi071 ceph-mon[31451]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:39:36.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:35 smithi071 ceph-mon[31451]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:36.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:35 smithi122 ceph-mon[36436]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-27T09:39:36.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:35 smithi122 ceph-mon[36436]: from='osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:39:36.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:35 smithi122 ceph-mon[36436]: osdmap e35: 6 total, 5 up, 6 in 2024-05-27T09:39:36.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:35 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:36.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:35 smithi122 ceph-mon[36436]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:39:36.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:35 smithi122 ceph-mon[36436]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:36.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:35 smithi072 ceph-mon[35951]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-27T09:39:36.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:35 smithi072 ceph-mon[35951]: from='osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:39:36.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:35 smithi072 ceph-mon[35951]: osdmap e35: 6 total, 5 up, 6 in 2024-05-27T09:39:36.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:35 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:36.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:35 smithi072 ceph-mon[35951]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:39:36.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:35 smithi072 ceph-mon[35951]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-27T09:39:37.076 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:36 smithi122 ceph-mon[36436]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:39:37.076 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:36 smithi122 ceph-mon[36436]: osdmap e36: 6 total, 5 up, 6 in 2024-05-27T09:39:37.076 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:37.076 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:36 smithi122 ceph-mon[36436]: from='osd.5 ' entity='osd.5' 2024-05-27T09:39:37.077 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:36 smithi122 ceph-mon[36436]: osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] boot 2024-05-27T09:39:37.077 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:36 smithi122 ceph-mon[36436]: osdmap e37: 6 total, 6 up, 6 in 2024-05-27T09:39:37.077 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:37.077 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 09:39:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T09:39:36.888+0000 7f2f921cf700 -1 osd.5 0 waiting for initial osdmap 2024-05-27T09:39:37.077 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 09:39:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T09:39:36.924+0000 7f2f89f7c700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:39:37.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:36 smithi071 ceph-mon[31451]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:39:37.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:36 smithi071 ceph-mon[31451]: osdmap e36: 6 total, 5 up, 6 in 2024-05-27T09:39:37.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:37.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:36 smithi071 ceph-mon[31451]: from='osd.5 ' entity='osd.5' 2024-05-27T09:39:37.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:36 smithi071 ceph-mon[31451]: osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] boot 2024-05-27T09:39:37.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:36 smithi071 ceph-mon[31451]: osdmap e37: 6 total, 6 up, 6 in 2024-05-27T09:39:37.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:37.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:36 smithi072 ceph-mon[35951]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:39:37.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:36 smithi072 ceph-mon[35951]: osdmap e36: 6 total, 5 up, 6 in 2024-05-27T09:39:37.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:37.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:36 smithi072 ceph-mon[35951]: from='osd.5 ' entity='osd.5' 2024-05-27T09:39:37.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:36 smithi072 ceph-mon[35951]: osd.5 [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] boot 2024-05-27T09:39:37.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:36 smithi072 ceph-mon[35951]: osdmap e37: 6 total, 6 up, 6 in 2024-05-27T09:39:37.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:39:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-27T09:39:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-27T09:39:37.864 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-05-27T09:39:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-05-27T09:39:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0565726 s, 185 MB/s 2024-05-27T09:39:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-05-27T09:39:38.697 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:39:38.697 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:39:38.697 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:38.697 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi122 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi122 to 8544M 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:38.698 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.699 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:38 smithi072 ceph-mon[35951]: osdmap e38: 6 total, 6 up, 6 in 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi122 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:38.712 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi122 to 8544M 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:38 smithi071 ceph-mon[31451]: osdmap e38: 6 total, 6 up, 6 in 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi122 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:39:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi122 to 8544M 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:39:38.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:38 smithi122 ceph-mon[36436]: osdmap e38: 6 total, 6 up, 6 in 2024-05-27T09:39:38.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-05-27T09:39:39.231 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:39:40.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:39 smithi122 ceph-mon[36436]: osdmap e39: 6 total, 6 up, 6 in 2024-05-27T09:39:40.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:39 smithi122 ceph-mon[36436]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:40.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:39 smithi071 ceph-mon[31451]: osdmap e39: 6 total, 6 up, 6 in 2024-05-27T09:39:40.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:39 smithi071 ceph-mon[31451]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:40.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:39 smithi072 ceph-mon[35951]: osdmap e39: 6 total, 6 up, 6 in 2024-05-27T09:39:40.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:39 smithi072 ceph-mon[35951]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:41.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:41 smithi071 ceph-mon[31451]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-27T09:39:41.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:41 smithi122 ceph-mon[36436]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-27T09:39:41.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:41 smithi072 ceph-mon[35951]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 -- 172.21.15.71:0/613014301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 msgr2=0x7f7c7410c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 --2- 172.21.15.71:0/613014301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 0x7f7c7410c6b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00b0a0 tx=0x7f7c6c00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 -- 172.21.15.71:0/613014301 shutdown_connections 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 --2- 172.21.15.71:0/613014301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 0x7f7c7410c6b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 --2- 172.21.15.71:0/613014301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74104330 0x7f7c74104740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 --2- 172.21.15.71:0/613014301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74105460 0x7f7c74105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 -- 172.21.15.71:0/613014301 >> 172.21.15.71:0/613014301 conn(0x7f7c740ff9b0 msgr2=0x7f7c74101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 -- 172.21.15.71:0/613014301 shutdown_connections 2024-05-27T09:39:41.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.661+0000 7f7c7a000700 1 -- 172.21.15.71:0/613014301 wait complete. 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.662+0000 7f7c7a000700 1 Processor -- start 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.662+0000 7f7c7a000700 1 -- start start 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.662+0000 7f7c7a000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74104330 0x7f7c7419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c7a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74105460 0x7f7c7419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c7a000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 0x7f7c741a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c7a000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410fde0 con 0x7f7c74105e00 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c7a000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410fc60 con 0x7f7c74105460 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c7a000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410ff60 con 0x7f7c74104330 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74104330 0x7f7c7419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:39:41.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 0x7f7c741a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74104330 0x7f7c7419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39952/0 (socket says 172.21.15.71:39952) 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 -- 172.21.15.71:0/1945743531 learned_addr learned my addr 172.21.15.71:0/1945743531 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c72a00700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74105460 0x7f7c7419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 -- 172.21.15.71:0/1945743531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74105460 msgr2=0x7f7c7419ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74105460 0x7f7c7419ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 -- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 msgr2=0x7f7c741a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 0x7f7c741a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.663+0000 7f7c73400700 1 -- 172.21.15.71:0/1945743531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c741a2420 con 0x7f7c74104330 2024-05-27T09:39:41.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.664+0000 7f7c73400700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74104330 0x7f7c7419a8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400e940 tx=0x7f7c6400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:39:41.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.664+0000 7f7c6be00700 1 -- 172.21.15.71:0/1945743531 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64004220 con 0x7f7c74104330 2024-05-27T09:39:41.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.664+0000 7f7c6be00700 1 -- 172.21.15.71:0/1945743531 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c640043c0 con 0x7f7c74104330 2024-05-27T09:39:41.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.664+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c741a2710 con 0x7f7c74104330 2024-05-27T09:39:41.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.664+0000 7f7c6be00700 1 -- 172.21.15.71:0/1945743531 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64003c60 con 0x7f7c74104330 2024-05-27T09:39:41.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.664+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741a2ca0 con 0x7f7c74104330 2024-05-27T09:39:41.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.665+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c740512b0 con 0x7f7c74104330 2024-05-27T09:39:41.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.668+0000 7f7c6be00700 1 -- 172.21.15.71:0/1945743531 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7c6400c7e0 con 0x7f7c74104330 2024-05-27T09:39:41.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.669+0000 7f7c6be00700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7c580b2900 0x7f7c580b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:39:41.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.670+0000 7f7c6be00700 1 -- 172.21.15.71:0/1945743531 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7f7c640e15c0 con 0x7f7c74104330 2024-05-27T09:39:41.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.670+0000 7f7c72a00700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7c580b2900 0x7f7c580b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:39:41.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.670+0000 7f7c72a00700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7c580b2900 0x7f7c580b4e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c7419b970 tx=0x7f7c60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:39:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.672+0000 7f7c6be00700 1 -- 172.21.15.71:0/1945743531 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7c640aa190 con 0x7f7c74104330 2024-05-27T09:39:41.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:39:41.913+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7c74063bf0 con 0x7f7c580b2900 2024-05-27T09:39:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:42 smithi122 ceph-mon[36436]: pgmap v158: 1 pgs: 1 active+recovery_wait+degraded; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-05-27T09:39:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:39:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:39:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:42 smithi071 ceph-mon[31451]: pgmap v158: 1 pgs: 1 active+recovery_wait+degraded; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-05-27T09:39:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:39:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:39:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:42.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:42 smithi072 ceph-mon[35951]: pgmap v158: 1 pgs: 1 active+recovery_wait+degraded; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-05-27T09:39:42.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:39:42.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:39:42.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:43.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:43 smithi122 ceph-mon[36436]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:39:43.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:43 smithi071 ceph-mon[31451]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:39:43.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:43 smithi072 ceph-mon[35951]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:39:44.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:44 smithi071 ceph-mon[31451]: pgmap v159: 1 pgs: 1 active+recovery_wait+degraded; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-05-27T09:39:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:44 smithi122 ceph-mon[36436]: pgmap v159: 1 pgs: 1 active+recovery_wait+degraded; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-05-27T09:39:44.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:44 smithi072 ceph-mon[35951]: pgmap v159: 1 pgs: 1 active+recovery_wait+degraded; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-05-27T09:39:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:45 smithi071 ceph-mon[31451]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-27T09:39:45.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:45 smithi071 ceph-mon[31451]: Cluster is now healthy 2024-05-27T09:39:45.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:45 smithi072 ceph-mon[35951]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-27T09:39:45.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:45 smithi072 ceph-mon[35951]: Cluster is now healthy 2024-05-27T09:39:45.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:45 smithi122 ceph-mon[36436]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-27T09:39:45.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:45 smithi122 ceph-mon[36436]: Cluster is now healthy 2024-05-27T09:39:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:46 smithi071 ceph-mon[31451]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:39:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:46 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3797952239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]: dispatch 2024-05-27T09:39:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:46 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]: dispatch 2024-05-27T09:39:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:46 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]': finished 2024-05-27T09:39:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:46 smithi071 ceph-mon[31451]: osdmap e40: 7 total, 6 up, 7 in 2024-05-27T09:39:46.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:39:46.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:46 smithi072 ceph-mon[35951]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:39:46.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:46 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3797952239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]: dispatch 2024-05-27T09:39:46.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:46 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]: dispatch 2024-05-27T09:39:46.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:46 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]': finished 2024-05-27T09:39:46.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:46 smithi072 ceph-mon[35951]: osdmap e40: 7 total, 6 up, 7 in 2024-05-27T09:39:46.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:39:46.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:46 smithi122 ceph-mon[36436]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:39:46.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:46 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3797952239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]: dispatch 2024-05-27T09:39:46.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:46 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]: dispatch 2024-05-27T09:39:46.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:46 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5c500cb-9e6e-4e19-86a4-854af29aa3c7"}]': finished 2024-05-27T09:39:46.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:46 smithi122 ceph-mon[36436]: osdmap e40: 7 total, 6 up, 7 in 2024-05-27T09:39:46.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:39:47.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:47 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1158630888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:39:47.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:47 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1158630888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:39:47.535 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:47 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1158630888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:39:48.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:48 smithi122 ceph-mon[36436]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-27T09:39:48.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:48 smithi071 ceph-mon[31451]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-27T09:39:48.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:48 smithi072 ceph-mon[35951]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-27T09:39:50.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:50 smithi072 ceph-mon[35951]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:50 smithi122 ceph-mon[36436]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:50.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:50 smithi071 ceph-mon[31451]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:52.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:52 smithi072 ceph-mon[35951]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:52.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:52 smithi122 ceph-mon[36436]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:52.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:52 smithi071 ceph-mon[31451]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:54.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:54 smithi071 ceph-mon[31451]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:54.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:54 smithi072 ceph-mon[35951]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:54.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:54 smithi122 ceph-mon[36436]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:39:56.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:56 smithi071 ceph-mon[31451]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:56.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:56 smithi072 ceph-mon[35951]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:56.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:56 smithi122 ceph-mon[36436]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:57.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:57 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-27T09:39:57.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:57 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:57.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:57 smithi071 ceph-mon[31451]: Deploying daemon osd.6 on smithi071 2024-05-27T09:39:57.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:57 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-27T09:39:57.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:57 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:57.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:57 smithi122 ceph-mon[36436]: Deploying daemon osd.6 on smithi071 2024-05-27T09:39:57.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:57 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-27T09:39:57.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:57 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:39:57.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:57 smithi072 ceph-mon[35951]: Deploying daemon osd.6 on smithi071 2024-05-27T09:39:58.425 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:39:58 smithi071 ceph-mon[31451]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:39:58 smithi122 ceph-mon[36436]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:39:58.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:39:58 smithi072 ceph-mon[35951]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:00 smithi071 ceph-mon[31451]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:00 smithi071 ceph-mon[31451]: overall HEALTH_OK 2024-05-27T09:40:00.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:00 smithi122 ceph-mon[36436]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:00.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:00 smithi122 ceph-mon[36436]: overall HEALTH_OK 2024-05-27T09:40:00.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:00 smithi072 ceph-mon[35951]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:00.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:00 smithi072 ceph-mon[35951]: overall HEALTH_OK 2024-05-27T09:40:02.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:02 smithi122 ceph-mon[36436]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:02.766 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:02 smithi071 ceph-mon[31451]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:02.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:02 smithi072 ceph-mon[35951]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:04 smithi071 ceph-mon[31451]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:04.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:04 smithi122 ceph-mon[36436]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:04.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:04 smithi072 ceph-mon[35951]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:06.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:06 smithi071 ceph-mon[31451]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:06.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:06.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:06.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:06.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:06 smithi122 ceph-mon[36436]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:06.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:06.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:06.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:06.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:06 smithi072 ceph-mon[35951]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:08 smithi122 ceph-mon[36436]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:08.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:08 smithi071 ceph-mon[31451]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:08.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:08 smithi072 ceph-mon[35951]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:10 smithi122 ceph-mon[36436]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:10 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:10 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:10 smithi122 ceph-mon[36436]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-27T09:40:10.494 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:10 smithi071 ceph-mon[31451]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:10.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:10 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:10.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:10 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:10.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:10 smithi071 ceph-mon[31451]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-27T09:40:10.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:10 smithi072 ceph-mon[35951]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:10.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:10 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:10.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:10 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:10.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:10 smithi072 ceph-mon[35951]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-27T09:40:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.069+0000 7f7c6be00700 1 -- 172.21.15.71:0/1945743531 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c74063bf0 con 0x7f7c580b2900 2024-05-27T09:40:11.071 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 6 on host 'smithi071' 2024-05-27T09:40:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.073+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7c580b2900 msgr2=0x7f7c580b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.073+0000 7f7c7a000700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7c580b2900 0x7f7c580b4e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c7419b970 tx=0x7f7c60009260 comp rx=0 tx=0).stop 2024-05-27T09:40:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.073+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74104330 msgr2=0x7f7c7419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.073+0000 7f7c7a000700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74104330 0x7f7c7419a8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400e940 tx=0x7f7c6400ec50 comp rx=0 tx=0).stop 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 shutdown_connections 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7c580b2900 0x7f7c580b4e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c74105e00 0x7f7c741a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74104330 0x7f7c7419a8c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 --2- 172.21.15.71:0/1945743531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74105460 0x7f7c7419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 >> 172.21.15.71:0/1945743531 conn(0x7f7c740ff9b0 msgr2=0x7f7c74108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 shutdown_connections 2024-05-27T09:40:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:40:11.074+0000 7f7c7a000700 1 -- 172.21.15.71:0/1945743531 wait complete. 2024-05-27T09:40:11.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: osdmap e41: 7 total, 6 up, 7 in 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: osdmap e41: 7 total, 6 up, 7 in 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:11.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: osdmap e41: 7 total, 6 up, 7 in 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:11.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:11.983 DEBUG:teuthology.orchestra.run.smithi071:osd.6> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.6.service 2024-05-27T09:40:11.988 INFO:tasks.cephadm:Deploying osd.7 on smithi072 with /dev/vg_nvme/lv_2... 2024-05-27T09:40:11.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-27T09:40:12.234 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:40:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:12 smithi071 ceph-mon[31451]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:12 smithi071 ceph-mon[31451]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:40:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:12 smithi071 ceph-mon[31451]: osdmap e42: 7 total, 6 up, 7 in 2024-05-27T09:40:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:12.656 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:12 smithi072 ceph-mon[35951]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:12.656 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:12 smithi072 ceph-mon[35951]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:40:12.656 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:12 smithi072 ceph-mon[35951]: osdmap e42: 7 total, 6 up, 7 in 2024-05-27T09:40:12.657 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:12.657 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:12 smithi122 ceph-mon[36436]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-05-27T09:40:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:12 smithi122 ceph-mon[36436]: from='osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:40:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:12 smithi122 ceph-mon[36436]: osdmap e42: 7 total, 6 up, 7 in 2024-05-27T09:40:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:13.515 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:13 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:40:13.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:13 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:40:13.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:13 smithi072 ceph-mon[35951]: osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] boot 2024-05-27T09:40:13.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:13 smithi072 ceph-mon[35951]: osdmap e43: 7 total, 7 up, 7 in 2024-05-27T09:40:13.516 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:13.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:13 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:40:13.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:13 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:40:13.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:13 smithi071 ceph-mon[31451]: osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] boot 2024-05-27T09:40:13.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:13 smithi071 ceph-mon[31451]: osdmap e43: 7 total, 7 up, 7 in 2024-05-27T09:40:13.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:13 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:40:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:13 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:40:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:13 smithi122 ceph-mon[36436]: osd.6 [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] boot 2024-05-27T09:40:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:13 smithi122 ceph-mon[36436]: osdmap e43: 7 total, 7 up, 7 in 2024-05-27T09:40:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:40:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-27T09:40:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-27T09:40:14.091 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-05-27T09:40:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-05-27T09:40:14.091 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116122 s, 903 MB/s 2024-05-27T09:40:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-05-27T09:40:14.687 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:14 smithi072 ceph-mon[35951]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:14.687 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:14 smithi072 ceph-mon[35951]: osdmap e44: 7 total, 7 up, 7 in 2024-05-27T09:40:14.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi072:vg_nvme/lv_2 2024-05-27T09:40:14.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:14 smithi071 ceph-mon[31451]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:14.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:14 smithi071 ceph-mon[31451]: osdmap e44: 7 total, 7 up, 7 in 2024-05-27T09:40:14.953 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:40:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:14 smithi122 ceph-mon[36436]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:14 smithi122 ceph-mon[36436]: osdmap e44: 7 total, 7 up, 7 in 2024-05-27T09:40:16.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 -- 172.21.15.72:0/727872333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 msgr2=0x7f5228105d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:16.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 --2- 172.21.15.72:0/727872333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f5228105d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f521c009990 tx=0x7f521c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:40:16.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 -- 172.21.15.72:0/727872333 shutdown_connections 2024-05-27T09:40:16.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 --2- 172.21.15.72:0/727872333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5228102c90 0x7f522810c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:16.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 --2- 172.21.15.72:0/727872333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f5228105d00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 --2- 172.21.15.72:0/727872333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5228102340 0x7f5228102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 -- 172.21.15.72:0/727872333 >> 172.21.15.72:0/727872333 conn(0x7f52280fe010 msgr2=0x7f52281004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 -- 172.21.15.72:0/727872333 shutdown_connections 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 -- 172.21.15.72:0/727872333 wait complete. 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 Processor -- start 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.445+0000 7f522ed9d700 1 -- start start 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5228102340 0x7f522819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522ed9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5228102c90 0x7f522819ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f52281a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522ed9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f522810fe10 con 0x7f5228102340 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522ed9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f522810fc90 con 0x7f52281058f0 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522ed9d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f522810ff90 con 0x7f5228102c90 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f52281a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f52281a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59310/0 (socket says 172.21.15.72:59310) 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 -- 172.21.15.72:0/246619184 learned_addr learned my addr 172.21.15.72:0/246619184 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f5227fff700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5228102c90 0x7f522819ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 -- 172.21.15.72:0/246619184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5228102c90 msgr2=0x7f522819ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5228102c90 0x7f522819ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 -- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5228102340 msgr2=0x7f522819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5228102340 0x7f522819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 -- 172.21.15.72:0/246619184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52281a2490 con 0x7f52281058f0 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522d33a700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f52281a1e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f522000b970 tx=0x7f522000bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:40:16.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f5225ffb700 1 -- 172.21.15.72:0/246619184 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220019070 con 0x7f52281058f0 2024-05-27T09:40:16.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f5225ffb700 1 -- 172.21.15.72:0/246619184 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5220014440 con 0x7f52281058f0 2024-05-27T09:40:16.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52281a2780 con 0x7f52281058f0 2024-05-27T09:40:16.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.446+0000 7f5225ffb700 1 -- 172.21.15.72:0/246619184 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522000ce60 con 0x7f52281058f0 2024-05-27T09:40:16.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.447+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52281a2cf0 con 0x7f52281058f0 2024-05-27T09:40:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.448+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52280512b0 con 0x7f52281058f0 2024-05-27T09:40:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.449+0000 7f5225ffb700 1 -- 172.21.15.72:0/246619184 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f522001c070 con 0x7f52281058f0 2024-05-27T09:40:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.450+0000 7f5225ffb700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52180b2880 0x7f52180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.450+0000 7f5225ffb700 1 -- 172.21.15.72:0/246619184 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f52200e0ec0 con 0x7f52281058f0 2024-05-27T09:40:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.450+0000 7f522cb39700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52180b2880 0x7f52180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:40:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.451+0000 7f522cb39700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52180b2880 0x7f52180b4d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f521c006010 tx=0x7f521c003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:40:16.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.454+0000 7f5225ffb700 1 -- 172.21.15.72:0/246619184 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52200a9850 con 0x7f52281058f0 2024-05-27T09:40:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:16.665+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5228063bf0 con 0x7f52180b2880 2024-05-27T09:40:16.666 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:16 smithi072 ceph-mon[35951]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:16 smithi071 ceph-mon[31451]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:16 smithi122 ceph-mon[36436]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:17.624 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:40:17.624 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:40:17.624 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:40:17.624 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:17.624 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi071 2024-05-27T09:40:17.624 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:17.625 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:40:17.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:40:17.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:40:17.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi071 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:17.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:40:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:40:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:40:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi071 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:17.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:18.646 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:18 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi071 to 5696M 2024-05-27T09:40:18.646 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:18 smithi072 ceph-mon[35951]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:18.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:18 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi071 to 5696M 2024-05-27T09:40:18.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:18 smithi071 ceph-mon[31451]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:18.804 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:18 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi071 to 5696M 2024-05-27T09:40:18.805 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:18 smithi122 ceph-mon[36436]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:19.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:19 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/1779474953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]: dispatch 2024-05-27T09:40:19.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:19 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]: dispatch 2024-05-27T09:40:19.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:19 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]': finished 2024-05-27T09:40:19.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:19 smithi072 ceph-mon[35951]: osdmap e45: 8 total, 7 up, 8 in 2024-05-27T09:40:19.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:19.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:19 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/1779474953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]: dispatch 2024-05-27T09:40:19.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:19 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]: dispatch 2024-05-27T09:40:19.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:19 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]': finished 2024-05-27T09:40:19.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:19 smithi122 ceph-mon[36436]: osdmap e45: 8 total, 7 up, 8 in 2024-05-27T09:40:19.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:19 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/1779474953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]: dispatch 2024-05-27T09:40:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:19 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]: dispatch 2024-05-27T09:40:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:19 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32d0220b-a785-43b4-901a-d503071d14e4"}]': finished 2024-05-27T09:40:20.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:19 smithi071 ceph-mon[31451]: osdmap e45: 8 total, 7 up, 8 in 2024-05-27T09:40:20.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:20 smithi072 ceph-mon[35951]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:20.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:20 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/2310719305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:40:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:20 smithi122 ceph-mon[36436]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:20 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/2310719305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:40:21.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:20 smithi071 ceph-mon[31451]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:21.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:20 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/2310719305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:40:22.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:22 smithi072 ceph-mon[35951]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:22.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:22 smithi122 ceph-mon[36436]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:23.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:22 smithi071 ceph-mon[31451]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:24 smithi072 ceph-mon[35951]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:24.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:24 smithi122 ceph-mon[36436]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:25.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:24 smithi071 ceph-mon[31451]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:26.579 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:26 smithi072 ceph-mon[35951]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:26.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:26 smithi122 ceph-mon[36436]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:26 smithi071 ceph-mon[31451]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-27T09:40:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:27 smithi122 ceph-mon[36436]: Deploying daemon osd.7 on smithi072 2024-05-27T09:40:28.008 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-27T09:40:28.009 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:28.009 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:27 smithi072 ceph-mon[35951]: Deploying daemon osd.7 on smithi072 2024-05-27T09:40:28.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-27T09:40:28.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:28.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:27 smithi071 ceph-mon[31451]: Deploying daemon osd.7 on smithi072 2024-05-27T09:40:28.930 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:28 smithi072 ceph-mon[35951]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:28.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:28 smithi122 ceph-mon[36436]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:29.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:28 smithi071 ceph-mon[31451]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:30.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:30 smithi072 ceph-mon[35951]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:30 smithi122 ceph-mon[36436]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:31.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:30 smithi071 ceph-mon[31451]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:32.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:32 smithi072 ceph-mon[35951]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:32.780 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:32.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:32.781 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:32.990 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:32 smithi122 ceph-mon[36436]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:32.990 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:32.990 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:32.991 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:33.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:32 smithi071 ceph-mon[31451]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:33.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:33.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:33.015 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:34.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:34 smithi072 ceph-mon[35951]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:34.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:34 smithi071 ceph-mon[31451]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:34 smithi122 ceph-mon[36436]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:35.550 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 7 on host 'smithi072' 2024-05-27T09:40:35.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.548+0000 7f5225ffb700 1 -- 172.21.15.72:0/246619184 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5228063bf0 con 0x7f52180b2880 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52180b2880 msgr2=0x7f52180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52180b2880 0x7f52180b4d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f521c006010 tx=0x7f521c003860 comp rx=0 tx=0).stop 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 msgr2=0x7f52281a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f52281a1e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f522000b970 tx=0x7f522000bd30 comp rx=0 tx=0).stop 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 shutdown_connections 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52281058f0 0x7f52281a1e10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52180b2880 0x7f52180b4d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5228102340 0x7f522819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 --2- 172.21.15.72:0/246619184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5228102c90 0x7f522819ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 >> 172.21.15.72:0/246619184 conn(0x7f52280fe010 msgr2=0x7f5228108890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:40:35.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 shutdown_connections 2024-05-27T09:40:35.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:40:35.551+0000 7f522ed9d700 1 -- 172.21.15.72:0/246619184 wait complete. 2024-05-27T09:40:36.184 DEBUG:teuthology.orchestra.run.smithi072:osd.7> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.7.service 2024-05-27T09:40:36.186 INFO:tasks.cephadm:Deploying osd.8 on smithi122 with /dev/vg_nvme/lv_2... 2024-05-27T09:40:36.187 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-27T09:40:36.431 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:40:36.724 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:36 smithi072 ceph-mon[35951]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:36.724 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.724 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.724 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.724 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.724 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:36 smithi072 ceph-mon[35951]: from='osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-27T09:40:36.724 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:36 smithi072 ceph-mon[35951]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-27T09:40:36.753 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:36 smithi122 ceph-mon[36436]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:36.753 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.753 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.753 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.753 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.753 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:36 smithi122 ceph-mon[36436]: from='osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-27T09:40:36.754 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:36 smithi122 ceph-mon[36436]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-27T09:40:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:36 smithi071 ceph-mon[31451]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:36 smithi071 ceph-mon[31451]: from='osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-27T09:40:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:36 smithi071 ceph-mon[31451]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-27T09:40:37.768 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:37 smithi072 ceph-mon[35951]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-27T09:40:37.768 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:37 smithi072 ceph-mon[35951]: from='osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:40:37.768 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:37 smithi072 ceph-mon[35951]: osdmap e46: 8 total, 7 up, 8 in 2024-05-27T09:40:37.768 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:37.768 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:37 smithi072 ceph-mon[35951]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:40:37.867 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:37 smithi122 ceph-mon[36436]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-27T09:40:37.867 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:37 smithi122 ceph-mon[36436]: from='osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:40:37.867 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:37 smithi122 ceph-mon[36436]: osdmap e46: 8 total, 7 up, 8 in 2024-05-27T09:40:37.867 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:37.868 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:37 smithi122 ceph-mon[36436]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:40:38.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:37 smithi071 ceph-mon[31451]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-27T09:40:38.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:37 smithi071 ceph-mon[31451]: from='osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:40:38.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:37 smithi071 ceph-mon[31451]: osdmap e46: 8 total, 7 up, 8 in 2024-05-27T09:40:38.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:38.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:37 smithi071 ceph-mon[31451]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:40:38.404 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-27T09:40:38.404 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-27T09:40:38.404 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-05-27T09:40:38.404 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-05-27T09:40:38.405 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111822 s, 938 MB/s 2024-05-27T09:40:38.405 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-05-27T09:40:38.766 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:38 smithi072 ceph-mon[35951]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:38.766 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:38 smithi072 ceph-mon[35951]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:40:38.766 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:38 smithi072 ceph-mon[35951]: osdmap e47: 8 total, 7 up, 8 in 2024-05-27T09:40:38.766 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:38.766 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:38 smithi072 ceph-mon[35951]: from='osd.7 ' entity='osd.7' 2024-05-27T09:40:38.766 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:38 smithi072 ceph-mon[35951]: osdmap e48: 8 total, 7 up, 8 in 2024-05-27T09:40:38.767 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:38.767 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 09:40:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T09:40:38.571+0000 7f7af5663700 -1 osd.7 0 waiting for initial osdmap 2024-05-27T09:40:38.767 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 09:40:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T09:40:38.631+0000 7f7aed410700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:40:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:38 smithi122 ceph-mon[36436]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:38 smithi122 ceph-mon[36436]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:40:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:38 smithi122 ceph-mon[36436]: osdmap e47: 8 total, 7 up, 8 in 2024-05-27T09:40:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:38 smithi122 ceph-mon[36436]: from='osd.7 ' entity='osd.7' 2024-05-27T09:40:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:38 smithi122 ceph-mon[36436]: osdmap e48: 8 total, 7 up, 8 in 2024-05-27T09:40:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:38 smithi071 ceph-mon[31451]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:38 smithi071 ceph-mon[31451]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:40:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:38 smithi071 ceph-mon[31451]: osdmap e47: 8 total, 7 up, 8 in 2024-05-27T09:40:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:38 smithi071 ceph-mon[31451]: from='osd.7 ' entity='osd.7' 2024-05-27T09:40:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:38 smithi071 ceph-mon[31451]: osdmap e48: 8 total, 7 up, 8 in 2024-05-27T09:40:39.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:39.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_2 2024-05-27T09:40:39.267 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:40:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:40:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:40:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] boot 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: osdmap e49: 8 total, 8 up, 8 in 2024-05-27T09:40:39.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:40.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:40:40.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:40:40.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] boot 2024-05-27T09:40:40.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: osdmap e49: 8 total, 8 up, 8 in 2024-05-27T09:40:40.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:40.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:40.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:40:40.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:40.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: osd.7 [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] boot 2024-05-27T09:40:40.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: osdmap e49: 8 total, 8 up, 8 in 2024-05-27T09:40:40.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:40:40.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 -- 172.21.15.122:0/2086344653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 msgr2=0x7fe250103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:40.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 --2- 172.21.15.122:0/2086344653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250103c30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe24000b0a0 tx=0x7fe24000b3b0 comp rx=0 tx=0).stop 2024-05-27T09:40:40.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 -- 172.21.15.122:0/2086344653 shutdown_connections 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 --2- 172.21.15.122:0/2086344653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250105070 0x7fe25010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 --2- 172.21.15.122:0/2086344653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250103c30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 --2- 172.21.15.122:0/2086344653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe250104720 0x7fe250104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 -- 172.21.15.122:0/2086344653 >> 172.21.15.122:0/2086344653 conn(0x7fe2500fdff0 msgr2=0x7fe2501004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 -- 172.21.15.122:0/2086344653 shutdown_connections 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.879+0000 7fe255c17700 1 -- 172.21.15.122:0/2086344653 wait complete. 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 Processor -- start 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 -- start start 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe250104720 0x7fe250199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:40.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250105070 0x7fe2501a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe25010ef50 con 0x7fe250104720 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe25010edd0 con 0x7fe250105070 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe255c17700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe25010f0d0 con 0x7fe250103820 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe24f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.880+0000 7fe24f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:50068/0 (socket says 172.21.15.122:50068) 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24f7fe700 1 -- 172.21.15.122:0/443064252 learned_addr learned my addr 172.21.15.122:0/443064252 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24ffff700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250105070 0x7fe2501a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24f7fe700 1 -- 172.21.15.122:0/443064252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250105070 msgr2=0x7fe2501a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24f7fe700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250105070 0x7fe2501a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24f7fe700 1 -- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe250104720 msgr2=0x7fe250199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:40:40.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24f7fe700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe250104720 0x7fe250199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24f7fe700 1 -- 172.21.15.122:0/443064252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe250102530 con 0x7fe250103820 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24f7fe700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250199aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe240004e20 tx=0x7fe240004f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24d7fa700 1 -- 172.21.15.122:0/443064252 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240021070 con 0x7fe250103820 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2501027c0 con 0x7fe250103820 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24d7fa700 1 -- 172.21.15.122:0/443064252 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe24001d900 con 0x7fe250103820 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe24d7fa700 1 -- 172.21.15.122:0/443064252 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240005460 con 0x7fe250103820 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.881+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe250102dd0 con 0x7fe250103820 2024-05-27T09:40:40.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.882+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2500512b0 con 0x7fe250103820 2024-05-27T09:40:40.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.884+0000 7fe24d7fa700 1 -- 172.21.15.122:0/443064252 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe240024070 con 0x7fe250103820 2024-05-27T09:40:40.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.884+0000 7fe24d7fa700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe23c0b2880 0x7fe23c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:40:40.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.884+0000 7fe24d7fa700 1 -- 172.21.15.122:0/443064252 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5397+0+0 (secure 0 0 0) 0x7fe24000f020 con 0x7fe250103820 2024-05-27T09:40:40.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.885+0000 7fe246ffd700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe23c0b2880 0x7fe23c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:40:40.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.886+0000 7fe246ffd700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe23c0b2880 0x7fe23c0b4d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe25019ab50 tx=0x7fe238006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:40:40.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:40.888+0000 7fe24d7fa700 1 -- 172.21.15.122:0/443064252 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe24002b020 con 0x7fe250103820 2024-05-27T09:40:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:40 smithi122 ceph-mon[36436]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:40 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi072 2024-05-27T09:40:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:40 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi072 to 5696M 2024-05-27T09:40:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:40 smithi122 ceph-mon[36436]: osdmap e50: 8 total, 8 up, 8 in 2024-05-27T09:40:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:40 smithi071 ceph-mon[31451]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:40 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi072 2024-05-27T09:40:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:40 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi072 to 5696M 2024-05-27T09:40:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:40 smithi071 ceph-mon[31451]: osdmap e50: 8 total, 8 up, 8 in 2024-05-27T09:40:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:40 smithi072 ceph-mon[35951]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-27T09:40:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:40 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi072 2024-05-27T09:40:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:40 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi072 to 5696M 2024-05-27T09:40:41.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:40 smithi072 ceph-mon[35951]: osdmap e50: 8 total, 8 up, 8 in 2024-05-27T09:40:41.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:40:41.102+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe250103200 con 0x7fe23c0b2880 2024-05-27T09:40:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:42 smithi122 ceph-mon[36436]: osdmap e51: 8 total, 8 up, 8 in 2024-05-27T09:40:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:42 smithi122 ceph-mon[36436]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:42 smithi122 ceph-mon[36436]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:40:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:40:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:40:42.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:42 smithi071 ceph-mon[31451]: osdmap e51: 8 total, 8 up, 8 in 2024-05-27T09:40:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:42 smithi071 ceph-mon[31451]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:42 smithi071 ceph-mon[31451]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:40:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:40:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:40:42.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:42.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:42 smithi072 ceph-mon[35951]: osdmap e51: 8 total, 8 up, 8 in 2024-05-27T09:40:42.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:42 smithi072 ceph-mon[35951]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:42.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:42 smithi072 ceph-mon[35951]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:40:42.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:40:42.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:40:42.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:44 smithi122 ceph-mon[36436]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:44 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/247647393' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]: dispatch 2024-05-27T09:40:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:44 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]: dispatch 2024-05-27T09:40:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:44 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]': finished 2024-05-27T09:40:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:44 smithi122 ceph-mon[36436]: osdmap e52: 9 total, 8 up, 9 in 2024-05-27T09:40:44.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:40:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:44 smithi071 ceph-mon[31451]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:44 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/247647393' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]: dispatch 2024-05-27T09:40:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:44 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]: dispatch 2024-05-27T09:40:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:44 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]': finished 2024-05-27T09:40:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:44 smithi071 ceph-mon[31451]: osdmap e52: 9 total, 8 up, 9 in 2024-05-27T09:40:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:40:44.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:44 smithi072 ceph-mon[35951]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:44.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:44 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/247647393' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]: dispatch 2024-05-27T09:40:44.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:44 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]: dispatch 2024-05-27T09:40:44.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:44 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3f8c4a1-f8eb-4c5c-b274-c09bf383869d"}]': finished 2024-05-27T09:40:44.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:44 smithi072 ceph-mon[35951]: osdmap e52: 9 total, 8 up, 9 in 2024-05-27T09:40:44.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:40:45.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:45 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/3633894021' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:40:45.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:45 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/3633894021' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:40:45.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:45 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/3633894021' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:40:46.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:46 smithi122 ceph-mon[36436]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-27T09:40:46.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:46 smithi071 ceph-mon[31451]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-27T09:40:46.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:46 smithi072 ceph-mon[35951]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-27T09:40:48.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:48 smithi122 ceph-mon[36436]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-27T09:40:48.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:48 smithi071 ceph-mon[31451]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-27T09:40:48.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:48 smithi072 ceph-mon[35951]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-27T09:40:50.455 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:50 smithi122 ceph-mon[36436]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:40:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:50 smithi071 ceph-mon[31451]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:40:50.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:50 smithi072 ceph-mon[35951]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:40:52.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:52 smithi122 ceph-mon[36436]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:40:52.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:52 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-27T09:40:52.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:52 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:52.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:52 smithi122 ceph-mon[36436]: Deploying daemon osd.8 on smithi122 2024-05-27T09:40:52.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:52 smithi071 ceph-mon[31451]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:40:52.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-27T09:40:52.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:52 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:52.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:52 smithi071 ceph-mon[31451]: Deploying daemon osd.8 on smithi122 2024-05-27T09:40:52.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:52 smithi072 ceph-mon[35951]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:40:52.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:52 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-27T09:40:52.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:52 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:40:52.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:52 smithi072 ceph-mon[35951]: Deploying daemon osd.8 on smithi122 2024-05-27T09:40:54.441 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:54 smithi122 ceph-mon[36436]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:40:54.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:54 smithi071 ceph-mon[31451]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:40:54.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:54 smithi072 ceph-mon[35951]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:40:56.312 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:56 smithi122 ceph-mon[36436]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-27T09:40:56.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:56 smithi071 ceph-mon[31451]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-27T09:40:56.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:56 smithi072 ceph-mon[35951]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-27T09:40:58.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:58 smithi122 ceph-mon[36436]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:58.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:58 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:58.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:58 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:58.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:40:58 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:58 smithi071 ceph-mon[31451]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:40:58 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:40:58.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:58 smithi072 ceph-mon[35951]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:40:58.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:58 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:58.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:58 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:40:58.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:40:58 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:00 smithi122 ceph-mon[36436]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:00 smithi071 ceph-mon[31451]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:00.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:00 smithi072 ceph-mon[35951]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:00.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:00.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:00.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:00.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.945+0000 7fe24d7fa700 1 -- 172.21.15.122:0/443064252 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe250103200 con 0x7fe23c0b2880 2024-05-27T09:41:00.947 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 8 on host 'smithi122' 2024-05-27T09:41:00.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe23c0b2880 msgr2=0x7fe23c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe23c0b2880 0x7fe23c0b4d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe25019ab50 tx=0x7fe238006d20 comp rx=0 tx=0).stop 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 msgr2=0x7fe250199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250199aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe240004e20 tx=0x7fe240004f00 comp rx=0 tx=0).stop 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 shutdown_connections 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250105070 0x7fe2501a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe250103820 0x7fe250199aa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe23c0b2880 0x7fe23c0b4d90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.947+0000 7fe255c17700 1 --2- 172.21.15.122:0/443064252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe250104720 0x7fe250199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.948+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 >> 172.21.15.122:0/443064252 conn(0x7fe2500fdff0 msgr2=0x7fe250107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.948+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 shutdown_connections 2024-05-27T09:41:00.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:41:00.948+0000 7fe255c17700 1 -- 172.21.15.122:0/443064252 wait complete. 2024-05-27T09:41:01.531 DEBUG:teuthology.orchestra.run.smithi122:osd.8> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.8.service 2024-05-27T09:41:01.534 INFO:tasks.cephadm:Deploying osd.9 on smithi071 with /dev/vg_nvme/lv_1... 2024-05-27T09:41:01.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-27T09:41:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:41:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:01 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:01 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:01 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:01 smithi122 ceph-mon[36436]: from='osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-27T09:41:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:01 smithi122 ceph-mon[36436]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-27T09:41:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:01 smithi122 ceph-mon[36436]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:01 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:01 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:01 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:01 smithi071 ceph-mon[31451]: from='osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-27T09:41:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:01 smithi071 ceph-mon[31451]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-27T09:41:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:01 smithi071 ceph-mon[31451]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:02.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:01 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:02.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:01 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:02.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:01 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:02.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:01 smithi072 ceph-mon[35951]: from='osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-27T09:41:02.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:01 smithi072 ceph-mon[35951]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-27T09:41:02.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:01 smithi072 ceph-mon[35951]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:02 smithi122 ceph-mon[36436]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-27T09:41:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:02 smithi122 ceph-mon[36436]: osdmap e53: 9 total, 8 up, 9 in 2024-05-27T09:41:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:02 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:02 smithi122 ceph-mon[36436]: from='osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:41:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:02 smithi122 ceph-mon[36436]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:41:03.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:02 smithi071 ceph-mon[31451]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-27T09:41:03.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:02 smithi071 ceph-mon[31451]: osdmap e53: 9 total, 8 up, 9 in 2024-05-27T09:41:03.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:02 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:03.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:02 smithi071 ceph-mon[31451]: from='osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:41:03.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:02 smithi071 ceph-mon[31451]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:41:03.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:02 smithi072 ceph-mon[35951]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-27T09:41:03.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:02 smithi072 ceph-mon[35951]: osdmap e53: 9 total, 8 up, 9 in 2024-05-27T09:41:03.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:02 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:03.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:02 smithi072 ceph-mon[35951]: from='osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:41:03.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:02 smithi072 ceph-mon[35951]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:41:04.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: osdmap e54: 9 total, 8 up, 9 in 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: from='osd.8 ' entity='osd.8' 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] boot 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: osdmap e55: 9 total, 9 up, 9 in 2024-05-27T09:41:04.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.053 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:41:04.053 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: osdmap e54: 9 total, 8 up, 9 in 2024-05-27T09:41:04.053 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.054 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.054 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:04.054 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: from='osd.8 ' entity='osd.8' 2024-05-27T09:41:04.054 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] boot 2024-05-27T09:41:04.054 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: osdmap e55: 9 total, 9 up, 9 in 2024-05-27T09:41:04.054 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.054 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 09:41:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T09:41:03.833+0000 7f4e9d1a1700 -1 osd.8 0 waiting for initial osdmap 2024-05-27T09:41:04.054 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 09:41:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T09:41:03.883+0000 7f4e9474d700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:41:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: osdmap e54: 9 total, 8 up, 9 in 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: from='osd.8 ' entity='osd.8' 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: osd.8 [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] boot 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: osdmap e55: 9 total, 9 up, 9 in 2024-05-27T09:41:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:41:04.953 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-27T09:41:04.953 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-27T09:41:04.954 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-05-27T09:41:04.954 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-05-27T09:41:04.954 INFO:teuthology.orchestra.run.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0343257 s, 305 MB/s 2024-05-27T09:41:04.954 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-05-27T09:41:04.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:41:04.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi122 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi122 to 5696M 2024-05-27T09:41:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:04.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:04.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:04.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:04.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:04 smithi071 ceph-mon[31451]: osdmap e56: 9 total, 9 up, 9 in 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi122 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:05.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi122 to 5696M 2024-05-27T09:41:05.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:05.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:05.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:04 smithi122 ceph-mon[36436]: osdmap e56: 9 total, 9 up, 9 in 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi122 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi122 to 5696M 2024-05-27T09:41:05.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:05.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:05.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:05.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:04 smithi072 ceph-mon[35951]: osdmap e56: 9 total, 9 up, 9 in 2024-05-27T09:41:05.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-05-27T09:41:06.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:05 smithi071 ceph-mon[31451]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 472 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:06.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:05 smithi071 ceph-mon[31451]: osdmap e57: 9 total, 9 up, 9 in 2024-05-27T09:41:06.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:05 smithi122 ceph-mon[36436]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 472 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:06.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:05 smithi122 ceph-mon[36436]: osdmap e57: 9 total, 9 up, 9 in 2024-05-27T09:41:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:05 smithi072 ceph-mon[35951]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 472 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:06.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:05 smithi072 ceph-mon[35951]: osdmap e57: 9 total, 9 up, 9 in 2024-05-27T09:41:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:41:08.430 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:08 smithi071 ceph-mon[31451]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 472 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:08 smithi122 ceph-mon[36436]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 472 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:08 smithi072 ceph-mon[35951]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 472 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.673+0000 7f5235800700 1 -- 172.21.15.71:0/2076690623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 msgr2=0x7f5230112cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.673+0000 7f5235800700 1 --2- 172.21.15.71:0/2076690623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 0x7f5230112cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f522800b0a0 tx=0x7f522800b3b0 comp rx=0 tx=0).stop 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.673+0000 7f5235800700 1 -- 172.21.15.71:0/2076690623 shutdown_connections 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.673+0000 7f5235800700 1 --2- 172.21.15.71:0/2076690623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 0x7f5230112cc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.673+0000 7f5235800700 1 --2- 172.21.15.71:0/2076690623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f523010ab00 0x7f523010af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.673+0000 7f5235800700 1 --2- 172.21.15.71:0/2076690623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ba70 0x7f523010be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.673+0000 7f5235800700 1 -- 172.21.15.71:0/2076690623 >> 172.21.15.71:0/2076690623 conn(0x7f52300799b0 msgr2=0x7f523007be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.674+0000 7f5235800700 1 -- 172.21.15.71:0/2076690623 shutdown_connections 2024-05-27T09:41:08.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.674+0000 7f5235800700 1 -- 172.21.15.71:0/2076690623 wait complete. 2024-05-27T09:41:08.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 Processor -- start 2024-05-27T09:41:08.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 -- start start 2024-05-27T09:41:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ab00 0x7f52301a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f523010ba70 0x7f52301a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 0x7f52301a8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5230116400 con 0x7f523010ab00 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5230116280 con 0x7f523010ba70 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f5235800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5230116580 con 0x7f523010c410 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f522ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ab00 0x7f52301a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f522ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ab00 0x7f52301a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55562/0 (socket says 172.21.15.71:55562) 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.675+0000 7f522ea00700 1 -- 172.21.15.71:0/676515321 learned_addr learned my addr 172.21.15.71:0/676515321 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522f400700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 0x7f52301a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f5227e00700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f523010ba70 0x7f52301a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522ea00700 1 -- 172.21.15.71:0/676515321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 msgr2=0x7f52301a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522ea00700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 0x7f52301a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522ea00700 1 -- 172.21.15.71:0/676515321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f523010ba70 msgr2=0x7f52301a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522ea00700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f523010ba70 0x7f52301a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522ea00700 1 -- 172.21.15.71:0/676515321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52301a89f0 con 0x7f523010ab00 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522f400700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 0x7f52301a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.676+0000 7f522ea00700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ab00 0x7f52301a0e90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f522000d950 tx=0x7f522000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.677+0000 7f5227400700 1 -- 172.21.15.71:0/676515321 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220017070 con 0x7f523010ab00 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.677+0000 7f5227400700 1 -- 172.21.15.71:0/676515321 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f522000f690 con 0x7f523010ab00 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.677+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52301a8ce0 con 0x7f523010ab00 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.677+0000 7f5227400700 1 -- 172.21.15.71:0/676515321 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220003aa0 con 0x7f523010ab00 2024-05-27T09:41:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.677+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52301a9170 con 0x7f523010ab00 2024-05-27T09:41:08.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.678+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52300512b0 con 0x7f523010ab00 2024-05-27T09:41:08.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.681+0000 7f5227400700 1 -- 172.21.15.71:0/676515321 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f522000f840 con 0x7f523010ab00 2024-05-27T09:41:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.684+0000 7f5227400700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52140b2880 0x7f52140b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.684+0000 7f5227400700 1 -- 172.21.15.71:0/676515321 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7f52200e1b70 con 0x7f523010ab00 2024-05-27T09:41:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.684+0000 7f5227e00700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52140b2880 0x7f52140b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.685+0000 7f5227e00700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52140b2880 0x7f52140b4d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52301a1f40 tx=0x7f5218009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:41:08.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.686+0000 7f5227400700 1 -- 172.21.15.71:0/676515321 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5220020030 con 0x7f523010ab00 2024-05-27T09:41:08.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:08.927+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5230063bf0 con 0x7f52140b2880 2024-05-27T09:41:09.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:41:09.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:41:09.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:41:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:41:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:41:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:41:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:10 smithi122 ceph-mon[36436]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:41:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:10 smithi122 ceph-mon[36436]: pgmap v220: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:10.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:10 smithi071 ceph-mon[31451]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:41:10.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:10 smithi071 ceph-mon[31451]: pgmap v220: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:10.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:10 smithi072 ceph-mon[35951]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:41:10.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:10 smithi072 ceph-mon[35951]: pgmap v220: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:12 smithi122 ceph-mon[36436]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-27T09:41:12.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:12 smithi071 ceph-mon[31451]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-27T09:41:12.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:12 smithi072 ceph-mon[35951]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-27T09:41:13.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:13 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1224594002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]: dispatch 2024-05-27T09:41:13.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:13 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]: dispatch 2024-05-27T09:41:13.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:13 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]': finished 2024-05-27T09:41:13.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:13 smithi122 ceph-mon[36436]: osdmap e58: 10 total, 9 up, 10 in 2024-05-27T09:41:13.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:13 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:13.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:13 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1224594002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]: dispatch 2024-05-27T09:41:13.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:13 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]: dispatch 2024-05-27T09:41:13.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:13 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]': finished 2024-05-27T09:41:13.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:13 smithi071 ceph-mon[31451]: osdmap e58: 10 total, 9 up, 10 in 2024-05-27T09:41:13.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:13 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:13.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:13 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1224594002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]: dispatch 2024-05-27T09:41:13.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:13 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]: dispatch 2024-05-27T09:41:13.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:13 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c875335-1ab1-4f1d-9ffd-895c97f78d56"}]': finished 2024-05-27T09:41:13.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:13 smithi072 ceph-mon[35951]: osdmap e58: 10 total, 9 up, 10 in 2024-05-27T09:41:13.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:13 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:14.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:14 smithi122 ceph-mon[36436]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-27T09:41:14.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:14 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4009045528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:41:14.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:14 smithi071 ceph-mon[31451]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-27T09:41:14.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:14 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4009045528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:41:14.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:14 smithi072 ceph-mon[35951]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-27T09:41:14.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:14 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4009045528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:41:16.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:16 smithi122 ceph-mon[36436]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-27T09:41:16.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:16 smithi071 ceph-mon[31451]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-27T09:41:16.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:16 smithi072 ceph-mon[35951]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-27T09:41:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:18 smithi122 ceph-mon[36436]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:41:18.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:18 smithi071 ceph-mon[31451]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:41:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:18 smithi072 ceph-mon[35951]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:41:20.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:20 smithi071 ceph-mon[31451]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:41:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:20 smithi122 ceph-mon[36436]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:41:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:20 smithi072 ceph-mon[35951]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:41:22.459 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:22 smithi071 ceph-mon[31451]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:22.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:22 smithi122 ceph-mon[36436]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:22.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:22 smithi072 ceph-mon[35951]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:24 smithi122 ceph-mon[36436]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-27T09:41:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:24 smithi122 ceph-mon[36436]: Deploying daemon osd.9 on smithi071 2024-05-27T09:41:24.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:24 smithi071 ceph-mon[31451]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:24.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-27T09:41:24.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:24.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:24 smithi071 ceph-mon[31451]: Deploying daemon osd.9 on smithi071 2024-05-27T09:41:24.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:24 smithi072 ceph-mon[35951]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:24.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-27T09:41:24.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:24.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:24 smithi072 ceph-mon[35951]: Deploying daemon osd.9 on smithi071 2024-05-27T09:41:26.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:26 smithi122 ceph-mon[36436]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:26.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:26 smithi071 ceph-mon[31451]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:26.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:26 smithi072 ceph-mon[35951]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:28.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:28 smithi071 ceph-mon[31451]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:28.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:28 smithi122 ceph-mon[36436]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:28.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:28 smithi072 ceph-mon[35951]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:30.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:30 smithi122 ceph-mon[36436]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:30.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:30 smithi071 ceph-mon[31451]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:30.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:30 smithi072 ceph-mon[35951]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:32.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:32 smithi122 ceph-mon[36436]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:32.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:32 smithi071 ceph-mon[31451]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:32.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:32 smithi072 ceph-mon[35951]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:33.699 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:33.699 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:33.699 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:33 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:33.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:33.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:33.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:33 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:33.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:33 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:34.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:34 smithi071 ceph-mon[31451]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:34.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:34 smithi072 ceph-mon[35951]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:34 smithi122 ceph-mon[36436]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:36 smithi071 ceph-mon[31451]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:36.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:36 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:36.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:36 smithi072 ceph-mon[35951]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:36.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:36.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:36 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:36.782 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:36 smithi122 ceph-mon[36436]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:36.782 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:36.782 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:36 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:37.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:37 smithi071 ceph-mon[31451]: from='osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-27T09:41:37.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:37 smithi071 ceph-mon[31451]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-27T09:41:37.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:37.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:37.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:37.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:37 smithi072 ceph-mon[35951]: from='osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-27T09:41:37.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:37 smithi072 ceph-mon[35951]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-27T09:41:37.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:37.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:37.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:37.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.893+0000 7f5227400700 1 -- 172.21.15.71:0/676515321 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5230063bf0 con 0x7f52140b2880 2024-05-27T09:41:37.896 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 9 on host 'smithi071' 2024-05-27T09:41:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52140b2880 msgr2=0x7f52140b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52140b2880 0x7f52140b4d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52301a1f40 tx=0x7f5218009260 comp rx=0 tx=0).stop 2024-05-27T09:41:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ab00 msgr2=0x7f52301a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ab00 0x7f52301a0e90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f522000d950 tx=0x7f522000dc60 comp rx=0 tx=0).stop 2024-05-27T09:41:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 shutdown_connections 2024-05-27T09:41:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f523010c410 0x7f52301a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f52140b2880 0x7f52140b4d90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523010ab00 0x7f52301a0e90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 --2- 172.21.15.71:0/676515321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f523010ba70 0x7f52301a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.897+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 >> 172.21.15.71:0/676515321 conn(0x7f52300799b0 msgr2=0x7f523010eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:41:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.898+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 shutdown_connections 2024-05-27T09:41:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:41:37.898+0000 7f5235800700 1 -- 172.21.15.71:0/676515321 wait complete. 2024-05-27T09:41:37.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:37 smithi122 ceph-mon[36436]: from='osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-27T09:41:37.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:37 smithi122 ceph-mon[36436]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-27T09:41:37.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:37.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:37.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:38.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:38.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-27T09:41:38.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: from='osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:41:38.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: osdmap e59: 10 total, 9 up, 10 in 2024-05-27T09:41:38.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:38.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:41:38.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:38.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:38.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:38 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:38.841 DEBUG:teuthology.orchestra.run.smithi071:osd.9> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.9.service 2024-05-27T09:41:38.846 INFO:tasks.cephadm:Deploying osd.10 on smithi072 with /dev/vg_nvme/lv_1... 2024-05-27T09:41:38.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: from='osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: osdmap e59: 10 total, 9 up, 10 in 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:38.873 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:38 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: from='osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: osdmap e59: 10 total, 9 up, 10 in 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:38 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:41:39.091 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:41:39.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:39 smithi071 ceph-mon[31451]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:41:39.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:39 smithi071 ceph-mon[31451]: osdmap e60: 10 total, 9 up, 10 in 2024-05-27T09:41:39.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:39.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:39 smithi122 ceph-mon[36436]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:41:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:39 smithi122 ceph-mon[36436]: osdmap e60: 10 total, 9 up, 10 in 2024-05-27T09:41:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:39 smithi072 ceph-mon[35951]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-05-27T09:41:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:39 smithi072 ceph-mon[35951]: osdmap e60: 10 total, 9 up, 10 in 2024-05-27T09:41:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:40.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:40 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:41:40.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:40 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:41:40.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:40 smithi071 ceph-mon[31451]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:40.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:40 smithi071 ceph-mon[31451]: osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] boot 2024-05-27T09:41:40.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:40 smithi071 ceph-mon[31451]: osdmap e61: 10 total, 10 up, 10 in 2024-05-27T09:41:40.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:40 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:40.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:40 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:41:40.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:40 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:41:40.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:40 smithi072 ceph-mon[35951]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:40.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:40 smithi072 ceph-mon[35951]: osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] boot 2024-05-27T09:41:40.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:40 smithi072 ceph-mon[35951]: osdmap e61: 10 total, 10 up, 10 in 2024-05-27T09:41:40.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:40 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:40 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:41:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:40 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:41:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:40 smithi122 ceph-mon[36436]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-05-27T09:41:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:40 smithi122 ceph-mon[36436]: osd.9 [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] boot 2024-05-27T09:41:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:40 smithi122 ceph-mon[36436]: osdmap e61: 10 total, 10 up, 10 in 2024-05-27T09:41:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:40 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:41:40.983 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-27T09:41:40.983 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-27T09:41:40.983 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-05-27T09:41:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-05-27T09:41:40.984 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112836 s, 929 MB/s 2024-05-27T09:41:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-05-27T09:41:41.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi072:vg_nvme/lv_1 2024-05-27T09:41:41.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:41 smithi122 ceph-mon[36436]: osdmap e62: 10 total, 10 up, 10 in 2024-05-27T09:41:41.981 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T09:41:42.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:41 smithi071 ceph-mon[31451]: osdmap e62: 10 total, 10 up, 10 in 2024-05-27T09:41:42.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:41 smithi072 ceph-mon[35951]: osdmap e62: 10 total, 10 up, 10 in 2024-05-27T09:41:42.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:42 smithi072 ceph-mon[35951]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:42.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:42 smithi071 ceph-mon[31451]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:42 smithi122 ceph-mon[36436]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 -- 172.21.15.72:0/3938057130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c105070 msgr2=0x7ff30c10b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 --2- 172.21.15.72:0/3938057130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c105070 0x7ff30c10b970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0099c0 tx=0x7ff2fc009cd0 comp rx=0 tx=0).stop 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 -- 172.21.15.72:0/3938057130 shutdown_connections 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 --2- 172.21.15.72:0/3938057130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c105070 0x7ff30c10b970 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 --2- 172.21.15.72:0/3938057130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff30c103820 0x7ff30c103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 --2- 172.21.15.72:0/3938057130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff30c104720 0x7ff30c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 -- 172.21.15.72:0/3938057130 >> 172.21.15.72:0/3938057130 conn(0x7ff30c0fe010 msgr2=0x7ff30c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 -- 172.21.15.72:0/3938057130 shutdown_connections 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 -- 172.21.15.72:0/3938057130 wait complete. 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.569+0000 7ff311094700 1 Processor -- start 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff311094700 1 -- start start 2024-05-27T09:41:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff311094700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff30c103820 0x7ff30c102ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff311094700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c104720 0x7ff30c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff311094700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff30c105070 0x7ff30c1a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff311094700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c10eef0 con 0x7ff30c103820 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff311094700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c10ed70 con 0x7ff30c104720 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff311094700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c10f070 con 0x7ff30c105070 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c104720 0x7ff30c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c104720 0x7ff30c19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45956/0 (socket says 172.21.15.72:45956) 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 -- 172.21.15.72:0/530129097 learned_addr learned my addr 172.21.15.72:0/530129097 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30b59e700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff30c105070 0x7ff30c1a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30ad9d700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff30c103820 0x7ff30c102ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 -- 172.21.15.72:0/530129097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff30c105070 msgr2=0x7ff30c1a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff30c105070 0x7ff30c1a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 -- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff30c103820 msgr2=0x7ff30c102ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff30c103820 0x7ff30c102ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.570+0000 7ff30a59c700 1 -- 172.21.15.72:0/530129097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c1a2550 con 0x7ff30c104720 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.571+0000 7ff30a59c700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c104720 0x7ff30c19f840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d950 tx=0x7ff2f400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.571+0000 7ff303fff700 1 -- 172.21.15.72:0/530129097 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4016070 con 0x7ff30c104720 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.571+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c1a2840 con 0x7ff30c104720 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.571+0000 7ff303fff700 1 -- 172.21.15.72:0/530129097 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f4009df0 con 0x7ff30c104720 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.571+0000 7ff303fff700 1 -- 172.21.15.72:0/530129097 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400f3c0 con 0x7ff30c104720 2024-05-27T09:41:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.571+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c1a2dd0 con 0x7ff30c104720 2024-05-27T09:41:43.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.572+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c0512b0 con 0x7ff30c104720 2024-05-27T09:41:43.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.573+0000 7ff303fff700 1 -- 172.21.15.72:0/530129097 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff2f4019070 con 0x7ff30c104720 2024-05-27T09:41:43.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.574+0000 7ff303fff700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2f80b2900 0x7ff2f80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:41:43.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.574+0000 7ff303fff700 1 -- 172.21.15.72:0/530129097 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7ff2f40e1560 con 0x7ff30c104720 2024-05-27T09:41:43.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.574+0000 7ff30ad9d700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2f80b2900 0x7ff2f80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:41:43.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.575+0000 7ff30ad9d700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2f80b2900 0x7ff2f80b4e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff30c1046b0 tx=0x7ff304009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:41:43.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.578+0000 7ff303fff700 1 -- 172.21.15.72:0/530129097 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff2f40a9a80 con 0x7ff30c104720 2024-05-27T09:41:43.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:41:43.791+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff30c02e910 con 0x7ff2f80b2900 2024-05-27T09:41:44.703 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:44.703 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi071 2024-05-27T09:41:44.703 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.703 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.703 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.703 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.703 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi071 to 4272M 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:41:44.704 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi071 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi071 to 4272M 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:41:44.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi071 2024-05-27T09:41:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi071 to 4272M 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:41:45.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:46.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:46 smithi071 ceph-mon[31451]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:46.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:46 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/2074282517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]: dispatch 2024-05-27T09:41:46.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:46 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]: dispatch 2024-05-27T09:41:46.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:46 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]': finished 2024-05-27T09:41:46.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:46 smithi071 ceph-mon[31451]: osdmap e63: 11 total, 10 up, 11 in 2024-05-27T09:41:46.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:46 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:41:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:46 smithi122 ceph-mon[36436]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:46 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/2074282517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]: dispatch 2024-05-27T09:41:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:46 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]: dispatch 2024-05-27T09:41:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:46 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]': finished 2024-05-27T09:41:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:46 smithi122 ceph-mon[36436]: osdmap e63: 11 total, 10 up, 11 in 2024-05-27T09:41:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:46 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:41:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:46 smithi072 ceph-mon[35951]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:46 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/2074282517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]: dispatch 2024-05-27T09:41:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:46 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]: dispatch 2024-05-27T09:41:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:46 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d03bc669-3810-4dd5-897c-3672443f1671"}]': finished 2024-05-27T09:41:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:46 smithi072 ceph-mon[35951]: osdmap e63: 11 total, 10 up, 11 in 2024-05-27T09:41:47.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:46 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:41:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:47 smithi122 ceph-mon[36436]: from='client.? 172.21.15.72:0/1421596151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:41:48.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:47 smithi071 ceph-mon[31451]: from='client.? 172.21.15.72:0/1421596151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:41:48.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:47 smithi072 ceph-mon[35951]: from='client.? 172.21.15.72:0/1421596151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:41:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:48 smithi122 ceph-mon[36436]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:49.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:48 smithi071 ceph-mon[31451]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:48 smithi072 ceph-mon[35951]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:50.761 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:50 smithi072 ceph-mon[35951]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:50 smithi122 ceph-mon[36436]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:51.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:50 smithi071 ceph-mon[31451]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:52.934 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:52 smithi072 ceph-mon[35951]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:52 smithi122 ceph-mon[36436]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:52 smithi071 ceph-mon[31451]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:54 smithi122 ceph-mon[36436]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:54 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-27T09:41:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:54 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:54 smithi071 ceph-mon[31451]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:54 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-27T09:41:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:54 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:55.021 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:54 smithi072 ceph-mon[35951]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:55.021 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:54 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-27T09:41:55.021 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:54 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:41:55.932 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:55 smithi072 ceph-mon[35951]: Deploying daemon osd.10 on smithi072 2024-05-27T09:41:55.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:55 smithi122 ceph-mon[36436]: Deploying daemon osd.10 on smithi072 2024-05-27T09:41:56.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:55 smithi071 ceph-mon[31451]: Deploying daemon osd.10 on smithi072 2024-05-27T09:41:56.895 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:56 smithi072 ceph-mon[35951]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:56 smithi122 ceph-mon[36436]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:57.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:56 smithi071 ceph-mon[31451]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:41:58 smithi072 ceph-mon[35951]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:58.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:41:58 smithi122 ceph-mon[36436]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:41:59.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:41:58 smithi071 ceph-mon[31451]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:00 smithi071 ceph-mon[31451]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:01.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:00 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:00 smithi072 ceph-mon[35951]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:01.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:00 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:00 smithi122 ceph-mon[36436]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:00 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:03.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:02 smithi071 ceph-mon[31451]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:02 smithi072 ceph-mon[35951]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:03.218 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 10 on host 'smithi072' 2024-05-27T09:42:03.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.217+0000 7ff303fff700 1 -- 172.21.15.72:0/530129097 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff30c02e910 con 0x7ff2f80b2900 2024-05-27T09:42:03.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.220+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2f80b2900 msgr2=0x7ff2f80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:03.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.220+0000 7ff311094700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2f80b2900 0x7ff2f80b4e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff30c1046b0 tx=0x7ff304009040 comp rx=0 tx=0).stop 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.220+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c104720 msgr2=0x7ff30c19f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.220+0000 7ff311094700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c104720 0x7ff30c19f840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d950 tx=0x7ff2f400dc60 comp rx=0 tx=0).stop 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 shutdown_connections 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff30c105070 0x7ff30c1a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2f80b2900 0x7ff2f80b4e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff30c103820 0x7ff30c102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 --2- 172.21.15.72:0/530129097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff30c104720 0x7ff30c19f840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 >> 172.21.15.72:0/530129097 conn(0x7ff30c0fe010 msgr2=0x7ff30c107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 shutdown_connections 2024-05-27T09:42:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T09:42:03.221+0000 7ff311094700 1 -- 172.21.15.72:0/530129097 wait complete. 2024-05-27T09:42:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:02 smithi122 ceph-mon[36436]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:03.811 DEBUG:teuthology.orchestra.run.smithi072:osd.10> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.10.service 2024-05-27T09:42:03.813 INFO:tasks.cephadm:Deploying osd.11 on smithi122 with /dev/vg_nvme/lv_1... 2024-05-27T09:42:03.813 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-27T09:42:04.058 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:42:04.403 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:04 smithi122 ceph-mon[36436]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:04.403 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.403 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.404 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:04 smithi122 ceph-mon[36436]: from='osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-27T09:42:04.404 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:04 smithi122 ceph-mon[36436]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-27T09:42:04.404 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.404 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:04 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:04 smithi071 ceph-mon[31451]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:04 smithi071 ceph-mon[31451]: from='osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-27T09:42:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:04 smithi071 ceph-mon[31451]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-27T09:42:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:04 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:04 smithi072 ceph-mon[35951]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:04.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:04 smithi072 ceph-mon[35951]: from='osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-27T09:42:04.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:04 smithi072 ceph-mon[35951]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-27T09:42:04.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:04.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:04 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:05.303 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:05 smithi122 ceph-mon[36436]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-27T09:42:05.303 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:05 smithi122 ceph-mon[36436]: from='osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:42:05.303 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:05 smithi122 ceph-mon[36436]: osdmap e64: 11 total, 10 up, 11 in 2024-05-27T09:42:05.304 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:05 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:05.304 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:05 smithi122 ceph-mon[36436]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:42:05.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:05 smithi071 ceph-mon[31451]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-27T09:42:05.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:05 smithi071 ceph-mon[31451]: from='osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:42:05.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:05 smithi071 ceph-mon[31451]: osdmap e64: 11 total, 10 up, 11 in 2024-05-27T09:42:05.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:05 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:05.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:05 smithi071 ceph-mon[31451]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:42:05.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:05 smithi072 ceph-mon[35951]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-27T09:42:05.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:05 smithi072 ceph-mon[35951]: from='osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:42:05.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:05 smithi072 ceph-mon[35951]: osdmap e64: 11 total, 10 up, 11 in 2024-05-27T09:42:05.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:05 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:05.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:05 smithi072 ceph-mon[35951]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-05-27T09:42:05.840 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-27T09:42:05.840 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-27T09:42:05.840 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-05-27T09:42:05.840 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-05-27T09:42:05.840 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111781 s, 938 MB/s 2024-05-27T09:42:05.841 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-05-27T09:42:06.191 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 09:42:06 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T09:42:06.115+0000 7f53c76f3700 -1 osd.10 0 waiting for initial osdmap 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: osdmap e65: 11 total, 10 up, 11 in 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: from='osd.10 ' entity='osd.10' 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: osdmap e66: 11 total, 10 up, 11 in 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.452 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.453 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_1 2024-05-27T09:42:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:42:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: osdmap e65: 11 total, 10 up, 11 in 2024-05-27T09:42:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: from='osd.10 ' entity='osd.10' 2024-05-27T09:42:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: osdmap e66: 11 total, 10 up, 11 in 2024-05-27T09:42:06.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: osdmap e65: 11 total, 10 up, 11 in 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: from='osd.10 ' entity='osd.10' 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: osdmap e66: 11 total, 10 up, 11 in 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.529 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:06.530 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 09:42:06 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T09:42:06.288+0000 7f53bf4a0700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:42:06.692 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:42:07.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:07 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:42:07.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:07 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:42:07.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:07 smithi122 ceph-mon[36436]: osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] boot 2024-05-27T09:42:07.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:07 smithi122 ceph-mon[36436]: osdmap e67: 11 total, 11 up, 11 in 2024-05-27T09:42:07.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:07 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:07.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:07 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:42:07.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:07 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:42:07.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:07 smithi071 ceph-mon[31451]: osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] boot 2024-05-27T09:42:07.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:07 smithi071 ceph-mon[31451]: osdmap e67: 11 total, 11 up, 11 in 2024-05-27T09:42:07.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:07 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:07.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:07 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:42:07.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:07 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:42:07.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:07 smithi072 ceph-mon[35951]: osd.10 [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] boot 2024-05-27T09:42:07.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:07 smithi072 ceph-mon[35951]: osdmap e67: 11 total, 11 up, 11 in 2024-05-27T09:42:07.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:07 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 -- 172.21.15.122:0/4271354555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 msgr2=0x7f3844104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 --2- 172.21.15.122:0/4271354555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f3844104770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3838009990 tx=0x7f3838009ca0 comp rx=0 tx=0).stop 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 -- 172.21.15.122:0/4271354555 shutdown_connections 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 --2- 172.21.15.122:0/4271354555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3844104d00 0x7f384410b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 --2- 172.21.15.122:0/4271354555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3844103230 0x7f3844103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 --2- 172.21.15.122:0/4271354555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f3844104770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 -- 172.21.15.122:0/4271354555 >> 172.21.15.122:0/4271354555 conn(0x7f38440fe870 msgr2=0x7f3844100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 -- 172.21.15.122:0/4271354555 shutdown_connections 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 -- 172.21.15.122:0/4271354555 wait complete. 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.318+0000 7f3849647700 1 Processor -- start 2024-05-27T09:42:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 -- start start 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3844103230 0x7f384406c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f384419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3844104d00 0x7f38441a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f384410ed60 con 0x7f3844103230 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f384410ebe0 con 0x7f3844104d00 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f384410eee0 con 0x7f3844104360 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f384419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f384419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36374/0 (socket says 172.21.15.122:36374) 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 -- 172.21.15.122:0/3067335147 learned_addr learned my addr 172.21.15.122:0/3067335147 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38437fe700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3844104d00 0x7f38441a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 -- 172.21.15.122:0/3067335147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3844104d00 msgr2=0x7f38441a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:08.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3844104d00 0x7f38441a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 -- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3844103230 msgr2=0x7f384406c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3844103230 0x7f384406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 -- 172.21.15.122:0/3067335147 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38441a24e0 con 0x7f3844104360 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f38427fc700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f384419f740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f383800b760 tx=0x7f3838004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f382bfff700 1 -- 172.21.15.122:0/3067335147 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383800fc40 con 0x7f3844104360 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38441a2770 con 0x7f3844104360 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.319+0000 7f382bfff700 1 -- 172.21.15.122:0/3067335147 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f383800fde0 con 0x7f3844104360 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.320+0000 7f382bfff700 1 -- 172.21.15.122:0/3067335147 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38380173f0 con 0x7f3844104360 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.320+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38441a2be0 con 0x7f3844104360 2024-05-27T09:42:08.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.321+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38440512b0 con 0x7f3844104360 2024-05-27T09:42:08.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.323+0000 7f382bfff700 1 -- 172.21.15.122:0/3067335147 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3838028060 con 0x7f3844104360 2024-05-27T09:42:08.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.324+0000 7f382bfff700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f382c0b2880 0x7f382c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:08.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.324+0000 7f382bfff700 1 -- 172.21.15.122:0/3067335147 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6694+0+0 (secure 0 0 0) 0x7f38380e2ef0 con 0x7f3844104360 2024-05-27T09:42:08.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.324+0000 7f3842ffd700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f382c0b2880 0x7f382c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:08.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.325+0000 7f3842ffd700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f382c0b2880 0x7f382c0b4d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3844104260 tx=0x7f38340096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:08.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.328+0000 7f382bfff700 1 -- 172.21.15.122:0/3067335147 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3838013070 con 0x7f3844104360 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi072 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi072 to 4272M 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:08 smithi122 ceph-mon[36436]: osdmap e68: 11 total, 11 up, 11 in 2024-05-27T09:42:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi072 2024-05-27T09:42:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi072 to 4272M 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:08.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.510 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:08 smithi071 ceph-mon[31451]: osdmap e68: 11 total, 11 up, 11 in 2024-05-27T09:42:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi072 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi072 to 4272M 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.528 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:08.528 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:08.528 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:08.528 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:08.528 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:08 smithi072 ceph-mon[35951]: osdmap e68: 11 total, 11 up, 11 in 2024-05-27T09:42:08.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:08.542+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3844063bf0 con 0x7f382c0b2880 2024-05-27T09:42:09.433 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:09 smithi122 ceph-mon[36436]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:42:09.433 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:42:09.433 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:42:09.433 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:09.433 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:09 smithi122 ceph-mon[36436]: osdmap e69: 11 total, 11 up, 11 in 2024-05-27T09:42:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:09 smithi071 ceph-mon[31451]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:42:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:42:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:42:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:09.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:09 smithi071 ceph-mon[31451]: osdmap e69: 11 total, 11 up, 11 in 2024-05-27T09:42:09.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:09 smithi072 ceph-mon[35951]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:42:09.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-27T09:42:09.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-27T09:42:09.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:09.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:09 smithi072 ceph-mon[35951]: osdmap e69: 11 total, 11 up, 11 in 2024-05-27T09:42:10.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:10 smithi122 ceph-mon[36436]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:10.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:10 smithi071 ceph-mon[31451]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:10.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:10 smithi072 ceph-mon[35951]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:12 smithi071 ceph-mon[31451]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-27T09:42:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:12 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/2158410240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]: dispatch 2024-05-27T09:42:12.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:12 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]: dispatch 2024-05-27T09:42:12.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:12 smithi071 ceph-mon[31451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]': finished 2024-05-27T09:42:12.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:12 smithi071 ceph-mon[31451]: osdmap e70: 12 total, 11 up, 12 in 2024-05-27T09:42:12.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:12.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:12 smithi071 ceph-mon[31451]: from='client.? 172.21.15.122:0/1793666103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:42:12.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:12 smithi072 ceph-mon[35951]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-27T09:42:12.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:12 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/2158410240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]: dispatch 2024-05-27T09:42:12.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:12 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]: dispatch 2024-05-27T09:42:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:12 smithi072 ceph-mon[35951]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]': finished 2024-05-27T09:42:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:12 smithi072 ceph-mon[35951]: osdmap e70: 12 total, 11 up, 12 in 2024-05-27T09:42:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:12 smithi072 ceph-mon[35951]: from='client.? 172.21.15.122:0/1793666103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:42:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:12 smithi122 ceph-mon[36436]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-27T09:42:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:12 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/2158410240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]: dispatch 2024-05-27T09:42:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:12 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]: dispatch 2024-05-27T09:42:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:12 smithi122 ceph-mon[36436]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc33924e-d7e4-4173-95f8-a72e6cc81e04"}]': finished 2024-05-27T09:42:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:12 smithi122 ceph-mon[36436]: osdmap e70: 12 total, 11 up, 12 in 2024-05-27T09:42:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:12 smithi122 ceph-mon[36436]: from='client.? 172.21.15.122:0/1793666103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-27T09:42:14.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:14 smithi072 ceph-mon[35951]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-27T09:42:14.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:14 smithi122 ceph-mon[36436]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-27T09:42:14.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:14 smithi071 ceph-mon[31451]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-27T09:42:16.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:16 smithi122 ceph-mon[36436]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-27T09:42:16.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:16 smithi071 ceph-mon[31451]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-27T09:42:16.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:16 smithi072 ceph-mon[35951]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-27T09:42:18.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:18 smithi122 ceph-mon[36436]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:42:18.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:18 smithi071 ceph-mon[31451]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:42:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:18 smithi072 ceph-mon[35951]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-27T09:42:19.467 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-27T09:42:19.468 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:19 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:19.468 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:19 smithi122 ceph-mon[36436]: Deploying daemon osd.11 on smithi122 2024-05-27T09:42:19.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-27T09:42:19.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:19 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:19.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:19 smithi071 ceph-mon[31451]: Deploying daemon osd.11 on smithi122 2024-05-27T09:42:19.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-27T09:42:19.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:19 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:19.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:19 smithi072 ceph-mon[35951]: Deploying daemon osd.11 on smithi122 2024-05-27T09:42:20.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:20 smithi122 ceph-mon[36436]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:42:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:20 smithi071 ceph-mon[31451]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:42:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:20 smithi072 ceph-mon[35951]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-27T09:42:22.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:22 smithi122 ceph-mon[36436]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:22.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:22 smithi071 ceph-mon[31451]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:22.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:22 smithi072 ceph-mon[35951]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:24 smithi122 ceph-mon[36436]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:24.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:24.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:24 smithi071 ceph-mon[31451]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:24.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:24.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:24.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:24.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:24 smithi072 ceph-mon[35951]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:24.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:24.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:24.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:26.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:26 smithi122 ceph-mon[36436]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:26.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:26 smithi071 ceph-mon[31451]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:26.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:26 smithi072 ceph-mon[35951]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:27.776 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 11 on host 'smithi122' 2024-05-27T09:42:27.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.774+0000 7f382bfff700 1 -- 172.21.15.122:0/3067335147 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3844063bf0 con 0x7f382c0b2880 2024-05-27T09:42:27.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f382c0b2880 msgr2=0x7f382c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:27.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f382c0b2880 0x7f382c0b4d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3844104260 tx=0x7f38340096c0 comp rx=0 tx=0).stop 2024-05-27T09:42:27.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 msgr2=0x7f384419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f384419f740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f383800b760 tx=0x7f3838004790 comp rx=0 tx=0).stop 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 shutdown_connections 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3844104d00 0x7f38441a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f382c0b2880 0x7f382c0b4d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3844103230 0x7f384406c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 --2- 172.21.15.122:0/3067335147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3844104360 0x7f384419f740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 >> 172.21.15.122:0/3067335147 conn(0x7f38440fe870 msgr2=0x7f3844107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 shutdown_connections 2024-05-27T09:42:27.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:27.777+0000 7f3849647700 1 -- 172.21.15.122:0/3067335147 wait complete. 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:27.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:27 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:27 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:28.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:28.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:27 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:28.400 DEBUG:teuthology.orchestra.run.smithi122:osd.11> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.11.service 2024-05-27T09:42:28.403 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-27T09:42:28.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-05-27T09:42:28.859 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:42:28.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:28 smithi122 ceph-mon[36436]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:28.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:28 smithi122 ceph-mon[36436]: from='osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-27T09:42:28.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:28 smithi122 ceph-mon[36436]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-27T09:42:29.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:28 smithi071 ceph-mon[31451]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:29.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:28 smithi071 ceph-mon[31451]: from='osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-27T09:42:29.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:28 smithi071 ceph-mon[31451]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-27T09:42:29.222 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:28 smithi072 ceph-mon[35951]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:29.222 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:28 smithi072 ceph-mon[35951]: from='osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-27T09:42:29.222 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:28 smithi072 ceph-mon[35951]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-27T09:42:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:29 smithi122 ceph-mon[36436]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-27T09:42:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:29 smithi122 ceph-mon[36436]: from='osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:42:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:29 smithi122 ceph-mon[36436]: osdmap e71: 12 total, 11 up, 12 in 2024-05-27T09:42:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:29 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:29 smithi122 ceph-mon[36436]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:42:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:29 smithi122 ceph-mon[36436]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:30.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:29 smithi071 ceph-mon[31451]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-27T09:42:30.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:29 smithi071 ceph-mon[31451]: from='osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:42:30.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:29 smithi071 ceph-mon[31451]: osdmap e71: 12 total, 11 up, 12 in 2024-05-27T09:42:30.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:29 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:30.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:29 smithi071 ceph-mon[31451]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:42:30.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:29 smithi071 ceph-mon[31451]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:30.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:29 smithi072 ceph-mon[35951]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-27T09:42:30.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:29 smithi072 ceph-mon[35951]: from='osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:42:30.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:29 smithi072 ceph-mon[35951]: osdmap e71: 12 total, 11 up, 12 in 2024-05-27T09:42:30.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:29 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:30.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:29 smithi072 ceph-mon[35951]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-05-27T09:42:30.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:29 smithi072 ceph-mon[35951]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:30 smithi122 ceph-mon[36436]: purged_snaps scrub starts 2024-05-27T09:42:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:30 smithi122 ceph-mon[36436]: purged_snaps scrub ok 2024-05-27T09:42:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:30 smithi122 ceph-mon[36436]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:42:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:30 smithi122 ceph-mon[36436]: osdmap e72: 12 total, 11 up, 12 in 2024-05-27T09:42:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:30 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:30 smithi122 ceph-mon[36436]: from='osd.11 ' entity='osd.11' 2024-05-27T09:42:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:30 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:30.981 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 09:42:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T09:42:30.740+0000 7fdff533c700 -1 osd.11 0 waiting for initial osdmap 2024-05-27T09:42:30.981 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 09:42:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T09:42:30.788+0000 7fdfed0e9700 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T09:42:30.983 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:30 smithi071 ceph-mon[31451]: purged_snaps scrub starts 2024-05-27T09:42:30.983 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:30 smithi071 ceph-mon[31451]: purged_snaps scrub ok 2024-05-27T09:42:30.983 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:30 smithi071 ceph-mon[31451]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:42:30.983 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:30 smithi071 ceph-mon[31451]: osdmap e72: 12 total, 11 up, 12 in 2024-05-27T09:42:30.984 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:30 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:30.984 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:30 smithi071 ceph-mon[31451]: from='osd.11 ' entity='osd.11' 2024-05-27T09:42:30.984 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:30 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:31.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 -- 172.21.15.71:0/1612423763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081049d0 msgr2=0x7f060810c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:31.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 --2- 172.21.15.71:0/1612423763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081049d0 0x7f060810c6e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f060400b0a0 tx=0x7f060400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 -- 172.21.15.71:0/1612423763 shutdown_connections 2024-05-27T09:42:31.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 --2- 172.21.15.71:0/1612423763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081049d0 0x7f060810c6e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 --2- 172.21.15.71:0/1612423763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06081059a0 0x7f0608105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 --2- 172.21.15.71:0/1612423763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 0x7f0608104360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 -- 172.21.15.71:0/1612423763 >> 172.21.15.71:0/1612423763 conn(0x7f06080ff9c0 msgr2=0x7f0608101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:31.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 -- 172.21.15.71:0/1612423763 shutdown_connections 2024-05-27T09:42:31.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.228+0000 7f0610800700 1 -- 172.21.15.71:0/1612423763 wait complete. 2024-05-27T09:42:31.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.230+0000 7f0610800700 1 Processor -- start 2024-05-27T09:42:31.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f0610800700 1 -- start start 2024-05-27T09:42:31.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f0610800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 0x7f060819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:31.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f0610800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06081049d0 0x7f060819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:31.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f0610800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081059a0 0x7f06081a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:31.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f0610800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f060810ff30 con 0x7f06081059a0 2024-05-27T09:42:31.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f0610800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f060810fdb0 con 0x7f06081049d0 2024-05-27T09:42:31.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f0610800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f06081100b0 con 0x7f0608103f50 2024-05-27T09:42:31.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f060de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 0x7f060819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:31.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f060de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 0x7f060819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:60540/0 (socket says 172.21.15.71:60540) 2024-05-27T09:42:31.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f060de00700 1 -- 172.21.15.71:0/3338565814 learned_addr learned my addr 172.21.15.71:0/3338565814 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:42:31.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.231+0000 7f060d400700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06081049d0 0x7f060819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:31.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.232+0000 7f060e800700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081059a0 0x7f06081a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:31.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.232+0000 7f060de00700 1 -- 172.21.15.71:0/3338565814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06081049d0 msgr2=0x7f060819aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:31.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.232+0000 7f060de00700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06081049d0 0x7f060819aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.232+0000 7f060de00700 1 -- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081059a0 msgr2=0x7f06081a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.232+0000 7f060de00700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081059a0 0x7f06081a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.232+0000 7f060de00700 1 -- 172.21.15.71:0/3338565814 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06081a2510 con 0x7f0608103f50 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.233+0000 7f060de00700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 0x7f060819a9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00e940 tx=0x7f05fc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.233+0000 7f0602a00700 1 -- 172.21.15.71:0/3338565814 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc004220 con 0x7f0608103f50 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.233+0000 7f0602a00700 1 -- 172.21.15.71:0/3338565814 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05fc0043c0 con 0x7f0608103f50 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.233+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06081a2800 con 0x7f0608103f50 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.233+0000 7f0602a00700 1 -- 172.21.15.71:0/3338565814 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc003c60 con 0x7f0608103f50 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.233+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081a2d40 con 0x7f0608103f50 2024-05-27T09:42:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.234+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06080512b0 con 0x7f0608103f50 2024-05-27T09:42:31.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.237+0000 7f0602a00700 1 -- 172.21.15.71:0/3338565814 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f05fc046910 con 0x7f0608103f50 2024-05-27T09:42:31.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.238+0000 7f0602a00700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f05f00b2880 0x7f05f00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:31.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.238+0000 7f0602a00700 1 -- 172.21.15.71:0/3338565814 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6847+0+0 (secure 0 0 0) 0x7f05fc0e1e70 con 0x7f0608103f50 2024-05-27T09:42:31.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.238+0000 7f060d400700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f05f00b2880 0x7f05f00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:31.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.239+0000 7f060d400700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f05f00b2880 0x7f05f00b4d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f060819ba60 tx=0x7f05f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:31.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.240+0000 7f0602a00700 1 -- 172.21.15.71:0/3338565814 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f05fc0aa0b0 con 0x7f0608103f50 2024-05-27T09:42:31.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:30 smithi072 ceph-mon[35951]: purged_snaps scrub starts 2024-05-27T09:42:31.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:30 smithi072 ceph-mon[35951]: purged_snaps scrub ok 2024-05-27T09:42:31.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:30 smithi072 ceph-mon[35951]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-05-27T09:42:31.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:30 smithi072 ceph-mon[35951]: osdmap e72: 12 total, 11 up, 12 in 2024-05-27T09:42:31.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:30 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:31.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:30 smithi072 ceph-mon[35951]: from='osd.11 ' entity='osd.11' 2024-05-27T09:42:31.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:30 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:31.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.484+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f060802ea10 con 0x7f0608103f50 2024-05-27T09:42:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:42:31.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.485+0000 7f0602a00700 1 -- 172.21.15.71:0/3338565814 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f05fc0a99b0 con 0x7f0608103f50 2024-05-27T09:42:31.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f05f00b2880 msgr2=0x7f05f00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:31.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f05f00b2880 0x7f05f00b4d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f060819ba60 tx=0x7f05f8009260 comp rx=0 tx=0).stop 2024-05-27T09:42:31.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 msgr2=0x7f060819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 0x7f060819a9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00e940 tx=0x7f05fc00ec50 comp rx=0 tx=0).stop 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 shutdown_connections 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f05f00b2880 0x7f05f00b4d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06081059a0 0x7f06081a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608103f50 0x7f060819a9b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 --2- 172.21.15.71:0/3338565814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06081049d0 0x7f060819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 >> 172.21.15.71:0/3338565814 conn(0x7f06080ff9c0 msgr2=0x7f06081086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 shutdown_connections 2024-05-27T09:42:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:31.488+0000 7f0610800700 1 -- 172.21.15.71:0/3338565814 wait complete. 2024-05-27T09:42:32.281 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1716802927,"num_in_osds":12,"osd_in_since":1716802931,"num_remapped_pgs":0} 2024-05-27T09:42:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: Detected new or changed devices on smithi122 2024-05-27T09:42:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi122 to 4272M 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3338565814' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] boot 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: osdmap e73: 12 total, 12 up, 12 in 2024-05-27T09:42:32.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:32.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:32.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: Detected new or changed devices on smithi122 2024-05-27T09:42:32.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi122 to 4272M 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3338565814' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] boot 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: osdmap e73: 12 total, 12 up, 12 in 2024-05-27T09:42:32.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: Detected new or changed devices on smithi122 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi122 to 4272M 2024-05-27T09:42:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:32.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:32.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:32.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3338565814' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-27T09:42:32.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: osd.11 [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] boot 2024-05-27T09:42:32.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: osdmap e73: 12 total, 12 up, 12 in 2024-05-27T09:42:32.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:42:33.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-05-27T09:42:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:42:34.122 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:33 smithi071 ceph-mon[31451]: osdmap e74: 12 total, 12 up, 12 in 2024-05-27T09:42:34.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:33 smithi071 ceph-mon[31451]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:34.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:33 smithi122 ceph-mon[36436]: osdmap e74: 12 total, 12 up, 12 in 2024-05-27T09:42:34.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:33 smithi122 ceph-mon[36436]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:34.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:33 smithi072 ceph-mon[35951]: osdmap e74: 12 total, 12 up, 12 in 2024-05-27T09:42:34.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:33 smithi072 ceph-mon[35951]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:35.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.879+0000 7fd65be00700 1 -- 172.21.15.71:0/840279660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65410c1e0 msgr2=0x7fd65410e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:35.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.879+0000 7fd65be00700 1 --2- 172.21.15.71:0/840279660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65410c1e0 0x7fd65410e6f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00b0a0 tx=0x7fd64c00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:42:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.880+0000 7fd65be00700 1 -- 172.21.15.71:0/840279660 shutdown_connections 2024-05-27T09:42:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.880+0000 7fd65be00700 1 --2- 172.21.15.71:0/840279660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd65410c1e0 0x7fd65410e6f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.880+0000 7fd65be00700 1 --2- 172.21.15.71:0/840279660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6540776d0 0x7fd654075ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.880+0000 7fd65be00700 1 --2- 172.21.15.71:0/840279660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 0x7fd654076570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.880+0000 7fd65be00700 1 -- 172.21.15.71:0/840279660 >> 172.21.15.71:0/840279660 conn(0x7fd6540ff9b0 msgr2=0x7fd654101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.880+0000 7fd65be00700 1 -- 172.21.15.71:0/840279660 shutdown_connections 2024-05-27T09:42:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.880+0000 7fd65be00700 1 -- 172.21.15.71:0/840279660 wait complete. 2024-05-27T09:42:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.881+0000 7fd65be00700 1 Processor -- start 2024-05-27T09:42:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd65be00700 1 -- start start 2024-05-27T09:42:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd65be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 0x7fd65419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd65be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6540776d0 0x7fd65419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd65be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd65410c1e0 0x7fd6541a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd65be00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd654111f90 con 0x7fd6540776d0 2024-05-27T09:42:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd65be00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd654111e10 con 0x7fd65410c1e0 2024-05-27T09:42:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd65be00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd654112110 con 0x7fd6540760e0 2024-05-27T09:42:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd658a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6540776d0 0x7fd65419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.882+0000 7fd659400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 0x7fd65419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 0x7fd65419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:49862/0 (socket says 172.21.15.71:49862) 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd65410c1e0 0x7fd6541a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 -- 172.21.15.71:0/1395345683 learned_addr learned my addr 172.21.15.71:0/1395345683 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 -- 172.21.15.71:0/1395345683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd65410c1e0 msgr2=0x7fd6541a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd65410c1e0 0x7fd6541a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 -- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6540776d0 msgr2=0x7fd65419cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6540776d0 0x7fd65419cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 -- 172.21.15.71:0/1395345683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6541a45d0 con 0x7fd6540760e0 2024-05-27T09:42:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.883+0000 7fd659400700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 0x7fd65419ca70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd64800e970 tx=0x7fd64800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:35.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.884+0000 7fd652000700 1 -- 172.21.15.71:0/1395345683 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648004a30 con 0x7fd6540760e0 2024-05-27T09:42:35.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.884+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6541a48c0 con 0x7fd6540760e0 2024-05-27T09:42:35.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.884+0000 7fd652000700 1 -- 172.21.15.71:0/1395345683 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd64800cc90 con 0x7fd6540760e0 2024-05-27T09:42:35.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.884+0000 7fd652000700 1 -- 172.21.15.71:0/1395345683 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648005610 con 0x7fd6540760e0 2024-05-27T09:42:35.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.884+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6541a4e50 con 0x7fd6540760e0 2024-05-27T09:42:35.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.885+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6540512b0 con 0x7fd6540760e0 2024-05-27T09:42:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.888+0000 7fd652000700 1 -- 172.21.15.71:0/1395345683 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd64800c7e0 con 0x7fd6540760e0 2024-05-27T09:42:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.889+0000 7fd652000700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd63c0b2880 0x7fd63c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.889+0000 7fd652000700 1 -- 172.21.15.71:0/1395345683 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd6480e21f0 con 0x7fd6540760e0 2024-05-27T09:42:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.889+0000 7fd658a00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd63c0b2880 0x7fd63c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.890+0000 7fd658a00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd63c0b2880 0x7fd63c0b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd65419db20 tx=0x7fd640009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:35.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:35.891+0000 7fd652000700 1 -- 172.21.15.71:0/1395345683 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd648054df0 con 0x7fd6540760e0 2024-05-27T09:42:36.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.124+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd65402e5e0 con 0x7fd6540760e0 2024-05-27T09:42:36.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.125+0000 7fd652000700 1 -- 172.21.15.71:0/1395345683 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fd6480aa310 con 0x7fd6540760e0 2024-05-27T09:42:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:42:36.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.128+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd63c0b2880 msgr2=0x7fd63c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:36.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.128+0000 7fd65be00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd63c0b2880 0x7fd63c0b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd65419db20 tx=0x7fd640009260 comp rx=0 tx=0).stop 2024-05-27T09:42:36.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 msgr2=0x7fd65419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:36.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 0x7fd65419ca70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd64800e970 tx=0x7fd64800ec80 comp rx=0 tx=0).stop 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 shutdown_connections 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd65410c1e0 0x7fd6541a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6540760e0 0x7fd65419ca70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd63c0b2880 0x7fd63c0b4d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 --2- 172.21.15.71:0/1395345683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6540776d0 0x7fd65419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 >> 172.21.15.71:0/1395345683 conn(0x7fd6540ff9b0 msgr2=0x7fd654108170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 shutdown_connections 2024-05-27T09:42:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:36.129+0000 7fd65be00700 1 -- 172.21.15.71:0/1395345683 wait complete. 2024-05-27T09:42:36.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:36 smithi122 ceph-mon[36436]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:36.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:36 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1395345683' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-27T09:42:36.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:36 smithi071 ceph-mon[31451]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:36.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:36 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1395345683' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-27T09:42:36.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:36 smithi072 ceph-mon[35951]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:36.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:36 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1395345683' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-27T09:42:36.932 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1716802951,"num_in_osds":12,"osd_in_since":1716802931,"num_remapped_pgs":0} 2024-05-27T09:42:36.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:42:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:42:38.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:38 smithi122 ceph-mon[36436]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:38.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:38 smithi071 ceph-mon[31451]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:38.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:38 smithi072 ceph-mon[35951]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:39.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 -- 172.21.15.71:0/1922254868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 msgr2=0x7fc9981049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:39.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 --2- 172.21.15.71:0/1922254868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 0x7fc9981049f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc98800b0d0 tx=0x7fc98800b3e0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 -- 172.21.15.71:0/1922254868 shutdown_connections 2024-05-27T09:42:39.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 --2- 172.21.15.71:0/1922254868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc998109860 0x7fc9981111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 --2- 172.21.15.71:0/1922254868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 0x7fc9981049f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 --2- 172.21.15.71:0/1922254868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 0x7fc998109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 -- 172.21.15.71:0/1922254868 >> 172.21.15.71:0/1922254868 conn(0x7fc998100030 msgr2=0x7fc998102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:39.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 -- 172.21.15.71:0/1922254868 shutdown_connections 2024-05-27T09:42:39.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.582+0000 7fc99e000700 1 -- 172.21.15.71:0/1922254868 wait complete. 2024-05-27T09:42:39.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.583+0000 7fc99e000700 1 Processor -- start 2024-05-27T09:42:39.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc99e000700 1 -- start start 2024-05-27T09:42:39.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc99e000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 0x7fc99819d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc99e000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 0x7fc99819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc99e000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc998109860 0x7fc9981a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc99e000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981144e0 con 0x7fc9981045e0 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc99e000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc998114360 con 0x7fc998108f10 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc99e000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc998114660 con 0x7fc998109860 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc98ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 0x7fc99819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc98ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 0x7fc99819d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:59612/0 (socket says 172.21.15.71:59612) 2024-05-27T09:42:39.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc98ea00700 1 -- 172.21.15.71:0/735468349 learned_addr learned my addr 172.21.15.71:0/735468349 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:42:39.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.584+0000 7fc997400700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 0x7fc99819d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:39.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc997e00700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc998109860 0x7fc9981a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:39.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc98ea00700 1 -- 172.21.15.71:0/735468349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc998109860 msgr2=0x7fc9981a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc98ea00700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc998109860 0x7fc9981a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc98ea00700 1 -- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 msgr2=0x7fc99819d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc98ea00700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 0x7fc99819d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc98ea00700 1 -- 172.21.15.71:0/735468349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9981a1f40 con 0x7fc998108f10 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc997400700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 0x7fc99819d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.585+0000 7fc98ea00700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 0x7fc99819d610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc98000ea30 tx=0x7fc98000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.586+0000 7fc994c00700 1 -- 172.21.15.71:0/735468349 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98000cbd0 con 0x7fc998108f10 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.586+0000 7fc994c00700 1 -- 172.21.15.71:0/735468349 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9800044d0 con 0x7fc998108f10 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.586+0000 7fc994c00700 1 -- 172.21.15.71:0/735468349 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980003dc0 con 0x7fc998108f10 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.586+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9981a2230 con 0x7fc998108f10 2024-05-27T09:42:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.586+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9981a9b50 con 0x7fc998108f10 2024-05-27T09:42:39.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.587+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9980512b0 con 0x7fc998108f10 2024-05-27T09:42:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.589+0000 7fc994c00700 1 -- 172.21.15.71:0/735468349 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc980003f60 con 0x7fc998108f10 2024-05-27T09:42:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.591+0000 7fc994c00700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc97c0b2900 0x7fc97c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.591+0000 7fc994c00700 1 -- 172.21.15.71:0/735468349 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fc9800e1ef0 con 0x7fc998108f10 2024-05-27T09:42:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.591+0000 7fc997400700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc97c0b2900 0x7fc97c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.592+0000 7fc997400700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc97c0b2900 0x7fc97c0b4e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98800bfd0 tx=0x7fc98800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:39.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.593+0000 7fc994c00700 1 -- 172.21.15.71:0/735468349 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc9800aa010 con 0x7fc998108f10 2024-05-27T09:42:39.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.825+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc99819e3d0 con 0x7fc998108f10 2024-05-27T09:42:39.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.827+0000 7fc994c00700 1 -- 172.21.15.71:0/735468349 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18408 (secure 0 0 0) 0x7fc99819e3d0 con 0x7fc998108f10 2024-05-27T09:42:39.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:42:39.828 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:42:32.869940+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc97c0b2900 msgr2=0x7fc97c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc97c0b2900 0x7fc97c0b4e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98800bfd0 tx=0x7fc98800b040 comp rx=0 tx=0).stop 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 msgr2=0x7fc99819d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 0x7fc99819d610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc98000ea30 tx=0x7fc98000ed40 comp rx=0 tx=0).stop 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 shutdown_connections 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc998109860 0x7fc9981a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc97c0b2900 0x7fc97c0b4e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9981045e0 0x7fc99819d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 --2- 172.21.15.71:0/735468349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc998108f10 0x7fc99819d610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:39.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 >> 172.21.15.71:0/735468349 conn(0x7fc998100030 msgr2=0x7fc998108680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:39.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 shutdown_connections 2024-05-27T09:42:39.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:39.830+0000 7fc99e000700 1 -- 172.21.15.71:0/735468349 wait complete. 2024-05-27T09:42:40.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:40 smithi122 ceph-mon[36436]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:40.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:40 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/735468349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:42:40.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:40 smithi071 ceph-mon[31451]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:40.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:40 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/735468349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:42:40.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:40 smithi072 ceph-mon[35951]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:40.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:40 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/735468349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:42:40.658 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T09:38:13.148765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T09:42:40.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-27T09:42:41.091 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:42:42.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:42 smithi071 ceph-mon[31451]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:42.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:42 smithi122 ceph-mon[36436]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:42.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:42 smithi072 ceph-mon[35951]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.246+0000 7f4311e00700 1 -- 172.21.15.71:0/1923286493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106ec0 msgr2=0x7f430c113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 --2- 172.21.15.71:0/1923286493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106ec0 0x7f430c113350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f430400b0a0 tx=0x7f430400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 -- 172.21.15.71:0/1923286493 shutdown_connections 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 --2- 172.21.15.71:0/1923286493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106ec0 0x7f430c113350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 --2- 172.21.15.71:0/1923286493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f430c10c5b0 0x7f430c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 --2- 172.21.15.71:0/1923286493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430c106570 0x7f430c106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 -- 172.21.15.71:0/1923286493 >> 172.21.15.71:0/1923286493 conn(0x7f430c102070 msgr2=0x7f430c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 -- 172.21.15.71:0/1923286493 shutdown_connections 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.247+0000 7f4311e00700 1 -- 172.21.15.71:0/1923286493 wait complete. 2024-05-27T09:42:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.248+0000 7f4311e00700 1 Processor -- start 2024-05-27T09:42:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.248+0000 7f4311e00700 1 -- start start 2024-05-27T09:42:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f4311e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106570 0x7f430c19d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f4311e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f430c106ec0 0x7f430c19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f4311e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430c10c5b0 0x7f430c1a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f4311e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f430c116730 con 0x7f430c10c5b0 2024-05-27T09:42:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f4311e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f430c1165b0 con 0x7f430c106570 2024-05-27T09:42:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f4311e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f430c1168b0 con 0x7f430c106ec0 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f430aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106570 0x7f430c19d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f430aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106570 0x7f430c19d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:59626/0 (socket says 172.21.15.71:59626) 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f430aa00700 1 -- 172.21.15.71:0/1943391045 learned_addr learned my addr 172.21.15.71:0/1943391045 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f430a000700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f430c106ec0 0x7f430c19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.249+0000 7f430b400700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430c10c5b0 0x7f430c1a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f430aa00700 1 -- 172.21.15.71:0/1943391045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f430c106ec0 msgr2=0x7f430c19d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f430aa00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f430c106ec0 0x7f430c19d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f430aa00700 1 -- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430c10c5b0 msgr2=0x7f430c1a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f430aa00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430c10c5b0 0x7f430c1a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f430aa00700 1 -- 172.21.15.71:0/1943391045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c1a1ed0 con 0x7f430c106570 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f430b400700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430c10c5b0 0x7f430c1a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f430aa00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106570 0x7f430c19d000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00e970 tx=0x7f42fc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f4310a00700 1 -- 172.21.15.71:0/1943391045 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00cbd0 con 0x7f430c106570 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f4310a00700 1 -- 172.21.15.71:0/1943391045 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42fc00cd70 con 0x7f430c106570 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c1a21c0 con 0x7f430c106570 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.250+0000 7f4310a00700 1 -- 172.21.15.71:0/1943391045 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc005680 con 0x7f430c106570 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.251+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c1a9ae0 con 0x7f430c106570 2024-05-27T09:42:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.252+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430c0512b0 con 0x7f430c106570 2024-05-27T09:42:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.254+0000 7f4310a00700 1 -- 172.21.15.71:0/1943391045 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f42fc004750 con 0x7f430c106570 2024-05-27T09:42:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.256+0000 7f4310a00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42f00b2900 0x7f42f00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.256+0000 7f4310a00700 1 -- 172.21.15.71:0/1943391045 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f42fc0e1f30 con 0x7f430c106570 2024-05-27T09:42:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.256+0000 7f430a000700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42f00b2900 0x7f42f00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.257+0000 7f430a000700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42f00b2900 0x7f42f00b4e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009680 tx=0x7f42f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.260+0000 7f4310a00700 1 -- 172.21.15.71:0/1943391045 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f42fc0aa0f0 con 0x7f430c106570 2024-05-27T09:42:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.489+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f430c19e360 con 0x7f430c106570 2024-05-27T09:42:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.490+0000 7f4310a00700 1 -- 172.21.15.71:0/1943391045 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f42fc0a99f0 con 0x7f430c106570 2024-05-27T09:42:43.490 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-05-27T09:42:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42f00b2900 msgr2=0x7f42f00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42f00b2900 0x7f42f00b4e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009680 tx=0x7f42f8009260 comp rx=0 tx=0).stop 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106570 msgr2=0x7f430c19d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106570 0x7f430c19d000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00e970 tx=0x7f42fc00ec80 comp rx=0 tx=0).stop 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 shutdown_connections 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42f00b2900 0x7f42f00b4e10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430c10c5b0 0x7f430c1a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430c106570 0x7f430c19d000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 --2- 172.21.15.71:0/1943391045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f430c106ec0 0x7f430c19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 >> 172.21.15.71:0/1943391045 conn(0x7f430c102070 msgr2=0x7f430c104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 shutdown_connections 2024-05-27T09:42:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:43.493+0000 7f4311e00700 1 -- 172.21.15.71:0/1943391045 wait complete. 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.a on smithi071 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.d on smithi071 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.g on smithi071 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.j on smithi071 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.b on smithi072 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.e on smithi072 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.h on smithi072 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.k on smithi072 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.c on smithi122 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.f on smithi122 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.i on smithi122 2024-05-27T09:42:44.203 INFO:tasks.cephadm:Adding mds.l on smithi122 2024-05-27T09:42:44.204 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l' 2024-05-27T09:42:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T09:42:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:44 smithi122 ceph-mon[36436]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:44.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:44 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1943391045' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:42:44.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:44 smithi071 ceph-mon[31451]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:44.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:44 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1943391045' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:42:44.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:44 smithi072 ceph-mon[35951]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:44.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:44 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1943391045' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:42:46.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 -- 172.21.15.122:0/4122062439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104d20 msgr2=0x7feacc10b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 --2- 172.21.15.122:0/4122062439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104d20 0x7feacc10b5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feac400b0a0 tx=0x7feac400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 -- 172.21.15.122:0/4122062439 shutdown_connections 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 --2- 172.21.15.122:0/4122062439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104d20 0x7feacc10b5d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 --2- 172.21.15.122:0/4122062439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feacc103250 0x7feacc103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 --2- 172.21.15.122:0/4122062439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feacc104380 0x7feacc104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 -- 172.21.15.122:0/4122062439 >> 172.21.15.122:0/4122062439 conn(0x7feacc0fe8b0 msgr2=0x7feacc100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 -- 172.21.15.122:0/4122062439 shutdown_connections 2024-05-27T09:42:46.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.071+0000 7fead29e4700 1 -- 172.21.15.122:0/4122062439 wait complete. 2024-05-27T09:42:46.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 Processor -- start 2024-05-27T09:42:46.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 -- start start 2024-05-27T09:42:46.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feacc103250 0x7feacc1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:46.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104380 0x7feacc199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feacc104d20 0x7feacc1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feacc10edb0 con 0x7feacc104d20 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feacc10ec30 con 0x7feacc103250 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7fead29e4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feacc10ef30 con 0x7feacc104380 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.072+0000 7feacb7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104380 0x7feacc199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104380 0x7feacc199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45018/0 (socket says 172.21.15.122:45018) 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 -- 172.21.15.122:0/2280248676 learned_addr learned my addr 172.21.15.122:0/2280248676 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacbfff700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feacc103250 0x7feacc1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 -- 172.21.15.122:0/2280248676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feacc103250 msgr2=0x7feacc1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feacc103250 0x7feacc1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 -- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feacc104d20 msgr2=0x7feacc1a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feacc104d20 0x7feacc1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 -- 172.21.15.122:0/2280248676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feacc075a60 con 0x7feacc104380 2024-05-27T09:42:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feacb7fe700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104380 0x7feacc199e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feac000b530 tx=0x7feac000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feac97fa700 1 -- 172.21.15.122:0/2280248676 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac0015020 con 0x7feacc104380 2024-05-27T09:42:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feac97fa700 1 -- 172.21.15.122:0/2280248676 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feac0011ce0 con 0x7feacc104380 2024-05-27T09:42:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feacc075d50 con 0x7feacc104380 2024-05-27T09:42:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7feac97fa700 1 -- 172.21.15.122:0/2280248676 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac0010d20 con 0x7feacc104380 2024-05-27T09:42:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.073+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feacc076310 con 0x7feacc104380 2024-05-27T09:42:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.074+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feacc0512b0 con 0x7feacc104380 2024-05-27T09:42:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.077+0000 7feac97fa700 1 -- 172.21.15.122:0/2280248676 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7feac0018020 con 0x7feacc104380 2024-05-27T09:42:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.077+0000 7feac97fa700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feab40b2880 0x7feab40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.077+0000 7feac97fa700 1 -- 172.21.15.122:0/2280248676 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7feac00e1b20 con 0x7feacc104380 2024-05-27T09:42:46.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.078+0000 7feacbfff700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feab40b2880 0x7feab40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:46.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.079+0000 7feacbfff700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feab40b2880 0x7feab40b4d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feabc006fd0 tx=0x7feabc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:46.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.081+0000 7feac97fa700 1 -- 172.21.15.122:0/2280248676 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feac001f020 con 0x7feacc104380 2024-05-27T09:42:46.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.295+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}) -- 0x7feacc02e850 con 0x7feab40b2880 2024-05-27T09:42:46.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.314+0000 7feac97fa700 1 -- 172.21.15.122:0/2280248676 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7feacc02e850 con 0x7feab40b2880 2024-05-27T09:42:46.314 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mds.all update... 2024-05-27T09:42:46.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feab40b2880 msgr2=0x7feab40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:46.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feab40b2880 0x7feab40b4d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feabc006fd0 tx=0x7feabc008040 comp rx=0 tx=0).stop 2024-05-27T09:42:46.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104380 msgr2=0x7feacc199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:46.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104380 0x7feacc199e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feac000b530 tx=0x7feac000b8f0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 shutdown_connections 2024-05-27T09:42:46.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feab40b2880 0x7feab40b4d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feacc104d20 0x7feacc1a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feacc103250 0x7feacc1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 --2- 172.21.15.122:0/2280248676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feacc104380 0x7feacc199e00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:46.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 >> 172.21.15.122:0/2280248676 conn(0x7feacc0fe8b0 msgr2=0x7feacc1075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:46.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 shutdown_connections 2024-05-27T09:42:46.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-27T09:42:46.316+0000 7fead29e4700 1 -- 172.21.15.122:0/2280248676 wait complete. 2024-05-27T09:42:46.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:46 smithi122 ceph-mon[36436]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:46.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:46 smithi071 ceph-mon[31451]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:46.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:46 smithi072 ceph-mon[35951]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:46.993 DEBUG:teuthology.orchestra.run.smithi071:mds.a> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.a.service 2024-05-27T09:42:47.003 DEBUG:teuthology.orchestra.run.smithi071:mds.d> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.d.service 2024-05-27T09:42:47.049 DEBUG:teuthology.orchestra.run.smithi071:mds.g> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.g.service 2024-05-27T09:42:47.094 DEBUG:teuthology.orchestra.run.smithi071:mds.j> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.j.service 2024-05-27T09:42:47.141 DEBUG:teuthology.orchestra.run.smithi072:mds.b> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.b.service 2024-05-27T09:42:47.143 DEBUG:teuthology.orchestra.run.smithi072:mds.e> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.e.service 2024-05-27T09:42:47.186 DEBUG:teuthology.orchestra.run.smithi072:mds.h> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.h.service 2024-05-27T09:42:47.229 DEBUG:teuthology.orchestra.run.smithi072:mds.k> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.k.service 2024-05-27T09:42:47.272 DEBUG:teuthology.orchestra.run.smithi122:mds.c> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.c.service 2024-05-27T09:42:47.275 DEBUG:teuthology.orchestra.run.smithi122:mds.f> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.f.service 2024-05-27T09:42:47.319 DEBUG:teuthology.orchestra.run.smithi122:mds.i> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.i.service 2024-05-27T09:42:47.362 DEBUG:teuthology.orchestra.run.smithi122:mds.l> sudo journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.l.service 2024-05-27T09:42:47.405 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-27T09:42:47.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:42:47.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:47 smithi072 ceph-mon[35951]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:42:47.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:47 smithi072 ceph-mon[35951]: Saving service mds.all spec with placement smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-05-27T09:42:47.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:47 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:47.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:47 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:47.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:47 smithi122 ceph-mon[36436]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:42:47.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:47 smithi122 ceph-mon[36436]: Saving service mds.all spec with placement smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-05-27T09:42:47.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:47 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:47.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:47 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:47 smithi071 ceph-mon[31451]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:42:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:47 smithi071 ceph-mon[31451]: Saving service mds.all spec with placement smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-05-27T09:42:47.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:47 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:47.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:47 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:42:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:48.461 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:48 smithi122 ceph-mon[36436]: Deploying daemon mds.l on smithi122 2024-05-27T09:42:48.752 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:48 smithi071 ceph-mon[31451]: Deploying daemon mds.l on smithi122 2024-05-27T09:42:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:42:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:48 smithi072 ceph-mon[35951]: Deploying daemon mds.l on smithi122 2024-05-27T09:42:49.730 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:49 smithi122 systemd[1]: Starting Ceph mds.l for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:42:49.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 -- 172.21.15.71:0/1048176666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c106610 msgr2=0x7f209c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:49.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 --2- 172.21.15.71:0/1048176666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c106610 0x7f209c106a20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f208c0099c0 tx=0x7f208c009cd0 comp rx=0 tx=0).stop 2024-05-27T09:42:49.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 -- 172.21.15.71:0/1048176666 shutdown_connections 2024-05-27T09:42:49.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 --2- 172.21.15.71:0/1048176666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f209c10b890 0x7f209c1131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:49.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 --2- 172.21.15.71:0/1048176666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c106610 0x7f209c106a20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:49.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 --2- 172.21.15.71:0/1048176666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209c10af40 0x7f209c10b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:49.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 -- 172.21.15.71:0/1048176666 >> 172.21.15.71:0/1048176666 conn(0x7f209c102020 msgr2=0x7f209c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:49.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 -- 172.21.15.71:0/1048176666 shutdown_connections 2024-05-27T09:42:49.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.908+0000 7f20a1400700 1 -- 172.21.15.71:0/1048176666 wait complete. 2024-05-27T09:42:49.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.909+0000 7f20a1400700 1 Processor -- start 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.909+0000 7f20a1400700 1 -- start start 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f20a1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209c106610 0x7f209c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f20a1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f209c10af40 0x7f209c19d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f20a1400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c10b890 0x7f209c1a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f20a1400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f209c116510 con 0x7f209c10b890 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f20a1400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f209c116390 con 0x7f209c10af40 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f20a1400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f209c116690 con 0x7f209c106610 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f209c10af40 0x7f209c19d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:49.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209c106610 0x7f209c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f20a0a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c10b890 0x7f209c1a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f209c10af40 0x7f209c19d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47474/0 (socket says 172.21.15.71:47474) 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209b400700 1 -- 172.21.15.71:0/1400629897 learned_addr learned my addr 172.21.15.71:0/1400629897 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209be00700 1 -- 172.21.15.71:0/1400629897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f209c10af40 msgr2=0x7f209c19d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209be00700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f209c10af40 0x7f209c19d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209be00700 1 -- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c10b890 msgr2=0x7f209c1a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209be00700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c10b890 0x7f209c1a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.910+0000 7f209be00700 1 -- 172.21.15.71:0/1400629897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1a1cf0 con 0x7f209c106610 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.911+0000 7f209be00700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209c106610 0x7f209c19ce20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f208c0098e0 tx=0x7f208c005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:49.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.911+0000 7f2098c00700 1 -- 172.21.15.71:0/1400629897 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c026070 con 0x7f209c106610 2024-05-27T09:42:49.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.911+0000 7f2098c00700 1 -- 172.21.15.71:0/1400629897 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f208c0056c0 con 0x7f209c106610 2024-05-27T09:42:49.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.911+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c1a1f80 con 0x7f209c106610 2024-05-27T09:42:49.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.911+0000 7f2098c00700 1 -- 172.21.15.71:0/1400629897 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c00f990 con 0x7f209c106610 2024-05-27T09:42:49.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.911+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c1a2460 con 0x7f209c106610 2024-05-27T09:42:49.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.912+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c0512b0 con 0x7f209c106610 2024-05-27T09:42:49.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.914+0000 7f2098c00700 1 -- 172.21.15.71:0/1400629897 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f208c029070 con 0x7f209c106610 2024-05-27T09:42:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.916+0000 7f2098c00700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20800b2880 0x7f20800b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.916+0000 7f2098c00700 1 -- 172.21.15.71:0/1400629897 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f208c0e2630 con 0x7f209c106610 2024-05-27T09:42:49.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.916+0000 7f209b400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20800b2880 0x7f20800b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:49.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.917+0000 7f209b400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20800b2880 0x7f20800b4d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2088009680 tx=0x7f2088009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:49.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:49.920+0000 7f2098c00700 1 -- 172.21.15.71:0/1400629897 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f208c013070 con 0x7f209c106610 2024-05-27T09:42:50.088 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:49 smithi122 podman[66875]: 2024-05-27 09:42:49.719970873 +0000 UTC m=+0.017290508 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:42:50.088 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:49 smithi122 podman[66875]: 2024-05-27 09:42:49.842090655 +0000 UTC m=+0.139410290 container create 8e37ca59b9a5053a6e27d6e8ede9f0e7e21c6525267cd84809ba9f0ab8911664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T09:42:50.089 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:50 smithi122 podman[66875]: 2024-05-27 09:42:50.052796028 +0000 UTC m=+0.350115663 container init 8e37ca59b9a5053a6e27d6e8ede9f0e7e21c6525267cd84809ba9f0ab8911664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521) 2024-05-27T09:42:50.089 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:50 smithi122 podman[66875]: 2024-05-27 09:42:50.05546625 +0000 UTC m=+0.352785886 container start 8e37ca59b9a5053a6e27d6e8ede9f0e7e21c6525267cd84809ba9f0ab8911664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2) 2024-05-27T09:42:50.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.202+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f209c02e5e0 con 0x7f209c106610 2024-05-27T09:42:50.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.205+0000 7f2098c00700 1 -- 172.21.15.71:0/1400629897 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f208c0aa7e0 con 0x7f209c106610 2024-05-27T09:42:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:42:50.207 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-27T09:42:50.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20800b2880 msgr2=0x7f20800b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:50.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20800b2880 0x7f20800b4d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2088009680 tx=0x7f2088009260 comp rx=0 tx=0).stop 2024-05-27T09:42:50.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209c106610 msgr2=0x7f209c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:50.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209c106610 0x7f209c19ce20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f208c0098e0 tx=0x7f208c005280 comp rx=0 tx=0).stop 2024-05-27T09:42:50.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 shutdown_connections 2024-05-27T09:42:50.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20800b2880 0x7f20800b4d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:50.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f209c10b890 0x7f209c1a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:50.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209c106610 0x7f209c19ce20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:50.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 --2- 172.21.15.71:0/1400629897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f209c10af40 0x7f209c19d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:50.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 >> 172.21.15.71:0/1400629897 conn(0x7f209c102020 msgr2=0x7f209c10a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:50.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.208+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 shutdown_connections 2024-05-27T09:42:50.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:50.209+0000 7f20a1400700 1 -- 172.21.15.71:0/1400629897 wait complete. 2024-05-27T09:42:50.211 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 2 2024-05-27T09:42:50.480 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mds[66894]: -- 172.21.15.122:0/3448645915 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce4925fa40 con 0x55ce492a7a80 2024-05-27T09:42:50.480 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l[66890]: starting mds.l at 2024-05-27T09:42:50.480 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:50 smithi122 bash[66875]: 8e37ca59b9a5053a6e27d6e8ede9f0e7e21c6525267cd84809ba9f0ab8911664 2024-05-27T09:42:50.480 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 09:42:50 smithi122 systemd[1]: Started Ceph mds.l for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:42:50.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6832/1541332524,v1:172.21.15.122:6833/1541332524] up:boot 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: fsmap 1 up:standby 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1400629897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:50.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:50 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6832/1541332524,v1:172.21.15.122:6833/1541332524] up:boot 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: fsmap 1 up:standby 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1400629897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:50.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:50.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:50 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:50.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6832/1541332524,v1:172.21.15.122:6833/1541332524] up:boot 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: fsmap 1 up:standby 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1400629897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:50.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:50 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:51.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:51 smithi072 ceph-mon[35951]: Deploying daemon mds.k on smithi072 2024-05-27T09:42:51.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:51 smithi122 ceph-mon[36436]: Deploying daemon mds.k on smithi072 2024-05-27T09:42:51.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:51 smithi071 ceph-mon[31451]: Deploying daemon mds.k on smithi072 2024-05-27T09:42:52.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:52 smithi072 ceph-mon[35951]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:52.527 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 systemd[1]: Starting Ceph mds.k for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:42:52.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:52 smithi122 ceph-mon[36436]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:52.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:52 smithi071 ceph-mon[31451]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:52.838 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 podman[65260]: 2024-05-27 09:42:52.587103552 +0000 UTC m=+0.110433613 container create 1087580b2c1ebb62dc05a390c33eee0bb34d3939c38cd47818525d3e94d5b8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k, org.label-schema.build-date=20240521, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-27T09:42:52.839 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 podman[65260]: 2024-05-27 09:42:52.493636009 +0000 UTC m=+0.016966080 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:42:52.839 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 podman[65260]: 2024-05-27 09:42:52.802068678 +0000 UTC m=+0.325398740 container init 1087580b2c1ebb62dc05a390c33eee0bb34d3939c38cd47818525d3e94d5b8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T09:42:52.839 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 podman[65260]: 2024-05-27 09:42:52.805381085 +0000 UTC m=+0.328711155 container start 1087580b2c1ebb62dc05a390c33eee0bb34d3939c38cd47818525d3e94d5b8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-27T09:42:53.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:42:53.276 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 ceph-mds[65279]: -- 172.21.15.72:0/1374795650 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584449b3a40 con 0x5584449fb180 2024-05-27T09:42:53.276 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k[65275]: starting mds.k at 2024-05-27T09:42:53.277 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 bash[65260]: 1087580b2c1ebb62dc05a390c33eee0bb34d3939c38cd47818525d3e94d5b8fc 2024-05-27T09:42:53.277 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 09:42:52 smithi072 systemd[1]: Started Ceph mds.k for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:42:53.484 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: Deploying daemon mds.j on smithi071 2024-05-27T09:42:54.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:54.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.72:6832/840166541,v1:172.21.15.72:6833/840166541] up:boot 2024-05-27T09:42:54.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: fsmap 2 up:standby 2024-05-27T09:42:54.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:53 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-27T09:42:54.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: Deploying daemon mds.j on smithi071 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.72:6832/840166541,v1:172.21.15.72:6833/840166541] up:boot 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: fsmap 2 up:standby 2024-05-27T09:42:54.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:53 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-27T09:42:54.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:54.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:54.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:54.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:54.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: Deploying daemon mds.j on smithi071 2024-05-27T09:42:54.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:54.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.72:6832/840166541,v1:172.21.15.72:6833/840166541] up:boot 2024-05-27T09:42:54.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: fsmap 2 up:standby 2024-05-27T09:42:54.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:53 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-27T09:42:55.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 -- 172.21.15.71:0/305793290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70075b50 msgr2=0x7f5c70075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 --2- 172.21.15.71:0/305793290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70075b50 0x7f5c70075f60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c600098f0 tx=0x7f5c60009c00 comp rx=0 tx=0).stop 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 -- 172.21.15.71:0/305793290 shutdown_connections 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 --2- 172.21.15.71:0/305793290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70115360 0x7f5c70117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 --2- 172.21.15.71:0/305793290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70075b50 0x7f5c70075f60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 --2- 172.21.15.71:0/305793290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c700764a0 0x7f5c70114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 -- 172.21.15.71:0/305793290 >> 172.21.15.71:0/305793290 conn(0x7f5c70100030 msgr2=0x7f5c70102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 -- 172.21.15.71:0/305793290 shutdown_connections 2024-05-27T09:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.843+0000 7f5c76a00700 1 -- 172.21.15.71:0/305793290 wait complete. 2024-05-27T09:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.844+0000 7f5c76a00700 1 Processor -- start 2024-05-27T09:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.844+0000 7f5c76a00700 1 -- start start 2024-05-27T09:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c76a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70075b50 0x7f5c701a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c76a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c700764a0 0x7f5c701a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c76a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70115360 0x7f5c701a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c76a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7011aab0 con 0x7f5c700764a0 2024-05-27T09:42:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c76a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7011a930 con 0x7f5c70075b50 2024-05-27T09:42:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c76a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7011ac30 con 0x7f5c70115360 2024-05-27T09:42:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c67e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c700764a0 0x7f5c701a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c6fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70075b50 0x7f5c701a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c6fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70075b50 0x7f5c701a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:43766/0 (socket says 172.21.15.71:43766) 2024-05-27T09:42:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c6fe00700 1 -- 172.21.15.71:0/3945044976 learned_addr learned my addr 172.21.15.71:0/3945044976 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.845+0000 7f5c74a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70115360 0x7f5c701a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6fe00700 1 -- 172.21.15.71:0/3945044976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70115360 msgr2=0x7f5c701a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6fe00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70115360 0x7f5c701a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6fe00700 1 -- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c700764a0 msgr2=0x7f5c701a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6fe00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c700764a0 0x7f5c701a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6fe00700 1 -- 172.21.15.71:0/3945044976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c701a6410 con 0x7f5c70075b50 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c74a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70115360 0x7f5c701a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6fe00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70075b50 0x7f5c701a1540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009230 tx=0x7f5c6000fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6d600700 1 -- 172.21.15.71:0/3945044976 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60005140 con 0x7f5c70075b50 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6d600700 1 -- 172.21.15.71:0/3945044976 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c6000b560 con 0x7f5c70075b50 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c701a66a0 con 0x7f5c70075b50 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.846+0000 7f5c6d600700 1 -- 172.21.15.71:0/3945044976 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60003ae0 con 0x7f5c70075b50 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.847+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c701a6b80 con 0x7f5c70075b50 2024-05-27T09:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.848+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c700512b0 con 0x7f5c70075b50 2024-05-27T09:42:55.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.850+0000 7f5c6d600700 1 -- 172.21.15.71:0/3945044976 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5c60003c80 con 0x7f5c70075b50 2024-05-27T09:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.851+0000 7f5c6d600700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5c540b2880 0x7f5c540b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.852+0000 7f5c6d600700 1 -- 172.21.15.71:0/3945044976 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f5c600e2fe0 con 0x7f5c70075b50 2024-05-27T09:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.852+0000 7f5c67e00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5c540b2880 0x7f5c540b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.852+0000 7f5c67e00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5c540b2880 0x7f5c540b4d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c70117c60 tx=0x7f5c58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:55.853+0000 7f5c6d600700 1 -- 172.21.15.71:0/3945044976 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5c6005fdf0 con 0x7f5c70075b50 2024-05-27T09:42:56.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.144+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c7002e5e0 con 0x7f5c70075b50 2024-05-27T09:42:56.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.145+0000 7f5c6d600700 1 -- 172.21.15.71:0/3945044976 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f5c60013030 con 0x7f5c70075b50 2024-05-27T09:42:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:42:56.147 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5c540b2880 msgr2=0x7f5c540b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5c540b2880 0x7f5c540b4d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c70117c60 tx=0x7f5c58009260 comp rx=0 tx=0).stop 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70075b50 msgr2=0x7f5c701a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70075b50 0x7f5c701a1540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009230 tx=0x7f5c6000fa70 comp rx=0 tx=0).stop 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 shutdown_connections 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c70115360 0x7f5c701a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c70075b50 0x7f5c701a1540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5c540b2880 0x7f5c540b4d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 --2- 172.21.15.71:0/3945044976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c700764a0 0x7f5c701a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:42:56.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.148+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 >> 172.21.15.71:0/3945044976 conn(0x7f5c70100030 msgr2=0x7f5c70100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:42:56.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.149+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 shutdown_connections 2024-05-27T09:42:56.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:42:56.149+0000 7f5c76a00700 1 -- 172.21.15.71:0/3945044976 wait complete. 2024-05-27T09:42:56.151 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 3 2024-05-27T09:42:56.428 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:56 smithi072 ceph-mon[35951]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:56.428 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:56 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3945044976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:42:56.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:56 smithi122 ceph-mon[36436]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:56.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:56 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3945044976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:42:56.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:56 smithi071 ceph-mon[31451]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:56.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:56 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3945044976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:42:58.145 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 09:42:57 smithi071 podman[72676]: 2024-05-27 09:42:57.906326835 +0000 UTC m=+0.162331110 container create 3f3b81a867fcc51f0fd96dada825bcba062ab6a7cd0460e44d72d030fd666fc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-27T09:42:58.145 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 09:42:58 smithi071 podman[72676]: 2024-05-27 09:42:58.142971621 +0000 UTC m=+0.398975876 container init 3f3b81a867fcc51f0fd96dada825bcba062ab6a7cd0460e44d72d030fd666fc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-27T09:42:58.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:58 smithi122 ceph-mon[36436]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:58.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:58 smithi071 ceph-mon[31451]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:58.508 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 09:42:58 smithi071 podman[72676]: 2024-05-27 09:42:58.152766621 +0000 UTC m=+0.408770899 container start 3f3b81a867fcc51f0fd96dada825bcba062ab6a7cd0460e44d72d030fd666fc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-27T09:42:58.508 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 09:42:58 smithi071 bash[72676]: 3f3b81a867fcc51f0fd96dada825bcba062ab6a7cd0460e44d72d030fd666fc4 2024-05-27T09:42:58.508 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 09:42:58 smithi071 systemd[1]: Started Ceph mds.j for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:42:58.508 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 09:42:58 smithi071 ceph-mds[72695]: -- 172.21.15.71:0/2166767377 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561a8007a40 con 0x5561a804f180 2024-05-27T09:42:58.508 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 09:42:58 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j[72691]: starting mds.j at 2024-05-27T09:42:58.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:58 smithi072 ceph-mon[35951]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:42:59.548 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:42:59.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:59.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:59.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:59.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: Deploying daemon mds.d on smithi071 2024-05-27T09:42:59.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6834/947679216,v1:172.21.15.71:6835/947679216] up:boot 2024-05-27T09:42:59.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: fsmap 3 up:standby 2024-05-27T09:42:59.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:42:59 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: Deploying daemon mds.d on smithi071 2024-05-27T09:42:59.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6834/947679216,v1:172.21.15.71:6835/947679216] up:boot 2024-05-27T09:42:59.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: fsmap 3 up:standby 2024-05-27T09:42:59.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:42:59 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-27T09:42:59.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: Deploying daemon mds.d on smithi071 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6834/947679216,v1:172.21.15.71:6835/947679216] up:boot 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: fsmap 3 up:standby 2024-05-27T09:42:59.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:42:59 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-27T09:43:00.420 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:00 smithi071 ceph-mon[31451]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:00.587 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:00.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:00 smithi122 ceph-mon[36436]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:00.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:00 smithi072 ceph-mon[35951]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:02.335 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 podman[73078]: 2024-05-27 09:43:02.120649994 +0000 UTC m=+0.031913217 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:43:02.335 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 podman[73078]: 2024-05-27 09:43:02.333707973 +0000 UTC m=+0.244971233 container create 339a9ca34e3e1adc60cf57d70f46cec143fb251c7a31263d9b12a76e3082cfe2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.build-date=20240521, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T09:43:02.596 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:02 smithi071 ceph-mon[31451]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:02.596 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 podman[73078]: 2024-05-27 09:43:02.595809726 +0000 UTC m=+0.507073032 container init 339a9ca34e3e1adc60cf57d70f46cec143fb251c7a31263d9b12a76e3082cfe2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5) 2024-05-27T09:43:02.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:02 smithi122 ceph-mon[36436]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:02.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:02 smithi072 ceph-mon[35951]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:02.923 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 podman[73078]: 2024-05-27 09:43:02.604436806 +0000 UTC m=+0.515700047 container start 339a9ca34e3e1adc60cf57d70f46cec143fb251c7a31263d9b12a76e3082cfe2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T09:43:02.923 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 bash[73078]: 339a9ca34e3e1adc60cf57d70f46cec143fb251c7a31263d9b12a76e3082cfe2 2024-05-27T09:43:02.923 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 ceph-mds[73113]: -- 172.21.15.71:0/2738339524 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555eae77a40 con 0x5555eaebfa80 2024-05-27T09:43:02.923 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d[73109]: starting mds.d at 2024-05-27T09:43:02.924 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 09:43:02 smithi071 systemd[1]: Started Ceph mds.d for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:03.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 -- 172.21.15.71:0/1335616046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc10a980 msgr2=0x7f82dc10ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:03.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 --2- 172.21.15.71:0/1335616046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc10a980 0x7f82dc10ad90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009990 tx=0x7f82c8009ca0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 -- 172.21.15.71:0/1335616046 shutdown_connections 2024-05-27T09:43:03.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 --2- 172.21.15.71:0/1335616046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10b2d0 0x7f82dc117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 --2- 172.21.15.71:0/1335616046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc110960 0x7f82dc110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 --2- 172.21.15.71:0/1335616046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc10a980 0x7f82dc10ad90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 -- 172.21.15.71:0/1335616046 >> 172.21.15.71:0/1335616046 conn(0x7f82dc077c70 msgr2=0x7f82dc0780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:03.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 -- 172.21.15.71:0/1335616046 shutdown_connections 2024-05-27T09:43:03.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.511+0000 7f82e3e00700 1 -- 172.21.15.71:0/1335616046 wait complete. 2024-05-27T09:43:03.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 Processor -- start 2024-05-27T09:43:03.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 -- start start 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10a980 0x7f82dc1a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc10b2d0 0x7f82dc1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc110960 0x7f82dc1a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc11aad0 con 0x7f82dc110960 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc11a950 con 0x7f82dc10a980 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e3e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc11ac50 con 0x7f82dc10b2d0 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.513+0000 7f82e1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10a980 0x7f82dc1a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10a980 0x7f82dc1a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:43820/0 (socket says 172.21.15.71:43820) 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 -- 172.21.15.71:0/3124648369 learned_addr learned my addr 172.21.15.71:0/3124648369 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e0a00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc10b2d0 0x7f82dc1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1e00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc110960 0x7f82dc1a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:03.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 -- 172.21.15.71:0/3124648369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc10b2d0 msgr2=0x7f82dc1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:03.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc10b2d0 0x7f82dc1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 -- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc110960 msgr2=0x7f82dc1a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:03.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc110960 0x7f82dc1a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 -- 172.21.15.71:0/3124648369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc1a6370 con 0x7f82dc10a980 2024-05-27T09:43:03.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.514+0000 7f82e1400700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10a980 0x7f82dc1a14a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82d000e970 tx=0x7f82d000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:03.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.515+0000 7f82da000700 1 -- 172.21.15.71:0/3124648369 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0004a30 con 0x7f82dc10a980 2024-05-27T09:43:03.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.515+0000 7f82da000700 1 -- 172.21.15.71:0/3124648369 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82d000cc90 con 0x7f82dc10a980 2024-05-27T09:43:03.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.515+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc1a6660 con 0x7f82dc10a980 2024-05-27T09:43:03.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.515+0000 7f82da000700 1 -- 172.21.15.71:0/3124648369 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0005610 con 0x7f82dc10a980 2024-05-27T09:43:03.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.515+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc1adf80 con 0x7f82dc10a980 2024-05-27T09:43:03.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.516+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82dc0512b0 con 0x7f82dc10a980 2024-05-27T09:43:03.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.518+0000 7f82da000700 1 -- 172.21.15.71:0/3124648369 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f82d000c7e0 con 0x7f82dc10a980 2024-05-27T09:43:03.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.520+0000 7f82da000700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f82c40b2900 0x7f82c40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:03.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.520+0000 7f82da000700 1 -- 172.21.15.71:0/3124648369 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f82d00e1eb0 con 0x7f82dc10a980 2024-05-27T09:43:03.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.520+0000 7f82e0a00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f82c40b2900 0x7f82c40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:03.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.521+0000 7f82e0a00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f82c40b2900 0x7f82c40b4e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82dc109950 tx=0x7f82c8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:03.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.524+0000 7f82da000700 1 -- 172.21.15.71:0/3124648369 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f82d00a9fd0 con 0x7f82dc10a980 2024-05-27T09:43:03.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.803+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82dc1a2800 con 0x7f82dc10a980 2024-05-27T09:43:03.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.804+0000 7f82da000700 1 -- 172.21.15.71:0/3124648369 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3859 (secure 0 0 0) 0x7f82d00a98d0 con 0x7f82dc10a980 2024-05-27T09:43:03.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:03.806 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-27T09:43:03.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f82c40b2900 msgr2=0x7f82c40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:03.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f82c40b2900 0x7f82c40b4e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82dc109950 tx=0x7f82c8005fd0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10a980 msgr2=0x7f82dc1a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10a980 0x7f82dc1a14a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82d000e970 tx=0x7f82d000ec80 comp rx=0 tx=0).stop 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 shutdown_connections 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f82c40b2900 0x7f82c40b4e10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc110960 0x7f82dc1a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc10a980 0x7f82dc1a14a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 --2- 172.21.15.71:0/3124648369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc10b2d0 0x7f82dc1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 >> 172.21.15.71:0/3124648369 conn(0x7f82dc077c70 msgr2=0x7f82dc07b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 shutdown_connections 2024-05-27T09:43:03.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:03.808+0000 7f82e3e00700 1 -- 172.21.15.71:0/3124648369 wait complete. 2024-05-27T09:43:03.811 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 5 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: Deploying daemon mds.e on smithi072 2024-05-27T09:43:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:04.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6836/95773383,v1:172.21.15.71:6837/95773383] up:boot 2024-05-27T09:43:04.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: fsmap 4 up:standby 2024-05-27T09:43:04.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-27T09:43:04.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:03 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3124648369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:04.232 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: Deploying daemon mds.e on smithi072 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6836/95773383,v1:172.21.15.71:6837/95773383] up:boot 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: fsmap 4 up:standby 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-27T09:43:04.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:03 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3124648369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:04.279 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.280 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.281 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:04.281 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:04.283 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:04.284 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:04.286 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: Deploying daemon mds.e on smithi072 2024-05-27T09:43:04.290 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:04.290 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6836/95773383,v1:172.21.15.71:6837/95773383] up:boot 2024-05-27T09:43:04.290 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: fsmap 4 up:standby 2024-05-27T09:43:04.290 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-27T09:43:04.290 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:03 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3124648369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:05.027 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:04 smithi072 systemd[1]: Starting Ceph mds.e for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:43:05.393 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 podman[65576]: 2024-05-27 09:43:05.043918474 +0000 UTC m=+0.017299311 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:43:05.393 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 podman[65576]: 2024-05-27 09:43:05.141078036 +0000 UTC m=+0.114458876 container create aa23f9e7c292efd221670c4ada5656eb6a627f08d8cc047dd13e9a3ac1b82333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-27T09:43:05.393 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 podman[65576]: 2024-05-27 09:43:05.354906838 +0000 UTC m=+0.328287659 container init aa23f9e7c292efd221670c4ada5656eb6a627f08d8cc047dd13e9a3ac1b82333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T09:43:05.393 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 podman[65576]: 2024-05-27 09:43:05.357602428 +0000 UTC m=+0.330983250 container start aa23f9e7c292efd221670c4ada5656eb6a627f08d8cc047dd13e9a3ac1b82333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T09:43:05.393 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 ceph-mds[65595]: -- 172.21.15.72:0/3683253336 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ed22c9a40 con 0x563ed2311600 2024-05-27T09:43:05.393 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e[65591]: starting mds.e at 2024-05-27T09:43:05.776 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 bash[65576]: aa23f9e7c292efd221670c4ada5656eb6a627f08d8cc047dd13e9a3ac1b82333 2024-05-27T09:43:05.776 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 09:43:05 smithi072 systemd[1]: Started Ceph mds.e for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:06.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:43:06.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:06.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: Deploying daemon mds.f on smithi122 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.72:6834/730426075,v1:172.21.15.72:6835/730426075] up:boot 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: fsmap 5 up:standby 2024-05-27T09:43:06.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:06 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-27T09:43:06.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:06.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: Deploying daemon mds.f on smithi122 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.72:6834/730426075,v1:172.21.15.72:6835/730426075] up:boot 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: fsmap 5 up:standby 2024-05-27T09:43:06.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:06 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: Deploying daemon mds.f on smithi122 2024-05-27T09:43:06.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.72:6834/730426075,v1:172.21.15.72:6835/730426075] up:boot 2024-05-27T09:43:06.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: fsmap 5 up:standby 2024-05-27T09:43:06.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:06 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-27T09:43:07.062 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:07.730 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:07 smithi122 systemd[1]: Starting Ceph mds.f for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:43:08.016 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:07 smithi122 podman[67178]: 2024-05-27 09:43:07.661783543 +0000 UTC m=+0.017560068 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:43:08.016 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:07 smithi122 podman[67178]: 2024-05-27 09:43:07.786745044 +0000 UTC m=+0.142521565 container create 2744fe3a12dcf346ef03e66bcc1db9ac8ff3c06d1fd9562a125ec8b2734a03ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD) 2024-05-27T09:43:08.016 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:07 smithi122 podman[67178]: 2024-05-27 09:43:07.980836701 +0000 UTC m=+0.336613219 container init 2744fe3a12dcf346ef03e66bcc1db9ac8ff3c06d1fd9562a125ec8b2734a03ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-27T09:43:08.017 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:07 smithi122 podman[67178]: 2024-05-27 09:43:07.983439373 +0000 UTC m=+0.339215900 container start 2744fe3a12dcf346ef03e66bcc1db9ac8ff3c06d1fd9562a125ec8b2734a03ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-05-27T09:43:08.341 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mds[67196]: -- 172.21.15.122:0/285179788 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e209831a40 con 0x55e209879a80 2024-05-27T09:43:08.341 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:08 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f[67192]: starting mds.f at 2024-05-27T09:43:08.341 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:08 smithi122 bash[67178]: 2744fe3a12dcf346ef03e66bcc1db9ac8ff3c06d1fd9562a125ec8b2734a03ba 2024-05-27T09:43:08.341 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 09:43:08 smithi122 systemd[1]: Started Ceph mds.f for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:08.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:08 smithi071 ceph-mon[31451]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:08.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:08.725 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:08.725 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mon[36436]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:08.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:08 smithi072 ceph-mon[35951]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:08.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:08.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:08.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:08.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:09.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 -- 172.21.15.71:0/1986993212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 msgr2=0x7fb65010b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:09.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 --2- 172.21.15.71:0/1986993212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 0x7fb65010b350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0098f0 tx=0x7fb63c009c00 comp rx=0 tx=0).stop 2024-05-27T09:43:09.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 -- 172.21.15.71:0/1986993212 shutdown_connections 2024-05-27T09:43:09.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 --2- 172.21.15.71:0/1986993212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65010b890 0x7fb6501131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 --2- 172.21.15.71:0/1986993212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 0x7fb650106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 --2- 172.21.15.71:0/1986993212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 0x7fb65010b350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 -- 172.21.15.71:0/1986993212 >> 172.21.15.71:0/1986993212 conn(0x7fb650102020 msgr2=0x7fb650104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:09.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 -- 172.21.15.71:0/1986993212 shutdown_connections 2024-05-27T09:43:09.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.268+0000 7fb64f200700 1 -- 172.21.15.71:0/1986993212 wait complete. 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.269+0000 7fb64f200700 1 Processor -- start 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64f200700 1 -- start start 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64f200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 0x7fb65019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64f200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 0x7fb65019d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64f200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65010b890 0x7fb6501a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64f200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501164f0 con 0x7fb650106610 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64f200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb650116370 con 0x7fb65010af40 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64f200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb650116670 con 0x7fb65010b890 2024-05-27T09:43:09.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.270+0000 7fb64de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 0x7fb65019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 0x7fb65019cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56902/0 (socket says 172.21.15.71:56902) 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64e800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65010b890 0x7fb6501a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64de00700 1 -- 172.21.15.71:0/4001549540 learned_addr learned my addr 172.21.15.71:0/4001549540 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64d400700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 0x7fb65019d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64e800700 1 -- 172.21.15.71:0/4001549540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 msgr2=0x7fb65019d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64e800700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 0x7fb65019d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64e800700 1 -- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 msgr2=0x7fb65019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64e800700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 0x7fb65019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64e800700 1 -- 172.21.15.71:0/4001549540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6501a1db0 con 0x7fb65010b890 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64de00700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 0x7fb65019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.271+0000 7fb64e800700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65010b890 0x7fb6501a1710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb64800efc0 tx=0x7fb64800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:09.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.272+0000 7fb646a00700 1 -- 172.21.15.71:0/4001549540 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6480092e0 con 0x7fb65010b890 2024-05-27T09:43:09.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.272+0000 7fb646a00700 1 -- 172.21.15.71:0/4001549540 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb648004bb0 con 0x7fb65010b890 2024-05-27T09:43:09.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.272+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6501a2040 con 0x7fb65010b890 2024-05-27T09:43:09.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.272+0000 7fb646a00700 1 -- 172.21.15.71:0/4001549540 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648004020 con 0x7fb65010b890 2024-05-27T09:43:09.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.272+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6501a2550 con 0x7fb65010b890 2024-05-27T09:43:09.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.273+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6500512b0 con 0x7fb65010b890 2024-05-27T09:43:09.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.275+0000 7fb646a00700 1 -- 172.21.15.71:0/4001549540 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb64801b030 con 0x7fb65010b890 2024-05-27T09:43:09.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.277+0000 7fb646a00700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb6340b2900 0x7fb6340b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:09.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.277+0000 7fb646a00700 1 -- 172.21.15.71:0/4001549540 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fb6480e1770 con 0x7fb65010b890 2024-05-27T09:43:09.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.277+0000 7fb64de00700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb6340b2900 0x7fb6340b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:09.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.278+0000 7fb64de00700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb6340b2900 0x7fb6340b4e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb640011550 tx=0x7fb640009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:09.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.286+0000 7fb646a00700 1 -- 172.21.15.71:0/4001549540 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb648022020 con 0x7fb65010b890 2024-05-27T09:43:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.564+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb65002e5e0 con 0x7fb65010b890 2024-05-27T09:43:09.567 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:09 smithi071 ceph-mon[31451]: Deploying daemon mds.c on smithi122 2024-05-27T09:43:09.567 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:09 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6834/132326532,v1:172.21.15.122:6835/132326532] up:boot 2024-05-27T09:43:09.567 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:09 smithi071 ceph-mon[31451]: fsmap 6 up:standby 2024-05-27T09:43:09.567 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-27T09:43:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.565+0000 7fb646a00700 1 -- 172.21.15.71:0/4001549540 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5506 (secure 0 0 0) 0x7fb648010040 con 0x7fb65010b890 2024-05-27T09:43:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:09.568 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-05-27T09:43:09.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb6340b2900 msgr2=0x7fb6340b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:09.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb6340b2900 0x7fb6340b4e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb640011550 tx=0x7fb640009260 comp rx=0 tx=0).stop 2024-05-27T09:43:09.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65010b890 msgr2=0x7fb6501a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:09.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65010b890 0x7fb6501a1710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb64800efc0 tx=0x7fb64800c3a0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 shutdown_connections 2024-05-27T09:43:09.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65010b890 0x7fb6501a1710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb6340b2900 0x7fb6340b4e10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650106610 0x7fb65019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 --2- 172.21.15.71:0/4001549540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb65010af40 0x7fb65019d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:09.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 >> 172.21.15.71:0/4001549540 conn(0x7fb650102020 msgr2=0x7fb65010a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:09.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 shutdown_connections 2024-05-27T09:43:09.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:09.569+0000 7fb64f200700 1 -- 172.21.15.71:0/4001549540 wait complete. 2024-05-27T09:43:09.571 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 7 2024-05-27T09:43:09.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:09 smithi072 ceph-mon[35951]: Deploying daemon mds.c on smithi122 2024-05-27T09:43:09.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:09 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6834/132326532,v1:172.21.15.122:6835/132326532] up:boot 2024-05-27T09:43:09.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:09 smithi072 ceph-mon[35951]: fsmap 6 up:standby 2024-05-27T09:43:09.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-27T09:43:09.946 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:09 smithi122 ceph-mon[36436]: Deploying daemon mds.c on smithi122 2024-05-27T09:43:09.947 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:09 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6834/132326532,v1:172.21.15.122:6835/132326532] up:boot 2024-05-27T09:43:09.947 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:09 smithi122 ceph-mon[36436]: fsmap 6 up:standby 2024-05-27T09:43:09.947 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-27T09:43:10.480 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:10 smithi122 systemd[1]: Starting Ceph mds.c for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:43:10.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:10 smithi071 ceph-mon[31451]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:10.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:10 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4001549540' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:10.772 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:10 smithi122 ceph-mon[36436]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:10.772 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:10 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4001549540' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:10.772 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:10 smithi122 podman[67489]: 2024-05-27 09:43:10.532401654 +0000 UTC m=+0.017249605 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:43:10.772 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:10 smithi122 podman[67489]: 2024-05-27 09:43:10.657048618 +0000 UTC m=+0.141896572 container create c917bd5528697ddbecfe3368745a586192445cd0cda5630ab437a2d62a564cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-27T09:43:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:10 smithi072 ceph-mon[35951]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:10 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4001549540' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:11.230 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:10 smithi122 podman[67489]: 2024-05-27 09:43:10.926070781 +0000 UTC m=+0.410918712 container init c917bd5528697ddbecfe3368745a586192445cd0cda5630ab437a2d62a564cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T09:43:11.230 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:10 smithi122 podman[67489]: 2024-05-27 09:43:10.92868874 +0000 UTC m=+0.413536672 container start c917bd5528697ddbecfe3368745a586192445cd0cda5630ab437a2d62a564cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T09:43:11.230 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:10 smithi122 ceph-mds[67508]: -- 172.21.15.122:0/897525101 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55741c7f9a40 con 0x55741c841180 2024-05-27T09:43:11.230 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c[67504]: starting mds.c at 2024-05-27T09:43:11.231 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:11 smithi122 bash[67489]: c917bd5528697ddbecfe3368745a586192445cd0cda5630ab437a2d62a564cea 2024-05-27T09:43:11.231 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 09:43:11 smithi122 systemd[1]: Started Ceph mds.c for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:12.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:43:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:12.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: Deploying daemon mds.h on smithi072 2024-05-27T09:43:12.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:12.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6836/1257572460,v1:172.21.15.122:6837/1257572460] up:boot 2024-05-27T09:43:12.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: fsmap 7 up:standby 2024-05-27T09:43:12.481 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:12 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T09:43:12.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: Deploying daemon mds.h on smithi072 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6836/1257572460,v1:172.21.15.122:6837/1257572460] up:boot 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: fsmap 7 up:standby 2024-05-27T09:43:12.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:12 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T09:43:12.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: Deploying daemon mds.h on smithi072 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6836/1257572460,v1:172.21.15.122:6837/1257572460] up:boot 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: fsmap 7 up:standby 2024-05-27T09:43:12.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:12 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T09:43:12.929 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:13.236 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 systemd[1]: Starting Ceph mds.h for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:43:13.498 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 podman[65882]: 2024-05-27 09:43:13.138366913 +0000 UTC m=+0.017148787 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:43:13.499 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 podman[65882]: 2024-05-27 09:43:13.251330072 +0000 UTC m=+0.130111927 container create d818b28baf420584cd84bd3bea3addfd9ba11cbd5be4d6471c3a41ac7f780542 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True) 2024-05-27T09:43:13.499 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 podman[65882]: 2024-05-27 09:43:13.498993622 +0000 UTC m=+0.377775488 container init d818b28baf420584cd84bd3bea3addfd9ba11cbd5be4d6471c3a41ac7f780542 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T09:43:13.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 podman[65882]: 2024-05-27 09:43:13.50165893 +0000 UTC m=+0.380440790 container start d818b28baf420584cd84bd3bea3addfd9ba11cbd5be4d6471c3a41ac7f780542 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-27T09:43:13.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 ceph-mds[65901]: -- 172.21.15.72:0/3435581188 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c0a5aba40 con 0x556c0a5f3600 2024-05-27T09:43:13.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h[65897]: starting mds.h at 2024-05-27T09:43:13.777 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 bash[65882]: d818b28baf420584cd84bd3bea3addfd9ba11cbd5be4d6471c3a41ac7f780542 2024-05-27T09:43:13.777 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 09:43:13 smithi072 systemd[1]: Started Ceph mds.h for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:14.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: Deploying daemon mds.i on smithi122 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.72:6836/4192538973,v1:172.21.15.72:6837/4192538973] up:boot 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: fsmap 8 up:standby 2024-05-27T09:43:14.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:14 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: Deploying daemon mds.i on smithi122 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.72:6836/4192538973,v1:172.21.15.72:6837/4192538973] up:boot 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: fsmap 8 up:standby 2024-05-27T09:43:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:14 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T09:43:15.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:15.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: Deploying daemon mds.i on smithi122 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.72:6836/4192538973,v1:172.21.15.72:6837/4192538973] up:boot 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: fsmap 8 up:standby 2024-05-27T09:43:15.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:14 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T09:43:15.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 -- 172.21.15.71:0/1104986743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c108d20 msgr2=0x7f0c6c109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:15.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 --2- 172.21.15.71:0/1104986743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c108d20 0x7f0c6c109130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0c580099c0 tx=0x7f0c58009cd0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 -- 172.21.15.71:0/1104986743 shutdown_connections 2024-05-27T09:43:15.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 --2- 172.21.15.71:0/1104986743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c109670 0x7f0c6c110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 --2- 172.21.15.71:0/1104986743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c1043f0 0x7f0c6c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 --2- 172.21.15.71:0/1104986743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c108d20 0x7f0c6c109130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 -- 172.21.15.71:0/1104986743 >> 172.21.15.71:0/1104986743 conn(0x7f0c6c079d00 msgr2=0x7f0c6c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:15.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 -- 172.21.15.71:0/1104986743 shutdown_connections 2024-05-27T09:43:15.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.364+0000 7f0c6b200700 1 -- 172.21.15.71:0/1104986743 wait complete. 2024-05-27T09:43:15.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.366+0000 7f0c6b200700 1 Processor -- start 2024-05-27T09:43:15.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.366+0000 7f0c6b200700 1 -- start start 2024-05-27T09:43:15.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.366+0000 7f0c6b200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c1043f0 0x7f0c6c075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:15.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.366+0000 7f0c6b200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108d20 0x7f0c6c075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.366+0000 7f0c6b200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c109670 0x7f0c6c076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c6b200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c114280 con 0x7f0c6c1043f0 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c6b200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c114100 con 0x7f0c6c109670 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c6b200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c114400 con 0x7f0c6c108d20 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c1043f0 0x7f0c6c075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c1043f0 0x7f0c6c075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57724/0 (socket says 172.21.15.71:57724) 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108d20 0x7f0c6c075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69e00700 1 -- 172.21.15.71:0/3552145905 learned_addr learned my addr 172.21.15.71:0/3552145905 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c6a800700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c109670 0x7f0c6c076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69400700 1 -- 172.21.15.71:0/3552145905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c109670 msgr2=0x7f0c6c076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69400700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c109670 0x7f0c6c076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69400700 1 -- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c1043f0 msgr2=0x7f0c6c075ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:15.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69400700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c1043f0 0x7f0c6c075ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.367+0000 7f0c69400700 1 -- 172.21.15.71:0/3552145905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c1a9030 con 0x7f0c6c108d20 2024-05-27T09:43:15.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.368+0000 7f0c69400700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108d20 0x7f0c6c075ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800b580 tx=0x7f0c58005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:15.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.368+0000 7f0c62a00700 1 -- 172.21.15.71:0/3552145905 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58026070 con 0x7f0c6c108d20 2024-05-27T09:43:15.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.368+0000 7f0c62a00700 1 -- 172.21.15.71:0/3552145905 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c58003c70 con 0x7f0c6c108d20 2024-05-27T09:43:15.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.368+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c1a92c0 con 0x7f0c6c108d20 2024-05-27T09:43:15.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.368+0000 7f0c62a00700 1 -- 172.21.15.71:0/3552145905 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800f9f0 con 0x7f0c6c108d20 2024-05-27T09:43:15.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.368+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c1a9710 con 0x7f0c6c108d20 2024-05-27T09:43:15.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.369+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c1058a0 con 0x7f0c6c108d20 2024-05-27T09:43:15.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.371+0000 7f0c62a00700 1 -- 172.21.15.71:0/3552145905 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0c58029070 con 0x7f0c6c108d20 2024-05-27T09:43:15.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.373+0000 7f0c62a00700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0c500b2880 0x7f0c500b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:15.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.373+0000 7f0c62a00700 1 -- 172.21.15.71:0/3552145905 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0c580e2be0 con 0x7f0c6c108d20 2024-05-27T09:43:15.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.373+0000 7f0c69e00700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0c500b2880 0x7f0c500b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:15.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.374+0000 7f0c69e00700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0c500b2880 0x7f0c500b4d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009d20 tx=0x7f0c5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:15.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.375+0000 7f0c62a00700 1 -- 172.21.15.71:0/3552145905 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0c58013070 con 0x7f0c6c108d20 2024-05-27T09:43:15.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.661+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c6c02e5e0 con 0x7f0c6c108d20 2024-05-27T09:43:15.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.662+0000 7f0c62a00700 1 -- 172.21.15.71:0/3552145905 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7159 (secure 0 0 0) 0x7f0c580aad90 con 0x7f0c6c108d20 2024-05-27T09:43:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:15.664 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-27T09:43:15.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0c500b2880 msgr2=0x7f0c500b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0c500b2880 0x7f0c500b4d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009d20 tx=0x7f0c5c009260 comp rx=0 tx=0).stop 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108d20 msgr2=0x7f0c6c075ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108d20 0x7f0c6c075ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800b580 tx=0x7f0c58005280 comp rx=0 tx=0).stop 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 shutdown_connections 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c109670 0x7f0c6c076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0c500b2880 0x7f0c500b4d90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c6c1043f0 0x7f0c6c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 --2- 172.21.15.71:0/3552145905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108d20 0x7f0c6c075ff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 >> 172.21.15.71:0/3552145905 conn(0x7f0c6c079d00 msgr2=0x7f0c6c101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.665+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 shutdown_connections 2024-05-27T09:43:15.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:15.666+0000 7f0c6b200700 1 -- 172.21.15.71:0/3552145905 wait complete. 2024-05-27T09:43:15.668 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2024-05-27T09:43:16.173 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:15 smithi122 systemd[1]: Starting Ceph mds.i for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:43:16.439 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 podman[67791]: 2024-05-27 09:43:16.075913815 +0000 UTC m=+0.017868077 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:43:16.439 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 podman[67791]: 2024-05-27 09:43:16.193682928 +0000 UTC m=+0.135637190 container create c0408e3305e74864560f39a64bfec0a0cba6965bd1eeab8260f94d3cfa85b77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T09:43:16.439 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 podman[67791]: 2024-05-27 09:43:16.404051195 +0000 UTC m=+0.346005458 container init c0408e3305e74864560f39a64bfec0a0cba6965bd1eeab8260f94d3cfa85b77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-27T09:43:16.440 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 podman[67791]: 2024-05-27 09:43:16.406562384 +0000 UTC m=+0.348516647 container start c0408e3305e74864560f39a64bfec0a0cba6965bd1eeab8260f94d3cfa85b77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, io.buildah.version=1.33.5) 2024-05-27T09:43:16.730 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mds[67810]: -- 172.21.15.122:0/2757304395 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c82729a40 con 0x558c82771180 2024-05-27T09:43:16.730 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: starting mds.i at 2024-05-27T09:43:16.730 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 bash[67791]: c0408e3305e74864560f39a64bfec0a0cba6965bd1eeab8260f94d3cfa85b77b 2024-05-27T09:43:16.730 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:43:16 smithi122 systemd[1]: Started Ceph mds.i for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3552145905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:16.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:16 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:16.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:16.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3552145905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:16.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:16.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:16 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:17.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3552145905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:16 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:17.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:17 smithi071 ceph-mon[31451]: Deploying daemon mds.g on smithi071 2024-05-27T09:43:17.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:17 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:boot 2024-05-27T09:43:17.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:17 smithi071 ceph-mon[31451]: fsmap 9 up:standby 2024-05-27T09:43:17.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:17 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T09:43:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:17 smithi122 ceph-mon[36436]: Deploying daemon mds.g on smithi071 2024-05-27T09:43:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:17 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:boot 2024-05-27T09:43:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:17 smithi122 ceph-mon[36436]: fsmap 9 up:standby 2024-05-27T09:43:17.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:17 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T09:43:18.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:17 smithi072 ceph-mon[35951]: Deploying daemon mds.g on smithi071 2024-05-27T09:43:18.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:17 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:boot 2024-05-27T09:43:18.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:17 smithi072 ceph-mon[35951]: fsmap 9 up:standby 2024-05-27T09:43:18.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:17 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T09:43:18.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:43:18.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:18 smithi071 ceph-mon[31451]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:18.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:18 smithi122 ceph-mon[36436]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:18 smithi072 ceph-mon[35951]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:19.096 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:20.011 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:19 smithi071 systemd[1]: Starting Ceph mds.g for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T09:43:20.677 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:20 smithi071 podman[73849]: 2024-05-27 09:43:20.543965566 +0000 UTC m=+0.034113647 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T09:43:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:20 smithi122 ceph-mon[36436]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:21.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:20 smithi071 ceph-mon[31451]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:21.008 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:20 smithi071 podman[73849]: 2024-05-27 09:43:20.685445524 +0000 UTC m=+0.175593667 container create 5ea437c5523b55b617354fa92e920d0125060d981ff017845441eecd0ad331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T09:43:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:20 smithi072 ceph-mon[35951]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:21.369 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:21 smithi071 podman[73849]: 2024-05-27 09:43:21.040985648 +0000 UTC m=+0.531133777 container init 5ea437c5523b55b617354fa92e920d0125060d981ff017845441eecd0ad331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T09:43:21.370 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:21 smithi071 podman[73849]: 2024-05-27 09:43:21.051822074 +0000 UTC m=+0.541970163 container start 5ea437c5523b55b617354fa92e920d0125060d981ff017845441eecd0ad331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T09:43:21.370 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:21 smithi071 ceph-mds[73885]: -- 172.21.15.71:0/4261760146 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fdc1ed7a40 con 0x55fdc1f1f600 2024-05-27T09:43:21.370 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: starting mds.g at 2024-05-27T09:43:21.370 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:21 smithi071 bash[73849]: 5ea437c5523b55b617354fa92e920d0125060d981ff017845441eecd0ad331ac 2024-05-27T09:43:21.370 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:43:21 smithi071 systemd[1]: Started Ceph mds.g for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 -- 172.21.15.71:0/1234132777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 msgr2=0x7f9d60112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 --2- 172.21.15.71:0/1234132777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 0x7f9d60112ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800b0a0 tx=0x7f9d5800b3b0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 -- 172.21.15.71:0/1234132777 shutdown_connections 2024-05-27T09:43:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 --2- 172.21.15.71:0/1234132777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 0x7f9d60112ff0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 --2- 172.21.15.71:0/1234132777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60075d20 0x7f9d60076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 --2- 172.21.15.71:0/1234132777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d60076670 0x7f9d60110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 -- 172.21.15.71:0/1234132777 >> 172.21.15.71:0/1234132777 conn(0x7f9d60100030 msgr2=0x7f9d60102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 -- 172.21.15.71:0/1234132777 shutdown_connections 2024-05-27T09:43:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.607+0000 7f9d67e00700 1 -- 172.21.15.71:0/1234132777 wait complete. 2024-05-27T09:43:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 Processor -- start 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 -- start start 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d60075d20 0x7f9d6019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60076670 0x7f9d6019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 0x7f9d601a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601166c0 con 0x7f9d60110b90 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60116540 con 0x7f9d60076670 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.609+0000 7f9d67e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60116840 con 0x7f9d60075d20 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60076670 0x7f9d6019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d65e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 0x7f9d601a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60076670 0x7f9d6019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42908/0 (socket says 172.21.15.71:42908) 2024-05-27T09:43:21.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 -- 172.21.15.71:0/183235006 learned_addr learned my addr 172.21.15.71:0/183235006 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:21.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d65400700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d60075d20 0x7f9d6019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:21.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 -- 172.21.15.71:0/183235006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d60075d20 msgr2=0x7f9d6019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:21.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d60075d20 0x7f9d6019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 -- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 msgr2=0x7f9d601a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:21.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 0x7f9d601a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 -- 172.21.15.71:0/183235006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d601a1ee0 con 0x7f9d60076670 2024-05-27T09:43:21.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.610+0000 7f9d64a00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60076670 0x7f9d6019d5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00e9a0 tx=0x7f9d4c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:21.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.611+0000 7f9d5e000700 1 -- 172.21.15.71:0/183235006 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00ca10 con 0x7f9d60076670 2024-05-27T09:43:21.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.611+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d601a21d0 con 0x7f9d60076670 2024-05-27T09:43:21.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.611+0000 7f9d5e000700 1 -- 172.21.15.71:0/183235006 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d4c00cbb0 con 0x7f9d60076670 2024-05-27T09:43:21.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.611+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601a9af0 con 0x7f9d60076670 2024-05-27T09:43:21.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.611+0000 7f9d5e000700 1 -- 172.21.15.71:0/183235006 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c018680 con 0x7f9d60076670 2024-05-27T09:43:21.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.612+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d40005330 con 0x7f9d60076670 2024-05-27T09:43:21.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.614+0000 7f9d5e000700 1 -- 172.21.15.71:0/183235006 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9d4c018820 con 0x7f9d60076670 2024-05-27T09:43:21.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.616+0000 7f9d5e000700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9d480b2900 0x7f9d480b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:21.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.616+0000 7f9d5e000700 1 -- 172.21.15.71:0/183235006 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f9d4c0e1dd0 con 0x7f9d60076670 2024-05-27T09:43:21.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.616+0000 7f9d65400700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9d480b2900 0x7f9d480b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.617+0000 7f9d65400700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9d480b2900 0x7f9d480b4e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009c60 tx=0x7f9d54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.621+0000 7f9d5e000700 1 -- 172.21.15.71:0/183235006 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9d4c0a9ef0 con 0x7f9d60076670 2024-05-27T09:43:21.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.910+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d40005620 con 0x7f9d60076670 2024-05-27T09:43:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.911+0000 7f9d5e000700 1 -- 172.21.15.71:0/183235006 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8815 (secure 0 0 0) 0x7f9d4c0a97f0 con 0x7f9d60076670 2024-05-27T09:43:21.912 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:21.912 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24506,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-27T09:43:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9d480b2900 msgr2=0x7f9d480b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9d480b2900 0x7f9d480b4e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009c60 tx=0x7f9d54009260 comp rx=0 tx=0).stop 2024-05-27T09:43:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60076670 msgr2=0x7f9d6019d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60076670 0x7f9d6019d5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00e9a0 tx=0x7f9d4c00ecb0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 shutdown_connections 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9d480b2900 0x7f9d480b4e10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d60110b90 0x7f9d601a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d60075d20 0x7f9d6019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 --2- 172.21.15.71:0/183235006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d60076670 0x7f9d6019d5b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 >> 172.21.15.71:0/183235006 conn(0x7f9d60100030 msgr2=0x7f9d60100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 shutdown_connections 2024-05-27T09:43:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:21.915+0000 7f9d67e00700 1 -- 172.21.15.71:0/183235006 wait complete. 2024-05-27T09:43:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 11 2024-05-27T09:43:22.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:22.713 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: Deploying daemon mds.a on smithi071 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6838/2510446999,v1:172.21.15.71:6839/2510446999] up:boot 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: fsmap 10 up:standby 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:43:22.714 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:22 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/183235006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:22.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: Deploying daemon mds.a on smithi071 2024-05-27T09:43:22.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6838/2510446999,v1:172.21.15.71:6839/2510446999] up:boot 2024-05-27T09:43:22.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: fsmap 10 up:standby 2024-05-27T09:43:22.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:43:22.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:22 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/183235006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:22.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:22.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: Deploying daemon mds.a on smithi071 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6838/2510446999,v1:172.21.15.71:6839/2510446999] up:boot 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: fsmap 10 up:standby 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:43:22.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:22 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/183235006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:24 smithi122 ceph-mon[36436]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:24.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:24 smithi071 ceph-mon[31451]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:24.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:43:24.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:24 smithi072 ceph-mon[35951]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:25.485 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 podman[74226]: 2024-05-27 09:43:25.21287562 +0000 UTC m=+0.160490689 container create 86704f9fb198f33c3f780d78292c6b8d800ad07699207de096d7e1c2d890c30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True) 2024-05-27T09:43:25.485 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 podman[74226]: 2024-05-27 09:43:25.483186839 +0000 UTC m=+0.430801915 container init 86704f9fb198f33c3f780d78292c6b8d800ad07699207de096d7e1c2d890c30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T09:43:25.709 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:25.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 podman[74226]: 2024-05-27 09:43:25.493117885 +0000 UTC m=+0.440732961 container start 86704f9fb198f33c3f780d78292c6b8d800ad07699207de096d7e1c2d890c30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T09:43:25.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 ceph-mds[74271]: -- 172.21.15.71:0/1520601760 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55cc3c96c4e0 con 0x55cc3c9b7180 2024-05-27T09:43:25.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 ceph-mds[74271]: -- 172.21.15.71:0/1520601760 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc3c96fa40 con 0x55cc3c9b7180 2024-05-27T09:43:25.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a[74267]: starting mds.a at 2024-05-27T09:43:25.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 bash[74226]: 86704f9fb198f33c3f780d78292c6b8d800ad07699207de096d7e1c2d890c30d 2024-05-27T09:43:25.759 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 09:43:25 smithi071 systemd[1]: Started Ceph mds.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:26.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:26.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:26.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:26.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:26.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:26.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:26.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:26.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: Deploying daemon mds.b on smithi072 2024-05-27T09:43:26.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] up:boot 2024-05-27T09:43:26.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: fsmap 11 up:standby 2024-05-27T09:43:26.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:26 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T09:43:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:27.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:27.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: Deploying daemon mds.b on smithi072 2024-05-27T09:43:27.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] up:boot 2024-05-27T09:43:27.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: fsmap 11 up:standby 2024-05-27T09:43:27.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:26 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T09:43:27.015 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:27.015 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:27.015 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: Deploying daemon mds.b on smithi072 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] up:boot 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: fsmap 11 up:standby 2024-05-27T09:43:27.016 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:26 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T09:43:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 -- 172.21.15.71:0/4273528252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 msgr2=0x7f8754110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 --2- 172.21.15.71:0/4273528252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 0x7f8754110460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87440098f0 tx=0x7f8744009c00 comp rx=0 tx=0).stop 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 -- 172.21.15.71:0/4273528252 shutdown_connections 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 --2- 172.21.15.71:0/4273528252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87541109a0 0x7f8754112e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 --2- 172.21.15.71:0/4273528252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8754075d20 0x7f8754076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 --2- 172.21.15.71:0/4273528252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 0x7f8754110460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 -- 172.21.15.71:0/4273528252 >> 172.21.15.71:0/4273528252 conn(0x7f8754079d00 msgr2=0x7f875407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 -- 172.21.15.71:0/4273528252 shutdown_connections 2024-05-27T09:43:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.049+0000 7f875a400700 1 -- 172.21.15.71:0/4273528252 wait complete. 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.051+0000 7f875a400700 1 Processor -- start 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.051+0000 7f875a400700 1 -- start start 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f875a400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8754075d20 0x7f875419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f875a400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 0x7f875419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f875a400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87541109a0 0x7f87541a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f875a400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f87541164a0 con 0x7f8754075d20 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f875a400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8754116320 con 0x7f8754076670 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f875a400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8754116620 con 0x7f87541109a0 2024-05-27T09:43:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f8759000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8754075d20 0x7f875419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f874be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 0x7f875419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f8759000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8754075d20 0x7f875419ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44524/0 (socket says 172.21.15.71:44524) 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f8759a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87541109a0 0x7f87541a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f8759000700 1 -- 172.21.15.71:0/967180702 learned_addr learned my addr 172.21.15.71:0/967180702 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f874be00700 1 -- 172.21.15.71:0/967180702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87541109a0 msgr2=0x7f87541a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f874be00700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87541109a0 0x7f87541a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f874be00700 1 -- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8754075d20 msgr2=0x7f875419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f874be00700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8754075d20 0x7f875419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.052+0000 7f874be00700 1 -- 172.21.15.71:0/967180702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87541a1da0 con 0x7f8754076670 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.053+0000 7f874be00700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 0x7f875419d470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8744009230 tx=0x7f874400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.053+0000 7f8752000700 1 -- 172.21.15.71:0/967180702 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744005040 con 0x7f8754076670 2024-05-27T09:43:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.053+0000 7f8752000700 1 -- 172.21.15.71:0/967180702 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8744005690 con 0x7f8754076670 2024-05-27T09:43:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.053+0000 7f8752000700 1 -- 172.21.15.71:0/967180702 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744003970 con 0x7f8754076670 2024-05-27T09:43:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.053+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87541a2030 con 0x7f8754076670 2024-05-27T09:43:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.053+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87541a24c0 con 0x7f8754076670 2024-05-27T09:43:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.054+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8754077290 con 0x7f8754076670 2024-05-27T09:43:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.056+0000 7f8752000700 1 -- 172.21.15.71:0/967180702 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f874400b7f0 con 0x7f8754076670 2024-05-27T09:43:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.058+0000 7f8752000700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f87340b2900 0x7f87340b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.058+0000 7f8752000700 1 -- 172.21.15.71:0/967180702 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f87440e2c20 con 0x7f8754076670 2024-05-27T09:43:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.058+0000 7f8759000700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f87340b2900 0x7f87340b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.059+0000 7f8759000700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f87340b2900 0x7f87340b4e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f873c009d20 tx=0x7f873c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.062+0000 7f8752000700 1 -- 172.21.15.71:0/967180702 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8744013030 con 0x7f8754076670 2024-05-27T09:43:28.230 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mds[66216]: -- 172.21.15.72:0/1467381446 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558ed1f89a40 con 0x558ed1fd1600 2024-05-27T09:43:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.350+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f875402e5e0 con 0x7f8754076670 2024-05-27T09:43:28.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.356+0000 7f8752000700 1 -- 172.21.15.71:0/967180702 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9641 (secure 0 0 0) 0x7f87440aadd0 con 0x7f8754076670 2024-05-27T09:43:28.357 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:28.357 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24506,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f87340b2900 msgr2=0x7f87340b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f87340b2900 0x7f87340b4e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f873c009d20 tx=0x7f873c009260 comp rx=0 tx=0).stop 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 msgr2=0x7f875419d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 0x7f875419d470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8744009230 tx=0x7f874400fa00 comp rx=0 tx=0).stop 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 shutdown_connections 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87541109a0 0x7f87541a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f87340b2900 0x7f87340b4e10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8754075d20 0x7f875419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 --2- 172.21.15.71:0/967180702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8754076670 0x7f875419d470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 >> 172.21.15.71:0/967180702 conn(0x7f8754079d00 msgr2=0x7f8754100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.360+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 shutdown_connections 2024-05-27T09:43:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:28.361+0000 7f875a400700 1 -- 172.21.15.71:0/967180702 wait complete. 2024-05-27T09:43:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 12 2024-05-27T09:43:28.526 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: starting mds.b at 2024-05-27T09:43:28.527 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 09:43:28 smithi072 bash[66197]: 5f8559384c0f52c5c263fd1a2f36f799c402d07cbb61b315a601b23156aa2c16 2024-05-27T09:43:28.527 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 09:43:28 smithi072 systemd[1]: Started Ceph mds.b for 13785e2a-1c0c-11ef-bc9b-c7b262605968. 2024-05-27T09:43:29.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:29.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/967180702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:29.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:28 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:43:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/967180702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:28 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/967180702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:28 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:43:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:29 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] up:boot 2024-05-27T09:43:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:29 smithi122 ceph-mon[36436]: fsmap 12 up:standby 2024-05-27T09:43:29.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:29 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T09:43:30.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:29 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] up:boot 2024-05-27T09:43:30.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:29 smithi071 ceph-mon[31451]: fsmap 12 up:standby 2024-05-27T09:43:30.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:29 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T09:43:30.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:29 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] up:boot 2024-05-27T09:43:30.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:29 smithi072 ceph-mon[35951]: fsmap 12 up:standby 2024-05-27T09:43:30.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:29 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T09:43:31.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:30 smithi071 ceph-mon[31451]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:31.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:30 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:30 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:30 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:30 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:30 smithi072 ceph-mon[35951]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:30 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:30 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:30 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:30 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:30 smithi122 ceph-mon[36436]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:31.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:30 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:30 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:30 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:30 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:31.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:43:31.679 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:32.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:32 smithi071 ceph-mon[31451]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:32.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:32.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:43:32.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:32 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:43:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:32 smithi072 ceph-mon[35951]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:43:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:32 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:43:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:32 smithi122 ceph-mon[36436]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:43:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:32.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:32 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:43:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 -- 172.21.15.71:0/2046234232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc1039c0 msgr2=0x7f23dc107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 --2- 172.21.15.71:0/2046234232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc1039c0 0x7f23dc107ef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009990 tx=0x7f23c4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 -- 172.21.15.71:0/2046234232 shutdown_connections 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 --2- 172.21.15.71:0/2046234232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23dc1084c0 0x7f23dc108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 --2- 172.21.15.71:0/2046234232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc103070 0x7f23dc103480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 --2- 172.21.15.71:0/2046234232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc1039c0 0x7f23dc107ef0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 -- 172.21.15.71:0/2046234232 >> 172.21.15.71:0/2046234232 conn(0x7f23dc078ab0 msgr2=0x7f23dc078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.971+0000 7f23e1600700 1 -- 172.21.15.71:0/2046234232 shutdown_connections 2024-05-27T09:43:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.972+0000 7f23e1600700 1 -- 172.21.15.71:0/2046234232 wait complete. 2024-05-27T09:43:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 Processor -- start 2024-05-27T09:43:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 -- start start 2024-05-27T09:43:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc103070 0x7f23dc1a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc1039c0 0x7f23dc1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23dc1084c0 0x7f23dc1a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc11a850 con 0x7f23dc103070 2024-05-27T09:43:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc11a6d0 con 0x7f23dc1039c0 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.973+0000 7f23e1600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc11a9d0 con 0x7f23dc1084c0 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23dbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc103070 0x7f23dc1a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23dbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc103070 0x7f23dc1a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56652/0 (socket says 172.21.15.71:56652) 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23dbe00700 1 -- 172.21.15.71:0/2754255248 learned_addr learned my addr 172.21.15.71:0/2754255248 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23e0c00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23dc1084c0 0x7f23dc1a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23db400700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc1039c0 0x7f23dc1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23e0c00700 1 -- 172.21.15.71:0/2754255248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc1039c0 msgr2=0x7f23dc1a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23e0c00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc1039c0 0x7f23dc1a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23e0c00700 1 -- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc103070 msgr2=0x7f23dc1a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23e0c00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc103070 0x7f23dc1a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23e0c00700 1 -- 172.21.15.71:0/2754255248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc1a6210 con 0x7f23dc1084c0 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23dbe00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc103070 0x7f23dc1a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:43:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.974+0000 7f23e0c00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23dc1084c0 0x7f23dc1a5b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23d400efc0 tx=0x7f23d400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.975+0000 7f23d8c00700 1 -- 172.21.15.71:0/2754255248 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d40092e0 con 0x7f23dc1084c0 2024-05-27T09:43:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.975+0000 7f23d8c00700 1 -- 172.21.15.71:0/2754255248 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d4004bb0 con 0x7f23dc1084c0 2024-05-27T09:43:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.975+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc1a64a0 con 0x7f23dc1084c0 2024-05-27T09:43:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.975+0000 7f23d8c00700 1 -- 172.21.15.71:0/2754255248 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4004020 con 0x7f23dc1084c0 2024-05-27T09:43:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.975+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc1a69b0 con 0x7f23dc1084c0 2024-05-27T09:43:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.976+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc0512b0 con 0x7f23dc1084c0 2024-05-27T09:43:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.979+0000 7f23d8c00700 1 -- 172.21.15.71:0/2754255248 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f23d401b030 con 0x7f23dc1084c0 2024-05-27T09:43:33.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.980+0000 7f23d8c00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f23c00b2900 0x7f23c00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:33.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.980+0000 7f23d8c00700 1 -- 172.21.15.71:0/2754255248 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f23d40e21e0 con 0x7f23dc1084c0 2024-05-27T09:43:33.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.980+0000 7f23dbe00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f23c00b2900 0x7f23c00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:33.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.981+0000 7f23dbe00700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f23c00b2900 0x7f23c00b4e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23cc011630 tx=0x7f23cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:33.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:33.982+0000 7f23d8c00700 1 -- 172.21.15.71:0/2754255248 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f23d4022020 con 0x7f23dc1084c0 2024-05-27T09:43:34.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.270+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23dc1adeb0 con 0x7f23dc1084c0 2024-05-27T09:43:34.271 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.272 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:34 smithi071 ceph-mon[31451]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:34.272 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.272 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.272 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.272 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:34 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.272+0000 7f23d8c00700 1 -- 172.21.15.71:0/2754255248 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10467 (secure 0 0 0) 0x7f23d4010040 con 0x7f23dc1084c0 2024-05-27T09:43:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:34.273 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24506,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-27T09:43:34.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f23c00b2900 msgr2=0x7f23c00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f23c00b2900 0x7f23c00b4e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23cc011630 tx=0x7f23cc009260 comp rx=0 tx=0).stop 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23dc1084c0 msgr2=0x7f23dc1a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23dc1084c0 0x7f23dc1a5b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23d400efc0 tx=0x7f23d400c3a0 comp rx=0 tx=0).stop 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 shutdown_connections 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23dc1084c0 0x7f23dc1a5b70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f23c00b2900 0x7f23c00b4e10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23dc103070 0x7f23dc1a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 --2- 172.21.15.71:0/2754255248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc1039c0 0x7f23dc1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 >> 172.21.15.71:0/2754255248 conn(0x7f23dc078ab0 msgr2=0x7f23dc105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 shutdown_connections 2024-05-27T09:43:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:34.275+0000 7f23e1600700 1 -- 172.21.15.71:0/2754255248 wait complete. 2024-05-27T09:43:34.277 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 13 2024-05-27T09:43:34.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:34 smithi122 ceph-mon[36436]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:34.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:34 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:34 smithi072 ceph-mon[35951]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:34.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:34.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:34 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:35.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-27T09:43:35.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:35 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2754255248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:35.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:35 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2754255248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:35.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:35 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2754255248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:43:35.583 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:36.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:36 smithi071 ceph-mon[31451]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:36.381 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:36 smithi122 ceph-mon[36436]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:36.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:36 smithi072 ceph-mon[35951]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 -- 172.21.15.71:0/1174148611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274076670 msgr2=0x7f0274110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 --2- 172.21.15.71:0/1174148611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274076670 0x7f0274110460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098f0 tx=0x7f025c009c00 comp rx=0 tx=0).stop 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 -- 172.21.15.71:0/1174148611 shutdown_connections 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 --2- 172.21.15.71:0/1174148611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02741109a0 0x7f0274112e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 --2- 172.21.15.71:0/1174148611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274075d20 0x7f0274076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 --2- 172.21.15.71:0/1174148611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274076670 0x7f0274110460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 -- 172.21.15.71:0/1174148611 >> 172.21.15.71:0/1174148611 conn(0x7f0274079d00 msgr2=0x7f027407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 -- 172.21.15.71:0/1174148611 shutdown_connections 2024-05-27T09:43:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.754+0000 7f0273e00700 1 -- 172.21.15.71:0/1174148611 wait complete. 2024-05-27T09:43:37.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.755+0000 7f0273e00700 1 Processor -- start 2024-05-27T09:43:37.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.755+0000 7f0273e00700 1 -- start start 2024-05-27T09:43:37.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0273e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274075d20 0x7f027419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0273e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274076670 0x7f027419d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0273e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02741109a0 0x7f02741a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0273e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02741164f0 con 0x7f0274076670 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0273e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0274116370 con 0x7f02741109a0 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0273e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0274116670 con 0x7f0274075d20 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0272a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274075d20 0x7f027419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0272a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274075d20 0x7f027419cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33548/0 (socket says 172.21.15.71:33548) 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0272a00700 1 -- 172.21.15.71:0/3739797947 learned_addr learned my addr 172.21.15.71:0/3739797947 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f0273400700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02741109a0 0x7f02741a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.756+0000 7f026a000700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274076670 0x7f027419d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0272a00700 1 -- 172.21.15.71:0/3739797947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02741109a0 msgr2=0x7f02741a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0272a00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02741109a0 0x7f02741a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0272a00700 1 -- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274076670 msgr2=0x7f027419d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0272a00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274076670 0x7f027419d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0272a00700 1 -- 172.21.15.71:0/3739797947 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02741a1d90 con 0x7f0274075d20 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0272a00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274075d20 0x7f027419cec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0264007f10 tx=0x7f026400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f026be00700 1 -- 172.21.15.71:0/3739797947 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400ddd0 con 0x7f0274075d20 2024-05-27T09:43:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f026be00700 1 -- 172.21.15.71:0/3739797947 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0264004020 con 0x7f0274075d20 2024-05-27T09:43:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f026be00700 1 -- 172.21.15.71:0/3739797947 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264015640 con 0x7f0274075d20 2024-05-27T09:43:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02741a2080 con 0x7f0274075d20 2024-05-27T09:43:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.757+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02741a99a0 con 0x7f0274075d20 2024-05-27T09:43:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.758+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02740512b0 con 0x7f0274075d20 2024-05-27T09:43:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.761+0000 7f026be00700 1 -- 172.21.15.71:0/3739797947 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f02640044f0 con 0x7f0274075d20 2024-05-27T09:43:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.762+0000 7f026be00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f02580b2900 0x7f02580b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.762+0000 7f026be00700 1 -- 172.21.15.71:0/3739797947 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f02640e1870 con 0x7f0274075d20 2024-05-27T09:43:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.762+0000 7f026a000700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f02580b2900 0x7f02580b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:37.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:37.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:37.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:37.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:43:37.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.763+0000 7f026a000700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f02580b2900 0x7f02580b4e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098c0 tx=0x7f025c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:37.767+0000 7f026be00700 1 -- 172.21.15.71:0/3739797947 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0264010070 con 0x7f0274075d20 2024-05-27T09:43:37.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:37.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:37.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:37.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:43:37.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:38.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.004+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f027419e220 con 0x7f0274075d20 2024-05-27T09:43:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.005+0000 7f026be00700 1 -- 172.21.15.71:0/3739797947 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f02640a9990 con 0x7f0274075d20 2024-05-27T09:43:38.005 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:38.006 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2024-05-27T09:43:38.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:43:38.006 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2024-05-27T09:43:38.006 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2024-05-27T09:43:38.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:43:38.006 INFO:teuthology.orchestra.run.smithi071.stdout:] 2024-05-27T09:43:38.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f02580b2900 msgr2=0x7f02580b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:38.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f02580b2900 0x7f02580b4e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098c0 tx=0x7f025c019040 comp rx=0 tx=0).stop 2024-05-27T09:43:38.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274075d20 msgr2=0x7f027419cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:38.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274075d20 0x7f027419cec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0264007f10 tx=0x7f026400d3b0 comp rx=0 tx=0).stop 2024-05-27T09:43:38.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 shutdown_connections 2024-05-27T09:43:38.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02741109a0 0x7f02741a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:38.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274075d20 0x7f027419cec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:38.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f02580b2900 0x7f02580b4e10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:38.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 --2- 172.21.15.71:0/3739797947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274076670 0x7f027419d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:38.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.008+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 >> 172.21.15.71:0/3739797947 conn(0x7f0274079d00 msgr2=0x7f0274100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:38.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.009+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 shutdown_connections 2024-05-27T09:43:38.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:38.009+0000 7f0273e00700 1 -- 172.21.15.71:0/3739797947 wait complete. 2024-05-27T09:43:38.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:38.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:38.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:43:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:43:38.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:43:38.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:38 smithi071 ceph-mon[31451]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:38.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:38 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3739797947' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-27T09:43:38.968 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T09:43:38.968 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T09:43:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:38 smithi122 ceph-mon[36436]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:38 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3739797947' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-27T09:43:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:38 smithi072 ceph-mon[35951]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:38 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3739797947' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-27T09:43:39.393 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:40 smithi122 ceph-mon[36436]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:40 smithi071 ceph-mon[31451]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:40 smithi072 ceph-mon[35951]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 -- 172.21.15.71:0/2320151878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 msgr2=0x7f127410b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 --2- 172.21.15.71:0/2320151878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 0x7f127410b350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12600098f0 tx=0x7f1260009c00 comp rx=0 tx=0).stop 2024-05-27T09:43:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 -- 172.21.15.71:0/2320151878 shutdown_connections 2024-05-27T09:43:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 --2- 172.21.15.71:0/2320151878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127410b890 0x7f12741131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 --2- 172.21.15.71:0/2320151878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 0x7f1274106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 --2- 172.21.15.71:0/2320151878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 0x7f127410b350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 -- 172.21.15.71:0/2320151878 >> 172.21.15.71:0/2320151878 conn(0x7f1274102020 msgr2=0x7f1274104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.691+0000 7f127ae00700 1 -- 172.21.15.71:0/2320151878 shutdown_connections 2024-05-27T09:43:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.692+0000 7f127ae00700 1 -- 172.21.15.71:0/2320151878 wait complete. 2024-05-27T09:43:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 Processor -- start 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 -- start start 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 0x7f127419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 0x7f127419d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127410b890 0x7f12741a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12741164a0 con 0x7f127410b890 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1274116320 con 0x7f127410af40 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.693+0000 7f127ae00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1274116620 con 0x7f1274106610 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 0x7f127419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 0x7f127419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33564/0 (socket says 172.21.15.71:33564) 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 -- 172.21.15.71:0/109060941 learned_addr learned my addr 172.21.15.71:0/109060941 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f127a400700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127410b890 0x7f12741a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279000700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 0x7f127419d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 -- 172.21.15.71:0/109060941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 msgr2=0x7f127419d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 0x7f127419d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 -- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127410b890 msgr2=0x7f12741a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127410b890 0x7f12741a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f1279a00700 1 -- 172.21.15.71:0/109060941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12741a1d40 con 0x7f1274106610 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.694+0000 7f127a400700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127410b890 0x7f12741a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:43:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.695+0000 7f1279a00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 0x7f127419ce70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f126800e9a0 tx=0x7f126800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.695+0000 7f1272000700 1 -- 172.21.15.71:0/109060941 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126800cbd0 con 0x7f1274106610 2024-05-27T09:43:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.695+0000 7f1272000700 1 -- 172.21.15.71:0/109060941 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f126800cd70 con 0x7f1274106610 2024-05-27T09:43:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.695+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12741a2030 con 0x7f1274106610 2024-05-27T09:43:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.695+0000 7f1272000700 1 -- 172.21.15.71:0/109060941 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268018680 con 0x7f1274106610 2024-05-27T09:43:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.695+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12741a9950 con 0x7f1274106610 2024-05-27T09:43:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.696+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12740512b0 con 0x7f1274106610 2024-05-27T09:43:41.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.699+0000 7f1272000700 1 -- 172.21.15.71:0/109060941 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1268010430 con 0x7f1274106610 2024-05-27T09:43:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.701+0000 7f1272000700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f125c0b2900 0x7f125c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.701+0000 7f1272000700 1 -- 172.21.15.71:0/109060941 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f12680e24c0 con 0x7f1274106610 2024-05-27T09:43:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.701+0000 7f1279000700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f125c0b2900 0x7f125c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.702+0000 7f1279000700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f125c0b2900 0x7f125c0b4e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1260009810 tx=0x7f1260019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.702+0000 7f1272000700 1 -- 172.21.15.71:0/109060941 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f12680aa5e0 con 0x7f1274106610 2024-05-27T09:43:41.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:41.934+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f127402e5e0 con 0x7f1274106610 2024-05-27T09:43:42.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.724+0000 7f1272000700 1 -- 172.21.15.71:0/109060941 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f12680a9ee0 con 0x7f1274106610 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.732+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f125c0b2900 msgr2=0x7f125c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.732+0000 7f127ae00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f125c0b2900 0x7f125c0b4e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1260009810 tx=0x7f1260019040 comp rx=0 tx=0).stop 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.732+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 msgr2=0x7f127419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.732+0000 7f127ae00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 0x7f127419ce70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f126800e9a0 tx=0x7f126800ecb0 comp rx=0 tx=0).stop 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.733+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 shutdown_connections 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.733+0000 7f127ae00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f125c0b2900 0x7f125c0b4e10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.733+0000 7f127ae00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127410b890 0x7f12741a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.733+0000 7f127ae00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1274106610 0x7f127419ce70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:42.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.733+0000 7f127ae00700 1 --2- 172.21.15.71:0/109060941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127410af40 0x7f127419d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:42.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.733+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 >> 172.21.15.71:0/109060941 conn(0x7f1274102020 msgr2=0x7f127410a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:42.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.734+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 shutdown_connections 2024-05-27T09:43:42.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:42.735+0000 7f127ae00700 1 -- 172.21.15.71:0/109060941 wait complete. 2024-05-27T09:43:42.738 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2024-05-27T09:43:43.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:42 smithi071 ceph-mon[31451]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:43.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:42 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/109060941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-27T09:43:43.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:42 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-27T09:43:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:42 smithi072 ceph-mon[35951]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:42 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/109060941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-27T09:43:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:42 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-27T09:43:43.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:42 smithi122 ceph-mon[36436]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:43.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:42 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/109060941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-27T09:43:43.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:42 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-27T09:43:43.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T09:43:44.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:43 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-27T09:43:44.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:43 smithi071 ceph-mon[31451]: osdmap e75: 12 total, 12 up, 12 in 2024-05-27T09:43:44.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:43 smithi071 ceph-mon[31451]: osdmap e76: 12 total, 12 up, 12 in 2024-05-27T09:43:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:43 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-27T09:43:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:43 smithi072 ceph-mon[35951]: osdmap e75: 12 total, 12 up, 12 in 2024-05-27T09:43:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:43 smithi072 ceph-mon[35951]: osdmap e76: 12 total, 12 up, 12 in 2024-05-27T09:43:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:44.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:43 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-27T09:43:44.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:43 smithi122 ceph-mon[36436]: osdmap e75: 12 total, 12 up, 12 in 2024-05-27T09:43:44.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:43 smithi122 ceph-mon[36436]: osdmap e76: 12 total, 12 up, 12 in 2024-05-27T09:43:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:44 smithi071 ceph-mon[31451]: pgmap v315: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:44 smithi071 ceph-mon[31451]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-27T09:43:45.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:44 smithi071 ceph-mon[31451]: osdmap e77: 12 total, 12 up, 12 in 2024-05-27T09:43:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:44 smithi072 ceph-mon[35951]: pgmap v315: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:44 smithi072 ceph-mon[35951]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-27T09:43:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:44 smithi072 ceph-mon[35951]: osdmap e77: 12 total, 12 up, 12 in 2024-05-27T09:43:45.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:44 smithi122 ceph-mon[36436]: pgmap v315: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:45.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:44 smithi122 ceph-mon[36436]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-27T09:43:45.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:44 smithi122 ceph-mon[36436]: osdmap e77: 12 total, 12 up, 12 in 2024-05-27T09:43:46.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 -- 172.21.15.71:0/4126435344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c10b860 msgr2=0x7eff0c1131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 --2- 172.21.15.71:0/4126435344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c10b860 0x7eff0c1131c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff04009fc0 tx=0x7eff0400b330 comp rx=0 tx=0).stop 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 -- 172.21.15.71:0/4126435344 shutdown_connections 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 --2- 172.21.15.71:0/4126435344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c10b860 0x7eff0c1131c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 --2- 172.21.15.71:0/4126435344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0c106630 0x7eff0c106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 --2- 172.21.15.71:0/4126435344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c10af10 0x7eff0c10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 -- 172.21.15.71:0/4126435344 >> 172.21.15.71:0/4126435344 conn(0x7eff0c102020 msgr2=0x7eff0c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 -- 172.21.15.71:0/4126435344 shutdown_connections 2024-05-27T09:43:46.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.558+0000 7eff11200700 1 -- 172.21.15.71:0/4126435344 wait complete. 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.559+0000 7eff11200700 1 Processor -- start 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.559+0000 7eff11200700 1 -- start start 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff11200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c106630 0x7eff0c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff11200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c10af10 0x7eff0c19d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff11200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0c10b860 0x7eff0c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff11200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c1164e0 con 0x7eff0c10af10 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff11200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c116360 con 0x7eff0c10b860 2024-05-27T09:43:46.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff11200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c116660 con 0x7eff0c106630 2024-05-27T09:43:46.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff0aa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c10af10 0x7eff0c19d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:46.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff0be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0c10b860 0x7eff0c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:46.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff0be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0c10b860 0x7eff0c1a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:48722/0 (socket says 172.21.15.71:48722) 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff0b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c106630 0x7eff0c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.560+0000 7eff0be00700 1 -- 172.21.15.71:0/3334674688 learned_addr learned my addr 172.21.15.71:0/3334674688 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.561+0000 7eff0b400700 1 -- 172.21.15.71:0/3334674688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0c10b860 msgr2=0x7eff0c1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.561+0000 7eff0b400700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0c10b860 0x7eff0c1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.561+0000 7eff0b400700 1 -- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c10af10 msgr2=0x7eff0c19d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.561+0000 7eff0b400700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c10af10 0x7eff0c19d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.561+0000 7eff0b400700 1 -- 172.21.15.71:0/3334674688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c1a1d80 con 0x7eff0c106630 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.561+0000 7eff0aa00700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c10af10 0x7eff0c19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:43:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.561+0000 7eff0b400700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c106630 0x7eff0c19ceb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e9f0 tx=0x7efefc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:46.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.562+0000 7eff03e00700 1 -- 172.21.15.71:0/3334674688 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc00c9c0 con 0x7eff0c106630 2024-05-27T09:43:46.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.562+0000 7eff03e00700 1 -- 172.21.15.71:0/3334674688 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efefc00cb60 con 0x7eff0c106630 2024-05-27T09:43:46.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.562+0000 7eff03e00700 1 -- 172.21.15.71:0/3334674688 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc018680 con 0x7eff0c106630 2024-05-27T09:43:46.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.562+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0c1a2070 con 0x7eff0c106630 2024-05-27T09:43:46.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.562+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0c1a9990 con 0x7eff0c106630 2024-05-27T09:43:46.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.563+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0c06a610 con 0x7eff0c106630 2024-05-27T09:43:46.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.565+0000 7eff03e00700 1 -- 172.21.15.71:0/3334674688 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7efefc018a30 con 0x7eff0c106630 2024-05-27T09:43:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.567+0000 7eff03e00700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2900 0x7efef00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.567+0000 7eff03e00700 1 -- 172.21.15.71:0/3334674688 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7efefc0e25a0 con 0x7eff0c106630 2024-05-27T09:43:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.567+0000 7eff0aa00700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2900 0x7efef00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:46.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.568+0000 7eff0aa00700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2900 0x7efef00b4e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff0c105950 tx=0x7efef8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:46.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.569+0000 7eff03e00700 1 -- 172.21.15.71:0/3334674688 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efefc0aa550 con 0x7eff0c106630 2024-05-27T09:43:46.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:46.806+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7eff0c02e5e0 con 0x7eff0c106630 2024-05-27T09:43:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:46 smithi072 ceph-mon[35951]: pgmap v318: 33 pgs: 17 active+clean, 16 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:47.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:46 smithi122 ceph-mon[36436]: pgmap v318: 33 pgs: 17 active+clean, 16 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:47.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:46 smithi071 ceph-mon[31451]: pgmap v318: 33 pgs: 17 active+clean, 16 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.785+0000 7eff03e00700 1 -- 172.21.15.71:0/3334674688 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7efefc0a9e50 con 0x7eff0c106630 2024-05-27T09:43:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.795+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2900 msgr2=0x7efef00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.795+0000 7eff11200700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2900 0x7efef00b4e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff0c105950 tx=0x7efef8009310 comp rx=0 tx=0).stop 2024-05-27T09:43:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.795+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c106630 msgr2=0x7eff0c19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.795+0000 7eff11200700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c106630 0x7eff0c19ceb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e9f0 tx=0x7efefc00ed00 comp rx=0 tx=0).stop 2024-05-27T09:43:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.796+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 shutdown_connections 2024-05-27T09:43:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.796+0000 7eff11200700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0c10b860 0x7eff0c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.796+0000 7eff11200700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0c106630 0x7eff0c19ceb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.796+0000 7eff11200700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2900 0x7efef00b4e10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.796+0000 7eff11200700 1 --2- 172.21.15.71:0/3334674688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c10af10 0x7eff0c19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.796+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 >> 172.21.15.71:0/3334674688 conn(0x7eff0c102020 msgr2=0x7eff0c10a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.797+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 shutdown_connections 2024-05-27T09:43:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:47.797+0000 7eff11200700 1 -- 172.21.15.71:0/3334674688 wait complete. 2024-05-27T09:43:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2024-05-27T09:43:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:47 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3334674688' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-27T09:43:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:47 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-27T09:43:48.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:47 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3334674688' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-27T09:43:48.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:47 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-27T09:43:48.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:47 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3334674688' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-27T09:43:48.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:47 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-27T09:43:48.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T09:43:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:48 smithi071 ceph-mon[31451]: pgmap v319: 33 pgs: 24 active+clean, 9 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:48 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-27T09:43:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:48 smithi071 ceph-mon[31451]: osdmap e78: 12 total, 12 up, 12 in 2024-05-27T09:43:49.120 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:49.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:48 smithi122 ceph-mon[36436]: pgmap v319: 33 pgs: 24 active+clean, 9 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:49.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:48 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-27T09:43:49.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:48 smithi122 ceph-mon[36436]: osdmap e78: 12 total, 12 up, 12 in 2024-05-27T09:43:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:48 smithi072 ceph-mon[35951]: pgmap v319: 33 pgs: 24 active+clean, 9 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:48 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-27T09:43:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:48 smithi072 ceph-mon[35951]: osdmap e78: 12 total, 12 up, 12 in 2024-05-27T09:43:50.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:49 smithi071 ceph-mon[31451]: osdmap e79: 12 total, 12 up, 12 in 2024-05-27T09:43:50.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:49 smithi122 ceph-mon[36436]: osdmap e79: 12 total, 12 up, 12 in 2024-05-27T09:43:50.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:49 smithi072 ceph-mon[35951]: osdmap e79: 12 total, 12 up, 12 in 2024-05-27T09:43:50.881 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:50 smithi071 ceph-mon[31451]: pgmap v322: 97 pgs: 8 creating+peering, 39 active+clean, 50 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:50.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:50 smithi071 ceph-mon[31451]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-27T09:43:50.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:50 smithi071 ceph-mon[31451]: osdmap e80: 12 total, 12 up, 12 in 2024-05-27T09:43:51.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:50 smithi122 ceph-mon[36436]: pgmap v322: 97 pgs: 8 creating+peering, 39 active+clean, 50 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:51.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:50 smithi122 ceph-mon[36436]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-27T09:43:51.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:50 smithi122 ceph-mon[36436]: osdmap e80: 12 total, 12 up, 12 in 2024-05-27T09:43:51.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:50 smithi072 ceph-mon[35951]: pgmap v322: 97 pgs: 8 creating+peering, 39 active+clean, 50 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:51.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:50 smithi072 ceph-mon[35951]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-27T09:43:51.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:50 smithi072 ceph-mon[35951]: osdmap e80: 12 total, 12 up, 12 in 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 -- 172.21.15.71:0/2808555588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c105470 msgr2=0x7fa32c105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 --2- 172.21.15.71:0/2808555588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c105470 0x7fa32c105880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009990 tx=0x7fa31c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 -- 172.21.15.71:0/2808555588 shutdown_connections 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 --2- 172.21.15.71:0/2808555588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa32c10e8e0 0x7fa32c110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 --2- 172.21.15.71:0/2808555588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c105470 0x7fa32c105880 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 --2- 172.21.15.71:0/2808555588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 0x7fa32c10e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 -- 172.21.15.71:0/2808555588 >> 172.21.15.71:0/2808555588 conn(0x7fa32c0fef20 msgr2=0x7fa32c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 -- 172.21.15.71:0/2808555588 shutdown_connections 2024-05-27T09:43:51.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.434+0000 7fa332600700 1 -- 172.21.15.71:0/2808555588 wait complete. 2024-05-27T09:43:51.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.436+0000 7fa332600700 1 Processor -- start 2024-05-27T09:43:51.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.436+0000 7fa332600700 1 -- start start 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.436+0000 7fa332600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa32c105470 0x7fa32c103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.436+0000 7fa332600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 0x7fa32c1036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.436+0000 7fa332600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c10e8e0 0x7fa32c103be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa332600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c114480 con 0x7fa32c105470 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa332600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c114300 con 0x7fa32c10e8e0 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa332600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c114600 con 0x7fa32c105dc0 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 0x7fa32c1036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa32c105470 0x7fa32c103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 0x7fa32c1036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:51654/0 (socket says 172.21.15.71:51654) 2024-05-27T09:43:51.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 -- 172.21.15.71:0/944396872 learned_addr learned my addr 172.21.15.71:0/944396872 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:51.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32be00700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c10e8e0 0x7fa32c103be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 -- 172.21.15.71:0/944396872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c10e8e0 msgr2=0x7fa32c103be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c10e8e0 0x7fa32c103be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 -- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa32c105470 msgr2=0x7fa32c103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa32c105470 0x7fa32c103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.437+0000 7fa32aa00700 1 -- 172.21.15.71:0/944396872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c1a9130 con 0x7fa32c105dc0 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.438+0000 7fa32aa00700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 0x7fa32c1036a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e9a0 tx=0x7fa31800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.438+0000 7fa323e00700 1 -- 172.21.15.71:0/944396872 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31800cbd0 con 0x7fa32c105dc0 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.438+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c1a9420 con 0x7fa32c105dc0 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.438+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c1a99b0 con 0x7fa32c105dc0 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.438+0000 7fa323e00700 1 -- 172.21.15.71:0/944396872 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa31800cd70 con 0x7fa32c105dc0 2024-05-27T09:43:51.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.438+0000 7fa323e00700 1 -- 172.21.15.71:0/944396872 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318018680 con 0x7fa32c105dc0 2024-05-27T09:43:51.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.440+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30c005360 con 0x7fa32c105dc0 2024-05-27T09:43:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.443+0000 7fa323e00700 1 -- 172.21.15.71:0/944396872 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa318018820 con 0x7fa32c105dc0 2024-05-27T09:43:51.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.445+0000 7fa323e00700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa3100b2880 0x7fa3100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:51.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.445+0000 7fa323e00700 1 -- 172.21.15.71:0/944396872 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7fa3180e2280 con 0x7fa32c105dc0 2024-05-27T09:43:51.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.445+0000 7fa32b400700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa3100b2880 0x7fa3100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.446+0000 7fa32b400700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa3100b2880 0x7fa3100b4d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b2e0 tx=0x7fa31c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.449+0000 7fa323e00700 1 -- 172.21.15.71:0/944396872 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa3180aa0b0 con 0x7fa32c105dc0 2024-05-27T09:43:51.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.728+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa30c005650 con 0x7fa32c105dc0 2024-05-27T09:43:51.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.834+0000 7fa323e00700 1 -- 172.21.15.71:0/944396872 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa3180b2130 con 0x7fa32c105dc0 2024-05-27T09:43:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa3100b2880 msgr2=0x7fa3100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa3100b2880 0x7fa3100b4d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b2e0 tx=0x7fa31c005fd0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 msgr2=0x7fa32c1036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 0x7fa32c1036a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e9a0 tx=0x7fa31800ecb0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 shutdown_connections 2024-05-27T09:43:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa32c10e8e0 0x7fa32c103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa3100b2880 0x7fa3100b4d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa32c105470 0x7fa32c103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 --2- 172.21.15.71:0/944396872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa32c105dc0 0x7fa32c1036a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.841+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 >> 172.21.15.71:0/944396872 conn(0x7fa32c0fef20 msgr2=0x7fa32c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.842+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 shutdown_connections 2024-05-27T09:43:51.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:51.842+0000 7fa332600700 1 -- 172.21.15.71:0/944396872 wait complete. 2024-05-27T09:43:51.846 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 2 and data pool 3 2024-05-27T09:43:52.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:51 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/944396872' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-27T09:43:52.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:51 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-27T09:43:52.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:51 smithi071 ceph-mon[31451]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-27T09:43:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:51 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/944396872' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-27T09:43:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:51 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-27T09:43:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:51 smithi122 ceph-mon[36436]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-27T09:43:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:51 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/944396872' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-27T09:43:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:51 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-27T09:43:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:51 smithi072 ceph-mon[35951]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-27T09:43:52.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:43:53.125 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:52 smithi122 ceph-mon[36436]: pgmap v324: 97 pgs: 8 creating+peering, 55 active+clean, 34 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:52 smithi122 ceph-mon[36436]: osdmap e81: 12 total, 12 up, 12 in 2024-05-27T09:43:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:52 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-27T09:43:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:52 smithi122 ceph-mon[36436]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-27T09:43:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:52 smithi122 ceph-mon[36436]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-27T09:43:53.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:52 smithi071 ceph-mon[31451]: pgmap v324: 97 pgs: 8 creating+peering, 55 active+clean, 34 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:53.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:52 smithi071 ceph-mon[31451]: osdmap e81: 12 total, 12 up, 12 in 2024-05-27T09:43:53.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:52 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-27T09:43:53.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:52 smithi071 ceph-mon[31451]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-27T09:43:53.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:52 smithi071 ceph-mon[31451]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-27T09:43:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:52 smithi072 ceph-mon[35951]: pgmap v324: 97 pgs: 8 creating+peering, 55 active+clean, 34 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:43:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:52 smithi072 ceph-mon[35951]: osdmap e81: 12 total, 12 up, 12 in 2024-05-27T09:43:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:52 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-27T09:43:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:52 smithi072 ceph-mon[35951]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-27T09:43:53.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:52 smithi072 ceph-mon[35951]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-27T09:43:54.026 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 09:43:53 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: 2024-05-27T09:43:53.739+0000 7f0b1d2b7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T09:43:54.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:53 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] up:active 2024-05-27T09:43:54.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:53 smithi072 ceph-mon[35951]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:43:54.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:53 smithi072 ceph-mon[35951]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:43:54.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:53 smithi072 ceph-mon[35951]: pgmap v326: 97 pgs: 8 creating+peering, 89 active+clean; 578 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-05-27T09:43:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:53 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] up:active 2024-05-27T09:43:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:53 smithi071 ceph-mon[31451]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:43:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:53 smithi071 ceph-mon[31451]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:43:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:53 smithi071 ceph-mon[31451]: pgmap v326: 97 pgs: 8 creating+peering, 89 active+clean; 578 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-05-27T09:43:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:53 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] up:active 2024-05-27T09:43:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:53 smithi122 ceph-mon[36436]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:43:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:53 smithi122 ceph-mon[36436]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:43:54.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:53 smithi122 ceph-mon[36436]: pgmap v326: 97 pgs: 8 creating+peering, 89 active+clean; 578 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-05-27T09:43:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:54 smithi071 ceph-mon[31451]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-27T09:43:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:54 smithi071 ceph-mon[31451]: Cluster is now healthy 2024-05-27T09:43:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:54 smithi122 ceph-mon[36436]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-27T09:43:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:54 smithi122 ceph-mon[36436]: Cluster is now healthy 2024-05-27T09:43:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:54 smithi072 ceph-mon[35951]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-27T09:43:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:54 smithi072 ceph-mon[35951]: Cluster is now healthy 2024-05-27T09:43:55.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 -- 172.21.15.71:0/1628971200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba280764a0 msgr2=0x7fba28114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:55.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 --2- 172.21.15.71:0/1628971200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba280764a0 0x7fba28114e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba14009990 tx=0x7fba14009ca0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 -- 172.21.15.71:0/1628971200 shutdown_connections 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 --2- 172.21.15.71:0/1628971200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba28115360 0x7fba28117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 --2- 172.21.15.71:0/1628971200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba28075b50 0x7fba28075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 --2- 172.21.15.71:0/1628971200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba280764a0 0x7fba28114e20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 -- 172.21.15.71:0/1628971200 >> 172.21.15.71:0/1628971200 conn(0x7fba28100030 msgr2=0x7fba28102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 -- 172.21.15.71:0/1628971200 shutdown_connections 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.275+0000 7fba30400700 1 -- 172.21.15.71:0/1628971200 wait complete. 2024-05-27T09:43:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.276+0000 7fba30400700 1 Processor -- start 2024-05-27T09:43:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.276+0000 7fba30400700 1 -- start start 2024-05-27T09:43:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba30400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba28075b50 0x7fba281a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba30400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba280764a0 0x7fba281a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba30400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba28115360 0x7fba281a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba30400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba2811aab0 con 0x7fba28115360 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba30400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fba2811a930 con 0x7fba280764a0 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba30400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba2811ac30 con 0x7fba28075b50 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba2e400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba28115360 0x7fba281a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba2e400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba28115360 0x7fba281a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48800/0 (socket says 172.21.15.71:48800) 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba2e400700 1 -- 172.21.15.71:0/3959864073 learned_addr learned my addr 172.21.15.71:0/3959864073 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba2da00700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba28075b50 0x7fba281a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.277+0000 7fba2d000700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba280764a0 0x7fba281a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2e400700 1 -- 172.21.15.71:0/3959864073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba28075b50 msgr2=0x7fba281a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2e400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba28075b50 0x7fba281a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2e400700 1 -- 172.21.15.71:0/3959864073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba280764a0 msgr2=0x7fba281a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2e400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba280764a0 0x7fba281a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2e400700 1 -- 172.21.15.71:0/3959864073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba281a6310 con 0x7fba28115360 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2d000700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba280764a0 0x7fba281a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2da00700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba28075b50 0x7fba281a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:43:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba2e400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba28115360 0x7fba281a5c70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba2000e940 tx=0x7fba2000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba26000700 1 -- 172.21.15.71:0/3959864073 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20004a30 con 0x7fba28115360 2024-05-27T09:43:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba26000700 1 -- 172.21.15.71:0/3959864073 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba200054d0 con 0x7fba28115360 2024-05-27T09:43:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba281a6600 con 0x7fba28115360 2024-05-27T09:43:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.278+0000 7fba26000700 1 -- 172.21.15.71:0/3959864073 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2000ccf0 con 0x7fba28115360 2024-05-27T09:43:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.279+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba281adf20 con 0x7fba28115360 2024-05-27T09:43:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.280+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba280512b0 con 0x7fba28115360 2024-05-27T09:43:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.283+0000 7fba26000700 1 -- 172.21.15.71:0/3959864073 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fba20005000 con 0x7fba28115360 2024-05-27T09:43:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.284+0000 7fba26000700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fba100b2900 0x7fba100b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.285+0000 7fba26000700 1 -- 172.21.15.71:0/3959864073 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fba200e2410 con 0x7fba28115360 2024-05-27T09:43:55.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.285+0000 7fba2da00700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fba100b2900 0x7fba100b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:55.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.285+0000 7fba2da00700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fba100b2900 0x7fba100b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009480 tx=0x7fba1c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:55.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.288+0000 7fba26000700 1 -- 172.21.15.71:0/3959864073 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba20054df0 con 0x7fba28115360 2024-05-27T09:43:55.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.524+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba2802e5e0 con 0x7fba28115360 2024-05-27T09:43:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.526+0000 7fba26000700 1 -- 172.21.15.71:0/3959864073 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22171 (secure 0 0 0) 0x7fba200052f0 con 0x7fba28115360 2024-05-27T09:43:55.529 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:55.529 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":81,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:43:51.731775+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fba100b2900 msgr2=0x7fba100b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fba100b2900 0x7fba100b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009480 tx=0x7fba1c00b040 comp rx=0 tx=0).stop 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba28115360 msgr2=0x7fba281a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba28115360 0x7fba281a5c70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba2000e940 tx=0x7fba2000ec50 comp rx=0 tx=0).stop 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 shutdown_connections 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fba100b2900 0x7fba100b4e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba28115360 0x7fba281a5c70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba28075b50 0x7fba281a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 --2- 172.21.15.71:0/3959864073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba280764a0 0x7fba281a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:55.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 >> 172.21.15.71:0/3959864073 conn(0x7fba28100030 msgr2=0x7fba28100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:55.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 shutdown_connections 2024-05-27T09:43:55.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:55.530+0000 7fba30400700 1 -- 172.21.15.71:0/3959864073 wait complete. 2024-05-27T09:43:56.178 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:55 smithi072 ceph-mon[35951]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-05-27T09:43:56.178 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:55 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3959864073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:43:56.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:55 smithi122 ceph-mon[36436]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-05-27T09:43:56.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:55 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3959864073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:43:56.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:55 smithi071 ceph-mon[31451]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-05-27T09:43:56.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:55 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3959864073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:43:56.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:43:56.786 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:43:58.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:43:58 smithi122 ceph-mon[36436]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-27T09:43:58.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:43:58 smithi071 ceph-mon[31451]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-27T09:43:58.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:43:58 smithi072 ceph-mon[35951]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-27T09:43:59.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 -- 172.21.15.71:0/443324767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc1045e0 msgr2=0x7f7adc1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 --2- 172.21.15.71:0/443324767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc1045e0 0x7f7adc1049f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0099c0 tx=0x7f7acc009cd0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 -- 172.21.15.71:0/443324767 shutdown_connections 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 --2- 172.21.15.71:0/443324767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7adc109860 0x7f7adc1111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 --2- 172.21.15.71:0/443324767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc1045e0 0x7f7adc1049f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 --2- 172.21.15.71:0/443324767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc108f10 0x7f7adc109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 -- 172.21.15.71:0/443324767 >> 172.21.15.71:0/443324767 conn(0x7f7adc100030 msgr2=0x7f7adc102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 -- 172.21.15.71:0/443324767 shutdown_connections 2024-05-27T09:43:59.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.121+0000 7f7ae2800700 1 -- 172.21.15.71:0/443324767 wait complete. 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.122+0000 7f7ae2800700 1 Processor -- start 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.122+0000 7f7ae2800700 1 -- start start 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ae2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc1045e0 0x7f7adc19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ae2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc108f10 0x7f7adc19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ae2800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7adc109860 0x7f7adc1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ae2800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc1144b0 con 0x7f7adc108f10 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ae2800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc114330 con 0x7f7adc1045e0 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ae2800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc114630 con 0x7f7adc109860 2024-05-27T09:43:59.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ad2a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc108f10 0x7f7adc19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ad2a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc108f10 0x7f7adc19d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48808/0 (socket says 172.21.15.71:48808) 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7ad2a00700 1 -- 172.21.15.71:0/135959834 learned_addr learned my addr 172.21.15.71:0/135959834 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7adb400700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc1045e0 0x7f7adc19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.123+0000 7f7adbe00700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7adc109860 0x7f7adc1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad2a00700 1 -- 172.21.15.71:0/135959834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7adc109860 msgr2=0x7f7adc1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad2a00700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7adc109860 0x7f7adc1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad2a00700 1 -- 172.21.15.71:0/135959834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc1045e0 msgr2=0x7f7adc19d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad2a00700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc1045e0 0x7f7adc19d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad2a00700 1 -- 172.21.15.71:0/135959834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc1a1ef0 con 0x7f7adc108f10 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7adbe00700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7adc109860 0x7f7adc1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:43:59.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7adb400700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc1045e0 0x7f7adc19d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:43:59.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad2a00700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc108f10 0x7f7adc19d5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400ea30 tx=0x7f7ac400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:59.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad8c00700 1 -- 172.21.15.71:0/135959834 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400cbd0 con 0x7f7adc108f10 2024-05-27T09:43:59.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ad8c00700 1 -- 172.21.15.71:0/135959834 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ac40044d0 con 0x7f7adc108f10 2024-05-27T09:43:59.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.124+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc1a21e0 con 0x7f7adc108f10 2024-05-27T09:43:59.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.125+0000 7f7ad8c00700 1 -- 172.21.15.71:0/135959834 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4003dc0 con 0x7f7adc108f10 2024-05-27T09:43:59.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.125+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc1a9b00 con 0x7f7adc108f10 2024-05-27T09:43:59.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.126+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7adc0512b0 con 0x7f7adc108f10 2024-05-27T09:43:59.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.128+0000 7f7ad8c00700 1 -- 172.21.15.71:0/135959834 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7ac4004000 con 0x7f7adc108f10 2024-05-27T09:43:59.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.130+0000 7f7ad8c00700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7ac00b2880 0x7f7ac00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:43:59.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.130+0000 7f7ad8c00700 1 -- 172.21.15.71:0/135959834 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f7ac40e2320 con 0x7f7adc108f10 2024-05-27T09:43:59.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.130+0000 7f7adb400700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7ac00b2880 0x7f7ac00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:43:59.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.131+0000 7f7adb400700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7ac00b2880 0x7f7ac00b4d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:43:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.133+0000 7f7ad8c00700 1 -- 172.21.15.71:0/135959834 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7ac40042f0 con 0x7f7adc108f10 2024-05-27T09:43:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.370+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7adc1a9cd0 con 0x7f7adc108f10 2024-05-27T09:43:59.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.372+0000 7f7ad8c00700 1 -- 172.21.15.71:0/135959834 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22171 (secure 0 0 0) 0x7f7ac40aa180 con 0x7f7adc108f10 2024-05-27T09:43:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:43:59.374 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":81,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:43:51.731775+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:43:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7ac00b2880 msgr2=0x7f7ac00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7ac00b2880 0x7f7ac00b4d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc01a040 comp rx=0 tx=0).stop 2024-05-27T09:43:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc108f10 msgr2=0x7f7adc19d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:43:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc108f10 0x7f7adc19d5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400ea30 tx=0x7f7ac400ed40 comp rx=0 tx=0).stop 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 shutdown_connections 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7adc109860 0x7f7adc1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc1045e0 0x7f7adc19d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7ac00b2880 0x7f7ac00b4d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 --2- 172.21.15.71:0/135959834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7adc108f10 0x7f7adc19d5c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 >> 172.21.15.71:0/135959834 conn(0x7f7adc100030 msgr2=0x7f7adc10a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 shutdown_connections 2024-05-27T09:43:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:43:59.376+0000 7f7ae2800700 1 -- 172.21.15.71:0/135959834 wait complete. 2024-05-27T09:44:00.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-27T09:44:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:00 smithi122 ceph-mon[36436]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-27T09:44:00.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:00 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/135959834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:44:00.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:00 smithi071 ceph-mon[31451]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-27T09:44:00.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:00 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/135959834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:44:00.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:00 smithi072 ceph-mon[35951]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-27T09:44:00.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:00 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/135959834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:44:00.647 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:02.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:02 smithi122 ceph-mon[36436]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-27T09:44:02.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:02 smithi071 ceph-mon[31451]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-27T09:44:02.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:02 smithi072 ceph-mon[35951]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-27T09:44:02.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.758+0000 7f7005c00700 1 -- 172.21.15.71:0/1220600145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 msgr2=0x7f70001131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:02.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.758+0000 7f7005c00700 1 --2- 172.21.15.71:0/1220600145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 0x7f70001131f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800b0d0 tx=0x7f6ff800b3e0 comp rx=0 tx=0).stop 2024-05-27T09:44:02.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.759+0000 7f7005c00700 1 -- 172.21.15.71:0/1220600145 shutdown_connections 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.759+0000 7f7005c00700 1 --2- 172.21.15.71:0/1220600145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 0x7f70001131f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.759+0000 7f7005c00700 1 --2- 172.21.15.71:0/1220600145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 0x7f7000106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.759+0000 7f7005c00700 1 --2- 172.21.15.71:0/1220600145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f700010af40 0x7f700010b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.759+0000 7f7005c00700 1 -- 172.21.15.71:0/1220600145 >> 172.21.15.71:0/1220600145 conn(0x7f7000102020 msgr2=0x7f7000104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.759+0000 7f7005c00700 1 -- 172.21.15.71:0/1220600145 shutdown_connections 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.759+0000 7f7005c00700 1 -- 172.21.15.71:0/1220600145 wait complete. 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.760+0000 7f7005c00700 1 Processor -- start 2024-05-27T09:44:02.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.760+0000 7f7005c00700 1 -- start start 2024-05-27T09:44:02.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f7005c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 0x7f700019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:02.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f7005c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f700010af40 0x7f700019d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:02.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f7005c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 0x7f70001a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:02.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f7005c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7000116510 con 0x7f700010b890 2024-05-27T09:44:02.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f7005c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7000116390 con 0x7f7000106610 2024-05-27T09:44:02.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f7005c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7000116690 con 0x7f700010af40 2024-05-27T09:44:02.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f7005200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 0x7f70001a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:02.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f6fffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 0x7f700019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f6fffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 0x7f700019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60924/0 (socket says 172.21.15.71:60924) 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f6fffe00700 1 -- 172.21.15.71:0/548799693 learned_addr learned my addr 172.21.15.71:0/548799693 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.761+0000 7f6fff400700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f700010af40 0x7f700019d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.762+0000 7f6fffe00700 1 -- 172.21.15.71:0/548799693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f700010af40 msgr2=0x7f700019d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.762+0000 7f6fffe00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f700010af40 0x7f700019d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.762+0000 7f6fffe00700 1 -- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 msgr2=0x7f70001a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.762+0000 7f6fffe00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 0x7f70001a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.762+0000 7f6fffe00700 1 -- 172.21.15.71:0/548799693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70001a1cf0 con 0x7f7000106610 2024-05-27T09:44:02.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.762+0000 7f6fffe00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 0x7f700019ce20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000e9a0 tx=0x7f6ff000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:02.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.763+0000 7f6ffcc00700 1 -- 172.21.15.71:0/548799693 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000ca10 con 0x7f7000106610 2024-05-27T09:44:02.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.763+0000 7f6ffcc00700 1 -- 172.21.15.71:0/548799693 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ff000cbb0 con 0x7f7000106610 2024-05-27T09:44:02.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.763+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70001a1fe0 con 0x7f7000106610 2024-05-27T09:44:02.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.763+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70001a9900 con 0x7f7000106610 2024-05-27T09:44:02.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.763+0000 7f6ffcc00700 1 -- 172.21.15.71:0/548799693 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0018680 con 0x7f7000106610 2024-05-27T09:44:02.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.764+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe0005360 con 0x7f7000106610 2024-05-27T09:44:02.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.767+0000 7f6ffcc00700 1 -- 172.21.15.71:0/548799693 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6ff0018820 con 0x7f7000106610 2024-05-27T09:44:02.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.768+0000 7f6ffcc00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6fe40b2900 0x7f6fe40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:02.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.768+0000 7f6ffcc00700 1 -- 172.21.15.71:0/548799693 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6ff00e24d0 con 0x7f7000106610 2024-05-27T09:44:02.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.768+0000 7f6fff400700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6fe40b2900 0x7f6fe40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:02.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.769+0000 7f6fff400700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6fe40b2900 0x7f6fe40b4e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7000109c70 tx=0x7f6fec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:02.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:02.770+0000 7f6ffcc00700 1 -- 172.21.15.71:0/548799693 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ff00aa2a0 con 0x7f7000106610 2024-05-27T09:44:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.050+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6fe0005650 con 0x7f7000106610 2024-05-27T09:44:03.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.227+0000 7f6ffcc00700 1 -- 172.21.15.71:0/548799693 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f6ff00b2320 con 0x7f7000106610 2024-05-27T09:44:03.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.231+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6fe40b2900 msgr2=0x7f6fe40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:03.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.231+0000 7f7005c00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6fe40b2900 0x7f6fe40b4e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7000109c70 tx=0x7f6fec009260 comp rx=0 tx=0).stop 2024-05-27T09:44:03.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.231+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 msgr2=0x7f700019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:03.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.231+0000 7f7005c00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 0x7f700019ce20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000e9a0 tx=0x7f6ff000ecb0 comp rx=0 tx=0).stop 2024-05-27T09:44:03.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.231+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 shutdown_connections 2024-05-27T09:44:03.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.231+0000 7f7005c00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6fe40b2900 0x7f6fe40b4e10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:03.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.231+0000 7f7005c00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f700010b890 0x7f70001a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:03.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.232+0000 7f7005c00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7000106610 0x7f700019ce20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:03.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.232+0000 7f7005c00700 1 --2- 172.21.15.71:0/548799693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f700010af40 0x7f700019d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:03.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.232+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 >> 172.21.15.71:0/548799693 conn(0x7f7000102020 msgr2=0x7f700010a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:03.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.232+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 shutdown_connections 2024-05-27T09:44:03.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:03.232+0000 7f7005c00700 1 -- 172.21.15.71:0/548799693 wait complete. 2024-05-27T09:44:03.321 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:03 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/548799693' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-27T09:44:03.321 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:03 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-27T09:44:03.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:03 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/548799693' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-27T09:44:03.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:03 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-27T09:44:03.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:03 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/548799693' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-27T09:44:03.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:03 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-27T09:44:04.085 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-27T09:44:04.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-05-27T09:44:04.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:04 smithi122 ceph-mon[36436]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-27T09:44:04.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:04 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-27T09:44:04.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:04 smithi122 ceph-mon[36436]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:44:04.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:04 smithi071 ceph-mon[31451]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-27T09:44:04.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:04 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-27T09:44:04.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:04 smithi071 ceph-mon[31451]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:44:04.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:04 smithi072 ceph-mon[35951]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-27T09:44:04.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:04 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-27T09:44:04.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:04 smithi072 ceph-mon[35951]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:44:04.533 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:06.457 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:06 smithi071 ceph-mon[31451]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 2 op/s 2024-05-27T09:44:06.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:06 smithi072 ceph-mon[35951]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 2 op/s 2024-05-27T09:44:06.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:06 smithi122 ceph-mon[36436]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 2 op/s 2024-05-27T09:44:06.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 -- 172.21.15.71:0/3640115775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410b890 msgr2=0x7fef641131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 --2- 172.21.15.71:0/3640115775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410b890 0x7fef641131f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b0d0 tx=0x7fef5c00b3e0 comp rx=0 tx=0).stop 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 -- 172.21.15.71:0/3640115775 shutdown_connections 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 --2- 172.21.15.71:0/3640115775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410b890 0x7fef641131f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 --2- 172.21.15.71:0/3640115775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 0x7fef64106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 --2- 172.21.15.71:0/3640115775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef6410af40 0x7fef6410b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 -- 172.21.15.71:0/3640115775 >> 172.21.15.71:0/3640115775 conn(0x7fef64102020 msgr2=0x7fef64104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 -- 172.21.15.71:0/3640115775 shutdown_connections 2024-05-27T09:44:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.791+0000 7fef6a800700 1 -- 172.21.15.71:0/3640115775 wait complete. 2024-05-27T09:44:06.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.792+0000 7fef6a800700 1 Processor -- start 2024-05-27T09:44:06.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef6a800700 1 -- start start 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef6a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 0x7fef6419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef6a800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410af40 0x7fef6419d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef6a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef6410b890 0x7fef641a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef6a800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef64116510 con 0x7fef6410af40 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef6a800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fef64116390 con 0x7fef64106610 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef6a800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fef64116690 con 0x7fef6410b890 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef68a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410af40 0x7fef6419d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef69400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 0x7fef6419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef68a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410af40 0x7fef6419d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47138/0 (socket says 172.21.15.71:47138) 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef68a00700 1 -- 172.21.15.71:0/3665455716 learned_addr learned my addr 172.21.15.71:0/3665455716 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.793+0000 7fef69400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 0x7fef6419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60066/0 (socket says 172.21.15.71:60066) 2024-05-27T09:44:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef69e00700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef6410b890 0x7fef641a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef68a00700 1 -- 172.21.15.71:0/3665455716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef6410b890 msgr2=0x7fef641a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef68a00700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef6410b890 0x7fef641a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef68a00700 1 -- 172.21.15.71:0/3665455716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 msgr2=0x7fef6419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef68a00700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 0x7fef6419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef68a00700 1 -- 172.21.15.71:0/3665455716 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef641a1cd0 con 0x7fef6410af40 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef69400700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 0x7fef6419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.794+0000 7fef68a00700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410af40 0x7fef6419d3a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef5000e970 tx=0x7fef5000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.795+0000 7fef62000700 1 -- 172.21.15.71:0/3665455716 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50004a30 con 0x7fef6410af40 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.795+0000 7fef62000700 1 -- 172.21.15.71:0/3665455716 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef5000cc90 con 0x7fef6410af40 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.795+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef641a1fc0 con 0x7fef6410af40 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.795+0000 7fef62000700 1 -- 172.21.15.71:0/3665455716 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50005610 con 0x7fef6410af40 2024-05-27T09:44:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.795+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef641a98e0 con 0x7fef6410af40 2024-05-27T09:44:06.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.796+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef640512b0 con 0x7fef6410af40 2024-05-27T09:44:06.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.799+0000 7fef62000700 1 -- 172.21.15.71:0/3665455716 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fef5000c7e0 con 0x7fef6410af40 2024-05-27T09:44:06.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.801+0000 7fef62000700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fef4c0b2900 0x7fef4c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:06.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.801+0000 7fef62000700 1 -- 172.21.15.71:0/3665455716 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fef500e23d0 con 0x7fef6410af40 2024-05-27T09:44:06.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.802+0000 7fef69400700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fef4c0b2900 0x7fef4c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:06.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.802+0000 7fef69400700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fef4c0b2900 0x7fef4c0b4e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef58011490 tx=0x7fef58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:06.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:06.804+0000 7fef62000700 1 -- 172.21.15.71:0/3665455716 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fef50054df0 con 0x7fef6410af40 2024-05-27T09:44:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.084+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fef6402e5e0 con 0x7fef6410af40 2024-05-27T09:44:07.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.245+0000 7fef62000700 1 -- 172.21.15.71:0/3665455716 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fef500aa1a0 con 0x7fef6410af40 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.249+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fef4c0b2900 msgr2=0x7fef4c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.249+0000 7fef6a800700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fef4c0b2900 0x7fef4c0b4e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef58011490 tx=0x7fef58009260 comp rx=0 tx=0).stop 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.249+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410af40 msgr2=0x7fef6419d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.249+0000 7fef6a800700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410af40 0x7fef6419d3a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef5000e970 tx=0x7fef5000ec80 comp rx=0 tx=0).stop 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 shutdown_connections 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef6410b890 0x7fef641a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef64106610 0x7fef6419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fef4c0b2900 0x7fef4c0b4e10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:07.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 --2- 172.21.15.71:0/3665455716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6410af40 0x7fef6419d3a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:07.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 >> 172.21.15.71:0/3665455716 conn(0x7fef64102020 msgr2=0x7fef64108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:07.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 shutdown_connections 2024-05-27T09:44:07.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:07.250+0000 7fef6a800700 1 -- 172.21.15.71:0/3665455716 wait complete. 2024-05-27T09:44:07.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:07 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3665455716' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-27T09:44:07.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:07 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3665455716' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-27T09:44:07.556 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:07 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3665455716' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-27T09:44:07.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-27T09:44:08.432 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:08.489 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:08 smithi122 ceph-mon[36436]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:44:08.489 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:08 smithi122 ceph-mon[36436]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-27T09:44:08.489 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:08 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3665455716' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-27T09:44:08.489 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:08 smithi122 ceph-mon[36436]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-27T09:44:08.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:08 smithi122 ceph-mon[36436]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:44:08.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:08 smithi122 ceph-mon[36436]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-05-27T09:44:08.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:08 smithi122 ceph-mon[36436]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-05-27T09:44:08.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:08 smithi071 ceph-mon[31451]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:44:08.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:08 smithi071 ceph-mon[31451]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-27T09:44:08.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:08 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3665455716' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-27T09:44:08.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:08 smithi071 ceph-mon[31451]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-27T09:44:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:08 smithi071 ceph-mon[31451]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:44:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:08 smithi071 ceph-mon[31451]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-05-27T09:44:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:08 smithi071 ceph-mon[31451]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-05-27T09:44:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-mon[35951]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:44:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-mon[35951]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-27T09:44:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3665455716' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-27T09:44:08.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-mon[35951]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-27T09:44:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-mon[35951]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-27T09:44:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-mon[35951]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-05-27T09:44:08.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-mon[35951]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-05-27T09:44:09.026 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 09:44:08 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: 2024-05-27T09:44:08.741+0000 7f0b1d2b7700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-27T09:44:09.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:09 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] up:active 2024-05-27T09:44:09.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:09 smithi071 ceph-mon[31451]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-27T09:44:09.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:09 smithi071 ceph-mon[31451]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-27T09:44:09.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:09 smithi071 ceph-mon[31451]: Cluster is now healthy 2024-05-27T09:44:09.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:09 smithi071 ceph-mon[31451]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-05-27T09:44:09.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:09 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-05-27T09:44:09.518 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:09 smithi071 ceph-mon[31451]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-27T09:44:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:09 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] up:active 2024-05-27T09:44:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:09 smithi072 ceph-mon[35951]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-27T09:44:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:09 smithi072 ceph-mon[35951]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-27T09:44:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:09 smithi072 ceph-mon[35951]: Cluster is now healthy 2024-05-27T09:44:09.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:09 smithi072 ceph-mon[35951]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-05-27T09:44:09.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:09 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-05-27T09:44:09.527 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:09 smithi072 ceph-mon[35951]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-27T09:44:09.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:09 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] up:active 2024-05-27T09:44:09.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:09 smithi122 ceph-mon[36436]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-27T09:44:09.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:09 smithi122 ceph-mon[36436]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-27T09:44:09.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:09 smithi122 ceph-mon[36436]: Cluster is now healthy 2024-05-27T09:44:09.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:09 smithi122 ceph-mon[36436]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-05-27T09:44:09.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:09 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-05-27T09:44:09.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:09 smithi122 ceph-mon[36436]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-27T09:44:10.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:10 smithi071 ceph-mon[31451]: pgmap v334: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 2 op/s 2024-05-27T09:44:10.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:10 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:active 2024-05-27T09:44:10.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:10 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-05-27T09:44:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:10 smithi122 ceph-mon[36436]: pgmap v334: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 2 op/s 2024-05-27T09:44:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:10 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:active 2024-05-27T09:44:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:10 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-05-27T09:44:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:10 smithi072 ceph-mon[35951]: pgmap v334: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 2 op/s 2024-05-27T09:44:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:10 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:active 2024-05-27T09:44:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:10 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-05-27T09:44:10.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1981922501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b181054d0 msgr2=0x7f7b181058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:10.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1981922501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b181054d0 0x7f7b181058e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009990 tx=0x7f7b08009ca0 comp rx=0 tx=0).stop 2024-05-27T09:44:10.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1981922501 shutdown_connections 2024-05-27T09:44:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1981922501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b1810e900 0x7f7b18110de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1981922501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b181054d0 0x7f7b181058e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1981922501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b18105e20 0x7f7b1810e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1981922501 >> 172.21.15.71:0/1981922501 conn(0x7f7b180fedb0 msgr2=0x7f7b181011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1981922501 shutdown_connections 2024-05-27T09:44:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.813+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1981922501 wait complete. 2024-05-27T09:44:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.814+0000 7f7b1ce00700 1 Processor -- start 2024-05-27T09:44:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b1ce00700 1 -- start start 2024-05-27T09:44:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b1ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b181054d0 0x7f7b1819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b1ce00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b18105e20 0x7f7b1819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b1ce00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1810e900 0x7f7b1819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b1ce00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b18114470 con 0x7f7b18105e20 2024-05-27T09:44:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b1ce00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7b181142f0 con 0x7f7b181054d0 2024-05-27T09:44:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b1ce00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b181145f0 con 0x7f7b1810e900 2024-05-27T09:44:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.815+0000 7f7b15400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b18105e20 0x7f7b1819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b181054d0 0x7f7b1819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b18105e20 0x7f7b1819b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47160/0 (socket says 172.21.15.71:47160) 2024-05-27T09:44:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15400700 1 -- 172.21.15.71:0/1383954021 learned_addr learned my addr 172.21.15.71:0/1383954021 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b16800700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1810e900 0x7f7b1819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15e00700 1 -- 172.21.15.71:0/1383954021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1810e900 msgr2=0x7f7b1819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15e00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1810e900 0x7f7b1819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15e00700 1 -- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b18105e20 msgr2=0x7f7b1819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15e00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b18105e20 0x7f7b1819b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15e00700 1 -- 172.21.15.71:0/1383954021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1819fcb0 con 0x7f7b181054d0 2024-05-27T09:44:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.816+0000 7f7b15e00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b181054d0 0x7f7b1819ade0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b080047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.817+0000 7f7b0ea00700 1 -- 172.21.15.71:0/1383954021 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08026070 con 0x7f7b181054d0 2024-05-27T09:44:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.817+0000 7f7b0ea00700 1 -- 172.21.15.71:0/1383954021 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b08021410 con 0x7f7b181054d0 2024-05-27T09:44:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.817+0000 7f7b0ea00700 1 -- 172.21.15.71:0/1383954021 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08017650 con 0x7f7b181054d0 2024-05-27T09:44:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.817+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1819ff40 con 0x7f7b181054d0 2024-05-27T09:44:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.817+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b181a03d0 con 0x7f7b181054d0 2024-05-27T09:44:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.818+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b180512b0 con 0x7f7b181054d0 2024-05-27T09:44:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.821+0000 7f7b0ea00700 1 -- 172.21.15.71:0/1383954021 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7b08029070 con 0x7f7b181054d0 2024-05-27T09:44:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.822+0000 7f7b0ea00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7afc0b2880 0x7f7afc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.822+0000 7f7b0ea00700 1 -- 172.21.15.71:0/1383954021 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f7b080e3600 con 0x7f7b181054d0 2024-05-27T09:44:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.822+0000 7f7b15400700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7afc0b2880 0x7f7afc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.823+0000 7f7b15400700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7afc0b2880 0x7f7afc0b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7b18102260 tx=0x7f7b04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:10.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:10.824+0000 7f7b0ea00700 1 -- 172.21.15.71:0/1383954021 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7b08013070 con 0x7f7b181054d0 2024-05-27T09:44:11.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.103+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f7b1802e5e0 con 0x7f7b181054d0 2024-05-27T09:44:11.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.300+0000 7f7b0ea00700 1 -- 172.21.15.71:0/1383954021 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f7b080ab460 con 0x7f7b181054d0 2024-05-27T09:44:11.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7afc0b2880 msgr2=0x7f7afc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:11.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7afc0b2880 0x7f7afc0b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7b18102260 tx=0x7f7b04009260 comp rx=0 tx=0).stop 2024-05-27T09:44:11.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b181054d0 msgr2=0x7f7b1819ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:11.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b181054d0 0x7f7b1819ade0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b080047b0 comp rx=0 tx=0).stop 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 shutdown_connections 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1810e900 0x7f7b1819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b181054d0 0x7f7b1819ade0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7afc0b2880 0x7f7afc0b4d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 --2- 172.21.15.71:0/1383954021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b18105e20 0x7f7b1819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.304+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 >> 172.21.15.71:0/1383954021 conn(0x7f7b180fedb0 msgr2=0x7f7b180ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.305+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 shutdown_connections 2024-05-27T09:44:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:11.305+0000 7f7b1ce00700 1 -- 172.21.15.71:0/1383954021 wait complete. 2024-05-27T09:44:11.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:11 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1383954021' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-27T09:44:11.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:11 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-27T09:44:11.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:11 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1383954021' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-27T09:44:11.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:11 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-27T09:44:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:11 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1383954021' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-27T09:44:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:11 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-27T09:44:12.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-27T09:44:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:12.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:12 smithi071 ceph-mon[31451]: pgmap v335: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2024-05-27T09:44:12.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:12 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-27T09:44:12.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:12 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-05-27T09:44:12.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:12 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:44:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:12 smithi122 ceph-mon[36436]: pgmap v335: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2024-05-27T09:44:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:12 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-27T09:44:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:12 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-05-27T09:44:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:12 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:44:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:12 smithi072 ceph-mon[35951]: pgmap v335: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2024-05-27T09:44:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:12 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-27T09:44:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:12 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-05-27T09:44:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:12 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:44:14.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:14 smithi071 ceph-mon[31451]: pgmap v336: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-27T09:44:14.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:14 smithi122 ceph-mon[36436]: pgmap v336: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-27T09:44:14.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:14 smithi072 ceph-mon[35951]: pgmap v336: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-27T09:44:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 -- 172.21.15.71:0/4113559708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f010a980 msgr2=0x7fb5f010ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 --2- 172.21.15.71:0/4113559708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f010a980 0x7fb5f010ad90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0098f0 tx=0x7fb5dc009c00 comp rx=0 tx=0).stop 2024-05-27T09:44:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 -- 172.21.15.71:0/4113559708 shutdown_connections 2024-05-27T09:44:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 --2- 172.21.15.71:0/4113559708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 0x7fb5f0117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 --2- 172.21.15.71:0/4113559708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f0110960 0x7fb5f0110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 --2- 172.21.15.71:0/4113559708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f010a980 0x7fb5f010ad90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 -- 172.21.15.71:0/4113559708 >> 172.21.15.71:0/4113559708 conn(0x7fb5f0077c70 msgr2=0x7fb5f00780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.906+0000 7fb5f7400700 1 -- 172.21.15.71:0/4113559708 shutdown_connections 2024-05-27T09:44:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.907+0000 7fb5f7400700 1 -- 172.21.15.71:0/4113559708 wait complete. 2024-05-27T09:44:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.908+0000 7fb5f7400700 1 Processor -- start 2024-05-27T09:44:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.908+0000 7fb5f7400700 1 -- start start 2024-05-27T09:44:14.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f010a980 0x7fb5f01a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:14.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 0x7fb5f01a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:14.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f7400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f0110960 0x7fb5f01a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:14.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f7400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f011aa60 con 0x7fb5f010a980 2024-05-27T09:44:14.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f7400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f011a8e0 con 0x7fb5f010b2d0 2024-05-27T09:44:14.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f7400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f011abe0 con 0x7fb5f0110960 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f4a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f010a980 0x7fb5f01a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5efe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 0x7fb5f01a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5efe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 0x7fb5f01a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47134/0 (socket says 172.21.15.71:47134) 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5efe00700 1 -- 172.21.15.71:0/3241466618 learned_addr learned my addr 172.21.15.71:0/3241466618 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f4a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f010a980 0x7fb5f01a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48860/0 (socket says 172.21.15.71:48860) 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5f5400700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f0110960 0x7fb5f01a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5efe00700 1 -- 172.21.15.71:0/3241466618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f0110960 msgr2=0x7fb5f01a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5efe00700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f0110960 0x7fb5f01a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5efe00700 1 -- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f010a980 msgr2=0x7fb5f01a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.909+0000 7fb5efe00700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f010a980 0x7fb5f01a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.910+0000 7fb5efe00700 1 -- 172.21.15.71:0/3241466618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f01a63c0 con 0x7fb5f010b2d0 2024-05-27T09:44:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.910+0000 7fb5efe00700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 0x7fb5f01a1a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009230 tx=0x7fb5dc00f990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:14.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.910+0000 7fb5ed600700 1 -- 172.21.15.71:0/3241466618 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc005140 con 0x7fb5f010b2d0 2024-05-27T09:44:14.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.910+0000 7fb5ed600700 1 -- 172.21.15.71:0/3241466618 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5dc00b560 con 0x7fb5f010b2d0 2024-05-27T09:44:14.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.910+0000 7fb5ed600700 1 -- 172.21.15.71:0/3241466618 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc003aa0 con 0x7fb5f010b2d0 2024-05-27T09:44:14.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.910+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f01a6650 con 0x7fb5f010b2d0 2024-05-27T09:44:14.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.910+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f01a6ae0 con 0x7fb5f010b2d0 2024-05-27T09:44:14.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.911+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f00512b0 con 0x7fb5f010b2d0 2024-05-27T09:44:14.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.914+0000 7fb5ed600700 1 -- 172.21.15.71:0/3241466618 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb5dc00ba50 con 0x7fb5f010b2d0 2024-05-27T09:44:14.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.915+0000 7fb5ed600700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb5d80b2900 0x7fb5d80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:14.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.916+0000 7fb5ed600700 1 -- 172.21.15.71:0/3241466618 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fb5dc0e34d0 con 0x7fb5f010b2d0 2024-05-27T09:44:14.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.916+0000 7fb5f4a00700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb5d80b2900 0x7fb5d80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:14.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.916+0000 7fb5f4a00700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb5d80b2900 0x7fb5d80b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009750 tx=0x7fb5e4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:14.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:14.918+0000 7fb5ed600700 1 -- 172.21.15.71:0/3241466618 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb5dc013030 con 0x7fb5f010b2d0 2024-05-27T09:44:15.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.197+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fb5f0112ee0 con 0x7fb5f010b2d0 2024-05-27T09:44:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.323+0000 7fb5ed600700 1 -- 172.21.15.71:0/3241466618 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7fb5dc0ab330 con 0x7fb5f010b2d0 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb5d80b2900 msgr2=0x7fb5d80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb5d80b2900 0x7fb5d80b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009750 tx=0x7fb5e4009310 comp rx=0 tx=0).stop 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 msgr2=0x7fb5f01a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 0x7fb5f01a1a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009230 tx=0x7fb5dc00f990 comp rx=0 tx=0).stop 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 shutdown_connections 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5f0110960 0x7fb5f01a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb5d80b2900 0x7fb5d80b4e10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5f010a980 0x7fb5f01a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 --2- 172.21.15.71:0/3241466618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5f010b2d0 0x7fb5f01a1a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 >> 172.21.15.71:0/3241466618 conn(0x7fb5f0077c70 msgr2=0x7fb5f007b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 shutdown_connections 2024-05-27T09:44:15.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:15.327+0000 7fb5f7400700 1 -- 172.21.15.71:0/3241466618 wait complete. 2024-05-27T09:44:15.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:15 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3241466618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-27T09:44:15.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:15 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-27T09:44:15.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:15 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3241466618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-27T09:44:15.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:15 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-27T09:44:15.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:15 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3241466618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-27T09:44:15.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:15 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-27T09:44:16.223 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-27T09:44:16.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-27T09:44:16.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:16 smithi071 ceph-mon[31451]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-27T09:44:16.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:16 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-27T09:44:16.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:16 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:44:16.668 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:16.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:16 smithi122 ceph-mon[36436]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-27T09:44:16.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:16 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-27T09:44:16.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:16 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:44:16.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:16 smithi072 ceph-mon[35951]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-27T09:44:16.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:16 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-27T09:44:16.779 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:16 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:44:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:18 smithi071 ceph-mon[31451]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-27T09:44:18.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:18 smithi122 ceph-mon[36436]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-27T09:44:18.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:18 smithi072 ceph-mon[35951]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 -- 172.21.15.71:0/346579190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f139410b890 msgr2=0x7f13941131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 --2- 172.21.15.71:0/346579190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f139410b890 0x7f13941131f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f138c00b0d0 tx=0x7f138c00b3e0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 -- 172.21.15.71:0/346579190 shutdown_connections 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 --2- 172.21.15.71:0/346579190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f139410b890 0x7f13941131f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 --2- 172.21.15.71:0/346579190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1394106610 0x7f1394106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 --2- 172.21.15.71:0/346579190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f139410af40 0x7f139410b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 -- 172.21.15.71:0/346579190 >> 172.21.15.71:0/346579190 conn(0x7f1394102020 msgr2=0x7f1394104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 -- 172.21.15.71:0/346579190 shutdown_connections 2024-05-27T09:44:19.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.006+0000 7f1399c00700 1 -- 172.21.15.71:0/346579190 wait complete. 2024-05-27T09:44:19.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.007+0000 7f1399c00700 1 Processor -- start 2024-05-27T09:44:19.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.007+0000 7f1399c00700 1 -- start start 2024-05-27T09:44:19.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1399c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1394106610 0x7f139419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:19.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1399c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139410af40 0x7f139419d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:19.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1399c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f139410b890 0x7f13941a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:19.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1399c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13941164c0 con 0x7f1394106610 2024-05-27T09:44:19.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1399c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1394116340 con 0x7f139410af40 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1399c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1394116640 con 0x7f139410b890 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1393400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139410af40 0x7f139419d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1393e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1394106610 0x7f139419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1393400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139410af40 0x7f139419d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47150/0 (socket says 172.21.15.71:47150) 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1393400700 1 -- 172.21.15.71:0/3596762850 learned_addr learned my addr 172.21.15.71:0/3596762850 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.008+0000 7f1399200700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f139410b890 0x7f13941a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1393400700 1 -- 172.21.15.71:0/3596762850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f139410b890 msgr2=0x7f13941a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1393400700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f139410b890 0x7f13941a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1393400700 1 -- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1394106610 msgr2=0x7f139419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1393400700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1394106610 0x7f139419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1393400700 1 -- 172.21.15.71:0/3596762850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13941a1ca0 con 0x7f139410af40 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1399200700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f139410b890 0x7f13941a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:19.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1393e00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1394106610 0x7f139419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:19.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1393400700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139410af40 0x7f139419d370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f138000e970 tx=0x7f138000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:19.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1390c00700 1 -- 172.21.15.71:0/3596762850 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380004a30 con 0x7f139410af40 2024-05-27T09:44:19.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1390c00700 1 -- 172.21.15.71:0/3596762850 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f138000cc90 con 0x7f139410af40 2024-05-27T09:44:19.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1390c00700 1 -- 172.21.15.71:0/3596762850 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380005610 con 0x7f139410af40 2024-05-27T09:44:19.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.009+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13941a1f90 con 0x7f139410af40 2024-05-27T09:44:19.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.010+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13941a98b0 con 0x7f139410af40 2024-05-27T09:44:19.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.011+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13940512b0 con 0x7f139410af40 2024-05-27T09:44:19.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.013+0000 7f1390c00700 1 -- 172.21.15.71:0/3596762850 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f138000c7e0 con 0x7f139410af40 2024-05-27T09:44:19.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.015+0000 7f1390c00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13780b2900 0x7f13780b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:19.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.015+0000 7f1390c00700 1 -- 172.21.15.71:0/3596762850 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f13800e2420 con 0x7f139410af40 2024-05-27T09:44:19.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.015+0000 7f1393e00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13780b2900 0x7f13780b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:19.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.016+0000 7f1393e00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13780b2900 0x7f13780b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1384011490 tx=0x7f1384009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:19.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.017+0000 7f1390c00700 1 -- 172.21.15.71:0/3596762850 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1380054df0 con 0x7f139410af40 2024-05-27T09:44:19.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.281+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1394063bf0 con 0x7f13780b2900 2024-05-27T09:44:19.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.322+0000 7f1390c00700 1 -- 172.21.15.71:0/3596762850 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1394063bf0 con 0x7f13780b2900 2024-05-27T09:44:19.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.325+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13780b2900 msgr2=0x7f13780b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:19.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.325+0000 7f1399c00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13780b2900 0x7f13780b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1384011490 tx=0x7f1384009260 comp rx=0 tx=0).stop 2024-05-27T09:44:19.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.325+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139410af40 msgr2=0x7f139419d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:19.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.325+0000 7f1399c00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139410af40 0x7f139419d370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f138000e970 tx=0x7f138000ec80 comp rx=0 tx=0).stop 2024-05-27T09:44:19.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 shutdown_connections 2024-05-27T09:44:19.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f139410b890 0x7f13941a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13780b2900 0x7f13780b4e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1394106610 0x7f139419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 --2- 172.21.15.71:0/3596762850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139410af40 0x7f139419d370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:19.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 >> 172.21.15.71:0/3596762850 conn(0x7f1394102020 msgr2=0x7f139410a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:19.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 shutdown_connections 2024-05-27T09:44:19.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:19.326+0000 7f1399c00700 1 -- 172.21.15.71:0/3596762850 wait complete. 2024-05-27T09:44:19.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:44:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:44:19.293+0000 7f20e8600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:44:19.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:44:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:44:19.293+0000 7f20e8600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:44:19.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:44:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:44:19.293+0000 7f20e8600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:44:19.759 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:44:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:44:19.293+0000 7f20e8600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:44:19.759 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:44:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:44:19.293+0000 7f20e8600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:44:20.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-27T09:44:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:20 smithi071 ceph-mon[31451]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-05-27T09:44:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:20 smithi071 ceph-mon[31451]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:20 smithi071 ceph-mon[31451]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-27T09:44:20.726 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:20 smithi122 ceph-mon[36436]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-05-27T09:44:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:20 smithi122 ceph-mon[36436]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:20 smithi122 ceph-mon[36436]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-27T09:44:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:20 smithi072 ceph-mon[35951]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-05-27T09:44:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:20 smithi072 ceph-mon[35951]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:20 smithi072 ceph-mon[35951]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-27T09:44:22.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:22 smithi071 ceph-mon[31451]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-27T09:44:22.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:22 smithi122 ceph-mon[36436]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-27T09:44:22.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:22 smithi072 ceph-mon[35951]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-27T09:44:22.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 -- 172.21.15.71:0/1480992078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 msgr2=0x7f8530110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 --2- 172.21.15.71:0/1480992078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f8530110640 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f851c009990 tx=0x7f851c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 -- 172.21.15.71:0/1480992078 shutdown_connections 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 --2- 172.21.15.71:0/1480992078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8530110b80 0x7f8530112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 --2- 172.21.15.71:0/1480992078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8530075d20 0x7f8530076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 --2- 172.21.15.71:0/1480992078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f8530110640 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 -- 172.21.15.71:0/1480992078 >> 172.21.15.71:0/1480992078 conn(0x7f85300ffe60 msgr2=0x7f85301022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 -- 172.21.15.71:0/1480992078 shutdown_connections 2024-05-27T09:44:22.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.873+0000 7f8536c00700 1 -- 172.21.15.71:0/1480992078 wait complete. 2024-05-27T09:44:22.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.874+0000 7f8536c00700 1 Processor -- start 2024-05-27T09:44:22.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.874+0000 7f8536c00700 1 -- start start 2024-05-27T09:44:22.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f8536c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8530075d20 0x7f853019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f8536c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f853019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f8536c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8530110b80 0x7f85301a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f8536c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85301166d0 con 0x7f8530076670 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f8536c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8530116550 con 0x7f8530110b80 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f8536c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8530116850 con 0x7f8530075d20 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f852f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f853019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f852f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f853019d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48916/0 (socket says 172.21.15.71:48916) 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f852f400700 1 -- 172.21.15.71:0/2000170465 learned_addr learned my addr 172.21.15.71:0/2000170465 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f852fe00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8530075d20 0x7f853019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.875+0000 7f8534c00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8530110b80 0x7f85301a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:22.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.876+0000 7f852f400700 1 -- 172.21.15.71:0/2000170465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8530075d20 msgr2=0x7f853019d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:22.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.876+0000 7f852f400700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8530075d20 0x7f853019d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:22.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.876+0000 7f852f400700 1 -- 172.21.15.71:0/2000170465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8530110b80 msgr2=0x7f85301a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:22.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.876+0000 7f852f400700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8530110b80 0x7f85301a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:22.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.876+0000 7f852f400700 1 -- 172.21.15.71:0/2000170465 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85301a1f10 con 0x7f8530076670 2024-05-27T09:44:22.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.876+0000 7f852f400700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f853019d5e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f851c005910 tx=0x7f851c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:22.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.877+0000 7f852cc00700 1 -- 172.21.15.71:0/2000170465 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c027070 con 0x7f8530076670 2024-05-27T09:44:22.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.877+0000 7f852cc00700 1 -- 172.21.15.71:0/2000170465 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f851c022470 con 0x7f8530076670 2024-05-27T09:44:22.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.877+0000 7f852cc00700 1 -- 172.21.15.71:0/2000170465 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c017650 con 0x7f8530076670 2024-05-27T09:44:22.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.877+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85301a21a0 con 0x7f8530076670 2024-05-27T09:44:22.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.877+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85301a2630 con 0x7f8530076670 2024-05-27T09:44:22.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.878+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85300512b0 con 0x7f8530076670 2024-05-27T09:44:22.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.881+0000 7f852cc00700 1 -- 172.21.15.71:0/2000170465 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f851c02a070 con 0x7f8530076670 2024-05-27T09:44:22.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.883+0000 7f852cc00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f85140b2910 0x7f85140b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:22.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.883+0000 7f852cc00700 1 -- 172.21.15.71:0/2000170465 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f851c0e2fb0 con 0x7f8530076670 2024-05-27T09:44:22.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.883+0000 7f852fe00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f85140b2910 0x7f85140b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:22.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.884+0000 7f852fe00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f85140b2910 0x7f85140b4e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8520009680 tx=0x7f8520009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:22.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:22.889+0000 7f852cc00700 1 -- 172.21.15.71:0/2000170465 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f851c013070 con 0x7f8530076670 2024-05-27T09:44:23.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.154+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8530063bf0 con 0x7f85140b2910 2024-05-27T09:44:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.187+0000 7f852cc00700 1 -- 172.21.15.71:0/2000170465 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8530063bf0 con 0x7f85140b2910 2024-05-27T09:44:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.190+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f85140b2910 msgr2=0x7f85140b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.190+0000 7f8536c00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f85140b2910 0x7f85140b4e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8520009680 tx=0x7f8520009260 comp rx=0 tx=0).stop 2024-05-27T09:44:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 msgr2=0x7f853019d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f853019d5e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f851c005910 tx=0x7f851c00b670 comp rx=0 tx=0).stop 2024-05-27T09:44:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 shutdown_connections 2024-05-27T09:44:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8530110b80 0x7f85301a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:23.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8530075d20 0x7f853019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:23.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f85140b2910 0x7f85140b4e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:23.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 --2- 172.21.15.71:0/2000170465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8530076670 0x7f853019d5e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:23.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 >> 172.21.15.71:0/2000170465 conn(0x7f85300ffe60 msgr2=0x7f8530101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:23.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 shutdown_connections 2024-05-27T09:44:23.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:23.191+0000 7f8536c00700 1 -- 172.21.15.71:0/2000170465 wait complete. 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-27T09:44:23.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:23 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-05-27T09:44:23.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-27T09:44:23.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-27T09:44:23.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-27T09:44:23.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-05-27T09:44:23.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-05-27T09:44:23.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-27T09:44:23.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-27T09:44:23.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:23 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-05-27T09:44:23.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-27T09:44:23.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-27T09:44:23.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-27T09:44:23.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-05-27T09:44:23.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-05-27T09:44:23.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-27T09:44:23.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-27T09:44:23.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:23 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-05-27T09:44:24.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-27T09:44:24.461 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: pgmap v341: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-05-27T09:44:24.657 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-27T09:44:24.658 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-27T09:44:24.658 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-05-27T09:44:24.658 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:24 smithi071 ceph-mon[31451]: osdmap e82: 12 total, 12 up, 12 in 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: pgmap v341: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-27T09:44:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-27T09:44:24.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-05-27T09:44:24.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:24 smithi122 ceph-mon[36436]: osdmap e82: 12 total, 12 up, 12 in 2024-05-27T09:44:24.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: pgmap v341: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-05-27T09:44:24.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:24 smithi072 ceph-mon[35951]: osdmap e82: 12 total, 12 up, 12 in 2024-05-27T09:44:25.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:25 smithi122 ceph-mon[36436]: osdmap e83: 12 total, 12 up, 12 in 2024-05-27T09:44:25.746 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:25 smithi071 ceph-mon[31451]: osdmap e83: 12 total, 12 up, 12 in 2024-05-27T09:44:25.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:25 smithi072 ceph-mon[35951]: osdmap e83: 12 total, 12 up, 12 in 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 -- 172.21.15.71:0/177160178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab810af40 msgr2=0x7ffab810b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 --2- 172.21.15.71:0/177160178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab810af40 0x7ffab810b350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40099c0 tx=0x7ffaa4009cd0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 -- 172.21.15.71:0/177160178 shutdown_connections 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 --2- 172.21.15.71:0/177160178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab810b890 0x7ffab81131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 --2- 172.21.15.71:0/177160178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffab8106610 0x7ffab8106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 --2- 172.21.15.71:0/177160178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab810af40 0x7ffab810b350 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 -- 172.21.15.71:0/177160178 >> 172.21.15.71:0/177160178 conn(0x7ffab8102020 msgr2=0x7ffab8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.631+0000 7ffabf000700 1 -- 172.21.15.71:0/177160178 shutdown_connections 2024-05-27T09:44:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.632+0000 7ffabf000700 1 -- 172.21.15.71:0/177160178 wait complete. 2024-05-27T09:44:26.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:26 smithi071 ceph-mon[31451]: pgmap v344: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-05-27T09:44:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.633+0000 7ffabf000700 1 Processor -- start 2024-05-27T09:44:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.633+0000 7ffabf000700 1 -- start start 2024-05-27T09:44:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabf000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab8106610 0x7ffab819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabf000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab810af40 0x7ffab819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabf000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffab810b890 0x7ffab81a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabf000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81164f0 con 0x7ffab8106610 2024-05-27T09:44:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabf000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8116370 con 0x7ffab810af40 2024-05-27T09:44:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabf000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8116670 con 0x7ffab810b890 2024-05-27T09:44:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabdc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab8106610 0x7ffab819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabd200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab810af40 0x7ffab819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabdc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab8106610 0x7ffab819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37544/0 (socket says 172.21.15.71:37544) 2024-05-27T09:44:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabdc00700 1 -- 172.21.15.71:0/4008511873 learned_addr learned my addr 172.21.15.71:0/4008511873 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.634+0000 7ffabe600700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffab810b890 0x7ffab81a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffabd200700 1 -- 172.21.15.71:0/4008511873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffab810b890 msgr2=0x7ffab81a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffabd200700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffab810b890 0x7ffab81a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffabd200700 1 -- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab8106610 msgr2=0x7ffab819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffabd200700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab8106610 0x7ffab819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffabd200700 1 -- 172.21.15.71:0/4008511873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab81a1d90 con 0x7ffab810af40 2024-05-27T09:44:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffabdc00700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab8106610 0x7ffab819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffabd200700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab810af40 0x7ffab819d460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40098e0 tx=0x7ffaa4005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.635+0000 7ffab6000700 1 -- 172.21.15.71:0/4008511873 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4026070 con 0x7ffab810af40 2024-05-27T09:44:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.636+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab81a2020 con 0x7ffab810af40 2024-05-27T09:44:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.636+0000 7ffab6000700 1 -- 172.21.15.71:0/4008511873 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa40056c0 con 0x7ffab810af40 2024-05-27T09:44:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.636+0000 7ffab6000700 1 -- 172.21.15.71:0/4008511873 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400f960 con 0x7ffab810af40 2024-05-27T09:44:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.636+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab81a99a0 con 0x7ffab810af40 2024-05-27T09:44:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.637+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab8107ac0 con 0x7ffab810af40 2024-05-27T09:44:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.639+0000 7ffab6000700 1 -- 172.21.15.71:0/4008511873 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ffaa4029070 con 0x7ffab810af40 2024-05-27T09:44:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.640+0000 7ffab6000700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ffaa00b2990 0x7ffaa00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.641+0000 7ffab6000700 1 -- 172.21.15.71:0/4008511873 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ffaa40e2b70 con 0x7ffab810af40 2024-05-27T09:44:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.641+0000 7ffabdc00700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ffaa00b2990 0x7ffaa00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.641+0000 7ffabdc00700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ffaa00b2990 0x7ffaa00b4ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffaac011550 tx=0x7ffaac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.646+0000 7ffab6000700 1 -- 172.21.15.71:0/4008511873 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffaa4013070 con 0x7ffab810af40 2024-05-27T09:44:26.677 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:26 smithi072 ceph-mon[35951]: pgmap v344: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-05-27T09:44:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:26 smithi122 ceph-mon[36436]: pgmap v344: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-05-27T09:44:26.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.918+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7ffab819e220 con 0x7ffaa00b2990 2024-05-27T09:44:26.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.932+0000 7ffab6000700 1 -- 172.21.15.71:0/4008511873 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffab819e220 con 0x7ffaa00b2990 2024-05-27T09:44:26.932 INFO:teuthology.orchestra.run.smithi071.stdout:/volumes/qa/sv_0/1691940a-35ce-4266-be65-a3c10ffc46fd 2024-05-27T09:44:26.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ffaa00b2990 msgr2=0x7ffaa00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:26.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ffaa00b2990 0x7ffaa00b4ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffaac011550 tx=0x7ffaac009260 comp rx=0 tx=0).stop 2024-05-27T09:44:26.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab810af40 msgr2=0x7ffab819d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:26.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab810af40 0x7ffab819d460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40098e0 tx=0x7ffaa4005280 comp rx=0 tx=0).stop 2024-05-27T09:44:26.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 shutdown_connections 2024-05-27T09:44:26.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffab810b890 0x7ffab81a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ffaa00b2990 0x7ffaa00b4ea0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab8106610 0x7ffab819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 --2- 172.21.15.71:0/4008511873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab810af40 0x7ffab819d460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:26.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 >> 172.21.15.71:0/4008511873 conn(0x7ffab8102020 msgr2=0x7ffab810a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:26.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 shutdown_connections 2024-05-27T09:44:26.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:26.935+0000 7ffabf000700 1 -- 172.21.15.71:0/4008511873 wait complete. 2024-05-27T09:44:27.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-27T09:44:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:28.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:28 smithi071 ceph-mon[31451]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:28.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:28 smithi071 ceph-mon[31451]: pgmap v345: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:28 smithi122 ceph-mon[36436]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:28 smithi122 ceph-mon[36436]: pgmap v345: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:28 smithi072 ceph-mon[35951]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:28 smithi072 ceph-mon[35951]: pgmap v345: 97 pgs: 97 active+clean; 588 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 -- 172.21.15.71:0/2674926721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 msgr2=0x7fd92c1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 --2- 172.21.15.71:0/2674926721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c1069a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd914009990 tx=0x7fd914009ca0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 -- 172.21.15.71:0/2674926721 shutdown_connections 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 --2- 172.21.15.71:0/2674926721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92c106ee0 0x7fd92c113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 --2- 172.21.15.71:0/2674926721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd92c10c5d0 0x7fd92c10c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 --2- 172.21.15.71:0/2674926721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c1069a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 -- 172.21.15.71:0/2674926721 >> 172.21.15.71:0/2674926721 conn(0x7fd92c102070 msgr2=0x7fd92c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 -- 172.21.15.71:0/2674926721 shutdown_connections 2024-05-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.536+0000 7fd930c00700 1 -- 172.21.15.71:0/2674926721 wait complete. 2024-05-27T09:44:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 Processor -- start 2024-05-27T09:44:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 -- start start 2024-05-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c19d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92c106ee0 0x7fd92c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd92c10c5d0 0x7fd92c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1166b0 con 0x7fd92c106590 2024-05-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c116530 con 0x7fd92c10c5d0 2024-05-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.538+0000 7fd930c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c116830 con 0x7fd92c106ee0 2024-05-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd929e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c19d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd921400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92c106ee0 0x7fd92c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd929e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c19d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37562/0 (socket says 172.21.15.71:37562) 2024-05-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd929e00700 1 -- 172.21.15.71:0/3296879011 learned_addr learned my addr 172.21.15.71:0/3296879011 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd92a800700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd92c10c5d0 0x7fd92c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:30.540 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:30 smithi071 ceph-mon[31451]: pgmap v346: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd921400700 1 -- 172.21.15.71:0/3296879011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd92c10c5d0 msgr2=0x7fd92c1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd921400700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd92c10c5d0 0x7fd92c1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd921400700 1 -- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 msgr2=0x7fd92c19d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd921400700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c19d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd921400700 1 -- 172.21.15.71:0/3296879011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c1a1fb0 con 0x7fd92c106ee0 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.539+0000 7fd929e00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c19d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.540+0000 7fd921400700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92c106ee0 0x7fd92c19d680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd92c06ace0 tx=0x7fd9140047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.540+0000 7fd923400700 1 -- 172.21.15.71:0/3296879011 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914027070 con 0x7fd92c106ee0 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.540+0000 7fd923400700 1 -- 172.21.15.71:0/3296879011 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd914022470 con 0x7fd92c106ee0 2024-05-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.540+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c1a2240 con 0x7fd92c106ee0 2024-05-27T09:44:30.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.540+0000 7fd923400700 1 -- 172.21.15.71:0/3296879011 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914017650 con 0x7fd92c106ee0 2024-05-27T09:44:30.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.540+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c1a2720 con 0x7fd92c106ee0 2024-05-27T09:44:30.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.542+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92c0512b0 con 0x7fd92c106ee0 2024-05-27T09:44:30.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.544+0000 7fd923400700 1 -- 172.21.15.71:0/3296879011 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd91402a070 con 0x7fd92c106ee0 2024-05-27T09:44:30.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.545+0000 7fd923400700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd9100b2910 0x7fd9100b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:30.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.545+0000 7fd923400700 1 -- 172.21.15.71:0/3296879011 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd9140e3060 con 0x7fd92c106ee0 2024-05-27T09:44:30.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.545+0000 7fd929e00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd9100b2910 0x7fd9100b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:30.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.546+0000 7fd929e00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd9100b2910 0x7fd9100b4e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009520 tx=0x7fd91c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:30.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.550+0000 7fd923400700 1 -- 172.21.15.71:0/3296879011 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd914013070 con 0x7fd92c106ee0 2024-05-27T09:44:30.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:30 smithi122 ceph-mon[36436]: pgmap v346: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:30.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:30 smithi072 ceph-mon[35951]: pgmap v346: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.818+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd92c063bf0 con 0x7fd9100b2910 2024-05-27T09:44:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.855+0000 7fd923400700 1 -- 172.21.15.71:0/3296879011 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd92c063bf0 con 0x7fd9100b2910 2024-05-27T09:44:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd9100b2910 msgr2=0x7fd9100b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd9100b2910 0x7fd9100b4e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009520 tx=0x7fd91c00b040 comp rx=0 tx=0).stop 2024-05-27T09:44:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92c106ee0 msgr2=0x7fd92c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92c106ee0 0x7fd92c19d680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd92c06ace0 tx=0x7fd9140047b0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 shutdown_connections 2024-05-27T09:44:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd92c10c5d0 0x7fd92c1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd9100b2910 0x7fd9100b4e20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd92c106590 0x7fd92c19d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.859+0000 7fd930c00700 1 --2- 172.21.15.71:0/3296879011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92c106ee0 0x7fd92c19d680 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.860+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 >> 172.21.15.71:0/3296879011 conn(0x7fd92c102070 msgr2=0x7fd92c103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.860+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 shutdown_connections 2024-05-27T09:44:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:30.860+0000 7fd930c00700 1 -- 172.21.15.71:0/3296879011 wait complete. 2024-05-27T09:44:31.635 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:31 smithi071 ceph-mon[31451]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:31.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-27T09:44:31.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:31 smithi122 ceph-mon[36436]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:31.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:31 smithi072 ceph-mon[35951]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:32.174 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:32.629 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:32 smithi071 ceph-mon[31451]: pgmap v347: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:32.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:32 smithi122 ceph-mon[36436]: pgmap v347: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:32.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:32 smithi072 ceph-mon[35951]: pgmap v347: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s; 13 B/s, 1 objects/s recovering 2024-05-27T09:44:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 -- 172.21.15.71:0/3368910332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 msgr2=0x7f7b6c110d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 --2- 172.21.15.71:0/3368910332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 0x7f7b6c110d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009990 tx=0x7f7b60009ca0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 -- 172.21.15.71:0/3368910332 shutdown_connections 2024-05-27T09:44:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 --2- 172.21.15.71:0/3368910332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10b2d0 0x7f7b6c117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 --2- 172.21.15.71:0/3368910332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 0x7f7b6c110d70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 --2- 172.21.15.71:0/3368910332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b6c10a980 0x7f7b6c10ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 -- 172.21.15.71:0/3368910332 >> 172.21.15.71:0/3368910332 conn(0x7f7b6c077c70 msgr2=0x7f7b6c0780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.392+0000 7f7b74200700 1 -- 172.21.15.71:0/3368910332 shutdown_connections 2024-05-27T09:44:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.393+0000 7f7b74200700 1 -- 172.21.15.71:0/3368910332 wait complete. 2024-05-27T09:44:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.394+0000 7f7b74200700 1 Processor -- start 2024-05-27T09:44:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.394+0000 7f7b74200700 1 -- start start 2024-05-27T09:44:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.394+0000 7f7b74200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10a980 0x7f7b6c1a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b74200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b6c10b2d0 0x7f7b6c1a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b74200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 0x7f7b6c1a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b74200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c11aab0 con 0x7f7b6c110960 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b74200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c11a930 con 0x7f7b6c10b2d0 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b74200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c11ac30 con 0x7f7b6c10a980 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b71800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10a980 0x7f7b6c1a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b71800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10a980 0x7f7b6c1a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33698/0 (socket says 172.21.15.71:33698) 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b71800700 1 -- 172.21.15.71:0/3843507170 learned_addr learned my addr 172.21.15.71:0/3843507170 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b70e00700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b6c10b2d0 0x7f7b6c1a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.395+0000 7f7b72200700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 0x7f7b6c1a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b71800700 1 -- 172.21.15.71:0/3843507170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b6c10b2d0 msgr2=0x7f7b6c1a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b71800700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b6c10b2d0 0x7f7b6c1a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b71800700 1 -- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 msgr2=0x7f7b6c1a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b71800700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 0x7f7b6c1a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b71800700 1 -- 172.21.15.71:0/3843507170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c1a6380 con 0x7f7b6c10a980 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b70e00700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b6c10b2d0 0x7f7b6c1a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b71800700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10a980 0x7f7b6c1a1500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000c00 tx=0x7f7b600047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b6a000700 1 -- 172.21.15.71:0/3843507170 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60026070 con 0x7f7b6c10a980 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b6a000700 1 -- 172.21.15.71:0/3843507170 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b60021410 con 0x7f7b6c10a980 2024-05-27T09:44:34.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.396+0000 7f7b6a000700 1 -- 172.21.15.71:0/3843507170 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60017650 con 0x7f7b6c10a980 2024-05-27T09:44:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.397+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6c1a6610 con 0x7f7b6c10a980 2024-05-27T09:44:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.397+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6c1a6aa0 con 0x7f7b6c10a980 2024-05-27T09:44:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.398+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6c0512b0 con 0x7f7b6c10a980 2024-05-27T09:44:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.400+0000 7f7b6a000700 1 -- 172.21.15.71:0/3843507170 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7b60029070 con 0x7f7b6c10a980 2024-05-27T09:44:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.402+0000 7f7b6a000700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7b540b2910 0x7f7b540b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.402+0000 7f7b6a000700 1 -- 172.21.15.71:0/3843507170 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f7b600e31d0 con 0x7f7b6c10a980 2024-05-27T09:44:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.402+0000 7f7b70e00700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7b540b2910 0x7f7b540b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.403+0000 7f7b70e00700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7b540b2910 0x7f7b540b4e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009680 tx=0x7f7b58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:34.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.404+0000 7f7b6a000700 1 -- 172.21.15.71:0/3843507170 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7b60013070 con 0x7f7b6c10a980 2024-05-27T09:44:34.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.675+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7b6c063bf0 con 0x7f7b540b2910 2024-05-27T09:44:34.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:34 smithi071 ceph-mon[31451]: pgmap v348: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-05-27T09:44:34.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.691+0000 7f7b6a000700 1 -- 172.21.15.71:0/3843507170 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7b6c063bf0 con 0x7f7b540b2910 2024-05-27T09:44:34.691 INFO:teuthology.orchestra.run.smithi071.stdout:/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14 2024-05-27T09:44:34.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.693+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7b540b2910 msgr2=0x7f7b540b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:34.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.693+0000 7f7b74200700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7b540b2910 0x7f7b540b4e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009680 tx=0x7f7b58009260 comp rx=0 tx=0).stop 2024-05-27T09:44:34.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.693+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10a980 msgr2=0x7f7b6c1a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:34.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.693+0000 7f7b74200700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10a980 0x7f7b6c1a1500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000c00 tx=0x7f7b600047b0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 shutdown_connections 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f7b540b2910 0x7f7b540b4e20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b6c110960 0x7f7b6c1a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b6c10a980 0x7f7b6c1a1500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 --2- 172.21.15.71:0/3843507170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b6c10b2d0 0x7f7b6c1a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 >> 172.21.15.71:0/3843507170 conn(0x7f7b6c077c70 msgr2=0x7f7b6c07bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 shutdown_connections 2024-05-27T09:44:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:34.694+0000 7f7b74200700 1 -- 172.21.15.71:0/3843507170 wait complete. 2024-05-27T09:44:34.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:34 smithi122 ceph-mon[36436]: pgmap v348: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-05-27T09:44:34.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:34 smithi072 ceph-mon[35951]: pgmap v348: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-05-27T09:44:35.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:44:35.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:35 smithi071 ceph-mon[31451]: from='client.24640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:35.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:35 smithi122 ceph-mon[36436]: from='client.24640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:35.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:35 smithi072 ceph-mon[35951]: from='client.24640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:44:36.045 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:36.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:36 smithi071 ceph-mon[31451]: pgmap v349: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2024-05-27T09:44:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:36 smithi122 ceph-mon[36436]: pgmap v349: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2024-05-27T09:44:36.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:36 smithi072 ceph-mon[35951]: pgmap v349: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2024-05-27T09:44:37.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:37 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:44:37.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:37 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:44:37.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:37 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:44:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 -- 172.21.15.71:0/3408710900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70076440 msgr2=0x7f1f701106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 --2- 172.21.15.71:0/3408710900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70076440 0x7f1f701106b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009990 tx=0x7f1f5c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 -- 172.21.15.71:0/3408710900 shutdown_connections 2024-05-27T09:44:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 --2- 172.21.15.71:0/3408710900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f70110bf0 0x7f1f70113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 --2- 172.21.15.71:0/3408710900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f70075af0 0x7f1f70075f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 --2- 172.21.15.71:0/3408710900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70076440 0x7f1f701106b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 -- 172.21.15.71:0/3408710900 >> 172.21.15.71:0/3408710900 conn(0x7f1f70100030 msgr2=0x7f1f70102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 -- 172.21.15.71:0/3408710900 shutdown_connections 2024-05-27T09:44:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.434+0000 7f1f76600700 1 -- 172.21.15.71:0/3408710900 wait complete. 2024-05-27T09:44:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.435+0000 7f1f76600700 1 Processor -- start 2024-05-27T09:44:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.436+0000 7f1f76600700 1 -- start start 2024-05-27T09:44:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.436+0000 7f1f76600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70075af0 0x7f1f7019d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.436+0000 7f1f76600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f70076440 0x7f1f7019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.436+0000 7f1f76600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f70110bf0 0x7f1f701a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.436+0000 7f1f76600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f70116720 con 0x7f1f70076440 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.436+0000 7f1f76600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f701165a0 con 0x7f1f70110bf0 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.436+0000 7f1f76600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f701168a0 con 0x7f1f70075af0 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f70110bf0 0x7f1f701a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f70076440 0x7f1f7019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f70076440 0x7f1f7019d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43612/0 (socket says 172.21.15.71:43612) 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6ea00700 1 -- 172.21.15.71:0/2905569101 learned_addr learned my addr 172.21.15.71:0/2905569101 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6f400700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70075af0 0x7f1f7019d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:38.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6f400700 1 -- 172.21.15.71:0/2905569101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f70110bf0 msgr2=0x7f1f701a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:38.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6f400700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f70110bf0 0x7f1f701a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6f400700 1 -- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f70076440 msgr2=0x7f1f7019d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6f400700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f70076440 0x7f1f7019d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6f400700 1 -- 172.21.15.71:0/2905569101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f701a1f40 con 0x7f1f70075af0 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.437+0000 7f1f6fe00700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f70110bf0 0x7f1f701a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.438+0000 7f1f6f400700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70075af0 0x7f1f7019d070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000e9f0 tx=0x7f1f6000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.438+0000 7f1f67e00700 1 -- 172.21.15.71:0/2905569101 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000cb70 con 0x7f1f70075af0 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.438+0000 7f1f67e00700 1 -- 172.21.15.71:0/2905569101 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f6000ee90 con 0x7f1f70075af0 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.438+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f701a2230 con 0x7f1f70075af0 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.438+0000 7f1f67e00700 1 -- 172.21.15.71:0/2905569101 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60003d40 con 0x7f1f70075af0 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.438+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f701a9b50 con 0x7f1f70075af0 2024-05-27T09:44:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.439+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f700512b0 con 0x7f1f70075af0 2024-05-27T09:44:38.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.442+0000 7f1f67e00700 1 -- 172.21.15.71:0/2905569101 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1f60004020 con 0x7f1f70075af0 2024-05-27T09:44:38.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.443+0000 7f1f67e00700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1f540b2990 0x7f1f540b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:38.443 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:38 smithi071 ceph-mon[31451]: pgmap v350: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-05-27T09:44:38.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.443+0000 7f1f67e00700 1 -- 172.21.15.71:0/2905569101 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1f600e2440 con 0x7f1f70075af0 2024-05-27T09:44:38.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.443+0000 7f1f6ea00700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1f540b2990 0x7f1f540b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:38.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.444+0000 7f1f6ea00700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1f540b2990 0x7f1f540b4ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f70103630 tx=0x7f1f5c00b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:38.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.447+0000 7f1f67e00700 1 -- 172.21.15.71:0/2905569101 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1f600a9fb0 con 0x7f1f70075af0 2024-05-27T09:44:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:38 smithi122 ceph-mon[36436]: pgmap v350: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-05-27T09:44:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.739+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f7019e400 con 0x7f1f70075af0 2024-05-27T09:44:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.740+0000 7f1f67e00700 1 -- 172.21.15.71:0/2905569101 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11854 (secure 0 0 0) 0x7f1f7019e400 con 0x7f1f70075af0 2024-05-27T09:44:38.741 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:44:38.741 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:44:15.200351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:44:38.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1f540b2990 msgr2=0x7f1f540b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:38.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1f540b2990 0x7f1f540b4ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f70103630 tx=0x7f1f5c00b280 comp rx=0 tx=0).stop 2024-05-27T09:44:38.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70075af0 msgr2=0x7f1f7019d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:38.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70075af0 0x7f1f7019d070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000e9f0 tx=0x7f1f6000ed00 comp rx=0 tx=0).stop 2024-05-27T09:44:38.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 shutdown_connections 2024-05-27T09:44:38.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f70110bf0 0x7f1f701a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f70075af0 0x7f1f7019d070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1f540b2990 0x7f1f540b4ea0 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f70103630 tx=0x7f1f5c00b280 comp rx=0 tx=0).stop 2024-05-27T09:44:38.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 --2- 172.21.15.71:0/2905569101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f70076440 0x7f1f7019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:38.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.743+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 >> 172.21.15.71:0/2905569101 conn(0x7f1f70100030 msgr2=0x7f1f70101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:38.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.744+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 shutdown_connections 2024-05-27T09:44:38.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:38.744+0000 7f1f76600700 1 -- 172.21.15.71:0/2905569101 wait complete. 2024-05-27T09:44:38.746 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-05-27T09:44:38.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:38 smithi072 ceph-mon[35951]: pgmap v350: 97 pgs: 97 active+clean; 626 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-05-27T09:44:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:39 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:39.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:39 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2905569101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:44:40.003 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.003 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.003 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.003 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:39 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.003 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:39 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2905569101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:44:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:39 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:40.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:39 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2905569101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:44:40.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:44:40.520 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:40.946 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:40 smithi071 ceph-mon[31451]: pgmap v351: 97 pgs: 97 active+clean; 635 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-05-27T09:44:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:40 smithi122 ceph-mon[36436]: pgmap v351: 97 pgs: 97 active+clean; 635 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-05-27T09:44:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:40 smithi072 ceph-mon[35951]: pgmap v351: 97 pgs: 97 active+clean; 635 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 -- 172.21.15.71:0/4292592260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc108f10 msgr2=0x7fd2dc109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/4292592260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc108f10 0x7fd2dc109320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80098f0 tx=0x7fd2c8009c00 comp rx=0 tx=0).stop 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 -- 172.21.15.71:0/4292592260 shutdown_connections 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/4292592260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2dc109860 0x7fd2dc1111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/4292592260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 0x7fd2dc1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/4292592260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc108f10 0x7fd2dc109320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 -- 172.21.15.71:0/4292592260 >> 172.21.15.71:0/4292592260 conn(0x7fd2dc100030 msgr2=0x7fd2dc102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 -- 172.21.15.71:0/4292592260 shutdown_connections 2024-05-27T09:44:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.643+0000 7fd2e2a00700 1 -- 172.21.15.71:0/4292592260 wait complete. 2024-05-27T09:44:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.645+0000 7fd2e2a00700 1 Processor -- start 2024-05-27T09:44:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.645+0000 7fd2e2a00700 1 -- start start 2024-05-27T09:44:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2e2a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 0x7fd2dc075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2e2a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2dc108f10 0x7fd2dc075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2e2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc109860 0x7fd2dc076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2e2a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc1144c0 con 0x7fd2dc108f10 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2e2a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc114340 con 0x7fd2dc109860 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2e2a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc114640 con 0x7fd2dc1045e0 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2dbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 0x7fd2dc075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2db400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2dc108f10 0x7fd2dc075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2dbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 0x7fd2dc075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33722/0 (socket says 172.21.15.71:33722) 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2dbe00700 1 -- 172.21.15.71:0/1340809901 learned_addr learned my addr 172.21.15.71:0/1340809901 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.646+0000 7fd2e0a00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc109860 0x7fd2dc076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2dbe00700 1 -- 172.21.15.71:0/1340809901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc109860 msgr2=0x7fd2dc076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2dbe00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc109860 0x7fd2dc076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2dbe00700 1 -- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2dc108f10 msgr2=0x7fd2dc075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2dbe00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2dc108f10 0x7fd2dc075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2dbe00700 1 -- 172.21.15.71:0/1340809901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc1a9250 con 0x7fd2dc1045e0 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2dbe00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 0x7fd2dc075ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e9a0 tx=0x7fd2cc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2d8c00700 1 -- 172.21.15.71:0/1340809901 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00ca10 con 0x7fd2dc1045e0 2024-05-27T09:44:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2d8c00700 1 -- 172.21.15.71:0/1340809901 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2cc00cbb0 con 0x7fd2dc1045e0 2024-05-27T09:44:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2d8c00700 1 -- 172.21.15.71:0/1340809901 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc018680 con 0x7fd2dc1045e0 2024-05-27T09:44:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.647+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2dc1a9540 con 0x7fd2dc1045e0 2024-05-27T09:44:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.648+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2dc1a9aa0 con 0x7fd2dc1045e0 2024-05-27T09:44:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.649+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2dc0512b0 con 0x7fd2dc1045e0 2024-05-27T09:44:42.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.651+0000 7fd2d8c00700 1 -- 172.21.15.71:0/1340809901 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd2cc010430 con 0x7fd2dc1045e0 2024-05-27T09:44:42.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.652+0000 7fd2d8c00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd2c00b2990 0x7fd2c00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:42.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.653+0000 7fd2d8c00700 1 -- 172.21.15.71:0/1340809901 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd2cc0e2820 con 0x7fd2dc1045e0 2024-05-27T09:44:42.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.653+0000 7fd2db400700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd2c00b2990 0x7fd2c00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.654+0000 7fd2db400700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd2c00b2990 0x7fd2c00b4ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009fd0 tx=0x7fd2c8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.655+0000 7fd2d8c00700 1 -- 172.21.15.71:0/1340809901 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2cc0aa390 con 0x7fd2dc1045e0 2024-05-27T09:44:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.908+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2dc02e5e0 con 0x7fd2dc1045e0 2024-05-27T09:44:42.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:42 smithi071 ceph-mon[31451]: pgmap v352: 97 pgs: 97 active+clean; 635 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-27T09:44:42.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:42.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:42 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.910+0000 7fd2d8c00700 1 -- 172.21.15.71:0/1340809901 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22603 (secure 0 0 0) 0x7fd2cc0b2410 con 0x7fd2dc1045e0 2024-05-27T09:44:42.911 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:44:42.912 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":83,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:44:24.357115+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:44:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd2c00b2990 msgr2=0x7fd2c00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd2c00b2990 0x7fd2c00b4ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009fd0 tx=0x7fd2c8019040 comp rx=0 tx=0).stop 2024-05-27T09:44:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 msgr2=0x7fd2dc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 0x7fd2dc075ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e9a0 tx=0x7fd2cc00ecb0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 shutdown_connections 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2dc109860 0x7fd2dc076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2dc1045e0 0x7fd2dc075ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fd2c00b2990 0x7fd2c00b4ea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 --2- 172.21.15.71:0/1340809901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2dc108f10 0x7fd2dc075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 >> 172.21.15.71:0/1340809901 conn(0x7fd2dc100030 msgr2=0x7fd2dc1086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 shutdown_connections 2024-05-27T09:44:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:42.913+0000 7fd2e2a00700 1 -- 172.21.15.71:0/1340809901 wait complete. 2024-05-27T09:44:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:42 smithi122 ceph-mon[36436]: pgmap v352: 97 pgs: 97 active+clean; 635 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-27T09:44:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:42 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:42 smithi072 ceph-mon[35951]: pgmap v352: 97 pgs: 97 active+clean; 635 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-27T09:44:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:42 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:43.863 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-27T09:44:43.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-27T09:44:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:43 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1340809901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:44:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:44:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:44:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:43 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:44.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:43 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1340809901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:44:44.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:44:44.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:44:44.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:43 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:43 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1340809901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:44:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:44:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:44:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:43 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:44:44.313 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:44.715 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:44 smithi071 ceph-mon[31451]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-05-27T09:44:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:44 smithi122 ceph-mon[36436]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-05-27T09:44:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:44 smithi072 ceph-mon[35951]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-05-27T09:44:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 -- 172.21.15.71:0/1833256973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f410af10 msgr2=0x7f25f410b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 --2- 172.21.15.71:0/1833256973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f410af10 0x7f25f410b320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0099c0 tx=0x7f25dc009cd0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 -- 172.21.15.71:0/1833256973 shutdown_connections 2024-05-27T09:44:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 --2- 172.21.15.71:0/1833256973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25f410b860 0x7f25f41131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 --2- 172.21.15.71:0/1833256973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f4106630 0x7f25f4106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 --2- 172.21.15.71:0/1833256973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f410af10 0x7f25f410b320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 -- 172.21.15.71:0/1833256973 >> 172.21.15.71:0/1833256973 conn(0x7f25f4102020 msgr2=0x7f25f4104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:46.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 -- 172.21.15.71:0/1833256973 shutdown_connections 2024-05-27T09:44:46.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.575+0000 7f25f9000700 1 -- 172.21.15.71:0/1833256973 wait complete. 2024-05-27T09:44:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.576+0000 7f25f9000700 1 Processor -- start 2024-05-27T09:44:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.577+0000 7f25f9000700 1 -- start start 2024-05-27T09:44:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.577+0000 7f25f9000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f4106630 0x7f25f419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.577+0000 7f25f9000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f410af10 0x7f25f419d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.577+0000 7f25f9000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25f410b860 0x7f25f41a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.577+0000 7f25f9000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25f4116470 con 0x7f25f4106630 2024-05-27T09:44:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.577+0000 7f25f9000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25f41162f0 con 0x7f25f410af10 2024-05-27T09:44:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.577+0000 7f25f9000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f25f41165f0 con 0x7f25f410b860 2024-05-27T09:44:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25eaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f410af10 0x7f25f419d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f4106630 0x7f25f419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25eaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f410af10 0x7f25f419d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47290/0 (socket says 172.21.15.71:47290) 2024-05-27T09:44:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25eaa00700 1 -- 172.21.15.71:0/368254417 learned_addr learned my addr 172.21.15.71:0/368254417 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3e00700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25f410b860 0x7f25f41a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3e00700 1 -- 172.21.15.71:0/368254417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f410af10 msgr2=0x7f25f419d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3e00700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f410af10 0x7f25f419d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3e00700 1 -- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f4106630 msgr2=0x7f25f419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3e00700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f4106630 0x7f25f419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3e00700 1 -- 172.21.15.71:0/368254417 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f41a1c90 con 0x7f25f410b860 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.578+0000 7f25f3e00700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25f410b860 0x7f25f41a15f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00e970 tx=0x7f25ec00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.579+0000 7f25f0c00700 1 -- 172.21.15.71:0/368254417 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec004220 con 0x7f25f410b860 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.579+0000 7f25f0c00700 1 -- 172.21.15.71:0/368254417 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25ec0043c0 con 0x7f25f410b860 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.579+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f41a1f80 con 0x7f25f410b860 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.579+0000 7f25f0c00700 1 -- 172.21.15.71:0/368254417 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec010700 con 0x7f25f410b860 2024-05-27T09:44:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.579+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f4077bf0 con 0x7f25f410b860 2024-05-27T09:44:46.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.582+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f4107a90 con 0x7f25f410b860 2024-05-27T09:44:46.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.583+0000 7f25f0c00700 1 -- 172.21.15.71:0/368254417 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f25ec004750 con 0x7f25f410b860 2024-05-27T09:44:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.584+0000 7f25f0c00700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f25d80b2990 0x7f25d80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.585+0000 7f25f0c00700 1 -- 172.21.15.71:0/368254417 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f25ec0e2080 con 0x7f25f410b860 2024-05-27T09:44:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.585+0000 7f25f3400700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f25d80b2990 0x7f25d80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.585+0000 7f25f3400700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f25d80b2990 0x7f25d80b4ea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f25e400f540 tx=0x7f25e400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.589+0000 7f25f0c00700 1 -- 172.21.15.71:0/368254417 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f25ec0a9c50 con 0x7f25f410b860 2024-05-27T09:44:46.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.820+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25f419e120 con 0x7f25d80b2990 2024-05-27T09:44:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.844+0000 7f25f0c00700 1 -- 172.21.15.71:0/368254417 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258739 (secure 0 0 0) 0x7f25f419e120 con 0x7f25d80b2990 2024-05-27T09:44:46.846 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:46 smithi071 ceph-mon[31451]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-27T09:44:46.849 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f25d80b2990 msgr2=0x7f25d80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f25d80b2990 0x7f25d80b4ea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f25e400f540 tx=0x7f25e400b040 comp rx=0 tx=0).stop 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25f410b860 msgr2=0x7f25f41a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25f410b860 0x7f25f41a15f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00e970 tx=0x7f25ec00ec80 comp rx=0 tx=0).stop 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 shutdown_connections 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25f410b860 0x7f25f41a15f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f25d80b2990 0x7f25d80b4ea0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f4106630 0x7f25f419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 --2- 172.21.15.71:0/368254417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f410af10 0x7f25f419d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.853+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 >> 172.21.15.71:0/368254417 conn(0x7f25f4102020 msgr2=0x7f25f410a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.854+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 shutdown_connections 2024-05-27T09:44:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:46.854+0000 7f25f9000700 1 -- 172.21.15.71:0/368254417 wait complete. 2024-05-27T09:44:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:44:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:46 smithi122 ceph-mon[36436]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-27T09:44:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:46 smithi072 ceph-mon[35951]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-27T09:44:47.694 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-05-27T09:44:45.168095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655128,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":296,"num_read_kb":244,"num_write":290,"num_write_kb":2262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390944,"kb_used_data":12640,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550880,"statfs":{"total":1151940427776,"available":1151540101120,"internally_reserved":0,"allocated":12943360,"data_stored":7244889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":387233085},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14276,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":18,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005879"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363969+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:44:24.363969+0000","last_peered":"2024-05-27T09:44:24.363969+0000","last_clean":"2024-05-27T09:44:24.363969+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:44:24.363969+0000","last_undegraded":"2024-05-27T09:44:24.363969+0000","last_fullsized":"2024-05-27T09:44:24.363969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371737+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:44:24.371737+0000","last_peered":"2024-05-27T09:44:24.371737+0000","last_clean":"2024-05-27T09:44:24.371737+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:44:24.371737+0000","last_undegraded":"2024-05-27T09:44:24.371737+0000","last_fullsized":"2024-05-27T09:44:24.371737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371379+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:44:24.371379+0000","last_peered":"2024-05-27T09:44:24.371379+0000","last_clean":"2024-05-27T09:44:24.371379+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:44:24.371379+0000","last_undegraded":"2024-05-27T09:44:24.371379+0000","last_fullsized":"2024-05-27T09:44:24.371379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535556+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:44:24.535556+0000","last_peered":"2024-05-27T09:44:24.535556+0000","last_clean":"2024-05-27T09:44:24.535556+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:44:24.535556+0000","last_undegraded":"2024-05-27T09:44:24.535556+0000","last_fullsized":"2024-05-27T09:44:24.535556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366048+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:44:24.366048+0000","last_peered":"2024-05-27T09:44:24.366048+0000","last_clean":"2024-05-27T09:44:24.366048+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:44:24.366048+0000","last_undegraded":"2024-05-27T09:44:24.366048+0000","last_fullsized":"2024-05-27T09:44:24.366048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368803+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:44:24.368803+0000","last_peered":"2024-05-27T09:44:24.368803+0000","last_clean":"2024-05-27T09:44:24.368803+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:44:24.368803+0000","last_undegraded":"2024-05-27T09:44:24.368803+0000","last_fullsized":"2024-05-27T09:44:24.368803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.377966+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:44:24.377966+0000","last_peered":"2024-05-27T09:44:24.377966+0000","last_clean":"2024-05-27T09:44:24.377966+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:44:24.377966+0000","last_undegraded":"2024-05-27T09:44:24.377966+0000","last_fullsized":"2024-05-27T09:44:24.377966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369870+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:44:24.369870+0000","last_peered":"2024-05-27T09:44:24.369870+0000","last_clean":"2024-05-27T09:44:24.369870+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:44:24.369870+0000","last_undegraded":"2024-05-27T09:44:24.369870+0000","last_fullsized":"2024-05-27T09:44:24.369870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364714+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:44:24.364714+0000","last_peered":"2024-05-27T09:44:24.364714+0000","last_clean":"2024-05-27T09:44:24.364714+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:44:24.364714+0000","last_undegraded":"2024-05-27T09:44:24.364714+0000","last_fullsized":"2024-05-27T09:44:24.364714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369655+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:44:24.369655+0000","last_peered":"2024-05-27T09:44:24.369655+0000","last_clean":"2024-05-27T09:44:24.369655+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:44:24.369655+0000","last_undegraded":"2024-05-27T09:44:24.369655+0000","last_fullsized":"2024-05-27T09:44:24.369655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368854+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:44:24.368854+0000","last_peered":"2024-05-27T09:44:24.368854+0000","last_clean":"2024-05-27T09:44:24.368854+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:44:24.368854+0000","last_undegraded":"2024-05-27T09:44:24.368854+0000","last_fullsized":"2024-05-27T09:44:24.368854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535561+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:44:24.535561+0000","last_peered":"2024-05-27T09:44:24.535561+0000","last_clean":"2024-05-27T09:44:24.535561+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:44:24.535561+0000","last_undegraded":"2024-05-27T09:44:24.535561+0000","last_fullsized":"2024-05-27T09:44:24.535561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362062+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:44:24.362062+0000","last_peered":"2024-05-27T09:44:24.362062+0000","last_clean":"2024-05-27T09:44:24.362062+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:44:24.362062+0000","last_undegraded":"2024-05-27T09:44:24.362062+0000","last_fullsized":"2024-05-27T09:44:24.362062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369827+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:44:24.369827+0000","last_peered":"2024-05-27T09:44:24.369827+0000","last_clean":"2024-05-27T09:44:24.369827+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:44:24.369827+0000","last_undegraded":"2024-05-27T09:44:24.369827+0000","last_fullsized":"2024-05-27T09:44:24.369827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368430+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:44:24.368430+0000","last_peered":"2024-05-27T09:44:24.368430+0000","last_clean":"2024-05-27T09:44:24.368430+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:44:24.368430+0000","last_undegraded":"2024-05-27T09:44:24.368430+0000","last_fullsized":"2024-05-27T09:44:24.368430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363995+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:44:24.363995+0000","last_peered":"2024-05-27T09:44:24.363995+0000","last_clean":"2024-05-27T09:44:24.363995+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:44:24.363995+0000","last_undegraded":"2024-05-27T09:44:24.363995+0000","last_fullsized":"2024-05-27T09:44:24.363995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364225+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:44:24.364225+0000","last_peered":"2024-05-27T09:44:24.364225+0000","last_clean":"2024-05-27T09:44:24.364225+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:44:24.364225+0000","last_undegraded":"2024-05-27T09:44:24.364225+0000","last_fullsized":"2024-05-27T09:44:24.364225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.367641+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:44:24.367641+0000","last_peered":"2024-05-27T09:44:24.367641+0000","last_clean":"2024-05-27T09:44:24.367641+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:44:24.367641+0000","last_undegraded":"2024-05-27T09:44:24.367641+0000","last_fullsized":"2024-05-27T09:44:24.367641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362227+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:44:24.362227+0000","last_peered":"2024-05-27T09:44:24.362227+0000","last_clean":"2024-05-27T09:44:24.362227+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:44:24.362227+0000","last_undegraded":"2024-05-27T09:44:24.362227+0000","last_fullsized":"2024-05-27T09:44:24.362227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366784+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:44:24.366784+0000","last_peered":"2024-05-27T09:44:24.366784+0000","last_clean":"2024-05-27T09:44:24.366784+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:44:24.366784+0000","last_undegraded":"2024-05-27T09:44:24.366784+0000","last_fullsized":"2024-05-27T09:44:24.366784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371916+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:44:24.371916+0000","last_peered":"2024-05-27T09:44:24.371916+0000","last_clean":"2024-05-27T09:44:24.371916+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:44:24.371916+0000","last_undegraded":"2024-05-27T09:44:24.371916+0000","last_fullsized":"2024-05-27T09:44:24.371916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372449+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:44:24.372449+0000","last_peered":"2024-05-27T09:44:24.372449+0000","last_clean":"2024-05-27T09:44:24.372449+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:44:24.372449+0000","last_undegraded":"2024-05-27T09:44:24.372449+0000","last_fullsized":"2024-05-27T09:44:24.372449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372641+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:44:24.372641+0000","last_peered":"2024-05-27T09:44:24.372641+0000","last_clean":"2024-05-27T09:44:24.372641+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:44:24.372641+0000","last_undegraded":"2024-05-27T09:44:24.372641+0000","last_fullsized":"2024-05-27T09:44:24.372641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366485+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:44:24.366485+0000","last_peered":"2024-05-27T09:44:24.366485+0000","last_clean":"2024-05-27T09:44:24.366485+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:44:24.366485+0000","last_undegraded":"2024-05-27T09:44:24.366485+0000","last_fullsized":"2024-05-27T09:44:24.366485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364251+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:44:24.364251+0000","last_peered":"2024-05-27T09:44:24.364251+0000","last_clean":"2024-05-27T09:44:24.364251+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:44:24.364251+0000","last_undegraded":"2024-05-27T09:44:24.364251+0000","last_fullsized":"2024-05-27T09:44:24.364251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366281+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:44:24.366281+0000","last_peered":"2024-05-27T09:44:24.366281+0000","last_clean":"2024-05-27T09:44:24.366281+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:44:24.366281+0000","last_undegraded":"2024-05-27T09:44:24.366281+0000","last_fullsized":"2024-05-27T09:44:24.366281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514372+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:44:24.514372+0000","last_peered":"2024-05-27T09:44:24.514372+0000","last_clean":"2024-05-27T09:44:24.514372+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:44:24.514372+0000","last_undegraded":"2024-05-27T09:44:24.514372+0000","last_fullsized":"2024-05-27T09:44:24.514372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":64,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:40.366286+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:44:40.366286+0000","last_peered":"2024-05-27T09:44:40.366286+0000","last_clean":"2024-05-27T09:44:40.366286+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:44:40.366286+0000","last_undegraded":"2024-05-27T09:44:40.366286+0000","last_fullsized":"2024-05-27T09:44:40.366286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366048+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:44:24.366048+0000","last_peered":"2024-05-27T09:44:24.366048+0000","last_clean":"2024-05-27T09:44:24.366048+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:44:24.366048+0000","last_undegraded":"2024-05-27T09:44:24.366048+0000","last_fullsized":"2024-05-27T09:44:24.366048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368660+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:44:24.368660+0000","last_peered":"2024-05-27T09:44:24.368660+0000","last_clean":"2024-05-27T09:44:24.368660+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:44:24.368660+0000","last_undegraded":"2024-05-27T09:44:24.368660+0000","last_fullsized":"2024-05-27T09:44:24.368660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514109+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:44:24.514109+0000","last_peered":"2024-05-27T09:44:24.514109+0000","last_clean":"2024-05-27T09:44:24.514109+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:44:24.514109+0000","last_undegraded":"2024-05-27T09:44:24.514109+0000","last_fullsized":"2024-05-27T09:44:24.514109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361697+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:44:24.361697+0000","last_peered":"2024-05-27T09:44:24.361697+0000","last_clean":"2024-05-27T09:44:24.361697+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:44:24.361697+0000","last_undegraded":"2024-05-27T09:44:24.361697+0000","last_fullsized":"2024-05-27T09:44:24.361697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369705+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:44:24.369705+0000","last_peered":"2024-05-27T09:44:24.369705+0000","last_clean":"2024-05-27T09:44:24.369705+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:44:24.369705+0000","last_undegraded":"2024-05-27T09:44:24.369705+0000","last_fullsized":"2024-05-27T09:44:24.369705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514010+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:44:24.514010+0000","last_peered":"2024-05-27T09:44:24.514010+0000","last_clean":"2024-05-27T09:44:24.514010+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:44:24.514010+0000","last_undegraded":"2024-05-27T09:44:24.514010+0000","last_fullsized":"2024-05-27T09:44:24.514010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366626+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:44:24.366626+0000","last_peered":"2024-05-27T09:44:24.366626+0000","last_clean":"2024-05-27T09:44:24.366626+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:44:24.366626+0000","last_undegraded":"2024-05-27T09:44:24.366626+0000","last_fullsized":"2024-05-27T09:44:24.366626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:40.365731+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:44:40.365731+0000","last_peered":"2024-05-27T09:44:40.365731+0000","last_clean":"2024-05-27T09:44:40.365731+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:44:40.365731+0000","last_undegraded":"2024-05-27T09:44:40.365731+0000","last_fullsized":"2024-05-27T09:44:40.365731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364609+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:44:24.364609+0000","last_peered":"2024-05-27T09:44:24.364609+0000","last_clean":"2024-05-27T09:44:24.364609+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:44:24.364609+0000","last_undegraded":"2024-05-27T09:44:24.364609+0000","last_fullsized":"2024-05-27T09:44:24.364609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368993+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:44:24.368993+0000","last_peered":"2024-05-27T09:44:24.368993+0000","last_clean":"2024-05-27T09:44:24.368993+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:44:24.368993+0000","last_undegraded":"2024-05-27T09:44:24.368993+0000","last_fullsized":"2024-05-27T09:44:24.368993+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.515777+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:44:24.515777+0000","last_peered":"2024-05-27T09:44:24.515777+0000","last_clean":"2024-05-27T09:44:24.515777+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:44:24.515777+0000","last_undegraded":"2024-05-27T09:44:24.515777+0000","last_fullsized":"2024-05-27T09:44:24.515777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514473+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:44:24.514473+0000","last_peered":"2024-05-27T09:44:24.514473+0000","last_clean":"2024-05-27T09:44:24.514473+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:44:24.514473+0000","last_undegraded":"2024-05-27T09:44:24.514473+0000","last_fullsized":"2024-05-27T09:44:24.514473+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364401+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:44:24.364401+0000","last_peered":"2024-05-27T09:44:24.364401+0000","last_clean":"2024-05-27T09:44:24.364401+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:44:24.364401+0000","last_undegraded":"2024-05-27T09:44:24.364401+0000","last_fullsized":"2024-05-27T09:44:24.364401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":125,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:41.392571+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:44:41.392571+0000","last_peered":"2024-05-27T09:44:41.392571+0000","last_clean":"2024-05-27T09:44:41.392571+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:44:41.392571+0000","last_undegraded":"2024-05-27T09:44:41.392571+0000","last_fullsized":"2024-05-27T09:44:41.392571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60525,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":70,"num_read_kb":94,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366315+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:44:24.366315+0000","last_peered":"2024-05-27T09:44:24.366315+0000","last_clean":"2024-05-27T09:44:24.366315+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:44:24.366315+0000","last_undegraded":"2024-05-27T09:44:24.366315+0000","last_fullsized":"2024-05-27T09:44:24.366315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361850+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:44:24.361850+0000","last_peered":"2024-05-27T09:44:24.361850+0000","last_clean":"2024-05-27T09:44:24.361850+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:44:24.361850+0000","last_undegraded":"2024-05-27T09:44:24.361850+0000","last_fullsized":"2024-05-27T09:44:24.361850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361711+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:44:24.361711+0000","last_peered":"2024-05-27T09:44:24.361711+0000","last_clean":"2024-05-27T09:44:24.361711+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:44:24.361711+0000","last_undegraded":"2024-05-27T09:44:24.361711+0000","last_fullsized":"2024-05-27T09:44:24.361711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514511+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:44:24.514511+0000","last_peered":"2024-05-27T09:44:24.514511+0000","last_clean":"2024-05-27T09:44:24.514511+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:44:24.514511+0000","last_undegraded":"2024-05-27T09:44:24.514511+0000","last_fullsized":"2024-05-27T09:44:24.514511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368921+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:44:24.368921+0000","last_peered":"2024-05-27T09:44:24.368921+0000","last_clean":"2024-05-27T09:44:24.368921+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:44:24.368921+0000","last_undegraded":"2024-05-27T09:44:24.368921+0000","last_fullsized":"2024-05-27T09:44:24.368921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:42.379673+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:44:42.379673+0000","last_peered":"2024-05-27T09:44:42.379673+0000","last_clean":"2024-05-27T09:44:42.379673+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:44:42.379673+0000","last_undegraded":"2024-05-27T09:44:42.379673+0000","last_fullsized":"2024-05-27T09:44:42.379673+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.378006+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:44:24.378006+0000","last_peered":"2024-05-27T09:44:24.378006+0000","last_clean":"2024-05-27T09:44:24.378006+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:44:24.378006+0000","last_undegraded":"2024-05-27T09:44:24.378006+0000","last_fullsized":"2024-05-27T09:44:24.378006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.388761+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:44:24.388761+0000","last_peered":"2024-05-27T09:44:24.388761+0000","last_clean":"2024-05-27T09:44:24.388761+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:44:24.388761+0000","last_undegraded":"2024-05-27T09:44:24.388761+0000","last_fullsized":"2024-05-27T09:44:24.388761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514147+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:44:24.514147+0000","last_peered":"2024-05-27T09:44:24.514147+0000","last_clean":"2024-05-27T09:44:24.514147+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:44:24.514147+0000","last_undegraded":"2024-05-27T09:44:24.514147+0000","last_fullsized":"2024-05-27T09:44:24.514147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366644+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:44:24.366644+0000","last_peered":"2024-05-27T09:44:24.366644+0000","last_clean":"2024-05-27T09:44:24.366644+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:44:24.366644+0000","last_undegraded":"2024-05-27T09:44:24.366644+0000","last_fullsized":"2024-05-27T09:44:24.366644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363848+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:44:24.363848+0000","last_peered":"2024-05-27T09:44:24.363848+0000","last_clean":"2024-05-27T09:44:24.363848+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:44:24.363848+0000","last_undegraded":"2024-05-27T09:44:24.363848+0000","last_fullsized":"2024-05-27T09:44:24.363848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366820+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:44:24.366820+0000","last_peered":"2024-05-27T09:44:24.366820+0000","last_clean":"2024-05-27T09:44:24.366820+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:44:24.366820+0000","last_undegraded":"2024-05-27T09:44:24.366820+0000","last_fullsized":"2024-05-27T09:44:24.366820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368814+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:44:24.368814+0000","last_peered":"2024-05-27T09:44:24.368814+0000","last_clean":"2024-05-27T09:44:24.368814+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:44:24.368814+0000","last_undegraded":"2024-05-27T09:44:24.368814+0000","last_fullsized":"2024-05-27T09:44:24.368814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368826+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:44:24.368826+0000","last_peered":"2024-05-27T09:44:24.368826+0000","last_clean":"2024-05-27T09:44:24.368826+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:44:24.368826+0000","last_undegraded":"2024-05-27T09:44:24.368826+0000","last_fullsized":"2024-05-27T09:44:24.368826+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.377606+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:44:24.377606+0000","last_peered":"2024-05-27T09:44:24.377606+0000","last_clean":"2024-05-27T09:44:24.377606+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:44:24.377606+0000","last_undegraded":"2024-05-27T09:44:24.377606+0000","last_fullsized":"2024-05-27T09:44:24.377606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514211+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:44:24.514211+0000","last_peered":"2024-05-27T09:44:24.514211+0000","last_clean":"2024-05-27T09:44:24.514211+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:44:24.514211+0000","last_undegraded":"2024-05-27T09:44:24.514211+0000","last_fullsized":"2024-05-27T09:44:24.514211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:41.376783+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:44:41.376783+0000","last_peered":"2024-05-27T09:44:41.376783+0000","last_clean":"2024-05-27T09:44:41.376783+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:44:41.376783+0000","last_undegraded":"2024-05-27T09:44:41.376783+0000","last_fullsized":"2024-05-27T09:44:41.376783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.516850+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:44:24.516850+0000","last_peered":"2024-05-27T09:44:24.516850+0000","last_clean":"2024-05-27T09:44:24.516850+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:44:24.516850+0000","last_undegraded":"2024-05-27T09:44:24.516850+0000","last_fullsized":"2024-05-27T09:44:24.516850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535290+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:44:24.535290+0000","last_peered":"2024-05-27T09:44:24.535290+0000","last_clean":"2024-05-27T09:44:24.535290+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:44:24.535290+0000","last_undegraded":"2024-05-27T09:44:24.535290+0000","last_fullsized":"2024-05-27T09:44:24.535290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369400+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:44:24.369400+0000","last_peered":"2024-05-27T09:44:24.369400+0000","last_clean":"2024-05-27T09:44:24.369400+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:44:24.369400+0000","last_undegraded":"2024-05-27T09:44:24.369400+0000","last_fullsized":"2024-05-27T09:44:24.369400+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361573+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:44:24.361573+0000","last_peered":"2024-05-27T09:44:24.361573+0000","last_clean":"2024-05-27T09:44:24.361573+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:44:24.361573+0000","last_undegraded":"2024-05-27T09:44:24.361573+0000","last_fullsized":"2024-05-27T09:44:24.361573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369505+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:44:24.369505+0000","last_peered":"2024-05-27T09:44:24.369505+0000","last_clean":"2024-05-27T09:44:24.369505+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:44:24.369505+0000","last_undegraded":"2024-05-27T09:44:24.369505+0000","last_fullsized":"2024-05-27T09:44:24.369505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366368+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:44:24.366368+0000","last_peered":"2024-05-27T09:44:24.366368+0000","last_clean":"2024-05-27T09:44:24.366368+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:44:24.366368+0000","last_undegraded":"2024-05-27T09:44:24.366368+0000","last_fullsized":"2024-05-27T09:44:24.366368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362129+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:44:24.362129+0000","last_peered":"2024-05-27T09:44:24.362129+0000","last_clean":"2024-05-27T09:44:24.362129+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:44:24.362129+0000","last_undegraded":"2024-05-27T09:44:24.362129+0000","last_fullsized":"2024-05-27T09:44:24.362129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:36.848345+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:44:36.848345+0000","last_peered":"2024-05-27T09:44:36.848345+0000","last_clean":"2024-05-27T09:44:36.848345+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:44:36.848345+0000","last_undegraded":"2024-05-27T09:44:36.848345+0000","last_fullsized":"2024-05-27T09:44:36.848345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372777+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:44:24.372777+0000","last_peered":"2024-05-27T09:44:24.372777+0000","last_clean":"2024-05-27T09:44:24.372777+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:44:24.372777+0000","last_undegraded":"2024-05-27T09:44:24.372777+0000","last_fullsized":"2024-05-27T09:44:24.372777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535442+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:44:24.535442+0000","last_peered":"2024-05-27T09:44:24.535442+0000","last_clean":"2024-05-27T09:44:24.535442+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:44:24.535442+0000","last_undegraded":"2024-05-27T09:44:24.535442+0000","last_fullsized":"2024-05-27T09:44:24.535442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.378797+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:44:24.378797+0000","last_peered":"2024-05-27T09:44:24.378797+0000","last_clean":"2024-05-27T09:44:24.378797+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:44:24.378797+0000","last_undegraded":"2024-05-27T09:44:24.378797+0000","last_fullsized":"2024-05-27T09:44:24.378797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363995+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:44:24.363995+0000","last_peered":"2024-05-27T09:44:24.363995+0000","last_clean":"2024-05-27T09:44:24.363995+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:44:24.363995+0000","last_undegraded":"2024-05-27T09:44:24.363995+0000","last_fullsized":"2024-05-27T09:44:24.363995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.365957+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:44:24.365957+0000","last_peered":"2024-05-27T09:44:24.365957+0000","last_clean":"2024-05-27T09:44:24.365957+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:44:24.365957+0000","last_undegraded":"2024-05-27T09:44:24.365957+0000","last_fullsized":"2024-05-27T09:44:24.365957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.370129+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:44:24.370129+0000","last_peered":"2024-05-27T09:44:24.370129+0000","last_clean":"2024-05-27T09:44:24.370129+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:44:24.370129+0000","last_undegraded":"2024-05-27T09:44:24.370129+0000","last_fullsized":"2024-05-27T09:44:24.370129+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364460+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:44:24.364460+0000","last_peered":"2024-05-27T09:44:24.364460+0000","last_clean":"2024-05-27T09:44:24.364460+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:44:24.364460+0000","last_undegraded":"2024-05-27T09:44:24.364460+0000","last_fullsized":"2024-05-27T09:44:24.364460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.376759+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:44:24.376759+0000","last_peered":"2024-05-27T09:44:24.376759+0000","last_clean":"2024-05-27T09:44:24.376759+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:44:24.376759+0000","last_undegraded":"2024-05-27T09:44:24.376759+0000","last_fullsized":"2024-05-27T09:44:24.376759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371967+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:44:24.371967+0000","last_peered":"2024-05-27T09:44:24.371967+0000","last_clean":"2024-05-27T09:44:24.371967+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:44:24.371967+0000","last_undegraded":"2024-05-27T09:44:24.371967+0000","last_fullsized":"2024-05-27T09:44:24.371967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366088+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:44:24.366088+0000","last_peered":"2024-05-27T09:44:24.366088+0000","last_clean":"2024-05-27T09:44:24.366088+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:44:24.366088+0000","last_undegraded":"2024-05-27T09:44:24.366088+0000","last_fullsized":"2024-05-27T09:44:24.366088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369012+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:44:24.369012+0000","last_peered":"2024-05-27T09:44:24.369012+0000","last_clean":"2024-05-27T09:44:24.369012+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:44:24.369012+0000","last_undegraded":"2024-05-27T09:44:24.369012+0000","last_fullsized":"2024-05-27T09:44:24.369012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362072+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:44:24.362072+0000","last_peered":"2024-05-27T09:44:24.362072+0000","last_clean":"2024-05-27T09:44:24.362072+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:44:24.362072+0000","last_undegraded":"2024-05-27T09:44:24.362072+0000","last_fullsized":"2024-05-27T09:44:24.362072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369125+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:44:24.369125+0000","last_peered":"2024-05-27T09:44:24.369125+0000","last_clean":"2024-05-27T09:44:24.369125+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:44:24.369125+0000","last_undegraded":"2024-05-27T09:44:24.369125+0000","last_fullsized":"2024-05-27T09:44:24.369125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514321+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:44:24.514321+0000","last_peered":"2024-05-27T09:44:24.514321+0000","last_clean":"2024-05-27T09:44:24.514321+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:44:24.514321+0000","last_undegraded":"2024-05-27T09:44:24.514321+0000","last_fullsized":"2024-05-27T09:44:24.514321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368650+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:44:24.368650+0000","last_peered":"2024-05-27T09:44:24.368650+0000","last_clean":"2024-05-27T09:44:24.368650+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:44:24.368650+0000","last_undegraded":"2024-05-27T09:44:24.368650+0000","last_fullsized":"2024-05-27T09:44:24.368650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361855+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:44:24.361855+0000","last_peered":"2024-05-27T09:44:24.361855+0000","last_clean":"2024-05-27T09:44:24.361855+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:44:24.361855+0000","last_undegraded":"2024-05-27T09:44:24.361855+0000","last_fullsized":"2024-05-27T09:44:24.361855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369184+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:44:24.369184+0000","last_peered":"2024-05-27T09:44:24.369184+0000","last_clean":"2024-05-27T09:44:24.369184+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:44:24.369184+0000","last_undegraded":"2024-05-27T09:44:24.369184+0000","last_fullsized":"2024-05-27T09:44:24.369184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364593+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:44:24.364593+0000","last_peered":"2024-05-27T09:44:24.364593+0000","last_clean":"2024-05-27T09:44:24.364593+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:44:24.364593+0000","last_undegraded":"2024-05-27T09:44:24.364593+0000","last_fullsized":"2024-05-27T09:44:24.364593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361669+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:44:24.361669+0000","last_peered":"2024-05-27T09:44:24.361669+0000","last_clean":"2024-05-27T09:44:24.361669+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:44:24.361669+0000","last_undegraded":"2024-05-27T09:44:24.361669+0000","last_fullsized":"2024-05-27T09:44:24.361669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361650+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:44:24.361650+0000","last_peered":"2024-05-27T09:44:24.361650+0000","last_clean":"2024-05-27T09:44:24.361650+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:44:24.361650+0000","last_undegraded":"2024-05-27T09:44:24.361650+0000","last_fullsized":"2024-05-27T09:44:24.361650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.370809+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:44:24.370809+0000","last_peered":"2024-05-27T09:44:24.370809+0000","last_clean":"2024-05-27T09:44:24.370809+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:44:24.370809+0000","last_undegraded":"2024-05-27T09:44:24.370809+0000","last_fullsized":"2024-05-27T09:44:24.370809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361969+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:44:24.361969+0000","last_peered":"2024-05-27T09:44:24.361969+0000","last_clean":"2024-05-27T09:44:24.361969+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:44:24.361969+0000","last_undegraded":"2024-05-27T09:44:24.361969+0000","last_fullsized":"2024-05-27T09:44:24.361969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363897+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:44:24.363897+0000","last_peered":"2024-05-27T09:44:24.363897+0000","last_clean":"2024-05-27T09:44:24.363897+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:44:24.363897+0000","last_undegraded":"2024-05-27T09:44:24.363897+0000","last_fullsized":"2024-05-27T09:44:24.363897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362169+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:44:24.362169+0000","last_peered":"2024-05-27T09:44:24.362169+0000","last_clean":"2024-05-27T09:44:24.362169+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:44:24.362169+0000","last_undegraded":"2024-05-27T09:44:24.362169+0000","last_fullsized":"2024-05-27T09:44:24.362169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372648+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:44:24.372648+0000","last_peered":"2024-05-27T09:44:24.372648+0000","last_clean":"2024-05-27T09:44:24.372648+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:44:24.372648+0000","last_undegraded":"2024-05-27T09:44:24.372648+0000","last_fullsized":"2024-05-27T09:44:24.372648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514038+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:44:24.514038+0000","last_peered":"2024-05-27T09:44:24.514038+0000","last_clean":"2024-05-27T09:44:24.514038+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:44:24.514038+0000","last_undegraded":"2024-05-27T09:44:24.514038+0000","last_fullsized":"2024-05-27T09:44:24.514038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368738+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:44:24.368738+0000","last_peered":"2024-05-27T09:44:24.368738+0000","last_clean":"2024-05-27T09:44:24.368738+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:44:24.368738+0000","last_undegraded":"2024-05-27T09:44:24.368738+0000","last_fullsized":"2024-05-27T09:44:24.368738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364356+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:44:24.364356+0000","last_peered":"2024-05-27T09:44:24.364356+0000","last_clean":"2024-05-27T09:44:24.364356+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:44:24.364356+0000","last_undegraded":"2024-05-27T09:44:24.364356+0000","last_fullsized":"2024-05-27T09:44:24.364356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362201+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:44:24.362201+0000","last_peered":"2024-05-27T09:44:24.362201+0000","last_clean":"2024-05-27T09:44:24.362201+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:44:24.362201+0000","last_undegraded":"2024-05-27T09:44:24.362201+0000","last_fullsized":"2024-05-27T09:44:24.362201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364077+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:44:24.364077+0000","last_peered":"2024-05-27T09:44:24.364077+0000","last_clean":"2024-05-27T09:44:24.364077+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:44:24.364077+0000","last_undegraded":"2024-05-27T09:44:24.364077+0000","last_fullsized":"2024-05-27T09:44:24.364077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64526,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":165,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":197835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612637,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":440298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32732,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712420,"statfs":{"total":95995035648,"available":95961518080,"internally_reserved":0,"allocated":1593344,"data_stored":1092583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005094,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":440422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201326,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":440230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397556,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1507328,"data_stored":1032272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593783,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":439811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":966656,"data_stored":504386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":441082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":501479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":440122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":440639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790015,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1519616,"data_stored":1031565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:44:47.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-27T09:44:47.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:47 smithi122 ceph-mon[36436]: from='client.24658 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:44:48.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:47 smithi071 ceph-mon[31451]: from='client.24658 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:44:48.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:47 smithi072 ceph-mon[35951]: from='client.24658 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:44:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:48 smithi122 ceph-mon[36436]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-05-27T09:44:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:48 smithi071 ceph-mon[31451]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-05-27T09:44:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:48 smithi072 ceph-mon[35951]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 -- 172.21.15.71:0/2998907575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4075b50 msgr2=0x7f95d4075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 --2- 172.21.15.71:0/2998907575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4075b50 0x7f95d4075f60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95c800b0a0 tx=0x7f95c800b3b0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 -- 172.21.15.71:0/2998907575 shutdown_connections 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 --2- 172.21.15.71:0/2998907575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95d4115170 0x7f95d4117590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 --2- 172.21.15.71:0/2998907575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4075b50 0x7f95d4075f60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 --2- 172.21.15.71:0/2998907575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40764a0 0x7f95d4114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 -- 172.21.15.71:0/2998907575 >> 172.21.15.71:0/2998907575 conn(0x7f95d4079d00 msgr2=0x7f95d407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 -- 172.21.15.71:0/2998907575 shutdown_connections 2024-05-27T09:44:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.338+0000 7f95da000700 1 -- 172.21.15.71:0/2998907575 wait complete. 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.339+0000 7f95da000700 1 Processor -- start 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95da000700 1 -- start start 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95da000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95d4075b50 0x7f95d41a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95da000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40764a0 0x7f95d41a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95da000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4115170 0x7f95d41a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95da000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95d411a880 con 0x7f95d40764a0 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95da000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f95d411a700 con 0x7f95d4115170 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95da000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95d411aa00 con 0x7f95d4075b50 2024-05-27T09:44:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95d8c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95d4075b50 0x7f95d41a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95d8c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95d4075b50 0x7f95d41a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:55320/0 (socket says 172.21.15.71:55320) 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95d8c00700 1 -- 172.21.15.71:0/2982588429 learned_addr learned my addr 172.21.15.71:0/2982588429 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.340+0000 7f95d3e00700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40764a0 0x7f95d41a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d9600700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4115170 0x7f95d41a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d3e00700 1 -- 172.21.15.71:0/2982588429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95d4075b50 msgr2=0x7f95d41a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d3e00700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95d4075b50 0x7f95d41a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d3e00700 1 -- 172.21.15.71:0/2982588429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4115170 msgr2=0x7f95d41a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d3e00700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4115170 0x7f95d41a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d3e00700 1 -- 172.21.15.71:0/2982588429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d41a6120 con 0x7f95d40764a0 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d9600700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4115170 0x7f95d41a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.341+0000 7f95d3e00700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40764a0 0x7f95d41a17f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95c000e9f0 tx=0x7f95c000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.342+0000 7f95d1600700 1 -- 172.21.15.71:0/2982588429 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c000c9c0 con 0x7f95d40764a0 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.342+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d41a6410 con 0x7f95d40764a0 2024-05-27T09:44:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.342+0000 7f95d1600700 1 -- 172.21.15.71:0/2982588429 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c000cb60 con 0x7f95d40764a0 2024-05-27T09:44:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.342+0000 7f95d1600700 1 -- 172.21.15.71:0/2982588429 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0018680 con 0x7f95d40764a0 2024-05-27T09:44:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.342+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d41add30 con 0x7f95d40764a0 2024-05-27T09:44:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.343+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d4077290 con 0x7f95d40764a0 2024-05-27T09:44:50.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.345+0000 7f95d1600700 1 -- 172.21.15.71:0/2982588429 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f95c0010430 con 0x7f95d40764a0 2024-05-27T09:44:50.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.347+0000 7f95d1600700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f95bc0b2910 0x7f95bc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:50.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.347+0000 7f95d1600700 1 -- 172.21.15.71:0/2982588429 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f95c00e24e0 con 0x7f95d40764a0 2024-05-27T09:44:50.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.347+0000 7f95d8c00700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f95bc0b2910 0x7f95bc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:50.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.348+0000 7f95d8c00700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f95bc0b2910 0x7f95bc0b4e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009e60 tx=0x7f95c800b740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:50.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.352+0000 7f95d1600700 1 -- 172.21.15.71:0/2982588429 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f95c00aa0b0 con 0x7f95d40764a0 2024-05-27T09:44:50.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.577+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95d4063bf0 con 0x7f95bc0b2910 2024-05-27T09:44:50.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.587+0000 7f95d1600700 1 -- 172.21.15.71:0/2982588429 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258716 (secure 0 0 0) 0x7f95d4063bf0 con 0x7f95bc0b2910 2024-05-27T09:44:50.592 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f95bc0b2910 msgr2=0x7f95bc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f95bc0b2910 0x7f95bc0b4e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009e60 tx=0x7f95c800b740 comp rx=0 tx=0).stop 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40764a0 msgr2=0x7f95d41a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40764a0 0x7f95d41a17f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95c000e9f0 tx=0x7f95c000ed00 comp rx=0 tx=0).stop 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 shutdown_connections 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4115170 0x7f95d41a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95d4075b50 0x7f95d41a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f95bc0b2910 0x7f95bc0b4e20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 --2- 172.21.15.71:0/2982588429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40764a0 0x7f95d41a17f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.592+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 >> 172.21.15.71:0/2982588429 conn(0x7f95d4079d00 msgr2=0x7f95d4100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.593+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 shutdown_connections 2024-05-27T09:44:50.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:50.593+0000 7f95da000700 1 -- 172.21.15.71:0/2982588429 wait complete. 2024-05-27T09:44:50.596 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:44:50.958 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:50 smithi071 ceph-mon[31451]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-27T09:44:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:50 smithi072 ceph-mon[35951]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-27T09:44:51.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:50 smithi122 ceph-mon[36436]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-27T09:44:51.473 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-05-27T09:44:49.169882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659385,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":327,"num_read_kb":264,"num_write":291,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390952,"kb_used_data":12648,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550872,"statfs":{"total":1151940427776,"available":1151540092928,"internally_reserved":0,"allocated":12951552,"data_stored":7253403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":387233085},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18416,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":65,"num_write":10,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005409"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363969+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:44:24.363969+0000","last_peered":"2024-05-27T09:44:24.363969+0000","last_clean":"2024-05-27T09:44:24.363969+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:44:24.363969+0000","last_undegraded":"2024-05-27T09:44:24.363969+0000","last_fullsized":"2024-05-27T09:44:24.363969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371737+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:44:24.371737+0000","last_peered":"2024-05-27T09:44:24.371737+0000","last_clean":"2024-05-27T09:44:24.371737+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:44:24.371737+0000","last_undegraded":"2024-05-27T09:44:24.371737+0000","last_fullsized":"2024-05-27T09:44:24.371737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371379+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:44:24.371379+0000","last_peered":"2024-05-27T09:44:24.371379+0000","last_clean":"2024-05-27T09:44:24.371379+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:44:24.371379+0000","last_undegraded":"2024-05-27T09:44:24.371379+0000","last_fullsized":"2024-05-27T09:44:24.371379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535556+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:44:24.535556+0000","last_peered":"2024-05-27T09:44:24.535556+0000","last_clean":"2024-05-27T09:44:24.535556+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:44:24.535556+0000","last_undegraded":"2024-05-27T09:44:24.535556+0000","last_fullsized":"2024-05-27T09:44:24.535556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366048+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:44:24.366048+0000","last_peered":"2024-05-27T09:44:24.366048+0000","last_clean":"2024-05-27T09:44:24.366048+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:44:24.366048+0000","last_undegraded":"2024-05-27T09:44:24.366048+0000","last_fullsized":"2024-05-27T09:44:24.366048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368803+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:44:24.368803+0000","last_peered":"2024-05-27T09:44:24.368803+0000","last_clean":"2024-05-27T09:44:24.368803+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:44:24.368803+0000","last_undegraded":"2024-05-27T09:44:24.368803+0000","last_fullsized":"2024-05-27T09:44:24.368803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.377966+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:44:24.377966+0000","last_peered":"2024-05-27T09:44:24.377966+0000","last_clean":"2024-05-27T09:44:24.377966+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:44:24.377966+0000","last_undegraded":"2024-05-27T09:44:24.377966+0000","last_fullsized":"2024-05-27T09:44:24.377966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369870+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:44:24.369870+0000","last_peered":"2024-05-27T09:44:24.369870+0000","last_clean":"2024-05-27T09:44:24.369870+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:44:24.369870+0000","last_undegraded":"2024-05-27T09:44:24.369870+0000","last_fullsized":"2024-05-27T09:44:24.369870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364714+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:44:24.364714+0000","last_peered":"2024-05-27T09:44:24.364714+0000","last_clean":"2024-05-27T09:44:24.364714+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:44:24.364714+0000","last_undegraded":"2024-05-27T09:44:24.364714+0000","last_fullsized":"2024-05-27T09:44:24.364714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369655+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:44:24.369655+0000","last_peered":"2024-05-27T09:44:24.369655+0000","last_clean":"2024-05-27T09:44:24.369655+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:44:24.369655+0000","last_undegraded":"2024-05-27T09:44:24.369655+0000","last_fullsized":"2024-05-27T09:44:24.369655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368854+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:44:24.368854+0000","last_peered":"2024-05-27T09:44:24.368854+0000","last_clean":"2024-05-27T09:44:24.368854+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:44:24.368854+0000","last_undegraded":"2024-05-27T09:44:24.368854+0000","last_fullsized":"2024-05-27T09:44:24.368854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535561+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:44:24.535561+0000","last_peered":"2024-05-27T09:44:24.535561+0000","last_clean":"2024-05-27T09:44:24.535561+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:44:24.535561+0000","last_undegraded":"2024-05-27T09:44:24.535561+0000","last_fullsized":"2024-05-27T09:44:24.535561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362062+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:44:24.362062+0000","last_peered":"2024-05-27T09:44:24.362062+0000","last_clean":"2024-05-27T09:44:24.362062+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:44:24.362062+0000","last_undegraded":"2024-05-27T09:44:24.362062+0000","last_fullsized":"2024-05-27T09:44:24.362062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369827+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:44:24.369827+0000","last_peered":"2024-05-27T09:44:24.369827+0000","last_clean":"2024-05-27T09:44:24.369827+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:44:24.369827+0000","last_undegraded":"2024-05-27T09:44:24.369827+0000","last_fullsized":"2024-05-27T09:44:24.369827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368430+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:44:24.368430+0000","last_peered":"2024-05-27T09:44:24.368430+0000","last_clean":"2024-05-27T09:44:24.368430+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:44:24.368430+0000","last_undegraded":"2024-05-27T09:44:24.368430+0000","last_fullsized":"2024-05-27T09:44:24.368430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363995+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:44:24.363995+0000","last_peered":"2024-05-27T09:44:24.363995+0000","last_clean":"2024-05-27T09:44:24.363995+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:44:24.363995+0000","last_undegraded":"2024-05-27T09:44:24.363995+0000","last_fullsized":"2024-05-27T09:44:24.363995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364225+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:44:24.364225+0000","last_peered":"2024-05-27T09:44:24.364225+0000","last_clean":"2024-05-27T09:44:24.364225+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:44:24.364225+0000","last_undegraded":"2024-05-27T09:44:24.364225+0000","last_fullsized":"2024-05-27T09:44:24.364225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.367641+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:44:24.367641+0000","last_peered":"2024-05-27T09:44:24.367641+0000","last_clean":"2024-05-27T09:44:24.367641+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:44:24.367641+0000","last_undegraded":"2024-05-27T09:44:24.367641+0000","last_fullsized":"2024-05-27T09:44:24.367641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362227+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:44:24.362227+0000","last_peered":"2024-05-27T09:44:24.362227+0000","last_clean":"2024-05-27T09:44:24.362227+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:44:24.362227+0000","last_undegraded":"2024-05-27T09:44:24.362227+0000","last_fullsized":"2024-05-27T09:44:24.362227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366784+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:44:24.366784+0000","last_peered":"2024-05-27T09:44:24.366784+0000","last_clean":"2024-05-27T09:44:24.366784+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:44:24.366784+0000","last_undegraded":"2024-05-27T09:44:24.366784+0000","last_fullsized":"2024-05-27T09:44:24.366784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371916+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:44:24.371916+0000","last_peered":"2024-05-27T09:44:24.371916+0000","last_clean":"2024-05-27T09:44:24.371916+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:44:24.371916+0000","last_undegraded":"2024-05-27T09:44:24.371916+0000","last_fullsized":"2024-05-27T09:44:24.371916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372449+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:44:24.372449+0000","last_peered":"2024-05-27T09:44:24.372449+0000","last_clean":"2024-05-27T09:44:24.372449+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:44:24.372449+0000","last_undegraded":"2024-05-27T09:44:24.372449+0000","last_fullsized":"2024-05-27T09:44:24.372449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372641+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:44:24.372641+0000","last_peered":"2024-05-27T09:44:24.372641+0000","last_clean":"2024-05-27T09:44:24.372641+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:44:24.372641+0000","last_undegraded":"2024-05-27T09:44:24.372641+0000","last_fullsized":"2024-05-27T09:44:24.372641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366485+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:44:24.366485+0000","last_peered":"2024-05-27T09:44:24.366485+0000","last_clean":"2024-05-27T09:44:24.366485+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:44:24.366485+0000","last_undegraded":"2024-05-27T09:44:24.366485+0000","last_fullsized":"2024-05-27T09:44:24.366485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364251+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:44:24.364251+0000","last_peered":"2024-05-27T09:44:24.364251+0000","last_clean":"2024-05-27T09:44:24.364251+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:44:24.364251+0000","last_undegraded":"2024-05-27T09:44:24.364251+0000","last_fullsized":"2024-05-27T09:44:24.364251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366281+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:44:24.366281+0000","last_peered":"2024-05-27T09:44:24.366281+0000","last_clean":"2024-05-27T09:44:24.366281+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:44:24.366281+0000","last_undegraded":"2024-05-27T09:44:24.366281+0000","last_fullsized":"2024-05-27T09:44:24.366281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514372+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:44:24.514372+0000","last_peered":"2024-05-27T09:44:24.514372+0000","last_clean":"2024-05-27T09:44:24.514372+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:44:24.514372+0000","last_undegraded":"2024-05-27T09:44:24.514372+0000","last_fullsized":"2024-05-27T09:44:24.514372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:45.374919+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:44:45.374919+0000","last_peered":"2024-05-27T09:44:45.374919+0000","last_clean":"2024-05-27T09:44:45.374919+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:44:45.374919+0000","last_undegraded":"2024-05-27T09:44:45.374919+0000","last_fullsized":"2024-05-27T09:44:45.374919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366048+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:44:24.366048+0000","last_peered":"2024-05-27T09:44:24.366048+0000","last_clean":"2024-05-27T09:44:24.366048+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:44:24.366048+0000","last_undegraded":"2024-05-27T09:44:24.366048+0000","last_fullsized":"2024-05-27T09:44:24.366048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368660+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:44:24.368660+0000","last_peered":"2024-05-27T09:44:24.368660+0000","last_clean":"2024-05-27T09:44:24.368660+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:44:24.368660+0000","last_undegraded":"2024-05-27T09:44:24.368660+0000","last_fullsized":"2024-05-27T09:44:24.368660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514109+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:44:24.514109+0000","last_peered":"2024-05-27T09:44:24.514109+0000","last_clean":"2024-05-27T09:44:24.514109+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:44:24.514109+0000","last_undegraded":"2024-05-27T09:44:24.514109+0000","last_fullsized":"2024-05-27T09:44:24.514109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361697+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:44:24.361697+0000","last_peered":"2024-05-27T09:44:24.361697+0000","last_clean":"2024-05-27T09:44:24.361697+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:44:24.361697+0000","last_undegraded":"2024-05-27T09:44:24.361697+0000","last_fullsized":"2024-05-27T09:44:24.361697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369705+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:44:24.369705+0000","last_peered":"2024-05-27T09:44:24.369705+0000","last_clean":"2024-05-27T09:44:24.369705+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:44:24.369705+0000","last_undegraded":"2024-05-27T09:44:24.369705+0000","last_fullsized":"2024-05-27T09:44:24.369705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514010+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:44:24.514010+0000","last_peered":"2024-05-27T09:44:24.514010+0000","last_clean":"2024-05-27T09:44:24.514010+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:44:24.514010+0000","last_undegraded":"2024-05-27T09:44:24.514010+0000","last_fullsized":"2024-05-27T09:44:24.514010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366626+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:44:24.366626+0000","last_peered":"2024-05-27T09:44:24.366626+0000","last_clean":"2024-05-27T09:44:24.366626+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:44:24.366626+0000","last_undegraded":"2024-05-27T09:44:24.366626+0000","last_fullsized":"2024-05-27T09:44:24.366626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:45.374416+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:44:45.374416+0000","last_peered":"2024-05-27T09:44:45.374416+0000","last_clean":"2024-05-27T09:44:45.374416+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:44:45.374416+0000","last_undegraded":"2024-05-27T09:44:45.374416+0000","last_fullsized":"2024-05-27T09:44:45.374416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364609+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:44:24.364609+0000","last_peered":"2024-05-27T09:44:24.364609+0000","last_clean":"2024-05-27T09:44:24.364609+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:44:24.364609+0000","last_undegraded":"2024-05-27T09:44:24.364609+0000","last_fullsized":"2024-05-27T09:44:24.364609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368993+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:44:24.368993+0000","last_peered":"2024-05-27T09:44:24.368993+0000","last_clean":"2024-05-27T09:44:24.368993+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:44:24.368993+0000","last_undegraded":"2024-05-27T09:44:24.368993+0000","last_fullsized":"2024-05-27T09:44:24.368993+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.515777+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:44:24.515777+0000","last_peered":"2024-05-27T09:44:24.515777+0000","last_clean":"2024-05-27T09:44:24.515777+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:44:24.515777+0000","last_undegraded":"2024-05-27T09:44:24.515777+0000","last_fullsized":"2024-05-27T09:44:24.515777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514473+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:44:24.514473+0000","last_peered":"2024-05-27T09:44:24.514473+0000","last_clean":"2024-05-27T09:44:24.514473+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:44:24.514473+0000","last_undegraded":"2024-05-27T09:44:24.514473+0000","last_fullsized":"2024-05-27T09:44:24.514473+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364401+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:44:24.364401+0000","last_peered":"2024-05-27T09:44:24.364401+0000","last_clean":"2024-05-27T09:44:24.364401+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:44:24.364401+0000","last_undegraded":"2024-05-27T09:44:24.364401+0000","last_fullsized":"2024-05-27T09:44:24.364401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:46.409035+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:44:46.409035+0000","last_peered":"2024-05-27T09:44:46.409035+0000","last_clean":"2024-05-27T09:44:46.409035+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:44:46.409035+0000","last_undegraded":"2024-05-27T09:44:46.409035+0000","last_fullsized":"2024-05-27T09:44:46.409035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64782,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":104,"num_write":31,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366315+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:44:24.366315+0000","last_peered":"2024-05-27T09:44:24.366315+0000","last_clean":"2024-05-27T09:44:24.366315+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:44:24.366315+0000","last_undegraded":"2024-05-27T09:44:24.366315+0000","last_fullsized":"2024-05-27T09:44:24.366315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361850+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:44:24.361850+0000","last_peered":"2024-05-27T09:44:24.361850+0000","last_clean":"2024-05-27T09:44:24.361850+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:44:24.361850+0000","last_undegraded":"2024-05-27T09:44:24.361850+0000","last_fullsized":"2024-05-27T09:44:24.361850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361711+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:44:24.361711+0000","last_peered":"2024-05-27T09:44:24.361711+0000","last_clean":"2024-05-27T09:44:24.361711+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:44:24.361711+0000","last_undegraded":"2024-05-27T09:44:24.361711+0000","last_fullsized":"2024-05-27T09:44:24.361711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514511+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:44:24.514511+0000","last_peered":"2024-05-27T09:44:24.514511+0000","last_clean":"2024-05-27T09:44:24.514511+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:44:24.514511+0000","last_undegraded":"2024-05-27T09:44:24.514511+0000","last_fullsized":"2024-05-27T09:44:24.514511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368921+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:44:24.368921+0000","last_peered":"2024-05-27T09:44:24.368921+0000","last_clean":"2024-05-27T09:44:24.368921+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:44:24.368921+0000","last_undegraded":"2024-05-27T09:44:24.368921+0000","last_fullsized":"2024-05-27T09:44:24.368921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:47.389791+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:44:47.389791+0000","last_peered":"2024-05-27T09:44:47.389791+0000","last_clean":"2024-05-27T09:44:47.389791+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:44:47.389791+0000","last_undegraded":"2024-05-27T09:44:47.389791+0000","last_fullsized":"2024-05-27T09:44:47.389791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.378006+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:44:24.378006+0000","last_peered":"2024-05-27T09:44:24.378006+0000","last_clean":"2024-05-27T09:44:24.378006+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:44:24.378006+0000","last_undegraded":"2024-05-27T09:44:24.378006+0000","last_fullsized":"2024-05-27T09:44:24.378006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.388761+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:44:24.388761+0000","last_peered":"2024-05-27T09:44:24.388761+0000","last_clean":"2024-05-27T09:44:24.388761+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:44:24.388761+0000","last_undegraded":"2024-05-27T09:44:24.388761+0000","last_fullsized":"2024-05-27T09:44:24.388761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514147+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:44:24.514147+0000","last_peered":"2024-05-27T09:44:24.514147+0000","last_clean":"2024-05-27T09:44:24.514147+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:44:24.514147+0000","last_undegraded":"2024-05-27T09:44:24.514147+0000","last_fullsized":"2024-05-27T09:44:24.514147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366644+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:44:24.366644+0000","last_peered":"2024-05-27T09:44:24.366644+0000","last_clean":"2024-05-27T09:44:24.366644+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:44:24.366644+0000","last_undegraded":"2024-05-27T09:44:24.366644+0000","last_fullsized":"2024-05-27T09:44:24.366644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363848+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:44:24.363848+0000","last_peered":"2024-05-27T09:44:24.363848+0000","last_clean":"2024-05-27T09:44:24.363848+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:44:24.363848+0000","last_undegraded":"2024-05-27T09:44:24.363848+0000","last_fullsized":"2024-05-27T09:44:24.363848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366820+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:44:24.366820+0000","last_peered":"2024-05-27T09:44:24.366820+0000","last_clean":"2024-05-27T09:44:24.366820+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:44:24.366820+0000","last_undegraded":"2024-05-27T09:44:24.366820+0000","last_fullsized":"2024-05-27T09:44:24.366820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368814+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:44:24.368814+0000","last_peered":"2024-05-27T09:44:24.368814+0000","last_clean":"2024-05-27T09:44:24.368814+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:44:24.368814+0000","last_undegraded":"2024-05-27T09:44:24.368814+0000","last_fullsized":"2024-05-27T09:44:24.368814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368826+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:44:24.368826+0000","last_peered":"2024-05-27T09:44:24.368826+0000","last_clean":"2024-05-27T09:44:24.368826+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:44:24.368826+0000","last_undegraded":"2024-05-27T09:44:24.368826+0000","last_fullsized":"2024-05-27T09:44:24.368826+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.377606+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:44:24.377606+0000","last_peered":"2024-05-27T09:44:24.377606+0000","last_clean":"2024-05-27T09:44:24.377606+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:44:24.377606+0000","last_undegraded":"2024-05-27T09:44:24.377606+0000","last_fullsized":"2024-05-27T09:44:24.377606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514211+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:44:24.514211+0000","last_peered":"2024-05-27T09:44:24.514211+0000","last_clean":"2024-05-27T09:44:24.514211+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:44:24.514211+0000","last_undegraded":"2024-05-27T09:44:24.514211+0000","last_fullsized":"2024-05-27T09:44:24.514211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:46.386831+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:44:46.386831+0000","last_peered":"2024-05-27T09:44:46.386831+0000","last_clean":"2024-05-27T09:44:46.386831+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:44:46.386831+0000","last_undegraded":"2024-05-27T09:44:46.386831+0000","last_fullsized":"2024-05-27T09:44:46.386831+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.516850+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:44:24.516850+0000","last_peered":"2024-05-27T09:44:24.516850+0000","last_clean":"2024-05-27T09:44:24.516850+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:44:24.516850+0000","last_undegraded":"2024-05-27T09:44:24.516850+0000","last_fullsized":"2024-05-27T09:44:24.516850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535290+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:44:24.535290+0000","last_peered":"2024-05-27T09:44:24.535290+0000","last_clean":"2024-05-27T09:44:24.535290+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:44:24.535290+0000","last_undegraded":"2024-05-27T09:44:24.535290+0000","last_fullsized":"2024-05-27T09:44:24.535290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369400+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:44:24.369400+0000","last_peered":"2024-05-27T09:44:24.369400+0000","last_clean":"2024-05-27T09:44:24.369400+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:44:24.369400+0000","last_undegraded":"2024-05-27T09:44:24.369400+0000","last_fullsized":"2024-05-27T09:44:24.369400+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361573+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:44:24.361573+0000","last_peered":"2024-05-27T09:44:24.361573+0000","last_clean":"2024-05-27T09:44:24.361573+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:44:24.361573+0000","last_undegraded":"2024-05-27T09:44:24.361573+0000","last_fullsized":"2024-05-27T09:44:24.361573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369505+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:44:24.369505+0000","last_peered":"2024-05-27T09:44:24.369505+0000","last_clean":"2024-05-27T09:44:24.369505+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:44:24.369505+0000","last_undegraded":"2024-05-27T09:44:24.369505+0000","last_fullsized":"2024-05-27T09:44:24.369505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366368+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:44:24.366368+0000","last_peered":"2024-05-27T09:44:24.366368+0000","last_clean":"2024-05-27T09:44:24.366368+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:44:24.366368+0000","last_undegraded":"2024-05-27T09:44:24.366368+0000","last_fullsized":"2024-05-27T09:44:24.366368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362129+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:44:24.362129+0000","last_peered":"2024-05-27T09:44:24.362129+0000","last_clean":"2024-05-27T09:44:24.362129+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:44:24.362129+0000","last_undegraded":"2024-05-27T09:44:24.362129+0000","last_fullsized":"2024-05-27T09:44:24.362129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:36.848345+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:44:36.848345+0000","last_peered":"2024-05-27T09:44:36.848345+0000","last_clean":"2024-05-27T09:44:36.848345+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:44:36.848345+0000","last_undegraded":"2024-05-27T09:44:36.848345+0000","last_fullsized":"2024-05-27T09:44:36.848345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372777+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:44:24.372777+0000","last_peered":"2024-05-27T09:44:24.372777+0000","last_clean":"2024-05-27T09:44:24.372777+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:44:24.372777+0000","last_undegraded":"2024-05-27T09:44:24.372777+0000","last_fullsized":"2024-05-27T09:44:24.372777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535442+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:44:24.535442+0000","last_peered":"2024-05-27T09:44:24.535442+0000","last_clean":"2024-05-27T09:44:24.535442+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:44:24.535442+0000","last_undegraded":"2024-05-27T09:44:24.535442+0000","last_fullsized":"2024-05-27T09:44:24.535442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.378797+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:44:24.378797+0000","last_peered":"2024-05-27T09:44:24.378797+0000","last_clean":"2024-05-27T09:44:24.378797+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:44:24.378797+0000","last_undegraded":"2024-05-27T09:44:24.378797+0000","last_fullsized":"2024-05-27T09:44:24.378797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363995+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:44:24.363995+0000","last_peered":"2024-05-27T09:44:24.363995+0000","last_clean":"2024-05-27T09:44:24.363995+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:44:24.363995+0000","last_undegraded":"2024-05-27T09:44:24.363995+0000","last_fullsized":"2024-05-27T09:44:24.363995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.365957+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:44:24.365957+0000","last_peered":"2024-05-27T09:44:24.365957+0000","last_clean":"2024-05-27T09:44:24.365957+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:44:24.365957+0000","last_undegraded":"2024-05-27T09:44:24.365957+0000","last_fullsized":"2024-05-27T09:44:24.365957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.370129+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:44:24.370129+0000","last_peered":"2024-05-27T09:44:24.370129+0000","last_clean":"2024-05-27T09:44:24.370129+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:44:24.370129+0000","last_undegraded":"2024-05-27T09:44:24.370129+0000","last_fullsized":"2024-05-27T09:44:24.370129+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364460+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:44:24.364460+0000","last_peered":"2024-05-27T09:44:24.364460+0000","last_clean":"2024-05-27T09:44:24.364460+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:44:24.364460+0000","last_undegraded":"2024-05-27T09:44:24.364460+0000","last_fullsized":"2024-05-27T09:44:24.364460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.376759+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:44:24.376759+0000","last_peered":"2024-05-27T09:44:24.376759+0000","last_clean":"2024-05-27T09:44:24.376759+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:44:24.376759+0000","last_undegraded":"2024-05-27T09:44:24.376759+0000","last_fullsized":"2024-05-27T09:44:24.376759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.371967+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:44:24.371967+0000","last_peered":"2024-05-27T09:44:24.371967+0000","last_clean":"2024-05-27T09:44:24.371967+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:44:24.371967+0000","last_undegraded":"2024-05-27T09:44:24.371967+0000","last_fullsized":"2024-05-27T09:44:24.371967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366088+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:44:24.366088+0000","last_peered":"2024-05-27T09:44:24.366088+0000","last_clean":"2024-05-27T09:44:24.366088+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:44:24.366088+0000","last_undegraded":"2024-05-27T09:44:24.366088+0000","last_fullsized":"2024-05-27T09:44:24.366088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369012+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:44:24.369012+0000","last_peered":"2024-05-27T09:44:24.369012+0000","last_clean":"2024-05-27T09:44:24.369012+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:44:24.369012+0000","last_undegraded":"2024-05-27T09:44:24.369012+0000","last_fullsized":"2024-05-27T09:44:24.369012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362072+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:44:24.362072+0000","last_peered":"2024-05-27T09:44:24.362072+0000","last_clean":"2024-05-27T09:44:24.362072+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:44:24.362072+0000","last_undegraded":"2024-05-27T09:44:24.362072+0000","last_fullsized":"2024-05-27T09:44:24.362072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369125+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:44:24.369125+0000","last_peered":"2024-05-27T09:44:24.369125+0000","last_clean":"2024-05-27T09:44:24.369125+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:44:24.369125+0000","last_undegraded":"2024-05-27T09:44:24.369125+0000","last_fullsized":"2024-05-27T09:44:24.369125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514321+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:44:24.514321+0000","last_peered":"2024-05-27T09:44:24.514321+0000","last_clean":"2024-05-27T09:44:24.514321+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:44:24.514321+0000","last_undegraded":"2024-05-27T09:44:24.514321+0000","last_fullsized":"2024-05-27T09:44:24.514321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368650+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:44:24.368650+0000","last_peered":"2024-05-27T09:44:24.368650+0000","last_clean":"2024-05-27T09:44:24.368650+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:44:24.368650+0000","last_undegraded":"2024-05-27T09:44:24.368650+0000","last_fullsized":"2024-05-27T09:44:24.368650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361855+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:44:24.361855+0000","last_peered":"2024-05-27T09:44:24.361855+0000","last_clean":"2024-05-27T09:44:24.361855+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:44:24.361855+0000","last_undegraded":"2024-05-27T09:44:24.361855+0000","last_fullsized":"2024-05-27T09:44:24.361855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369184+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:44:24.369184+0000","last_peered":"2024-05-27T09:44:24.369184+0000","last_clean":"2024-05-27T09:44:24.369184+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:44:24.369184+0000","last_undegraded":"2024-05-27T09:44:24.369184+0000","last_fullsized":"2024-05-27T09:44:24.369184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364593+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:44:24.364593+0000","last_peered":"2024-05-27T09:44:24.364593+0000","last_clean":"2024-05-27T09:44:24.364593+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:44:24.364593+0000","last_undegraded":"2024-05-27T09:44:24.364593+0000","last_fullsized":"2024-05-27T09:44:24.364593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361669+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:44:24.361669+0000","last_peered":"2024-05-27T09:44:24.361669+0000","last_clean":"2024-05-27T09:44:24.361669+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:44:24.361669+0000","last_undegraded":"2024-05-27T09:44:24.361669+0000","last_fullsized":"2024-05-27T09:44:24.361669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361650+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:44:24.361650+0000","last_peered":"2024-05-27T09:44:24.361650+0000","last_clean":"2024-05-27T09:44:24.361650+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:44:24.361650+0000","last_undegraded":"2024-05-27T09:44:24.361650+0000","last_fullsized":"2024-05-27T09:44:24.361650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.370809+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:44:24.370809+0000","last_peered":"2024-05-27T09:44:24.370809+0000","last_clean":"2024-05-27T09:44:24.370809+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:44:24.370809+0000","last_undegraded":"2024-05-27T09:44:24.370809+0000","last_fullsized":"2024-05-27T09:44:24.370809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361969+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:44:24.361969+0000","last_peered":"2024-05-27T09:44:24.361969+0000","last_clean":"2024-05-27T09:44:24.361969+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:44:24.361969+0000","last_undegraded":"2024-05-27T09:44:24.361969+0000","last_fullsized":"2024-05-27T09:44:24.361969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363897+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:44:24.363897+0000","last_peered":"2024-05-27T09:44:24.363897+0000","last_clean":"2024-05-27T09:44:24.363897+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:44:24.363897+0000","last_undegraded":"2024-05-27T09:44:24.363897+0000","last_fullsized":"2024-05-27T09:44:24.363897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362169+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:44:24.362169+0000","last_peered":"2024-05-27T09:44:24.362169+0000","last_clean":"2024-05-27T09:44:24.362169+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:44:24.362169+0000","last_undegraded":"2024-05-27T09:44:24.362169+0000","last_fullsized":"2024-05-27T09:44:24.362169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372648+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:44:24.372648+0000","last_peered":"2024-05-27T09:44:24.372648+0000","last_clean":"2024-05-27T09:44:24.372648+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:44:24.372648+0000","last_undegraded":"2024-05-27T09:44:24.372648+0000","last_fullsized":"2024-05-27T09:44:24.372648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514038+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:44:24.514038+0000","last_peered":"2024-05-27T09:44:24.514038+0000","last_clean":"2024-05-27T09:44:24.514038+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:44:24.514038+0000","last_undegraded":"2024-05-27T09:44:24.514038+0000","last_fullsized":"2024-05-27T09:44:24.514038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368738+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:44:24.368738+0000","last_peered":"2024-05-27T09:44:24.368738+0000","last_clean":"2024-05-27T09:44:24.368738+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:44:24.368738+0000","last_undegraded":"2024-05-27T09:44:24.368738+0000","last_fullsized":"2024-05-27T09:44:24.368738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364356+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:44:24.364356+0000","last_peered":"2024-05-27T09:44:24.364356+0000","last_clean":"2024-05-27T09:44:24.364356+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:44:24.364356+0000","last_undegraded":"2024-05-27T09:44:24.364356+0000","last_fullsized":"2024-05-27T09:44:24.364356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.362201+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:44:24.362201+0000","last_peered":"2024-05-27T09:44:24.362201+0000","last_clean":"2024-05-27T09:44:24.362201+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:44:24.362201+0000","last_undegraded":"2024-05-27T09:44:24.362201+0000","last_fullsized":"2024-05-27T09:44:24.362201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364077+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:44:24.364077+0000","last_peered":"2024-05-27T09:44:24.364077+0000","last_clean":"2024-05-27T09:44:24.364077+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:44:24.364077+0000","last_undegraded":"2024-05-27T09:44:24.364077+0000","last_fullsized":"2024-05-27T09:44:24.364077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68783,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":246,"num_read_kb":195,"num_write":166,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":206349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612638,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":440298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1597440,"data_stored":1096840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005094,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":440422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201327,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":440230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397556,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1507328,"data_stored":1032272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":439811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":966656,"data_stored":504386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":441082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":505736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":440122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":440639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1519616,"data_stored":1031565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:44:51.477 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-27T09:44:51.478 INFO:tasks.cephadm:Setting up client nodes... 2024-05-27T09:44:51.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-27T09:44:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:52.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:51 smithi071 ceph-mon[31451]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:44:52.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:51 smithi072 ceph-mon[35951]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:44:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:51 smithi122 ceph-mon[36436]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:44:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:52 smithi071 ceph-mon[31451]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-27T09:44:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:52 smithi072 ceph-mon[35951]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-27T09:44:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:52 smithi122 ceph-mon[36436]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-27T09:44:54.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 -- 172.21.15.71:0/3991976387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 msgr2=0x7f583c104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:54.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 --2- 172.21.15.71:0/3991976387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 0x7f583c104c00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5824009990 tx=0x7f5824009ca0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 -- 172.21.15.71:0/3991976387 shutdown_connections 2024-05-27T09:44:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 --2- 172.21.15.71:0/3991976387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c10c3a0 0x7f583c10e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 --2- 172.21.15.71:0/3991976387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 0x7f583c104c00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 --2- 172.21.15.71:0/3991976387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f583c109a40 0x7f583c10be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 -- 172.21.15.71:0/3991976387 >> 172.21.15.71:0/3991976387 conn(0x7f583c0fe000 msgr2=0x7f583c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.314+0000 7f5843600700 1 -- 172.21.15.71:0/3991976387 shutdown_connections 2024-05-27T09:44:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.315+0000 7f5843600700 1 -- 172.21.15.71:0/3991976387 wait complete. 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 Processor -- start 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 -- start start 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 0x7f583c19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c109a40 0x7f583c19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f583c10c3a0 0x7f583c1a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f583c111fd0 con 0x7f583c10c3a0 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f583c111e50 con 0x7f583c109a40 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.316+0000 7f5843600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f583c112150 con 0x7f583c1047f0 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c109a40 0x7f583c19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5840c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 0x7f583c19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5841600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f583c10c3a0 0x7f583c1a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c109a40 0x7f583c19d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:48974/0 (socket says 172.21.15.71:48974) 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 -- 172.21.15.71:0/1728428844 learned_addr learned my addr 172.21.15.71:0/1728428844 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 -- 172.21.15.71:0/1728428844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 msgr2=0x7f583c19cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 0x7f583c19cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 -- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f583c10c3a0 msgr2=0x7f583c1a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f583c10c3a0 0x7f583c1a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 -- 172.21.15.71:0/1728428844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583c1a4680 con 0x7f583c109a40 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5840c00700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 0x7f583c19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.317+0000 7f5833e00700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c109a40 0x7f583c19d060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f582c00e9a0 tx=0x7f582c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.318+0000 7f583a000700 1 -- 172.21.15.71:0/1728428844 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c00ca10 con 0x7f583c109a40 2024-05-27T09:44:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.318+0000 7f583a000700 1 -- 172.21.15.71:0/1728428844 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f582c00cbb0 con 0x7f583c109a40 2024-05-27T09:44:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.318+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583c1a4970 con 0x7f583c109a40 2024-05-27T09:44:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.318+0000 7f583a000700 1 -- 172.21.15.71:0/1728428844 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c018680 con 0x7f583c109a40 2024-05-27T09:44:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.318+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f583c1a4eb0 con 0x7f583c109a40 2024-05-27T09:44:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.319+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f583c0512b0 con 0x7f583c109a40 2024-05-27T09:44:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.321+0000 7f583a000700 1 -- 172.21.15.71:0/1728428844 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f582c04aae0 con 0x7f583c109a40 2024-05-27T09:44:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.323+0000 7f583a000700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f581c0b2910 0x7f581c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.323+0000 7f583a000700 1 -- 172.21.15.71:0/1728428844 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f582c0e2650 con 0x7f583c109a40 2024-05-27T09:44:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.323+0000 7f5840c00700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f581c0b2910 0x7f581c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.324+0000 7f5840c00700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f581c0b2910 0x7f581c0b4e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f582400b6c0 tx=0x7f582400b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:54.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.325+0000 7f583a000700 1 -- 172.21.15.71:0/1728428844 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f582c0aa1c0 con 0x7f583c109a40 2024-05-27T09:44:54.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.650+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f583c02e770 con 0x7f583c109a40 2024-05-27T09:44:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.661+0000 7f583a000700 1 -- 172.21.15.71:0/1728428844 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f582c0b2240 con 0x7f583c109a40 2024-05-27T09:44:54.662 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-05-27T09:44:54.662 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAWVlRmlgX1JhAAAVO6wP7DFWd2oAS2PtErcQ== 2024-05-27T09:44:54.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f581c0b2910 msgr2=0x7f581c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f581c0b2910 0x7f581c0b4e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f582400b6c0 tx=0x7f582400b720 comp rx=0 tx=0).stop 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c109a40 msgr2=0x7f583c19d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c109a40 0x7f583c19d060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f582c00e9a0 tx=0x7f582c00ecb0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 shutdown_connections 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f581c0b2910 0x7f581c0b4e20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f583c10c3a0 0x7f583c1a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f583c1047f0 0x7f583c19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 --2- 172.21.15.71:0/1728428844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c109a40 0x7f583c19d060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 >> 172.21.15.71:0/1728428844 conn(0x7f583c0fe000 msgr2=0x7f583c10a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 shutdown_connections 2024-05-27T09:44:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:54.664+0000 7f5843600700 1 -- 172.21.15.71:0/1728428844 wait complete. 2024-05-27T09:44:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:54 smithi071 ceph-mon[31451]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-05-27T09:44:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:54 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1728428844' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-27T09:44:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:54 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-27T09:44:55.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:54 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-27T09:44:55.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:54 smithi072 ceph-mon[35951]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-05-27T09:44:55.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:54 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1728428844' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-27T09:44:55.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:54 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-27T09:44:55.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:54 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-27T09:44:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:54 smithi122 ceph-mon[36436]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-05-27T09:44:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:54 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1728428844' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-27T09:44:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:54 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-27T09:44:55.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:54 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-27T09:44:55.621 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:44:55.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-27T09:44:55.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-27T09:44:55.761 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-27T09:44:55.762 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-27T09:44:55.762 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-05-27T09:44:56.249 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:44:57.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:56 smithi071 ceph-mon[31451]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:44:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:56 smithi072 ceph-mon[35951]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:44:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:56 smithi122 ceph-mon[36436]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:44:58.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 -- 172.21.15.71:0/2736930568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 msgr2=0x7f0864110d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:58.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 --2- 172.21.15.71:0/2736930568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 0x7f0864110d70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f085400b0a0 tx=0x7f085400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 -- 172.21.15.71:0/2736930568 shutdown_connections 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 --2- 172.21.15.71:0/2736930568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 0x7f0864117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 --2- 172.21.15.71:0/2736930568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 0x7f0864110d70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 --2- 172.21.15.71:0/2736930568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f086410a980 0x7f086410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 -- 172.21.15.71:0/2736930568 >> 172.21.15.71:0/2736930568 conn(0x7f0864077c70 msgr2=0x7f08640780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 -- 172.21.15.71:0/2736930568 shutdown_connections 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.600+0000 7f0869800700 1 -- 172.21.15.71:0/2736930568 wait complete. 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.601+0000 7f0869800700 1 Processor -- start 2024-05-27T09:44:58.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.601+0000 7f0869800700 1 -- start start 2024-05-27T09:44:58.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0869800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f086410a980 0x7f08641a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:58.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0869800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 0x7f08641a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:58.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0869800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 0x7f08641a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:58.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0869800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f086411aad0 con 0x7f0864110960 2024-05-27T09:44:58.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0869800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f086411a950 con 0x7f086410b2d0 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0869800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f086411ac50 con 0x7f086410a980 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 0x7f08641a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 0x7f08641a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:48982/0 (socket says 172.21.15.71:48982) 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0863400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 0x7f08641a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 -- 172.21.15.71:0/1222756030 learned_addr learned my addr 172.21.15.71:0/1222756030 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f0862a00700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f086410a980 0x7f08641a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 -- 172.21.15.71:0/1222756030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f086410a980 msgr2=0x7f08641a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f086410a980 0x7f08641a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 -- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 msgr2=0x7f08641a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 0x7f08641a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.602+0000 7f085a000700 1 -- 172.21.15.71:0/1222756030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08641a6410 con 0x7f086410b2d0 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.603+0000 7f085a000700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 0x7f08641a1ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f084c00e9f0 tx=0x7f084c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.603+0000 7f085be00700 1 -- 172.21.15.71:0/1222756030 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c004a30 con 0x7f086410b2d0 2024-05-27T09:44:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.603+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08641a6700 con 0x7f086410b2d0 2024-05-27T09:44:58.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.603+0000 7f085be00700 1 -- 172.21.15.71:0/1222756030 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f084c00cc70 con 0x7f086410b2d0 2024-05-27T09:44:58.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.603+0000 7f085be00700 1 -- 172.21.15.71:0/1222756030 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c005530 con 0x7f086410b2d0 2024-05-27T09:44:58.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.603+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08641ae020 con 0x7f086410b2d0 2024-05-27T09:44:58.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.604+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08640512b0 con 0x7f086410b2d0 2024-05-27T09:44:58.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.606+0000 7f085be00700 1 -- 172.21.15.71:0/1222756030 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f084c004bd0 con 0x7f086410b2d0 2024-05-27T09:44:58.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.608+0000 7f085be00700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08480b2910 0x7f08480b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:44:58.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.608+0000 7f085be00700 1 -- 172.21.15.71:0/1222756030 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f084c0e25b0 con 0x7f086410b2d0 2024-05-27T09:44:58.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.608+0000 7f0862a00700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08480b2910 0x7f08480b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:44:58.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.609+0000 7f0862a00700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08480b2910 0x7f08480b4e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f085400b780 tx=0x7f0854006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:44:58.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.610+0000 7f085be00700 1 -- 172.21.15.71:0/1222756030 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f084c00ce20 con 0x7f086410b2d0 2024-05-27T09:44:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.900+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f08641a28a0 con 0x7f086410b2d0 2024-05-27T09:44:58.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:58 smithi071 ceph-mon[31451]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:44:58.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.906+0000 7f085be00700 1 -- 172.21.15.71:0/1222756030 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288646 (secure 0 0 0) 0x7f084c0aa120 con 0x7f086410b2d0 2024-05-27T09:44:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:44:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08480b2910 msgr2=0x7f08480b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08480b2910 0x7f08480b4e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f085400b780 tx=0x7f0854006210 comp rx=0 tx=0).stop 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 msgr2=0x7f08641a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 0x7f08641a1ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f084c00e9f0 tx=0x7f084c00ed00 comp rx=0 tx=0).stop 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 shutdown_connections 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08480b2910 0x7f08480b4e20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0864110960 0x7f08641a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f086410a980 0x7f08641a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 --2- 172.21.15.71:0/1222756030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086410b2d0 0x7f08641a1ae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 >> 172.21.15.71:0/1222756030 conn(0x7f0864077c70 msgr2=0x7f086407bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 shutdown_connections 2024-05-27T09:44:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:44:58.914+0000 7f0869800700 1 -- 172.21.15.71:0/1222756030 wait complete. 2024-05-27T09:44:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:58 smithi072 ceph-mon[35951]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:44:59.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:58 smithi122 ceph-mon[36436]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:44:59.805 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1797397372},{"type":"v1","addr":"172.21.15.71:6801","nonce":1797397372}]},"active_addr":"172.21.15.71:6801/1797397372","active_change":"2024-05-27T09:35:22.974897+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.71:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":4081778329}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1381797399}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":193022273}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":4261728686}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1067333696}]}]} 2024-05-27T09:44:59.812 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-27T09:44:59.812 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-27T09:44:59.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:45:00.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:44:59 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1222756030' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-27T09:45:00.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:44:59 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1222756030' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-27T09:45:00.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:44:59 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1222756030' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-27T09:45:00.291 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:01.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:00 smithi071 ceph-mon[31451]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:45:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:00 smithi122 ceph-mon[36436]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:45:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:00 smithi072 ceph-mon[35951]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:45:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 -- 172.21.15.71:0/4170377461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a010b2d0 msgr2=0x7f07a0117800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 --2- 172.21.15.71:0/4170377461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a010b2d0 0x7f07a0117800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0798009f90 tx=0x7f079800b330 comp rx=0 tx=0).stop 2024-05-27T09:45:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 -- 172.21.15.71:0/4170377461 shutdown_connections 2024-05-27T09:45:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 --2- 172.21.15.71:0/4170377461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a010b2d0 0x7f07a0117800 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 --2- 172.21.15.71:0/4170377461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a0110960 0x7f07a0110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 --2- 172.21.15.71:0/4170377461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a010a980 0x7f07a010ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 -- 172.21.15.71:0/4170377461 >> 172.21.15.71:0/4170377461 conn(0x7f07a0077c70 msgr2=0x7f07a00780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 -- 172.21.15.71:0/4170377461 shutdown_connections 2024-05-27T09:45:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.559+0000 7f07a4c00700 1 -- 172.21.15.71:0/4170377461 wait complete. 2024-05-27T09:45:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.560+0000 7f07a4c00700 1 Processor -- start 2024-05-27T09:45:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f07a4c00700 1 -- start start 2024-05-27T09:45:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f07a4c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a010a980 0x7f07a01a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f07a4c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a010b2d0 0x7f07a01a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f07a4c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a0110960 0x7f07a01a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f07a4c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07a011aad0 con 0x7f07a010a980 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f07a4c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f07a011a950 con 0x7f07a010b2d0 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f07a4c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f07a011ac50 con 0x7f07a0110960 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f079de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a010a980 0x7f07a01a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f079de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a010a980 0x7f07a01a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47956/0 (socket says 172.21.15.71:47956) 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f079de00700 1 -- 172.21.15.71:0/3923438994 learned_addr learned my addr 172.21.15.71:0/3923438994 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.561+0000 7f079d400700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a010b2d0 0x7f07a01a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079e800700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a0110960 0x7f07a01a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079de00700 1 -- 172.21.15.71:0/3923438994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a0110960 msgr2=0x7f07a01a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079de00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a0110960 0x7f07a01a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079de00700 1 -- 172.21.15.71:0/3923438994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a010b2d0 msgr2=0x7f07a01a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079de00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a010b2d0 0x7f07a01a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079de00700 1 -- 172.21.15.71:0/3923438994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a01a62b0 con 0x7f07a010a980 2024-05-27T09:45:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079d400700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a010b2d0 0x7f07a01a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.562+0000 7f079de00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a010a980 0x7f07a01a13e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f079000e9f0 tx=0x7f079000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.563+0000 7f0796a00700 1 -- 172.21.15.71:0/3923438994 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079000c9c0 con 0x7f07a010a980 2024-05-27T09:45:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.563+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a01a65a0 con 0x7f07a010a980 2024-05-27T09:45:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.563+0000 7f0796a00700 1 -- 172.21.15.71:0/3923438994 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f079000cb60 con 0x7f07a010a980 2024-05-27T09:45:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.563+0000 7f0796a00700 1 -- 172.21.15.71:0/3923438994 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790018680 con 0x7f07a010a980 2024-05-27T09:45:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.563+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a01adec0 con 0x7f07a010a980 2024-05-27T09:45:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.564+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a010c070 con 0x7f07a010a980 2024-05-27T09:45:02.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.568+0000 7f0796a00700 1 -- 172.21.15.71:0/3923438994 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0790010430 con 0x7f07a010a980 2024-05-27T09:45:02.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.569+0000 7f0796a00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f07840b2910 0x7f07840b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.570+0000 7f0796a00700 1 -- 172.21.15.71:0/3923438994 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f07900e2520 con 0x7f07a010a980 2024-05-27T09:45:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.570+0000 7f079d400700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f07840b2910 0x7f07840b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.570+0000 7f079d400700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f07840b2910 0x7f07840b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f07a01098d0 tx=0x7f078c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:02.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.575+0000 7f0796a00700 1 -- 172.21.15.71:0/3923438994 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f07900aa090 con 0x7f07a010a980 2024-05-27T09:45:02.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.809+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07a002e5e0 con 0x7f07a010a980 2024-05-27T09:45:02.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.811+0000 7f0796a00700 1 -- 172.21.15.71:0/3923438994 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22603 (secure 0 0 0) 0x7f07900b2110 con 0x7f07a010a980 2024-05-27T09:45:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:45:02.814 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":83,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:44:24.357115+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:45:02.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f07840b2910 msgr2=0x7f07840b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:02.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f07840b2910 0x7f07840b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f07a01098d0 tx=0x7f078c009260 comp rx=0 tx=0).stop 2024-05-27T09:45:02.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a010a980 msgr2=0x7f07a01a13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:02.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a010a980 0x7f07a01a13e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f079000e9f0 tx=0x7f079000ed00 comp rx=0 tx=0).stop 2024-05-27T09:45:02.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 shutdown_connections 2024-05-27T09:45:02.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07a0110960 0x7f07a01a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f07840b2910 0x7f07840b4e20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:02 smithi071 ceph-mon[31451]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:02.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07a010a980 0x7f07a01a13e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 --2- 172.21.15.71:0/3923438994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a010b2d0 0x7f07a01a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:02.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.814+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 >> 172.21.15.71:0/3923438994 conn(0x7f07a0077c70 msgr2=0x7f07a007b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:02.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.815+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 shutdown_connections 2024-05-27T09:45:02.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:02.815+0000 7f07a4c00700 1 -- 172.21.15.71:0/3923438994 wait complete. 2024-05-27T09:45:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:02 smithi122 ceph-mon[36436]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:03.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:02 smithi072 ceph-mon[35951]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:03.704 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-27T09:45:03.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:45:04.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:03 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3923438994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:45:04.142 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:03 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3923438994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:45:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:03 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3923438994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:45:04.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:04 smithi071 ceph-mon[31451]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:04 smithi122 ceph-mon[36436]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:04 smithi072 ceph-mon[35951]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:06.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.492+0000 7fca9b000700 1 -- 172.21.15.71:0/4073880278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 msgr2=0x7fca94117610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:06.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.492+0000 7fca9b000700 1 --2- 172.21.15.71:0/4073880278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 0x7fca94117610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009f90 tx=0x7fca8c00b330 comp rx=0 tx=0).stop 2024-05-27T09:45:06.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.492+0000 7fca9b000700 1 -- 172.21.15.71:0/4073880278 shutdown_connections 2024-05-27T09:45:06.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.492+0000 7fca9b000700 1 --2- 172.21.15.71:0/4073880278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 0x7fca94117610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.492+0000 7fca9b000700 1 --2- 172.21.15.71:0/4073880278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9410f6b0 0x7fca9410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.492+0000 7fca9b000700 1 --2- 172.21.15.71:0/4073880278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca9410a7b0 0x7fca9410abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.492+0000 7fca9b000700 1 -- 172.21.15.71:0/4073880278 >> 172.21.15.71:0/4073880278 conn(0x7fca94076af0 msgr2=0x7fca94076f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:06.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.493+0000 7fca9b000700 1 -- 172.21.15.71:0/4073880278 shutdown_connections 2024-05-27T09:45:06.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.493+0000 7fca9b000700 1 -- 172.21.15.71:0/4073880278 wait complete. 2024-05-27T09:45:06.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 Processor -- start 2024-05-27T09:45:06.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 -- start start 2024-05-27T09:45:06.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9410a7b0 0x7fca941a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:06.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 0x7fca941a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:06.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca9410f6b0 0x7fca941a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:06.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca9411a8e0 con 0x7fca9410a7b0 2024-05-27T09:45:06.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca9411a760 con 0x7fca9410f6b0 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.494+0000 7fca9b000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca9411aa60 con 0x7fca9410b100 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca99200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 0x7fca941a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca99c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9410a7b0 0x7fca941a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca99200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 0x7fca941a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58026/0 (socket says 172.21.15.71:58026) 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca9a600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca9410f6b0 0x7fca941a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca99200700 1 -- 172.21.15.71:0/2141769105 learned_addr learned my addr 172.21.15.71:0/2141769105 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca99c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9410a7b0 0x7fca941a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55282/0 (socket says 172.21.15.71:55282) 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca9a600700 1 -- 172.21.15.71:0/2141769105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 msgr2=0x7fca941a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca9a600700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 0x7fca941a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca9a600700 1 -- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9410a7b0 msgr2=0x7fca941a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca9a600700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9410a7b0 0x7fca941a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.495+0000 7fca9a600700 1 -- 172.21.15.71:0/2141769105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca941a6090 con 0x7fca9410f6b0 2024-05-27T09:45:06.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.496+0000 7fca9a600700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca9410f6b0 0x7fca941a59f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00b6c0 tx=0x7fca8c00cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:06.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.496+0000 7fca92000700 1 -- 172.21.15.71:0/2141769105 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c021070 con 0x7fca9410f6b0 2024-05-27T09:45:06.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.496+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca941a6320 con 0x7fca9410f6b0 2024-05-27T09:45:06.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.496+0000 7fca92000700 1 -- 172.21.15.71:0/2141769105 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca8c007ac0 con 0x7fca9410f6b0 2024-05-27T09:45:06.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.496+0000 7fca92000700 1 -- 172.21.15.71:0/2141769105 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c005040 con 0x7fca9410f6b0 2024-05-27T09:45:06.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.496+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca941adca0 con 0x7fca9410f6b0 2024-05-27T09:45:06.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.497+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9410bea0 con 0x7fca9410f6b0 2024-05-27T09:45:06.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.500+0000 7fca92000700 1 -- 172.21.15.71:0/2141769105 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fca8c024070 con 0x7fca9410f6b0 2024-05-27T09:45:06.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.501+0000 7fca92000700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fca7c0b2990 0x7fca7c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:06.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.502+0000 7fca92000700 1 -- 172.21.15.71:0/2141769105 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fca8c00f020 con 0x7fca9410f6b0 2024-05-27T09:45:06.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.502+0000 7fca99c00700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fca7c0b2990 0x7fca7c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.503+0000 7fca99c00700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fca7c0b2990 0x7fca7c0b4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca88005fd0 tx=0x7fca88009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.504+0000 7fca92000700 1 -- 172.21.15.71:0/2141769105 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fca8c02b020 con 0x7fca9410f6b0 2024-05-27T09:45:06.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.737+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca9402e5e0 con 0x7fca9410f6b0 2024-05-27T09:45:06.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.739+0000 7fca92000700 1 -- 172.21.15.71:0/2141769105 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22603 (secure 0 0 0) 0x7fca8c0ab5e0 con 0x7fca9410f6b0 2024-05-27T09:45:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:45:06.741 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":83,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:44:24.357115+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:45:06.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fca7c0b2990 msgr2=0x7fca7c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:06.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fca7c0b2990 0x7fca7c0b4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca88005fd0 tx=0x7fca88009310 comp rx=0 tx=0).stop 2024-05-27T09:45:06.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca9410f6b0 msgr2=0x7fca941a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:06.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca9410f6b0 0x7fca941a59f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00b6c0 tx=0x7fca8c00cc30 comp rx=0 tx=0).stop 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 shutdown_connections 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca9410f6b0 0x7fca941a59f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fca7c0b2990 0x7fca7c0b4ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9410a7b0 0x7fca941a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 --2- 172.21.15.71:0/2141769105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca9410b100 0x7fca941a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.742+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 >> 172.21.15.71:0/2141769105 conn(0x7fca94076af0 msgr2=0x7fca94108850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.743+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 shutdown_connections 2024-05-27T09:45:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:06.743+0000 7fca9b000700 1 -- 172.21.15.71:0/2141769105 wait complete. 2024-05-27T09:45:07.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:06 smithi071 ceph-mon[31451]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:07.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:06 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2141769105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:45:07.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:06 smithi122 ceph-mon[36436]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:07.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:06 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2141769105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:45:07.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:06 smithi072 ceph-mon[35951]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:07.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:06 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2141769105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:45:07.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-27T09:45:07.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-27T09:45:07.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-27T09:45:07.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-27T09:45:07.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-27T09:45:07.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-27T09:45:07.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-27T09:45:07.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-27T09:45:07.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-27T09:45:07.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-27T09:45:07.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-27T09:45:07.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-27T09:45:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:08.942 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:09.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:08 smithi071 ceph-mon[31451]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:09.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:08 smithi122 ceph-mon[36436]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:09.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:08 smithi072 ceph-mon[35951]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:09.534 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:09.535 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:09.548 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:09.549 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:11.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:10 smithi071 ceph-mon[31451]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:11.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:10 smithi122 ceph-mon[36436]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:11.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:10 smithi072 ceph-mon[35951]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:12.982 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:12 smithi071 ceph-mon[31451]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:13.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:12 smithi122 ceph-mon[36436]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:13.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:12 smithi072 ceph-mon[35951]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:13.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 -- 172.21.15.71:0/3498988426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6edc105560 msgr2=0x7f6edc105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:13.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 --2- 172.21.15.71:0/3498988426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6edc105560 0x7f6edc105970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009990 tx=0x7f6ed0009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 -- 172.21.15.71:0/3498988426 shutdown_connections 2024-05-27T09:45:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 --2- 172.21.15.71:0/3498988426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6edc10e940 0x7f6edc110e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 --2- 172.21.15.71:0/3498988426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6edc105560 0x7f6edc105970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 --2- 172.21.15.71:0/3498988426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6edc105eb0 0x7f6edc10e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 -- 172.21.15.71:0/3498988426 >> 172.21.15.71:0/3498988426 conn(0x7f6edc078df0 msgr2=0x7f6edc079230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 -- 172.21.15.71:0/3498988426 shutdown_connections 2024-05-27T09:45:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.781+0000 7f6ee4600700 1 -- 172.21.15.71:0/3498988426 wait complete. 2024-05-27T09:45:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.782+0000 7f6ee4600700 1 Processor -- start 2024-05-27T09:45:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.782+0000 7f6ee4600700 1 -- start start 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee4600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6edc105560 0x7f6edc19d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee4600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6edc105eb0 0x7f6edc19d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee4600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6edc10e940 0x7f6edc1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee4600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc1144b0 con 0x7f6edc105eb0 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee4600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc114330 con 0x7f6edc10e940 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee4600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc114630 con 0x7f6edc105560 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee1c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6edc105560 0x7f6edc19d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee1c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6edc105560 0x7f6edc19d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58044/0 (socket says 172.21.15.71:58044) 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee1c00700 1 -- 172.21.15.71:0/2814892744 learned_addr learned my addr 172.21.15.71:0/2814892744 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee1200700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6edc105eb0 0x7f6edc19d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.783+0000 7f6ee2600700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6edc10e940 0x7f6edc1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6ee1c00700 1 -- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6edc10e940 msgr2=0x7f6edc1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6ee1c00700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6edc10e940 0x7f6edc1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6ee1c00700 1 -- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6edc105eb0 msgr2=0x7f6edc19d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6ee1c00700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6edc105eb0 0x7f6edc19d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6ee1c00700 1 -- 172.21.15.71:0/2814892744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc1a1f10 con 0x7f6edc105560 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6ee1c00700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6edc105560 0x7f6edc19d040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000c00 tx=0x7f6ed00057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0027070 con 0x7f6edc105560 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ed0022470 con 0x7f6edc105560 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6edc1a21a0 con 0x7f6edc105560 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.784+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0017650 con 0x7f6edc105560 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.785+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6edc1a2680 con 0x7f6edc105560 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.785+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6edc104670 con 0x7f6edc105560 2024-05-27T09:45:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.788+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6ed002a070 con 0x7f6edc105560 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.790+0000 7f6eda000700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ec40b2910 0x7f6ec40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.790+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f6ed00e34d0 con 0x7f6edc105560 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.790+0000 7f6ee1200700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ec40b2910 0x7f6ec40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.790+0000 7f6eda000700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] conn(0x7f6ec40bc4a0 0x7f6ec40be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.790+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 --> [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ed0012ec0 con 0x7f6ec40bc4a0 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.790+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f6ed00e3880 con 0x7f6edc105560 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.791+0000 7f6ee2600700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] conn(0x7f6ec40bc4a0 0x7f6ec40be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.791+0000 7f6ee1200700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ec40b2910 0x7f6ec40b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6edc104e90 tx=0x7f6ec80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.791+0000 7f6ee2600700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] conn(0x7f6ec40bc4a0 0x7f6ec40be990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.792+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== osd.1 v2:172.21.15.72:6800/936392023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ed0012ec0 con 0x7f6ec40bc4a0 2024-05-27T09:45:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.810+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 --> [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6edc0761f0 con 0x7f6ec40bc4a0 2024-05-27T09:45:13.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6eda000700 1 -- 172.21.15.71:0/2814892744 <== osd.1 v2:172.21.15.72:6800/936392023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6edc0761f0 con 0x7f6ec40bc4a0 2024-05-27T09:45:13.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] conn(0x7f6ec40bc4a0 msgr2=0x7f6ec40be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:13.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6ee4600700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] conn(0x7f6ec40bc4a0 0x7f6ec40be990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ec40b2910 msgr2=0x7f6ec40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6ee4600700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ec40b2910 0x7f6ec40b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6edc104e90 tx=0x7f6ec80073d0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6edc105560 msgr2=0x7f6edc19d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6ee4600700 1 --2- 172.21.15.71:0/2814892744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6edc105560 0x7f6edc19d040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000c00 tx=0x7f6ed00057c0 comp rx=0 tx=0).stop 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.811+0000 7f6ee2600700 1 -- 172.21.15.71:0/2814892744 reap_dead start 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.812+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 shutdown_connections 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.812+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 >> 172.21.15.71:0/2814892744 conn(0x7f6edc078df0 msgr2=0x7f6edc103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.812+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 shutdown_connections 2024-05-27T09:45:13.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:13.812+0000 7f6ee4600700 1 -- 172.21.15.71:0/2814892744 wait complete. 2024-05-27T09:45:15.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:14 smithi071 ceph-mon[31451]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:15.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:14 smithi122 ceph-mon[36436]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:14 smithi072 ceph-mon[35951]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.941+0000 7f9ced400700 1 -- 172.21.15.71:0/1641407729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 msgr2=0x7f9ce8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.941+0000 7f9ced400700 1 --2- 172.21.15.71:0/1641407729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 0x7f9ce8114c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40098f0 tx=0x7f9cd4009c00 comp rx=0 tx=0).stop 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.942+0000 7f9ced400700 1 -- 172.21.15.71:0/1641407729 shutdown_connections 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.942+0000 7f9ced400700 1 --2- 172.21.15.71:0/1641407729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce8115170 0x7f9ce8117590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.942+0000 7f9ced400700 1 --2- 172.21.15.71:0/1641407729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce8075b50 0x7f9ce8075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.942+0000 7f9ced400700 1 --2- 172.21.15.71:0/1641407729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 0x7f9ce8114c30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.942+0000 7f9ced400700 1 -- 172.21.15.71:0/1641407729 >> 172.21.15.71:0/1641407729 conn(0x7f9ce8079d00 msgr2=0x7f9ce807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.942+0000 7f9ced400700 1 -- 172.21.15.71:0/1641407729 shutdown_connections 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.942+0000 7f9ced400700 1 -- 172.21.15.71:0/1641407729 wait complete. 2024-05-27T09:45:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.943+0000 7f9ced400700 1 Processor -- start 2024-05-27T09:45:16.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.943+0000 7f9ced400700 1 -- start start 2024-05-27T09:45:16.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ced400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce8075b50 0x7f9ce81a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:16.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ced400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 0x7f9ce81a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:16.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ced400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce8115170 0x7f9ce81a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:16.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ced400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce811a8a0 con 0x7f9ce8075b50 2024-05-27T09:45:16.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ced400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce811a720 con 0x7f9ce80764a0 2024-05-27T09:45:16.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ced400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce811aa20 con 0x7f9ce8115170 2024-05-27T09:45:16.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ce7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce8075b50 0x7f9ce81a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ce7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 0x7f9ce81a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ceca00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce8115170 0x7f9ce81a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ce7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 0x7f9ce81a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:33130/0 (socket says 172.21.15.71:33130) 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ceca00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce8115170 0x7f9ce81a5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36014/0 (socket says 172.21.15.71:36014) 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ce7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce8075b50 0x7f9ce81a1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51636/0 (socket says 172.21.15.71:51636) 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.944+0000 7f9ce7400700 1 -- 172.21.15.71:0/1412285797 learned_addr learned my addr 172.21.15.71:0/1412285797 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce7400700 1 -- 172.21.15.71:0/1412285797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce8115170 msgr2=0x7f9ce81a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce7400700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce8115170 0x7f9ce81a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce7400700 1 -- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce8075b50 msgr2=0x7f9ce81a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce7400700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce8075b50 0x7f9ce81a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:16.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce7400700 1 -- 172.21.15.71:0/1412285797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce81a6200 con 0x7f9ce80764a0 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce7e00700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce8075b50 0x7f9ce81a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce7400700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 0x7f9ce81a18d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f990 tx=0x7f9cd400f9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4027070 con 0x7f9ce80764a0 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd4005570 con 0x7f9ce80764a0 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4004930 con 0x7f9ce80764a0 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.945+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce81a6490 con 0x7f9ce80764a0 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.946+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce81a6920 con 0x7f9ce80764a0 2024-05-27T09:45:16.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.947+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ce8063ec0 con 0x7f9ce80764a0 2024-05-27T09:45:16.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.949+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9cd402a070 con 0x7f9ce80764a0 2024-05-27T09:45:16.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.951+0000 7f9ce4c00700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9ccc0b2910 0x7f9ccc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:16.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.951+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f9cd40e37d0 con 0x7f9ce80764a0 2024-05-27T09:45:16.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.951+0000 7f9ce7e00700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9ccc0b2910 0x7f9ccc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.951+0000 7f9ce4c00700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] conn(0x7f9ccc0bc4a0 0x7f9ccc0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.951+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 --> [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cd401ce50 con 0x7f9ccc0bc4a0 2024-05-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.951+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9cd40e3b80 con 0x7f9ce80764a0 2024-05-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.952+0000 7f9ceca00700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] conn(0x7f9ccc0bc4a0 0x7f9ccc0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.952+0000 7f9ce7e00700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9ccc0b2910 0x7f9ccc0b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009480 tx=0x7f9cd800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.952+0000 7f9ceca00700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] conn(0x7f9ccc0bc4a0 0x7f9ccc0be990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:16.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.953+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== osd.4 v2:172.21.15.72:6808/3529630414 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cd401ce50 con 0x7f9ccc0bc4a0 2024-05-27T09:45:16.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.971+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 --> [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ce8064340 con 0x7f9ccc0bc4a0 2024-05-27T09:45:16.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ce4c00700 1 -- 172.21.15.71:0/1412285797 <== osd.4 v2:172.21.15.72:6808/3529630414 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9ce8064340 con 0x7f9ccc0bc4a0 2024-05-27T09:45:16.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] conn(0x7f9ccc0bc4a0 msgr2=0x7f9ccc0be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:16.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ced400700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] conn(0x7f9ccc0bc4a0 0x7f9ccc0be990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9ccc0b2910 msgr2=0x7f9ccc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ced400700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9ccc0b2910 0x7f9ccc0b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009480 tx=0x7f9cd800b040 comp rx=0 tx=0).stop 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 msgr2=0x7f9ce81a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ced400700 1 --2- 172.21.15.71:0/1412285797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ce80764a0 0x7f9ce81a18d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f990 tx=0x7f9cd400f9c0 comp rx=0 tx=0).stop 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.972+0000 7f9ceca00700 1 -- 172.21.15.71:0/1412285797 reap_dead start 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.973+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 shutdown_connections 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.973+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 >> 172.21.15.71:0/1412285797 conn(0x7f9ce8079d00 msgr2=0x7f9ce8100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.973+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 shutdown_connections 2024-05-27T09:45:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:16.973+0000 7f9ced400700 1 -- 172.21.15.71:0/1412285797 wait complete. 2024-05-27T09:45:17.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:16 smithi122 ceph-mon[36436]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:17.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:16 smithi071 ceph-mon[31451]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:17.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:16 smithi072 ceph-mon[35951]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:19.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:18 smithi071 ceph-mon[31451]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:19.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:18 smithi122 ceph-mon[36436]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:19.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:18 smithi072 ceph-mon[35951]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:19.535 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:19.539 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:20.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 -- 172.21.15.71:0/2619433384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 msgr2=0x7f9e2410b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:20.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 --2- 172.21.15.71:0/2619433384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 0x7f9e2410b350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009990 tx=0x7f9e10009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 -- 172.21.15.71:0/2619433384 shutdown_connections 2024-05-27T09:45:20.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 --2- 172.21.15.71:0/2619433384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e2410b890 0x7f9e241131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 --2- 172.21.15.71:0/2619433384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e24106610 0x7f9e24106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 --2- 172.21.15.71:0/2619433384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 0x7f9e2410b350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 -- 172.21.15.71:0/2619433384 >> 172.21.15.71:0/2619433384 conn(0x7f9e24102020 msgr2=0x7f9e24104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:20.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 -- 172.21.15.71:0/2619433384 shutdown_connections 2024-05-27T09:45:20.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.182+0000 7f9e23e00700 1 -- 172.21.15.71:0/2619433384 wait complete. 2024-05-27T09:45:20.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 Processor -- start 2024-05-27T09:45:20.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 -- start start 2024-05-27T09:45:20.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e24106610 0x7f9e2419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:20.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 0x7f9e2419d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:20.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e2410b890 0x7f9e241a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e241164a0 con 0x7f9e2410b890 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24116320 con 0x7f9e2410af40 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e23e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24116620 con 0x7f9e24106610 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.184+0000 7f9e22a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e24106610 0x7f9e2419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e24106610 0x7f9e2419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36026/0 (socket says 172.21.15.71:36026) 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 -- 172.21.15.71:0/3333140005 learned_addr learned my addr 172.21.15.71:0/3333140005 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22000700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 0x7f9e2419d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e23400700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e2410b890 0x7f9e241a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 -- 172.21.15.71:0/3333140005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 msgr2=0x7f9e2419d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 0x7f9e2419d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 -- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e2410b890 msgr2=0x7f9e241a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e2410b890 0x7f9e241a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 -- 172.21.15.71:0/3333140005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e241a1ca0 con 0x7f9e24106610 2024-05-27T09:45:20.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22000700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e2410af40 0x7f9e2419d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:20.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.185+0000 7f9e22a00700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e24106610 0x7f9e2419cdd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400e9a0 tx=0x7f9e1400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:20.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.186+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400ca10 con 0x7f9e24106610 2024-05-27T09:45:20.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.186+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e1400cbb0 con 0x7f9e24106610 2024-05-27T09:45:20.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.186+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e241a1f90 con 0x7f9e24106610 2024-05-27T09:45:20.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.186+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14018680 con 0x7f9e24106610 2024-05-27T09:45:20.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.186+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e241a98b0 con 0x7f9e24106610 2024-05-27T09:45:20.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.187+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e24063f00 con 0x7f9e24106610 2024-05-27T09:45:20.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.190+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9e14010430 con 0x7f9e24106610 2024-05-27T09:45:20.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.191+0000 7f9e1b400700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9e080b2910 0x7f9e080b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:20.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.191+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f9e140e2b30 con 0x7f9e24106610 2024-05-27T09:45:20.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.191+0000 7f9e22000700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9e080b2910 0x7f9e080b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:20.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.192+0000 7f9e1b400700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] conn(0x7f9e080bc4a0 0x7f9e080be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:20.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.192+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 --> [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e14016ec0 con 0x7f9e080bc4a0 2024-05-27T09:45:20.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.192+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9e140e2ee0 con 0x7f9e24106610 2024-05-27T09:45:20.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.192+0000 7f9e23400700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] conn(0x7f9e080bc4a0 0x7f9e080be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:20.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.192+0000 7f9e22000700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9e080b2910 0x7f9e080b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000b2e0 tx=0x7f9e10005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:20.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.192+0000 7f9e23400700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] conn(0x7f9e080bc4a0 0x7f9e080be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:20.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.193+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== osd.0 v2:172.21.15.71:6802/335199757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e14016ec0 con 0x7f9e080bc4a0 2024-05-27T09:45:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.212+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 --> [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e24064380 con 0x7f9e080bc4a0 2024-05-27T09:45:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.212+0000 7f9e1b400700 1 -- 172.21.15.71:0/3333140005 <== osd.0 v2:172.21.15.71:6802/335199757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e24064380 con 0x7f9e080bc4a0 2024-05-27T09:45:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.213+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] conn(0x7f9e080bc4a0 msgr2=0x7f9e080be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.213+0000 7f9e23e00700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] conn(0x7f9e080bc4a0 0x7f9e080be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.213+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9e080b2910 msgr2=0x7f9e080b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.213+0000 7f9e23e00700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9e080b2910 0x7f9e080b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000b2e0 tx=0x7f9e10005960 comp rx=0 tx=0).stop 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.213+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e24106610 msgr2=0x7f9e2419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.213+0000 7f9e23e00700 1 --2- 172.21.15.71:0/3333140005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e24106610 0x7f9e2419cdd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400e9a0 tx=0x7f9e1400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.213+0000 7f9e23400700 1 -- 172.21.15.71:0/3333140005 reap_dead start 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.214+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 shutdown_connections 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.214+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 >> 172.21.15.71:0/3333140005 conn(0x7f9e24102020 msgr2=0x7f9e2410a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.214+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 shutdown_connections 2024-05-27T09:45:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:20.214+0000 7f9e23e00700 1 -- 172.21.15.71:0/3333140005 wait complete. 2024-05-27T09:45:21.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:20 smithi071 ceph-mon[31451]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:21.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:20 smithi122 ceph-mon[36436]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:21.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:20 smithi072 ceph-mon[35951]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 -- 172.21.15.71:0/4002562100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410a980 msgr2=0x7f13b410ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 --2- 172.21.15.71:0/4002562100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410a980 0x7f13b410ad90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f139c009990 tx=0x7f139c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 -- 172.21.15.71:0/4002562100 shutdown_connections 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 --2- 172.21.15.71:0/4002562100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13b410b2d0 0x7f13b4117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 --2- 172.21.15.71:0/4002562100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b4110960 0x7f13b4110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 --2- 172.21.15.71:0/4002562100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410a980 0x7f13b410ad90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 -- 172.21.15.71:0/4002562100 >> 172.21.15.71:0/4002562100 conn(0x7f13b4077c70 msgr2=0x7f13b40780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 -- 172.21.15.71:0/4002562100 shutdown_connections 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.739+0000 7f13bae00700 1 -- 172.21.15.71:0/4002562100 wait complete. 2024-05-27T09:45:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.740+0000 7f13bae00700 1 Processor -- start 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.740+0000 7f13bae00700 1 -- start start 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13bae00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13b410a980 0x7f13b41a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13bae00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410b2d0 0x7f13b41a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13bae00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b4110960 0x7f13b41a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13bae00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13b411aad0 con 0x7f13b4110960 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13bae00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f13b411a950 con 0x7f13b410b2d0 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13bae00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f13b411ac50 con 0x7f13b410a980 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13abe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410b2d0 0x7f13b41a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13b3e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13b410a980 0x7f13b41a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13b8e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b4110960 0x7f13b41a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13abe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410b2d0 0x7f13b41a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:33158/0 (socket says 172.21.15.71:33158) 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13abe00700 1 -- 172.21.15.71:0/2477568035 learned_addr learned my addr 172.21.15.71:0/2477568035 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.741+0000 7f13b3e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13b410a980 0x7f13b41a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36036/0 (socket says 172.21.15.71:36036) 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13abe00700 1 -- 172.21.15.71:0/2477568035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13b410a980 msgr2=0x7f13b41a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13abe00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13b410a980 0x7f13b41a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13abe00700 1 -- 172.21.15.71:0/2477568035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b4110960 msgr2=0x7f13b41a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13abe00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b4110960 0x7f13b41a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13abe00700 1 -- 172.21.15.71:0/2477568035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b41a6350 con 0x7f13b410b2d0 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13abe00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410b2d0 0x7f13b41a1a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f139c000c00 tx=0x7f139c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c026070 con 0x7f13b410b2d0 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f139c021410 con 0x7f13b410b2d0 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b41a65e0 con 0x7f13b410b2d0 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.742+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c017650 con 0x7f13b410b2d0 2024-05-27T09:45:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.743+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b41a6ac0 con 0x7f13b410b2d0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.743+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13b4063f40 con 0x7f13b410b2d0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.746+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f139c029070 con 0x7f13b410b2d0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.748+0000 7f13b1600700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13980b2910 0x7f13980b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.748+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f139c0e36b0 con 0x7f13b410b2d0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.748+0000 7f13b3e00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13980b2910 0x7f13980b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.748+0000 7f13b1600700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] conn(0x7f13980bc4a0 0x7f13980be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.748+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 --> [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13980bf060 con 0x7f13980bc4a0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.748+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f139c0e3a60 con 0x7f13b410b2d0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.749+0000 7f13b8e00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] conn(0x7f13980bc4a0 0x7f13980be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.749+0000 7f13b3e00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13980b2910 0x7f13980b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f13b407d0e0 tx=0x7f13a4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.749+0000 7f13b8e00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] conn(0x7f13980bc4a0 0x7f13980be990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.750+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== osd.7 v2:172.21.15.72:6816/2828879424 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13980bf060 con 0x7f13980bc4a0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.768+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 --> [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f13b40643c0 con 0x7f13980bc4a0 2024-05-27T09:45:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13b1600700 1 -- 172.21.15.71:0/2477568035 <== osd.7 v2:172.21.15.72:6816/2828879424 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f13b40643c0 con 0x7f13980bc4a0 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] conn(0x7f13980bc4a0 msgr2=0x7f13980be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13bae00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] conn(0x7f13980bc4a0 0x7f13980be990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13980b2910 msgr2=0x7f13980b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13bae00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f13980b2910 0x7f13980b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f13b407d0e0 tx=0x7f13a4009260 comp rx=0 tx=0).stop 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410b2d0 msgr2=0x7f13b41a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13bae00700 1 --2- 172.21.15.71:0/2477568035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13b410b2d0 0x7f13b41a1a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f139c000c00 tx=0x7f139c0047b0 comp rx=0 tx=0).stop 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.769+0000 7f13b8e00700 1 -- 172.21.15.71:0/2477568035 reap_dead start 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.770+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 shutdown_connections 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.770+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 >> 172.21.15.71:0/2477568035 conn(0x7f13b4077c70 msgr2=0x7f13b407b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.770+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 shutdown_connections 2024-05-27T09:45:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:21.770+0000 7f13bae00700 1 -- 172.21.15.71:0/2477568035 wait complete. 2024-05-27T09:45:23.118 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:22 smithi071 ceph-mon[31451]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:23.181 INFO:teuthology.orchestra.run.smithi071.stdout:34359738467 2024-05-27T09:45:23.182 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-27T09:45:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:22 smithi122 ceph-mon[36436]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:22 smithi072 ceph-mon[35951]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:23 smithi122 ceph-mon[36436]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:24.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:23 smithi071 ceph-mon[31451]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:23 smithi072 ceph-mon[35951]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:25.354 INFO:teuthology.orchestra.run.smithi071.stdout:137438953547 2024-05-27T09:45:25.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.640+0000 7f0f29000700 1 -- 172.21.15.71:0/3445285929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 msgr2=0x7f0f241081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.640+0000 7f0f29000700 1 --2- 172.21.15.71:0/3445285929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 0x7f0f241081f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f100099c0 tx=0x7f0f10009cd0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.641+0000 7f0f29000700 1 -- 172.21.15.71:0/3445285929 shutdown_connections 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.641+0000 7f0f29000700 1 --2- 172.21.15.71:0/3445285929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f24108730 0x7f0f24110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.641+0000 7f0f29000700 1 --2- 172.21.15.71:0/3445285929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f241034b0 0x7f0f241038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.641+0000 7f0f29000700 1 --2- 172.21.15.71:0/3445285929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 0x7f0f241081f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.641+0000 7f0f29000700 1 -- 172.21.15.71:0/3445285929 >> 172.21.15.71:0/3445285929 conn(0x7f0f240fedb0 msgr2=0x7f0f241011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.641+0000 7f0f29000700 1 -- 172.21.15.71:0/3445285929 shutdown_connections 2024-05-27T09:45:25.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.641+0000 7f0f29000700 1 -- 172.21.15.71:0/3445285929 wait complete. 2024-05-27T09:45:25.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.642+0000 7f0f29000700 1 Processor -- start 2024-05-27T09:45:25.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.642+0000 7f0f29000700 1 -- start start 2024-05-27T09:45:25.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.642+0000 7f0f29000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f241034b0 0x7f0f2419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:25.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.642+0000 7f0f29000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 0x7f0f2419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:25.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.642+0000 7f0f29000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f24108730 0x7f0f241a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:25.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f29000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f241144c0 con 0x7f0f24107de0 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f29000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0f24114340 con 0x7f0f24108730 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f29000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0f24114640 con 0x7f0f241034b0 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f21e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f241034b0 0x7f0f2419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f21400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 0x7f0f2419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f21e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f241034b0 0x7f0f2419d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57552/0 (socket says 172.21.15.71:57552) 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f21e00700 1 -- 172.21.15.71:0/2366483052 learned_addr learned my addr 172.21.15.71:0/2366483052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f22800700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f24108730 0x7f0f241a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:25.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f21e00700 1 -- 172.21.15.71:0/2366483052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f24108730 msgr2=0x7f0f241a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.643+0000 7f0f21e00700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f24108730 0x7f0f241a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.644+0000 7f0f21e00700 1 -- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 msgr2=0x7f0f2419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.644+0000 7f0f21e00700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 0x7f0f2419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.644+0000 7f0f21e00700 1 -- 172.21.15.71:0/2366483052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f241a1f40 con 0x7f0f241034b0 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.644+0000 7f0f21400700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24107de0 0x7f0f2419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.644+0000 7f0f22800700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f24108730 0x7f0f241a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.644+0000 7f0f21e00700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f241034b0 0x7f0f2419d070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400e9a0 tx=0x7f0f1400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.644+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400ca10 con 0x7f0f241034b0 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.645+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f1400cbb0 con 0x7f0f241034b0 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.645+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f241a2230 con 0x7f0f241034b0 2024-05-27T09:45:25.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.645+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14018680 con 0x7f0f241034b0 2024-05-27T09:45:25.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.645+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f241a9b50 con 0x7f0f241034b0 2024-05-27T09:45:25.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.646+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f24111d00 con 0x7f0f241034b0 2024-05-27T09:45:25.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.649+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0f14010430 con 0x7f0f241034b0 2024-05-27T09:45:25.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.650+0000 7f0f1aa00700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f080b2990 0x7f0f080b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:25.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.651+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0f140e2a30 con 0x7f0f241034b0 2024-05-27T09:45:25.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.651+0000 7f0f21400700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f080b2990 0x7f0f080b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:25.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.651+0000 7f0f1aa00700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] conn(0x7f0f080bc580 0x7f0f080bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:25.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.651+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 --> [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f140056b0 con 0x7f0f080bc580 2024-05-27T09:45:25.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.651+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f0f140e2de0 con 0x7f0f241034b0 2024-05-27T09:45:25.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.651+0000 7f0f22800700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] conn(0x7f0f080bc580 0x7f0f080bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:25.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.652+0000 7f0f21400700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f080b2990 0x7f0f080b4ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f10000c00 tx=0x7f0f1001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:25.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.652+0000 7f0f22800700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] conn(0x7f0f080bc580 0x7f0f080bea70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:25.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.653+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== osd.6 v2:172.21.15.71:6818/1007330832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f140056b0 con 0x7f0f080bc580 2024-05-27T09:45:25.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.672+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 --> [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f24104960 con 0x7f0f080bc580 2024-05-27T09:45:25.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.672+0000 7f0f1aa00700 1 -- 172.21.15.71:0/2366483052 <== osd.6 v2:172.21.15.71:6818/1007330832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0f24104960 con 0x7f0f080bc580 2024-05-27T09:45:25.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] conn(0x7f0f080bc580 msgr2=0x7f0f080bea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:25.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] conn(0x7f0f080bc580 0x7f0f080bea70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f080b2990 msgr2=0x7f0f080b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f080b2990 0x7f0f080b4ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f10000c00 tx=0x7f0f1001a040 comp rx=0 tx=0).stop 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f241034b0 msgr2=0x7f0f2419d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 --2- 172.21.15.71:0/2366483052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f241034b0 0x7f0f2419d070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400e9a0 tx=0x7f0f1400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f22800700 1 -- 172.21.15.71:0/2366483052 reap_dead start 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 shutdown_connections 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 >> 172.21.15.71:0/2366483052 conn(0x7f0f240fedb0 msgr2=0x7f0f24109690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 shutdown_connections 2024-05-27T09:45:25.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:25.673+0000 7f0f29000700 1 -- 172.21.15.71:0/2366483052 wait complete. 2024-05-27T09:45:26.352 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:26 smithi071 ceph-mon[31451]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:26.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:26 smithi072 ceph-mon[35951]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 -- 172.21.15.71:0/3592034251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c1045e0 msgr2=0x7f810c1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 --2- 172.21.15.71:0/3592034251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c1045e0 0x7f810c1049f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f81000099c0 tx=0x7f8100009cd0 comp rx=0 tx=0).stop 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 -- 172.21.15.71:0/3592034251 shutdown_connections 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 --2- 172.21.15.71:0/3592034251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810c109860 0x7f810c1111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 --2- 172.21.15.71:0/3592034251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c1045e0 0x7f810c1049f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 --2- 172.21.15.71:0/3592034251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c108f10 0x7f810c109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 -- 172.21.15.71:0/3592034251 >> 172.21.15.71:0/3592034251 conn(0x7f810c100030 msgr2=0x7f810c102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 -- 172.21.15.71:0/3592034251 shutdown_connections 2024-05-27T09:45:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.597+0000 7f8114600700 1 -- 172.21.15.71:0/3592034251 wait complete. 2024-05-27T09:45:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 Processor -- start 2024-05-27T09:45:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 -- start start 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810c1045e0 0x7f810c19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c108f10 0x7f810c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c109860 0x7f810c1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f810c1145a0 con 0x7f810c108f10 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f810c114420 con 0x7f810c1045e0 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.599+0000 7f8114600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f810c114720 con 0x7f810c109860 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c109860 0x7f810c1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c109860 0x7f810c1a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57584/0 (socket says 172.21.15.71:57584) 2024-05-27T09:45:26.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 -- 172.21.15.71:0/2734203245 learned_addr learned my addr 172.21.15.71:0/2734203245 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8111c00700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810c1045e0 0x7f810c19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8111200700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c108f10 0x7f810c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 -- 172.21.15.71:0/2734203245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810c1045e0 msgr2=0x7f810c19d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810c1045e0 0x7f810c19d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 -- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c108f10 msgr2=0x7f810c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:26.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c108f10 0x7f810c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:26.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 -- 172.21.15.71:0/2734203245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c1a1fa0 con 0x7f810c109860 2024-05-27T09:45:26.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8111200700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f810c108f10 0x7f810c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:45:26.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.600+0000 7f8112600700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c109860 0x7f810c1a1900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f810400ef30 tx=0x7f810400c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:26.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.601+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81040092e0 con 0x7f810c109860 2024-05-27T09:45:26.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.601+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8104004bb0 con 0x7f810c109860 2024-05-27T09:45:26.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.601+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104004280 con 0x7f810c109860 2024-05-27T09:45:26.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.601+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c1a2230 con 0x7f810c109860 2024-05-27T09:45:26.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.601+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c1a2720 con 0x7f810c109860 2024-05-27T09:45:26.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.602+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f810c1089d0 con 0x7f810c109860 2024-05-27T09:45:26.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.605+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f810401b030 con 0x7f810c109860 2024-05-27T09:45:26.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.607+0000 7f810a000700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80f40b29c0 0x7f80f40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:26.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.607+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f81040e29c0 con 0x7f810c109860 2024-05-27T09:45:26.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.607+0000 7f8111c00700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80f40b29c0 0x7f80f40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:26.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.607+0000 7f810a000700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] conn(0x7f80f40bc550 0x7f80f40bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:26.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.607+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 --> [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8104008ec0 con 0x7f80f40bc550 2024-05-27T09:45:26.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.607+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f81040e2d70 con 0x7f810c109860 2024-05-27T09:45:26.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.608+0000 7f8111200700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] conn(0x7f80f40bc550 0x7f80f40bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:26.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.608+0000 7f8111c00700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80f40b29c0 0x7f80f40b4ed0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8100000c00 tx=0x7f810001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:26.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.609+0000 7f8111200700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] conn(0x7f80f40bc550 0x7f80f40bea40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:26.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.610+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== osd.8 v2:172.21.15.122:6816/2821031673 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8104008ec0 con 0x7f80f40bc550 2024-05-27T09:45:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.628+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 --> [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f810c105a90 con 0x7f80f40bc550 2024-05-27T09:45:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.628+0000 7f810a000700 1 -- 172.21.15.71:0/2734203245 <== osd.8 v2:172.21.15.122:6816/2821031673 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f810c105a90 con 0x7f80f40bc550 2024-05-27T09:45:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] conn(0x7f80f40bc550 msgr2=0x7f80f40bea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] conn(0x7f80f40bc550 0x7f80f40bea40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80f40b29c0 msgr2=0x7f80f40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f80f40b29c0 0x7f80f40b4ed0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8100000c00 tx=0x7f810001a040 comp rx=0 tx=0).stop 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c109860 msgr2=0x7f810c1a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 --2- 172.21.15.71:0/2734203245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c109860 0x7f810c1a1900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f810400ef30 tx=0x7f810400c450 comp rx=0 tx=0).stop 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8112600700 1 -- 172.21.15.71:0/2734203245 reap_dead start 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 shutdown_connections 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 >> 172.21.15.71:0/2734203245 conn(0x7f810c100030 msgr2=0x7f810c10a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.629+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 shutdown_connections 2024-05-27T09:45:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.630+0000 7f8114600700 1 -- 172.21.15.71:0/2734203245 wait complete. 2024-05-27T09:45:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:26 smithi122 ceph-mon[36436]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:26.789 INFO:teuthology.orchestra.run.smithi071.stdout:210453397564 2024-05-27T09:45:26.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-27T09:45:27.635 INFO:teuthology.orchestra.run.smithi071.stdout:236223201335 2024-05-27T09:45:27.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-27T09:45:28.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:28 smithi071 ceph-mon[31451]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-27T09:45:28.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:28 smithi072 ceph-mon[35951]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-27T09:45:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:28 smithi122 ceph-mon[36436]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-27T09:45:28.821 INFO:teuthology.orchestra.run.smithi071.stdout:55834574941 2024-05-27T09:45:28.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-27T09:45:28.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 -- 172.21.15.71:0/4115561723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4308108d20 msgr2=0x7f4308109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:28.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 --2- 172.21.15.71:0/4115561723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4308108d20 0x7f4308109130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009920 tx=0x7f42f4009c30 comp rx=0 tx=0).stop 2024-05-27T09:45:28.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 -- 172.21.15.71:0/4115561723 shutdown_connections 2024-05-27T09:45:28.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 --2- 172.21.15.71:0/4115561723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308109670 0x7f4308110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:28.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 --2- 172.21.15.71:0/4115561723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43081043f0 0x7f4308104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 --2- 172.21.15.71:0/4115561723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4308108d20 0x7f4308109130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 -- 172.21.15.71:0/4115561723 >> 172.21.15.71:0/4115561723 conn(0x7f4308079d00 msgr2=0x7f430807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 -- 172.21.15.71:0/4115561723 shutdown_connections 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.168+0000 7f430e000700 1 -- 172.21.15.71:0/4115561723 wait complete. 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.170+0000 7f430e000700 1 Processor -- start 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.170+0000 7f430e000700 1 -- start start 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430e000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43081043f0 0x7f4308075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430e000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308108d20 0x7f4308075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430e000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4308109670 0x7f4308076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430e000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4308114280 con 0x7f43081043f0 2024-05-27T09:45:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430e000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4308114100 con 0x7f4308108d20 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430e000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4308114400 con 0x7f4308109670 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430cc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43081043f0 0x7f4308075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f42ffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308108d20 0x7f4308075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f42ffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308108d20 0x7f4308075ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47284/0 (socket says 172.21.15.71:47284) 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f42ffe00700 1 -- 172.21.15.71:0/1506540548 learned_addr learned my addr 172.21.15.71:0/1506540548 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.171+0000 7f430d600700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4308109670 0x7f4308076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430cc00700 1 -- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4308109670 msgr2=0x7f4308076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430cc00700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4308109670 0x7f4308076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430cc00700 1 -- 172.21.15.71:0/1506540548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308108d20 msgr2=0x7f4308075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430cc00700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308108d20 0x7f4308075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430cc00700 1 -- 172.21.15.71:0/1506540548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43081a9050 con 0x7f43081043f0 2024-05-27T09:45:28.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430cc00700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43081043f0 0x7f4308075ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42f800eb90 tx=0x7f42f800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f800cc90 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42f800ce30 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43081a9340 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8010430 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.172+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43081a9880 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.173+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4308063eb0 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.176+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f42f8003ef0 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.178+0000 7f4306000700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42ec0b2910 0x7f42ec0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.178+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f42f80e2960 con 0x7f43081043f0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.178+0000 7f42ffe00700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42ec0b2910 0x7f42ec0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:28.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.178+0000 7f4306000700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] conn(0x7f42ec0bc4a0 0x7f42ec0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.178+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 --> [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42ec0bf060 con 0x7f42ec0bc4a0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.178+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f42f80e2d10 con 0x7f43081043f0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.179+0000 7f42ffe00700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42ec0b2910 0x7f42ec0b4e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005f40 tx=0x7f42f4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.179+0000 7f430d600700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] conn(0x7f42ec0bc4a0 0x7f42ec0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.179+0000 7f430d600700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] conn(0x7f42ec0bc4a0 0x7f42ec0be990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.180+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== osd.5 v2:172.21.15.122:6808/3344426333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42ec0bf060 con 0x7f42ec0bc4a0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.198+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 --> [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4308064330 con 0x7f42ec0bc4a0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f4306000700 1 -- 172.21.15.71:0/1506540548 <== osd.5 v2:172.21.15.122:6808/3344426333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4308064330 con 0x7f42ec0bc4a0 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] conn(0x7f42ec0bc4a0 msgr2=0x7f42ec0be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:28.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f430e000700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] conn(0x7f42ec0bc4a0 0x7f42ec0be990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42ec0b2910 msgr2=0x7f42ec0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f430e000700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42ec0b2910 0x7f42ec0b4e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005f40 tx=0x7f42f4019040 comp rx=0 tx=0).stop 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43081043f0 msgr2=0x7f4308075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f430e000700 1 --2- 172.21.15.71:0/1506540548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43081043f0 0x7f4308075ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42f800eb90 tx=0x7f42f800eea0 comp rx=0 tx=0).stop 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.199+0000 7f430d600700 1 -- 172.21.15.71:0/1506540548 reap_dead start 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.200+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 shutdown_connections 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.200+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 >> 172.21.15.71:0/1506540548 conn(0x7f4308079d00 msgr2=0x7f43081017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.200+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 shutdown_connections 2024-05-27T09:45:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:28.200+0000 7f430e000700 1 -- 172.21.15.71:0/1506540548 wait complete. 2024-05-27T09:45:29.429 INFO:teuthology.orchestra.run.smithi071.stdout:184683593792 2024-05-27T09:45:29.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.749+0000 7f33de600700 1 -- 172.21.15.71:0/2889341834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 msgr2=0x7f33d8114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.749+0000 7f33de600700 1 --2- 172.21.15.71:0/2889341834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 0x7f33d8114e20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009990 tx=0x7f33c4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.749+0000 7f33de600700 1 -- 172.21.15.71:0/2889341834 shutdown_connections 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.749+0000 7f33de600700 1 --2- 172.21.15.71:0/2889341834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d8115360 0x7f33d8117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.749+0000 7f33de600700 1 --2- 172.21.15.71:0/2889341834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33d8075b50 0x7f33d8075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.749+0000 7f33de600700 1 --2- 172.21.15.71:0/2889341834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 0x7f33d8114e20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.749+0000 7f33de600700 1 -- 172.21.15.71:0/2889341834 >> 172.21.15.71:0/2889341834 conn(0x7f33d8100030 msgr2=0x7f33d8102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.750+0000 7f33de600700 1 -- 172.21.15.71:0/2889341834 shutdown_connections 2024-05-27T09:45:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.750+0000 7f33de600700 1 -- 172.21.15.71:0/2889341834 wait complete. 2024-05-27T09:45:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 Processor -- start 2024-05-27T09:45:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 -- start start 2024-05-27T09:45:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d8075b50 0x7f33d81a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 0x7f33d81a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33d8115360 0x7f33d81a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33d811aab0 con 0x7f33d8115360 2024-05-27T09:45:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f33d811a930 con 0x7f33d8075b50 2024-05-27T09:45:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.751+0000 7f33de600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f33d811ac30 con 0x7f33d80764a0 2024-05-27T09:45:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33d8115360 0x7f33d81a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d6a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 0x7f33d81a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33d8115360 0x7f33d81a5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53458/0 (socket says 172.21.15.71:53458) 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d6a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 0x7f33d81a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57640/0 (socket says 172.21.15.71:57640) 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7e00700 1 -- 172.21.15.71:0/2982289835 learned_addr learned my addr 172.21.15.71:0/2982289835 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7400700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d8075b50 0x7f33d81a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7e00700 1 -- 172.21.15.71:0/2982289835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 msgr2=0x7f33d81a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7e00700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33d80764a0 0x7f33d81a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7e00700 1 -- 172.21.15.71:0/2982289835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d8075b50 msgr2=0x7f33d81a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.752+0000 7f33d7e00700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d8075b50 0x7f33d81a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.753+0000 7f33d7e00700 1 -- 172.21.15.71:0/2982289835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d81a6330 con 0x7f33d8115360 2024-05-27T09:45:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.753+0000 7f33d7e00700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33d8115360 0x7f33d81a5c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f33d000ef30 tx=0x7f33d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.753+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d00092e0 con 0x7f33d8115360 2024-05-27T09:45:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.753+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33d0004bb0 con 0x7f33d8115360 2024-05-27T09:45:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.753+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0004280 con 0x7f33d8115360 2024-05-27T09:45:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.753+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d81a65c0 con 0x7f33d8115360 2024-05-27T09:45:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.754+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d81a69f0 con 0x7f33d8115360 2024-05-27T09:45:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.755+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33d8063ec0 con 0x7f33d8115360 2024-05-27T09:45:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.758+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f33d001b030 con 0x7f33d8115360 2024-05-27T09:45:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.760+0000 7f33cfe00700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f33bc0b2910 0x7f33bc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.760+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f33d00e2810 con 0x7f33d8115360 2024-05-27T09:45:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.760+0000 7f33cfe00700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] conn(0x7f33bc0bc4a0 0x7f33bc0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.760+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 --> [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33bc0bf060 con 0x7f33bc0bc4a0 2024-05-27T09:45:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.760+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f33d00e2c60 con 0x7f33d8115360 2024-05-27T09:45:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.760+0000 7f33d7400700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f33bc0b2910 0x7f33bc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.761+0000 7f33d6a00700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] conn(0x7f33bc0bc4a0 0x7f33bc0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.761+0000 7f33d6a00700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] conn(0x7f33bc0bc4a0 0x7f33bc0be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.762+0000 7f33d7400700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f33bc0b2910 0x7f33bc0b4e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009bf0 tx=0x7f33c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.763+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== osd.3 v2:172.21.15.71:6810/4167682826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33bc0bf060 con 0x7f33bc0bc4a0 2024-05-27T09:45:29.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.785+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 --> [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f33d80642c0 con 0x7f33bc0bc4a0 2024-05-27T09:45:29.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.786+0000 7f33cfe00700 1 -- 172.21.15.71:0/2982289835 <== osd.3 v2:172.21.15.71:6810/4167682826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f33d80642c0 con 0x7f33bc0bc4a0 2024-05-27T09:45:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.786+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] conn(0x7f33bc0bc4a0 msgr2=0x7f33bc0be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.786+0000 7f33de600700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] conn(0x7f33bc0bc4a0 0x7f33bc0be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f33bc0b2910 msgr2=0x7f33bc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f33bc0b2910 0x7f33bc0b4e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009bf0 tx=0x7f33c8009260 comp rx=0 tx=0).stop 2024-05-27T09:45:29.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33d8115360 msgr2=0x7f33d81a5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:29.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 --2- 172.21.15.71:0/2982289835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33d8115360 0x7f33d81a5c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f33d000ef30 tx=0x7f33d000c3a0 comp rx=0 tx=0).stop 2024-05-27T09:45:29.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33d7e00700 1 -- 172.21.15.71:0/2982289835 reap_dead start 2024-05-27T09:45:29.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 shutdown_connections 2024-05-27T09:45:29.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 >> 172.21.15.71:0/2982289835 conn(0x7f33d8100030 msgr2=0x7f33d8100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:29.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 shutdown_connections 2024-05-27T09:45:29.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:29.787+0000 7f33de600700 1 -- 172.21.15.71:0/2982289835 wait complete. 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 -- 172.21.15.71:0/2260004768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 msgr2=0x7f0834075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 --2- 172.21.15.71:0/2260004768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 0x7f0834075f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0824009990 tx=0x7f0824009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 -- 172.21.15.71:0/2260004768 shutdown_connections 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 --2- 172.21.15.71:0/2260004768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0834115360 0x7f0834117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 --2- 172.21.15.71:0/2260004768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 0x7f0834075f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 --2- 172.21.15.71:0/2260004768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08340764a0 0x7f0834114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 -- 172.21.15.71:0/2260004768 >> 172.21.15.71:0/2260004768 conn(0x7f0834100030 msgr2=0x7f0834102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 -- 172.21.15.71:0/2260004768 shutdown_connections 2024-05-27T09:45:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.497+0000 7f0839800700 1 -- 172.21.15.71:0/2260004768 wait complete. 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.498+0000 7f0839800700 1 Processor -- start 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0839800700 1 -- start start 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0839800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 0x7f08341a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0839800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08340764a0 0x7f08341a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0839800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0834115360 0x7f08341a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0839800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f083411aab0 con 0x7f08340764a0 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0839800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f083411a930 con 0x7f0834075b50 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0839800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f083411ac30 con 0x7f0834115360 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f082be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08340764a0 0x7f08341a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0832a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 0x7f08341a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0832a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 0x7f08341a1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47240/0 (socket says 172.21.15.71:47240) 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.499+0000 7f0832a00700 1 -- 172.21.15.71:0/662448907 learned_addr learned my addr 172.21.15.71:0/662448907 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f0833400700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0834115360 0x7f08341a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f082be00700 1 -- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0834115360 msgr2=0x7f08341a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f082be00700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0834115360 0x7f08341a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f082be00700 1 -- 172.21.15.71:0/662448907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 msgr2=0x7f08341a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f082be00700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 0x7f08341a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f082be00700 1 -- 172.21.15.71:0/662448907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08341a62d0 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f0832a00700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0834075b50 0x7f08341a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f082be00700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08340764a0 0x7f08341a19a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f081c00e9f0 tx=0x7f081c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.500+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c00c9c0 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.501+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08341a65c0 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.501+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08341adee0 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.501+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f081c00cb60 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.501+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c018420 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.502+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0810001060 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.505+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f081c018660 con 0x7f08340764a0 2024-05-27T09:45:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.506+0000 7f082b400700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08180b2990 0x7f08180b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.506+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f081c0e2f50 con 0x7f08340764a0 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.506+0000 7f0832a00700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08180b2990 0x7f08180b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.506+0000 7f082b400700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] conn(0x7f08180bc520 0x7f08180bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.506+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 --> [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08180bf0e0 con 0x7f08180bc520 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.506+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f081c0e3300 con 0x7f08340764a0 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.507+0000 7f0833400700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] conn(0x7f08180bc520 0x7f08180bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.507+0000 7f0832a00700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08180b2990 0x7f08180b4ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0824006010 tx=0x7f082400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.507+0000 7f0833400700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] conn(0x7f08180bc520 0x7f08180bea10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.508+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== osd.11 v2:172.21.15.122:6824/1471732856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08180bf0e0 con 0x7f08180bc520 2024-05-27T09:45:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.526+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 --> [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0810002e90 con 0x7f08180bc520 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.527+0000 7f082b400700 1 -- 172.21.15.71:0/662448907 <== osd.11 v2:172.21.15.122:6824/1471732856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0810002e90 con 0x7f08180bc520 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.527+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] conn(0x7f08180bc520 msgr2=0x7f08180bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.527+0000 7f0839800700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] conn(0x7f08180bc520 0x7f08180bea10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:30.441 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:30 smithi071 ceph-mon[31451]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08180b2990 msgr2=0x7f08180b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f08180b2990 0x7f08180b4ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0824006010 tx=0x7f082400b280 comp rx=0 tx=0).stop 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08340764a0 msgr2=0x7f08341a19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 --2- 172.21.15.71:0/662448907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08340764a0 0x7f08341a19a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f081c00e9f0 tx=0x7f081c00ed00 comp rx=0 tx=0).stop 2024-05-27T09:45:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0833400700 1 -- 172.21.15.71:0/662448907 reap_dead start 2024-05-27T09:45:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 shutdown_connections 2024-05-27T09:45:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 >> 172.21.15.71:0/662448907 conn(0x7f0834100030 msgr2=0x7f0834100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 shutdown_connections 2024-05-27T09:45:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:26.528+0000 7f0839800700 1 -- 172.21.15.71:0/662448907 wait complete. 2024-05-27T09:45:30.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:30 smithi072 ceph-mon[35951]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:45:30.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:30 smithi122 ceph-mon[36436]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:45:31.197 INFO:teuthology.orchestra.run.smithi071.stdout:313532612646 2024-05-27T09:45:31.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-27T09:45:31.220 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:111669149779 2024-05-27T09:45:31.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-27T09:45:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:158913790025 2024-05-27T09:45:32.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-27T09:45:32.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:32 smithi071 ceph-mon[31451]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:32.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:32 smithi072 ceph-mon[35951]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:32.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:32 smithi122 ceph-mon[36436]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 -- 172.21.15.71:0/1500255199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c108d20 msgr2=0x7f1b2c109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 --2- 172.21.15.71:0/1500255199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c108d20 0x7f1b2c109130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1b180099c0 tx=0x7f1b18009cd0 comp rx=0 tx=0).stop 2024-05-27T09:45:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 -- 172.21.15.71:0/1500255199 shutdown_connections 2024-05-27T09:45:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 --2- 172.21.15.71:0/1500255199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b2c109670 0x7f1b2c110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 --2- 172.21.15.71:0/1500255199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2c1043f0 0x7f1b2c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 --2- 172.21.15.71:0/1500255199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c108d20 0x7f1b2c109130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 -- 172.21.15.71:0/1500255199 >> 172.21.15.71:0/1500255199 conn(0x7f1b2c079d00 msgr2=0x7f1b2c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 -- 172.21.15.71:0/1500255199 shutdown_connections 2024-05-27T09:45:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.995+0000 7f1b31400700 1 -- 172.21.15.71:0/1500255199 wait complete. 2024-05-27T09:45:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.997+0000 7f1b31400700 1 Processor -- start 2024-05-27T09:45:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.997+0000 7f1b31400700 1 -- start start 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b31400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c1043f0 0x7f1b2c1a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b31400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2c108d20 0x7f1b2c1a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b31400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b2c109670 0x7f1b2c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b31400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c1142d0 con 0x7f1b2c109670 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b31400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c114150 con 0x7f1b2c108d20 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b31400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c114450 con 0x7f1b2c1043f0 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c1043f0 0x7f1b2c1a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b30a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b2c109670 0x7f1b2c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c1043f0 0x7f1b2c1a0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:49686/0 (socket says 172.21.15.71:49686) 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 -- 172.21.15.71:0/1034092314 learned_addr learned my addr 172.21.15.71:0/1034092314 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2b400700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2c108d20 0x7f1b2c1a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 -- 172.21.15.71:0/1034092314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2c108d20 msgr2=0x7f1b2c1a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2c108d20 0x7f1b2c1a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 -- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b2c109670 msgr2=0x7f1b2c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b2c109670 0x7f1b2c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.998+0000 7f1b2be00700 1 -- 172.21.15.71:0/1034092314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c19b140 con 0x7f1b2c1043f0 2024-05-27T09:45:34.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.999+0000 7f1b2be00700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c1043f0 0x7f1b2c1a0870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00d980 tx=0x7f1b1c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:34.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.999+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c016070 con 0x7f1b2c1043f0 2024-05-27T09:45:34.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.999+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b1c004830 con 0x7f1b2c1043f0 2024-05-27T09:45:34.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.999+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2c19b430 con 0x7f1b2c1043f0 2024-05-27T09:45:34.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.999+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c005540 con 0x7f1b2c1043f0 2024-05-27T09:45:34.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:33.999+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2c1a7700 con 0x7f1b2c1043f0 2024-05-27T09:45:34.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.000+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b2c063f00 con 0x7f1b2c1043f0 2024-05-27T09:45:34.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.003+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1b1c004220 con 0x7f1b2c1043f0 2024-05-27T09:45:34.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.004+0000 7f1b28c00700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b100b2910 0x7f1b100b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:34.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.004+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1b1c0e2830 con 0x7f1b2c1043f0 2024-05-27T09:45:34.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.005+0000 7f1b2b400700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b100b2910 0x7f1b100b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:34.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.005+0000 7f1b28c00700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] conn(0x7f1b100bc4a0 0x7f1b100be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:34.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.005+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 --> [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b1c015ec0 con 0x7f1b100bc4a0 2024-05-27T09:45:34.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.005+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f1b1c0e2be0 con 0x7f1b2c1043f0 2024-05-27T09:45:34.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.005+0000 7f1b30a00700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] conn(0x7f1b100bc4a0 0x7f1b100be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:34.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.005+0000 7f1b2b400700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b100b2910 0x7f1b100b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000c00 tx=0x7f1b1801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:34.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.006+0000 7f1b30a00700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] conn(0x7f1b100bc4a0 0x7f1b100be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:34.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.007+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== osd.9 v2:172.21.15.71:6826/3462604941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b1c015ec0 con 0x7f1b100bc4a0 2024-05-27T09:45:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.024+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 --> [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b2c0643b0 con 0x7f1b100bc4a0 2024-05-27T09:45:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.025+0000 7f1b28c00700 1 -- 172.21.15.71:0/1034092314 <== osd.9 v2:172.21.15.71:6826/3462604941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1b2c0643b0 con 0x7f1b100bc4a0 2024-05-27T09:45:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.025+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] conn(0x7f1b100bc4a0 msgr2=0x7f1b100be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.025+0000 7f1b31400700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] conn(0x7f1b100bc4a0 0x7f1b100be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b100b2910 msgr2=0x7f1b100b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b100b2910 0x7f1b100b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000c00 tx=0x7f1b1801a040 comp rx=0 tx=0).stop 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c1043f0 msgr2=0x7f1b2c1a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 --2- 172.21.15.71:0/1034092314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2c1043f0 0x7f1b2c1a0870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00d980 tx=0x7f1b1c00dc90 comp rx=0 tx=0).stop 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b30a00700 1 -- 172.21.15.71:0/1034092314 reap_dead start 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 shutdown_connections 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 >> 172.21.15.71:0/1034092314 conn(0x7f1b2c079d00 msgr2=0x7f1b2c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 shutdown_connections 2024-05-27T09:45:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:34.026+0000 7f1b31400700 1 -- 172.21.15.71:0/1034092314 wait complete. 2024-05-27T09:45:34.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:34 smithi072 ceph-mon[35951]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:34.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:34 smithi122 ceph-mon[36436]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:34.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:34 smithi071 ceph-mon[31451]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:35.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.622+0000 7f8a87a00700 1 -- 172.21.15.71:0/571125799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80108f10 msgr2=0x7f8a80109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:35.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.622+0000 7f8a87a00700 1 --2- 172.21.15.71:0/571125799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80108f10 0x7f8a80109320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0099c0 tx=0x7f8a6c009cd0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.623+0000 7f8a87a00700 1 -- 172.21.15.71:0/571125799 shutdown_connections 2024-05-27T09:45:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.623+0000 7f8a87a00700 1 --2- 172.21.15.71:0/571125799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a80109860 0x7f8a801111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.623+0000 7f8a87a00700 1 --2- 172.21.15.71:0/571125799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a801045e0 0x7f8a801049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.623+0000 7f8a87a00700 1 --2- 172.21.15.71:0/571125799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80108f10 0x7f8a80109320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.623+0000 7f8a87a00700 1 -- 172.21.15.71:0/571125799 >> 172.21.15.71:0/571125799 conn(0x7f8a80100030 msgr2=0x7f8a80102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.623+0000 7f8a87a00700 1 -- 172.21.15.71:0/571125799 shutdown_connections 2024-05-27T09:45:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.623+0000 7f8a87a00700 1 -- 172.21.15.71:0/571125799 wait complete. 2024-05-27T09:45:35.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.624+0000 7f8a87a00700 1 Processor -- start 2024-05-27T09:45:35.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.624+0000 7f8a87a00700 1 -- start start 2024-05-27T09:45:35.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a87a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a801045e0 0x7f8a8019ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:35.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a87a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a80108f10 0x7f8a8019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:35.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a87a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80109860 0x7f8a8019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:35.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a87a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80114470 con 0x7f8a80109860 2024-05-27T09:45:35.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a87a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a801142f0 con 0x7f8a80108f10 2024-05-27T09:45:35.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a87a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a801145f0 con 0x7f8a801045e0 2024-05-27T09:45:35.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a801045e0 0x7f8a8019ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:35.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80109860 0x7f8a8019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:35.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a801045e0 0x7f8a8019ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:49706/0 (socket says 172.21.15.71:49706) 2024-05-27T09:45:35.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 -- 172.21.15.71:0/1742119404 learned_addr learned my addr 172.21.15.71:0/1742119404 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a7fe00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a80108f10 0x7f8a8019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 -- 172.21.15.71:0/1742119404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a80108f10 msgr2=0x7f8a8019b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a80108f10 0x7f8a8019b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 -- 172.21.15.71:0/1742119404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80109860 msgr2=0x7f8a8019f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80109860 0x7f8a8019f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.625+0000 7f8a85000700 1 -- 172.21.15.71:0/1742119404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8019fcf0 con 0x7f8a801045e0 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.626+0000 7f8a85000700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a801045e0 0x7f8a8019ae20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9a0 tx=0x7f8a7400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.626+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7400ca10 con 0x7f8a801045e0 2024-05-27T09:45:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.626+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8019ffe0 con 0x7f8a801045e0 2024-05-27T09:45:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.626+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a7400cbb0 con 0x7f8a801045e0 2024-05-27T09:45:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.626+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74018680 con 0x7f8a801045e0 2024-05-27T09:45:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.626+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a801a7900 con 0x7f8a801045e0 2024-05-27T09:45:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.627+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a80063f00 con 0x7f8a801045e0 2024-05-27T09:45:35.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.630+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8a74010430 con 0x7f8a801045e0 2024-05-27T09:45:35.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.632+0000 7f8a7d600700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8a680b2910 0x7f8a680b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:35.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.632+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f8a740e2b70 con 0x7f8a801045e0 2024-05-27T09:45:35.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.632+0000 7f8a7fe00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8a680b2910 0x7f8a680b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:35.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.632+0000 7f8a7d600700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] conn(0x7f8a680bc500 0x7f8a680be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:35.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.632+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 --> [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a74024e70 con 0x7f8a680bc500 2024-05-27T09:45:35.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.632+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f8a740e2f20 con 0x7f8a801045e0 2024-05-27T09:45:35.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.633+0000 7f8a85a00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] conn(0x7f8a680bc500 0x7f8a680be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:35.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.633+0000 7f8a7fe00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8a680b2910 0x7f8a680b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c000c00 tx=0x7f8a6c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:35.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.633+0000 7f8a85a00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] conn(0x7f8a680bc500 0x7f8a680be9f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:35.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.634+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== osd.2 v2:172.21.15.122:6800/631250224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a74024e70 con 0x7f8a680bc500 2024-05-27T09:45:35.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.658+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 --> [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a80064380 con 0x7f8a680bc500 2024-05-27T09:45:35.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.659+0000 7f8a7d600700 1 -- 172.21.15.71:0/1742119404 <== osd.2 v2:172.21.15.122:6800/631250224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a80064380 con 0x7f8a680bc500 2024-05-27T09:45:35.662 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.662+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] conn(0x7f8a680bc500 msgr2=0x7f8a680be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:35.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.662+0000 7f8a87a00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] conn(0x7f8a680bc500 0x7f8a680be9f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.663+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8a680b2910 msgr2=0x7f8a680b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.663+0000 7f8a87a00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f8a680b2910 0x7f8a680b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c000c00 tx=0x7f8a6c01a040 comp rx=0 tx=0).stop 2024-05-27T09:45:35.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.663+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a801045e0 msgr2=0x7f8a8019ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:35.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.663+0000 7f8a87a00700 1 --2- 172.21.15.71:0/1742119404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a801045e0 0x7f8a8019ae20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9a0 tx=0x7f8a7400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:45:35.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.663+0000 7f8a85a00700 1 -- 172.21.15.71:0/1742119404 reap_dead start 2024-05-27T09:45:35.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.663+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 shutdown_connections 2024-05-27T09:45:35.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.663+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 >> 172.21.15.71:0/1742119404 conn(0x7f8a80100030 msgr2=0x7f8a8010a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:35.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.664+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 shutdown_connections 2024-05-27T09:45:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:35.664+0000 7f8a87a00700 1 -- 172.21.15.71:0/1742119404 wait complete. 2024-05-27T09:45:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.682 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.691 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.691 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.694 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.695 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:35.707 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:36.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:36 smithi072 ceph-mon[35951]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:36.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:36 smithi071 ceph-mon[31451]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:36 smithi122 ceph-mon[36436]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:37.093 INFO:teuthology.orchestra.run.smithi071.stdout:261993005104 2024-05-27T09:45:37.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-27T09:45:38.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:38 smithi071 ceph-mon[31451]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:38.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:38 smithi072 ceph-mon[35951]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:38.532 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:38 smithi122 ceph-mon[36436]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:39.886 INFO:teuthology.orchestra.run.smithi071.stdout:77309411419 2024-05-27T09:45:39.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-27T09:45:40.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:40 smithi071 ceph-mon[31451]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-27T09:45:40.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:40 smithi122 ceph-mon[36436]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-27T09:45:40.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:40 smithi072 ceph-mon[35951]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-27T09:45:42.638 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:42 smithi071 ceph-mon[31451]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-27T09:45:42.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:42 smithi122 ceph-mon[36436]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-27T09:45:42.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:42 smithi072 ceph-mon[35951]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-27T09:45:44.556 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:44 smithi071 ceph-mon[31451]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:45:44.556 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:44 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:45:44.609 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:44 smithi122 ceph-mon[36436]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:45:44.609 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:44 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:45:44.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:44 smithi072 ceph-mon[35951]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:45:44.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:44 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:45:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 -- 172.21.15.71:0/1716392777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee0107de0 msgr2=0x7feee01081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 --2- 172.21.15.71:0/1716392777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee0107de0 0x7feee01081f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feecc009990 tx=0x7feecc009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 -- 172.21.15.71:0/1716392777 shutdown_connections 2024-05-27T09:45:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 --2- 172.21.15.71:0/1716392777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feee0108730 0x7feee0110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 --2- 172.21.15.71:0/1716392777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feee01034b0 0x7feee01038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 --2- 172.21.15.71:0/1716392777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee0107de0 0x7feee01081f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 -- 172.21.15.71:0/1716392777 >> 172.21.15.71:0/1716392777 conn(0x7feee00fedb0 msgr2=0x7feee01011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 -- 172.21.15.71:0/1716392777 shutdown_connections 2024-05-27T09:45:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.275+0000 7feee5600700 1 -- 172.21.15.71:0/1716392777 wait complete. 2024-05-27T09:45:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.276+0000 7feee5600700 1 Processor -- start 2024-05-27T09:45:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feee5600700 1 -- start start 2024-05-27T09:45:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feee5600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee01034b0 0x7feee019d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feee5600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feee0107de0 0x7feee019d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feee5600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feee0108730 0x7feee01a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feee5600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feee0113390 con 0x7feee0107de0 2024-05-27T09:45:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feee5600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feee0113210 con 0x7feee01034b0 2024-05-27T09:45:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feee5600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feee0113510 con 0x7feee0108730 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.277+0000 7feedea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee01034b0 0x7feee019d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee01034b0 0x7feee019d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60200/0 (socket says 172.21.15.71:60200) 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 -- 172.21.15.71:0/2978819160 learned_addr learned my addr 172.21.15.71:0/2978819160 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedf400700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feee0108730 0x7feee01a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feede000700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feee0107de0 0x7feee019d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 -- 172.21.15.71:0/2978819160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feee0108730 msgr2=0x7feee01a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feee0108730 0x7feee01a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 -- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feee0107de0 msgr2=0x7feee019d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feee0107de0 0x7feee019d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 -- 172.21.15.71:0/2978819160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee01a1f00 con 0x7feee01034b0 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feede000700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feee0107de0 0x7feee019d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feedea00700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee01034b0 0x7feee019d030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feed000e9a0 tx=0x7feed000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.278+0000 7feed7400700 1 -- 172.21.15.71:0/2978819160 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed000cbd0 con 0x7feee01034b0 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.279+0000 7feed7400700 1 -- 172.21.15.71:0/2978819160 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feed000cd70 con 0x7feee01034b0 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.279+0000 7feed7400700 1 -- 172.21.15.71:0/2978819160 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0018680 con 0x7feee01034b0 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.279+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee01a21f0 con 0x7feee01034b0 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.279+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee010a040 con 0x7feee01034b0 2024-05-27T09:45:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.280+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee00512b0 con 0x7feee01034b0 2024-05-27T09:45:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.282+0000 7feed7400700 1 -- 172.21.15.71:0/2978819160 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7feed0010430 con 0x7feee01034b0 2024-05-27T09:45:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.284+0000 7feed7400700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feec40b2990 0x7feec40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.284+0000 7feed7400700 1 -- 172.21.15.71:0/2978819160 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7feed00e2600 con 0x7feee01034b0 2024-05-27T09:45:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.284+0000 7feede000700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feec40b2990 0x7feec40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.285+0000 7feede000700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feec40b2990 0x7feec40b4ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feecc006010 tx=0x7feecc005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.288+0000 7feed7400700 1 -- 172.21.15.71:0/2978819160 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feed00aa170 con 0x7feee01034b0 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.088+0000 7fec64000700 1 -- 172.21.15.71:0/2187566415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c110b90 msgr2=0x7fec5c112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.088+0000 7fec64000700 1 --2- 172.21.15.71:0/2187566415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c110b90 0x7fec5c112ff0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec54009990 tx=0x7fec54009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.089+0000 7fec64000700 1 -- 172.21.15.71:0/2187566415 shutdown_connections 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.089+0000 7fec64000700 1 --2- 172.21.15.71:0/2187566415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c110b90 0x7fec5c112ff0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.089+0000 7fec64000700 1 --2- 172.21.15.71:0/2187566415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c075d20 0x7fec5c076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.089+0000 7fec64000700 1 --2- 172.21.15.71:0/2187566415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec5c076670 0x7fec5c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.089+0000 7fec64000700 1 -- 172.21.15.71:0/2187566415 >> 172.21.15.71:0/2187566415 conn(0x7fec5c100030 msgr2=0x7fec5c102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.089+0000 7fec64000700 1 -- 172.21.15.71:0/2187566415 shutdown_connections 2024-05-27T09:45:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.089+0000 7fec64000700 1 -- 172.21.15.71:0/2187566415 wait complete. 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.090+0000 7fec64000700 1 Processor -- start 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.090+0000 7fec64000700 1 -- start start 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec64000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c075d20 0x7fec5c19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec64000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec5c076670 0x7fec5c19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec64000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c110b90 0x7fec5c1a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec64000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c1166c0 con 0x7fec5c075d20 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec64000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c116540 con 0x7fec5c110b90 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec64000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c116840 con 0x7fec5c076670 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec61600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c075d20 0x7fec5c19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec62000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c110b90 0x7fec5c1a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec61600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c075d20 0x7fec5c19d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45186/0 (socket says 172.21.15.71:45186) 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec61600700 1 -- 172.21.15.71:0/586382329 learned_addr learned my addr 172.21.15.71:0/586382329 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.091+0000 7fec60c00700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec5c076670 0x7fec5c19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec61600700 1 -- 172.21.15.71:0/586382329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec5c076670 msgr2=0x7fec5c19d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec61600700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec5c076670 0x7fec5c19d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec61600700 1 -- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c110b90 msgr2=0x7fec5c1a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec61600700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c110b90 0x7fec5c1a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec61600700 1 -- 172.21.15.71:0/586382329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c1a1ee0 con 0x7fec5c075d20 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec62000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c110b90 0x7fec5c1a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec61600700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c075d20 0x7fec5c19d010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00ef10 tx=0x7fec4c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:45.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00c9c0 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c1a2170 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec4c019070 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.092+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c014480 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.093+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c1a9af0 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.093+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec5c063f40 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.096+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fec4c012050 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.097+0000 7fec5a000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec400b2910 0x7fec400b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.098+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fec4c0e2e10 con 0x7fec5c075d20 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.098+0000 7fec60c00700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec400b2910 0x7fec400b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.098+0000 7fec5a000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] conn(0x7fec400bc4a0 0x7fec400be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.098+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 --> [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec400bf060 con 0x7fec400bc4a0 2024-05-27T09:45:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.098+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fec4c0e31c0 con 0x7fec5c075d20 2024-05-27T09:45:45.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.098+0000 7fec62000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] conn(0x7fec400bc4a0 0x7fec400be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:45.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.098+0000 7fec60c00700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec400b2910 0x7fec400b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fec5c103470 tx=0x7fec48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:45.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.099+0000 7fec62000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] conn(0x7fec400bc4a0 0x7fec400be990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:45.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.100+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== osd.10 v2:172.21.15.72:6824/3492113822 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec400bf060 con 0x7fec400bc4a0 2024-05-27T09:45:45.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.118+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 --> [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec5c0643c0 con 0x7fec400bc4a0 2024-05-27T09:45:45.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec5a000700 1 -- 172.21.15.71:0/586382329 <== osd.10 v2:172.21.15.72:6824/3492113822 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fec5c0643c0 con 0x7fec400bc4a0 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] conn(0x7fec400bc4a0 msgr2=0x7fec400be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec64000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] conn(0x7fec400bc4a0 0x7fec400be990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec400b2910 msgr2=0x7fec400b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec64000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fec400b2910 0x7fec400b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fec5c103470 tx=0x7fec48009260 comp rx=0 tx=0).stop 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c075d20 msgr2=0x7fec5c19d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec64000700 1 --2- 172.21.15.71:0/586382329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec5c075d20 0x7fec5c19d010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00ef10 tx=0x7fec4c00c3a0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.119+0000 7fec62000700 1 -- 172.21.15.71:0/586382329 reap_dead start 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.120+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 shutdown_connections 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.120+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 >> 172.21.15.71:0/586382329 conn(0x7fec5c100030 msgr2=0x7fec5c100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.120+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 shutdown_connections 2024-05-27T09:45:45.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:41.120+0000 7fec64000700 1 -- 172.21.15.71:0/586382329 wait complete. 2024-05-27T09:45:45.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.549+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7feee010a2a0 con 0x7feee01034b0 2024-05-27T09:45:45.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.550+0000 7feed7400700 1 -- 172.21.15.71:0/2978819160 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feed00a9a70 con 0x7feee01034b0 2024-05-27T09:45:45.552 INFO:teuthology.orchestra.run.smithi071.stdout:184683593796 2024-05-27T09:45:45.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feec40b2990 msgr2=0x7feec40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feec40b2990 0x7feec40b4ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feecc006010 tx=0x7feecc005ab0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee01034b0 msgr2=0x7feee019d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee01034b0 0x7feee019d030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feed000e9a0 tx=0x7feed000ecb0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 shutdown_connections 2024-05-27T09:45:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feee0108730 0x7feee01a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feee01034b0 0x7feee019d030 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7feec40b2990 0x7feec40b4ea0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 --2- 172.21.15.71:0/2978819160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feee0107de0 0x7feee019d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 >> 172.21.15.71:0/2978819160 conn(0x7feee00fedb0 msgr2=0x7feee006b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.553+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 shutdown_connections 2024-05-27T09:45:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:45.554+0000 7feee5600700 1 -- 172.21.15.71:0/2978819160 wait complete. 2024-05-27T09:45:45.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:45 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:45 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2978819160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-27T09:45:45.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:45 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:45.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:45 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2978819160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-27T09:45:46.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:46.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:46.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:45 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:45:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:45 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2978819160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-27T09:45:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:46 smithi122 ceph-mon[36436]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:47.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:46 smithi071 ceph-mon[31451]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:46 smithi072 ceph-mon[35951]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:47.298 INFO:teuthology.orchestra.run.smithi071.stdout:287762808877 2024-05-27T09:45:47.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-27T09:45:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:48 smithi122 ceph-mon[36436]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:48.981 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:48 smithi071 ceph-mon[31451]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:48 smithi072 ceph-mon[35951]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:45:49.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 -- 172.21.15.71:0/2541412691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc10c5b0 msgr2=0x7f86dc10c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:49.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 --2- 172.21.15.71:0/2541412691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc10c5b0 0x7f86dc10c9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009990 tx=0x7f86cc009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 -- 172.21.15.71:0/2541412691 shutdown_connections 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 --2- 172.21.15.71:0/2541412691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86dc106ec0 0x7f86dc113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 --2- 172.21.15.71:0/2541412691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc10c5b0 0x7f86dc10c9c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 --2- 172.21.15.71:0/2541412691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86dc106570 0x7f86dc106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 -- 172.21.15.71:0/2541412691 >> 172.21.15.71:0/2541412691 conn(0x7f86dc102070 msgr2=0x7f86dc1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 -- 172.21.15.71:0/2541412691 shutdown_connections 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.360+0000 7f86e1200700 1 -- 172.21.15.71:0/2541412691 wait complete. 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.361+0000 7f86e1200700 1 Processor -- start 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.361+0000 7f86e1200700 1 -- start start 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86e1200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86dc106570 0x7f86dc19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86e1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc106ec0 0x7f86dc19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86e1200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86dc10c5b0 0x7f86dc1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:49.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86e1200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc1166c0 con 0x7f86dc10c5b0 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86e1200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc116540 con 0x7f86dc106ec0 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86e1200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc116840 con 0x7f86dc106570 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86d9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86dc106570 0x7f86dc19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86d9400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc106ec0 0x7f86dc19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86d9400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc106ec0 0x7f86dc19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60226/0 (socket says 172.21.15.71:60226) 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86da800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86dc10c5b0 0x7f86dc1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86d9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86dc106570 0x7f86dc19d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:44284/0 (socket says 172.21.15.71:44284) 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.362+0000 7f86d9400700 1 -- 172.21.15.71:0/1412074007 learned_addr learned my addr 172.21.15.71:0/1412074007 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d9400700 1 -- 172.21.15.71:0/1412074007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86dc106570 msgr2=0x7f86dc19d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d9400700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86dc106570 0x7f86dc19d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d9400700 1 -- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86dc10c5b0 msgr2=0x7f86dc1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:49.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d9400700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86dc10c5b0 0x7f86dc1a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d9400700 1 -- 172.21.15.71:0/1412074007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc1a1f00 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d9400700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc106ec0 0x7f86dc19d5d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009fd0 tx=0x7f86c800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d2a00700 1 -- 172.21.15.71:0/1412074007 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c800eea0 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d2a00700 1 -- 172.21.15.71:0/1412074007 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86c80044d0 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc1a21f0 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.363+0000 7f86d2a00700 1 -- 172.21.15.71:0/1412074007 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8003dd0 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.364+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc1a9b10 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.365+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc0512b0 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.368+0000 7f86d2a00700 1 -- 172.21.15.71:0/1412074007 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f86c8004000 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.370+0000 7f86d2a00700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f86c00b2990 0x7f86c00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.370+0000 7f86d2a00700 1 -- 172.21.15.71:0/1412074007 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f86c80e2520 con 0x7f86dc106ec0 2024-05-27T09:45:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.370+0000 7f86d9e00700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f86c00b2990 0x7f86c00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:49.639 INFO:teuthology.orchestra.run.smithi071.stdout:158913790029 2024-05-27T09:45:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.371+0000 7f86d9e00700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f86c00b2990 0x7f86c00b4ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00b2e0 tx=0x7f86cc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.371+0000 7f86d2a00700 1 -- 172.21.15.71:0/1412074007 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f86c80042f0 con 0x7f86dc106ec0 2024-05-27T09:45:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.625+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f86dc19e390 con 0x7f86dc106ec0 2024-05-27T09:45:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.626+0000 7f86d2a00700 1 -- 172.21.15.71:0/1412074007 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f86c80aa120 con 0x7f86dc106ec0 2024-05-27T09:45:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f86c00b2990 msgr2=0x7f86c00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f86c00b2990 0x7f86c00b4ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00b2e0 tx=0x7f86cc005960 comp rx=0 tx=0).stop 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc106ec0 msgr2=0x7f86dc19d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc106ec0 0x7f86dc19d5d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009fd0 tx=0x7f86c800ed10 comp rx=0 tx=0).stop 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 shutdown_connections 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f86c00b2990 0x7f86c00b4ea0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86dc10c5b0 0x7f86dc1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86dc106570 0x7f86dc19d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 --2- 172.21.15.71:0/1412074007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc106ec0 0x7f86dc19d5d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 >> 172.21.15.71:0/1412074007 conn(0x7f86dc102070 msgr2=0x7f86dc104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 shutdown_connections 2024-05-27T09:45:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.629+0000 7f86e1200700 1 -- 172.21.15.71:0/1412074007 wait complete. 2024-05-27T09:45:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:49 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2002043091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-27T09:45:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:49 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1412074007' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-27T09:45:50.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:49 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2002043091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-27T09:45:50.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:49 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1412074007' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-27T09:45:50.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:49 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2002043091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-27T09:45:50.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:49 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1412074007' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-27T09:45:50.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.757+0000 7f9ba5a00700 1 -- 172.21.15.71:0/3855617262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba010af10 msgr2=0x7f9ba010b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:50.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.757+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/3855617262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba010af10 0x7f9ba010b320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0099c0 tx=0x7f9b8c009cd0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.758+0000 7f9ba5a00700 1 -- 172.21.15.71:0/3855617262 shutdown_connections 2024-05-27T09:45:50.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.758+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/3855617262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 0x7f9ba01131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.758+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/3855617262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ba0106630 0x7f9ba0106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.758+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/3855617262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba010af10 0x7f9ba010b320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.758+0000 7f9ba5a00700 1 -- 172.21.15.71:0/3855617262 >> 172.21.15.71:0/3855617262 conn(0x7f9ba0102020 msgr2=0x7f9ba0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.758+0000 7f9ba5a00700 1 -- 172.21.15.71:0/3855617262 shutdown_connections 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.758+0000 7f9ba5a00700 1 -- 172.21.15.71:0/3855617262 wait complete. 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.759+0000 7f9ba5a00700 1 Processor -- start 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.759+0000 7f9ba5a00700 1 -- start start 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0106630 0x7f9ba019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ba010af10 0x7f9ba019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 0x7f9ba01a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01164e0 con 0x7f9ba010b860 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0116360 con 0x7f9ba010af10 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0116660 con 0x7f9ba0106630 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 0x7f9ba01a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 0x7f9ba01a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54856/0 (socket says 172.21.15.71:54856) 2024-05-27T09:45:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9b9fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0106630 0x7f9ba019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9ba5000700 1 -- 172.21.15.71:0/2002043091 learned_addr learned my addr 172.21.15.71:0/2002043091 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.760+0000 7f9b9f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ba010af10 0x7f9ba019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9b9f400700 1 -- 172.21.15.71:0/2002043091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0106630 msgr2=0x7f9ba019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9b9f400700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0106630 0x7f9ba019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9b9f400700 1 -- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 msgr2=0x7f9ba01a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9b9f400700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 0x7f9ba01a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9b9f400700 1 -- 172.21.15.71:0/2002043091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba01a1d60 con 0x7f9ba010af10 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9ba5000700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 0x7f9ba01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9b9f400700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ba010af10 0x7f9ba019d430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098e0 tx=0x7f9b8c005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.761+0000 7f9b9cc00700 1 -- 172.21.15.71:0/2002043091 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c026070 con 0x7f9ba010af10 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.762+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba01a1ff0 con 0x7f9ba010af10 2024-05-27T09:45:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.762+0000 7f9b9cc00700 1 -- 172.21.15.71:0/2002043091 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b8c0056c0 con 0x7f9ba010af10 2024-05-27T09:45:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.762+0000 7f9b9cc00700 1 -- 172.21.15.71:0/2002043091 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00f960 con 0x7f9ba010af10 2024-05-27T09:45:50.368 INFO:teuthology.orchestra.run.smithi071.stdout:313532612651 2024-05-27T09:45:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.762+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba01a9970 con 0x7f9ba010af10 2024-05-27T09:45:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.763+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba0107a90 con 0x7f9ba010af10 2024-05-27T09:45:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.766+0000 7f9b9cc00700 1 -- 172.21.15.71:0/2002043091 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9b8c029070 con 0x7f9ba010af10 2024-05-27T09:45:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.767+0000 7f9b9cc00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9b840b2910 0x7f9b840b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.767+0000 7f9b9cc00700 1 -- 172.21.15.71:0/2002043091 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f9b8c0e3060 con 0x7f9ba010af10 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.768+0000 7f9b9fe00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9b840b2910 0x7f9b840b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.768+0000 7f9b9fe00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9b840b2910 0x7f9b840b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009c60 tx=0x7f9b90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:48.769+0000 7f9b9cc00700 1 -- 172.21.15.71:0/2002043091 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b8c030080 con 0x7f9ba010af10 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.019+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f9ba00512b0 con 0x7f9ba010af10 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.020+0000 7f9b9cc00700 1 -- 172.21.15.71:0/2002043091 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9b8c013070 con 0x7f9ba010af10 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9b840b2910 msgr2=0x7f9b840b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9b840b2910 0x7f9b840b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009c60 tx=0x7f9b90009260 comp rx=0 tx=0).stop 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ba010af10 msgr2=0x7f9ba019d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ba010af10 0x7f9ba019d430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098e0 tx=0x7f9b8c005280 comp rx=0 tx=0).stop 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 shutdown_connections 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f9b840b2910 0x7f9b840b4e20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba010b860 0x7f9ba01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0106630 0x7f9ba019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 --2- 172.21.15.71:0/2002043091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ba010af10 0x7f9ba019d430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:50.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 >> 172.21.15.71:0/2002043091 conn(0x7f9ba0102020 msgr2=0x7f9ba010a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:50.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 shutdown_connections 2024-05-27T09:45:50.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:49.023+0000 7f9ba5a00700 1 -- 172.21.15.71:0/2002043091 wait complete. 2024-05-27T09:45:50.760 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593792 got 184683593796 for osd.6 2024-05-27T09:45:50.760 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:50 smithi122 ceph-mon[36436]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:51.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:50 smithi071 ceph-mon[31451]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:50 smithi072 ceph-mon[35951]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:45:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.475+0000 7fe9fa000700 1 -- 172.21.15.71:0/3153669931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4076c00 msgr2=0x7fe9f4077010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.475+0000 7fe9fa000700 1 --2- 172.21.15.71:0/3153669931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4076c00 0x7fe9f4077010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009990 tx=0x7fe9e4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.475+0000 7fe9fa000700 1 -- 172.21.15.71:0/3153669931 shutdown_connections 2024-05-27T09:45:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.475+0000 7fe9fa000700 1 --2- 172.21.15.71:0/3153669931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f4110bd0 0x7fe9f4112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.475+0000 7fe9fa000700 1 --2- 172.21.15.71:0/3153669931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4076c00 0x7fe9f4077010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.475+0000 7fe9fa000700 1 --2- 172.21.15.71:0/3153669931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f4077550 0x7fe9f4110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.475+0000 7fe9fa000700 1 -- 172.21.15.71:0/3153669931 >> 172.21.15.71:0/3153669931 conn(0x7fe9f40ffe90 msgr2=0x7fe9f41022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.476+0000 7fe9fa000700 1 -- 172.21.15.71:0/3153669931 shutdown_connections 2024-05-27T09:45:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.476+0000 7fe9fa000700 1 -- 172.21.15.71:0/3153669931 wait complete. 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 Processor -- start 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 -- start start 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f4076c00 0x7fe9f419d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4077550 0x7fe9f419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f4110bd0 0x7fe9f41a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41166b0 con 0x7fe9f4110bd0 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4116530 con 0x7fe9f4077550 2024-05-27T09:45:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.477+0000 7fe9fa000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4116830 con 0x7fe9f4076c00 2024-05-27T09:45:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f4076c00 0x7fe9f419d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f4110bd0 0x7fe9f41a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4077550 0x7fe9f419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f4110bd0 0x7fe9f41a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54888/0 (socket says 172.21.15.71:54888) 2024-05-27T09:45:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3e00700 1 -- 172.21.15.71:0/2192164101 learned_addr learned my addr 172.21.15.71:0/2192164101 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3400700 1 -- 172.21.15.71:0/2192164101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4077550 msgr2=0x7fe9f419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3400700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4077550 0x7fe9f419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3400700 1 -- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f4110bd0 msgr2=0x7fe9f41a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3400700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f4110bd0 0x7fe9f41a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3400700 1 -- 172.21.15.71:0/2192164101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f41a1f30 con 0x7fe9f4076c00 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f2a00700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4077550 0x7fe9f419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.478+0000 7fe9f3400700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f4076c00 0x7fe9f419d060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40059d0 tx=0x7fe9e40047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.479+0000 7fe9ebe00700 1 -- 172.21.15.71:0/2192164101 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4027070 con 0x7fe9f4076c00 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.479+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f41a21c0 con 0x7fe9f4076c00 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.479+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f41a26c0 con 0x7fe9f4076c00 2024-05-27T09:45:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.479+0000 7fe9ebe00700 1 -- 172.21.15.71:0/2192164101 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9e4022470 con 0x7fe9f4076c00 2024-05-27T09:45:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.479+0000 7fe9ebe00700 1 -- 172.21.15.71:0/2192164101 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4017650 con 0x7fe9f4076c00 2024-05-27T09:45:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.480+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d4005330 con 0x7fe9f4076c00 2024-05-27T09:45:51.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.483+0000 7fe9ebe00700 1 -- 172.21.15.71:0/2192164101 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe9e402a070 con 0x7fe9f4076c00 2024-05-27T09:45:51.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.484+0000 7fe9ebe00700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe9d80b2910 0x7fe9d80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:51.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.484+0000 7fe9ebe00700 1 -- 172.21.15.71:0/2192164101 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe9e40e39c0 con 0x7fe9f4076c00 2024-05-27T09:45:51.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.485+0000 7fe9f2a00700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe9d80b2910 0x7fe9d80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:51.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.485+0000 7fe9f2a00700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe9d80b2910 0x7fe9d80b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4103380 tx=0x7fe9e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:51.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.487+0000 7fe9ebe00700 1 -- 172.21.15.71:0/2192164101 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe9e4031070 con 0x7fe9f4076c00 2024-05-27T09:45:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.729+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe9d40058f0 con 0x7fe9f4076c00 2024-05-27T09:45:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.730+0000 7fe9ebe00700 1 -- 172.21.15.71:0/2192164101 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9f41a26c0 con 0x7fe9f4076c00 2024-05-27T09:45:51.732 INFO:teuthology.orchestra.run.smithi071.stdout:55834574949 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe9d80b2910 msgr2=0x7fe9d80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe9d80b2910 0x7fe9d80b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4103380 tx=0x7fe9e0009260 comp rx=0 tx=0).stop 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f4076c00 msgr2=0x7fe9f419d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f4076c00 0x7fe9f419d060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40059d0 tx=0x7fe9e40047b0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 shutdown_connections 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe9d80b2910 0x7fe9d80b4e20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f4110bd0 0x7fe9f41a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f4076c00 0x7fe9f419d060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 --2- 172.21.15.71:0/2192164101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9f4077550 0x7fe9f419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 >> 172.21.15.71:0/2192164101 conn(0x7fe9f40ffe90 msgr2=0x7fe9f4100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 shutdown_connections 2024-05-27T09:45:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:51.734+0000 7fe9fa000700 1 -- 172.21.15.71:0/2192164101 wait complete. 2024-05-27T09:45:52.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.481+0000 7fa507a00700 1 -- 172.21.15.71:0/1274898095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 msgr2=0x7fa5001111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:52.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.481+0000 7fa507a00700 1 --2- 172.21.15.71:0/1274898095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 0x7fa5001111a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800b0d0 tx=0x7fa4f800b3e0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.482+0000 7fa507a00700 1 -- 172.21.15.71:0/1274898095 shutdown_connections 2024-05-27T09:45:52.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.482+0000 7fa507a00700 1 --2- 172.21.15.71:0/1274898095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 0x7fa5001111a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.482+0000 7fa507a00700 1 --2- 172.21.15.71:0/1274898095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5001045c0 0x7fa5001049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.482+0000 7fa507a00700 1 --2- 172.21.15.71:0/1274898095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 0x7fa500109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.482+0000 7fa507a00700 1 -- 172.21.15.71:0/1274898095 >> 172.21.15.71:0/1274898095 conn(0x7fa5000ffe90 msgr2=0x7fa5001022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.482+0000 7fa507a00700 1 -- 172.21.15.71:0/1274898095 shutdown_connections 2024-05-27T09:45:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.482+0000 7fa507a00700 1 -- 172.21.15.71:0/1274898095 wait complete. 2024-05-27T09:45:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.483+0000 7fa507a00700 1 Processor -- start 2024-05-27T09:45:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa507a00700 1 -- start start 2024-05-27T09:45:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa507a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5001045c0 0x7fa50019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa507a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 0x7fa50019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa507a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 0x7fa50019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa507a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5001144c0 con 0x7fa500109840 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa507a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa500114340 con 0x7fa500108ef0 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa507a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa500114640 con 0x7fa5001045c0 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa505a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 0x7fa50019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa4ffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 0x7fa50019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa505000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5001045c0 0x7fa50019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa505a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 0x7fa50019f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54892/0 (socket says 172.21.15.71:54892) 2024-05-27T09:45:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa4ffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 0x7fa50019b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60260/0 (socket says 172.21.15.71:60260) 2024-05-27T09:45:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.484+0000 7fa505a00700 1 -- 172.21.15.71:0/3374755765 learned_addr learned my addr 172.21.15.71:0/3374755765 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.485+0000 7fa4ffe00700 1 -- 172.21.15.71:0/3374755765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5001045c0 msgr2=0x7fa50019ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.485+0000 7fa4ffe00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5001045c0 0x7fa50019ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.485+0000 7fa4ffe00700 1 -- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 msgr2=0x7fa50019f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.485+0000 7fa4ffe00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 0x7fa50019f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.485+0000 7fa4ffe00700 1 -- 172.21.15.71:0/3374755765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50019fce0 con 0x7fa500108ef0 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.485+0000 7fa4ffe00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 0x7fa50019b3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00e9c0 tx=0x7fa4ec00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.486+0000 7fa4fd600700 1 -- 172.21.15.71:0/3374755765 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00c9c0 con 0x7fa500108ef0 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.486+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50019ffd0 con 0x7fa500108ef0 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.486+0000 7fa4fd600700 1 -- 172.21.15.71:0/3374755765 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4ec00cb60 con 0x7fa500108ef0 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.486+0000 7fa4fd600700 1 -- 172.21.15.71:0/3374755765 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec018680 con 0x7fa500108ef0 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.486+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5001a78f0 con 0x7fa500108ef0 2024-05-27T09:45:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.487+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5000512b0 con 0x7fa500108ef0 2024-05-27T09:45:52.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.489+0000 7fa4fd600700 1 -- 172.21.15.71:0/3374755765 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa4ec04aae0 con 0x7fa500108ef0 2024-05-27T09:45:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.491+0000 7fa4fd600700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa4e80b2910 0x7fa4e80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.491+0000 7fa4fd600700 1 -- 172.21.15.71:0/3374755765 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fa4ec0e2660 con 0x7fa500108ef0 2024-05-27T09:45:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.491+0000 7fa505000700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa4e80b2910 0x7fa4e80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:52.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.492+0000 7fa505000700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa4e80b2910 0x7fa4e80b4e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4007be0 tx=0x7fa4f40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:52.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.493+0000 7fa4fd600700 1 -- 172.21.15.71:0/3374755765 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa4ec0aa1d0 con 0x7fa500108ef0 2024-05-27T09:45:52.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.731+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa50002e5e0 con 0x7fa500108ef0 2024-05-27T09:45:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.732+0000 7fa4fd600700 1 -- 172.21.15.71:0/3374755765 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa4ec0b2250 con 0x7fa500108ef0 2024-05-27T09:45:52.733 INFO:teuthology.orchestra.run.smithi071.stdout:137438953554 2024-05-27T09:45:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa4e80b2910 msgr2=0x7fa4e80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa4e80b2910 0x7fa4e80b4e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4007be0 tx=0x7fa4f40073d0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 msgr2=0x7fa50019b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 0x7fa50019b3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00e9c0 tx=0x7fa4ec00ecd0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 shutdown_connections 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa4e80b2910 0x7fa4e80b4e20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500109840 0x7fa50019f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5001045c0 0x7fa50019ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 --2- 172.21.15.71:0/3374755765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500108ef0 0x7fa50019b3b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 >> 172.21.15.71:0/3374755765 conn(0x7fa5000ffe90 msgr2=0x7fa500108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 shutdown_connections 2024-05-27T09:45:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:52.735+0000 7fa507a00700 1 -- 172.21.15.71:0/3374755765 wait complete. 2024-05-27T09:45:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:52 smithi122 ceph-mon[36436]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:52 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2192164101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-27T09:45:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:52 smithi071 ceph-mon[31451]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:52 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2192164101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-27T09:45:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:52 smithi072 ceph-mon[35951]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:45:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:52 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2192164101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 -- 172.21.15.71:0/3445801538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d8108f10 msgr2=0x7ff2d8109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 --2- 172.21.15.71:0/3445801538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d8108f10 0x7ff2d8109320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40099c0 tx=0x7ff2c4009cd0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 -- 172.21.15.71:0/3445801538 shutdown_connections 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 --2- 172.21.15.71:0/3445801538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2d8109860 0x7ff2d81111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 --2- 172.21.15.71:0/3445801538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d81045e0 0x7ff2d81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 --2- 172.21.15.71:0/3445801538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d8108f10 0x7ff2d8109320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 -- 172.21.15.71:0/3445801538 >> 172.21.15.71:0/3445801538 conn(0x7ff2d8100030 msgr2=0x7ff2d8102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 -- 172.21.15.71:0/3445801538 shutdown_connections 2024-05-27T09:45:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.648+0000 7ff2df200700 1 -- 172.21.15.71:0/3445801538 wait complete. 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.649+0000 7ff2df200700 1 Processor -- start 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.649+0000 7ff2df200700 1 -- start start 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2df200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d81045e0 0x7ff2d819d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2df200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2d8108f10 0x7ff2d819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2df200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d8109860 0x7ff2d81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2df200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81144c0 con 0x7ff2d81045e0 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2df200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8114340 con 0x7ff2d8109860 2024-05-27T09:45:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2df200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8114640 con 0x7ff2d8108f10 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2d7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d81045e0 0x7ff2d819d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2d7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d81045e0 0x7ff2d819d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54900/0 (socket says 172.21.15.71:54900) 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2d7e00700 1 -- 172.21.15.71:0/2477728355 learned_addr learned my addr 172.21.15.71:0/2477728355 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2d7400700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2d8108f10 0x7ff2d819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.650+0000 7ff2dd200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d8109860 0x7ff2d81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d7e00700 1 -- 172.21.15.71:0/2477728355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2d8108f10 msgr2=0x7ff2d819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d7e00700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2d8108f10 0x7ff2d819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d7e00700 1 -- 172.21.15.71:0/2477728355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d8109860 msgr2=0x7ff2d81a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d7e00700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d8109860 0x7ff2d81a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d7e00700 1 -- 172.21.15.71:0/2477728355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d81a1f60 con 0x7ff2d81045e0 2024-05-27T09:45:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2dd200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d8109860 0x7ff2d81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d7e00700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d81045e0 0x7ff2d819d090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800eb30 tx=0x7ff2c800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800cbd0 con 0x7ff2d81045e0 2024-05-27T09:45:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d81a2250 con 0x7ff2d81045e0 2024-05-27T09:45:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.651+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2c80044d0 con 0x7ff2d81045e0 2024-05-27T09:45:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.652+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8003e30 con 0x7ff2d81045e0 2024-05-27T09:45:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.652+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d81a9b70 con 0x7ff2d81045e0 2024-05-27T09:45:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.653+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d80512b0 con 0x7ff2d81045e0 2024-05-27T09:45:53.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.655+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff2c8004000 con 0x7ff2d81045e0 2024-05-27T09:45:53.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.657+0000 7ff2d4c00700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2bc0b2990 0x7ff2bc0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:53.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.657+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff2c80e26e0 con 0x7ff2d81045e0 2024-05-27T09:45:53.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.657+0000 7ff2d7400700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2bc0b2990 0x7ff2bc0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:53.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.658+0000 7ff2d7400700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2bc0b2990 0x7ff2bc0b4ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4000c00 tx=0x7ff2c401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:53.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.662+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff2c80042f0 con 0x7ff2d81045e0 2024-05-27T09:45:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.748+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff2c80a5de0 con 0x7ff2d81045e0 2024-05-27T09:45:53.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.910+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff2d81a9d40 con 0x7ff2d81045e0 2024-05-27T09:45:53.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.911+0000 7ff2d4c00700 1 -- 172.21.15.71:0/2477728355 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff2c80aa250 con 0x7ff2d81045e0 2024-05-27T09:45:53.912 INFO:teuthology.orchestra.run.smithi071.stdout:111669149784 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2bc0b2990 msgr2=0x7ff2bc0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2bc0b2990 0x7ff2bc0b4ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4000c00 tx=0x7ff2c401a040 comp rx=0 tx=0).stop 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d81045e0 msgr2=0x7ff2d819d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d81045e0 0x7ff2d819d090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800eb30 tx=0x7ff2c800ee40 comp rx=0 tx=0).stop 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 shutdown_connections 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d8109860 0x7ff2d81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7ff2bc0b2990 0x7ff2bc0b4ea0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2d81045e0 0x7ff2d819d090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 --2- 172.21.15.71:0/2477728355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2d8108f10 0x7ff2d819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 >> 172.21.15.71:0/2477728355 conn(0x7ff2d8100030 msgr2=0x7ff2d81087f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.914+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 shutdown_connections 2024-05-27T09:45:53.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:53.915+0000 7ff2df200700 1 -- 172.21.15.71:0/2477728355 wait complete. 2024-05-27T09:45:53.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:53 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3374755765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-27T09:45:53.984 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:53 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3374755765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-27T09:45:54.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:53 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3374755765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-27T09:45:54.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 -- 172.21.15.71:0/2403830143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90301043f0 msgr2=0x7f9030104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:54.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 --2- 172.21.15.71:0/2403830143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90301043f0 0x7f9030104800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f90200098f0 tx=0x7f9020009c00 comp rx=0 tx=0).stop 2024-05-27T09:45:54.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 -- 172.21.15.71:0/2403830143 shutdown_connections 2024-05-27T09:45:54.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 --2- 172.21.15.71:0/2403830143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9030109670 0x7f9030110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 --2- 172.21.15.71:0/2403830143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90301043f0 0x7f9030104800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 --2- 172.21.15.71:0/2403830143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9030108d20 0x7f9030109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 -- 172.21.15.71:0/2403830143 >> 172.21.15.71:0/2403830143 conn(0x7f9030079d00 msgr2=0x7f903007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.214+0000 7f9035600700 1 -- 172.21.15.71:0/2403830143 shutdown_connections 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.215+0000 7f9035600700 1 -- 172.21.15.71:0/2403830143 wait complete. 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.216+0000 7f9035600700 1 Processor -- start 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.217+0000 7f9035600700 1 -- start start 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.217+0000 7f9035600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90301043f0 0x7f9030075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.217+0000 7f9035600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9030108d20 0x7f9030075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.217+0000 7f9035600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9030109670 0x7f9030076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.217+0000 7f9035600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90301142a0 con 0x7f9030109670 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.217+0000 7f9035600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9030114120 con 0x7f9030108d20 2024-05-27T09:45:54.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.217+0000 7f9035600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9030114420 con 0x7f90301043f0 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90301043f0 0x7f9030075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90301043f0 0x7f9030075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:48440/0 (socket says 172.21.15.71:48440) 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 -- 172.21.15.71:0/889939874 learned_addr learned my addr 172.21.15.71:0/889939874 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f9034c00700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9030109670 0x7f9030076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902f400700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9030108d20 0x7f9030075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 -- 172.21.15.71:0/889939874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9030108d20 msgr2=0x7f9030075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9030108d20 0x7f9030075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 -- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9030109670 msgr2=0x7f9030076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9030109670 0x7f9030076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.218+0000 7f902fe00700 1 -- 172.21.15.71:0/889939874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90301a9030 con 0x7f90301043f0 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.219+0000 7f902fe00700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90301043f0 0x7f9030075ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9020009230 tx=0x7f902000fa60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.219+0000 7f902cc00700 1 -- 172.21.15.71:0/889939874 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020005400 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.219+0000 7f902cc00700 1 -- 172.21.15.71:0/889939874 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90200055a0 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.219+0000 7f902cc00700 1 -- 172.21.15.71:0/889939874 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020004dc0 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.219+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90301a92c0 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.219+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90301a96c0 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.220+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90301058a0 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.223+0000 7f902cc00700 1 -- 172.21.15.71:0/889939874 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f902000b560 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.224+0000 7f902cc00700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f90140b2900 0x7f90140b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.225+0000 7f902cc00700 1 -- 172.21.15.71:0/889939874 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f90200e37c0 con 0x7f90301043f0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.225+0000 7f902f400700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f90140b2900 0x7f90140b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.225+0000 7f902f400700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f90140b2900 0x7f90140b4e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f903007a410 tx=0x7f901c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.226+0000 7f902cc00700 1 -- 172.21.15.71:0/889939874 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9020013030 con 0x7f90301043f0 2024-05-27T09:45:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.471+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f903002e5e0 con 0x7f90301043f0 2024-05-27T09:45:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.471+0000 7f902cc00700 1 -- 172.21.15.71:0/889939874 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f90200ab520 con 0x7f90301043f0 2024-05-27T09:45:54.473 INFO:teuthology.orchestra.run.smithi071.stdout:210453397570 2024-05-27T09:45:54.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.474+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f90140b2900 msgr2=0x7f90140b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:54.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.474+0000 7f9035600700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f90140b2900 0x7f90140b4e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f903007a410 tx=0x7f901c009310 comp rx=0 tx=0).stop 2024-05-27T09:45:54.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.474+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90301043f0 msgr2=0x7f9030075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:54.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.474+0000 7f9035600700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90301043f0 0x7f9030075ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9020009230 tx=0x7f902000fa60 comp rx=0 tx=0).stop 2024-05-27T09:45:54.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 shutdown_connections 2024-05-27T09:45:54.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f90140b2900 0x7f90140b4e10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9030109670 0x7f9030076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90301043f0 0x7f9030075ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 --2- 172.21.15.71:0/889939874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9030108d20 0x7f9030075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 >> 172.21.15.71:0/889939874 conn(0x7f9030079d00 msgr2=0x7f9030102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 shutdown_connections 2024-05-27T09:45:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:54.475+0000 7f9035600700 1 -- 172.21.15.71:0/889939874 wait complete. 2024-05-27T09:45:54.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:54 smithi071 ceph-mon[31451]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-27T09:45:54.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:54 smithi071 ceph-mon[31451]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-27T09:45:54.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:54 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2477728355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-27T09:45:54.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:54 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/889939874' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-27T09:45:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:54 smithi122 ceph-mon[36436]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-27T09:45:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:54 smithi122 ceph-mon[36436]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-27T09:45:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:54 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2477728355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-27T09:45:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:54 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/889939874' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-27T09:45:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:54 smithi072 ceph-mon[35951]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-27T09:45:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:54 smithi072 ceph-mon[35951]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-27T09:45:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:54 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2477728355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-27T09:45:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:54 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/889939874' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-27T09:45:55.035 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574941 got 55834574949 for osd.1 2024-05-27T09:45:55.035 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:55.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953547 got 137438953554 for osd.4 2024-05-27T09:45:55.584 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:55.657 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790025 got 158913790029 for osd.5 2024-05-27T09:45:55.657 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 -- 172.21.15.71:0/342717452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410b100 msgr2=0x7f1b44117610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 --2- 172.21.15.71:0/342717452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410b100 0x7f1b44117610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00b0a0 tx=0x7f1b3c00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 -- 172.21.15.71:0/342717452 shutdown_connections 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 --2- 172.21.15.71:0/342717452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410b100 0x7f1b44117610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 --2- 172.21.15.71:0/342717452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4410f6b0 0x7f1b4410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 --2- 172.21.15.71:0/342717452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b4410a7b0 0x7f1b4410abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 -- 172.21.15.71:0/342717452 >> 172.21.15.71:0/342717452 conn(0x7f1b44076af0 msgr2=0x7f1b44076f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 -- 172.21.15.71:0/342717452 shutdown_connections 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.015+0000 7f1b49600700 1 -- 172.21.15.71:0/342717452 wait complete. 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.016+0000 7f1b49600700 1 Processor -- start 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.016+0000 7f1b49600700 1 -- start start 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b49600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4410a7b0 0x7f1b441a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b49600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b4410b100 0x7f1b441a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b49600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410f6b0 0x7f1b441a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b49600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4411a8e0 con 0x7f1b4410f6b0 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b49600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4411a760 con 0x7f1b4410a7b0 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b49600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4411aa60 con 0x7f1b4410b100 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b48c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410f6b0 0x7f1b441a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b43e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4410a7b0 0x7f1b441a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b43e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4410a7b0 0x7f1b441a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51112/0 (socket says 172.21.15.71:51112) 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b43e00700 1 -- 172.21.15.71:0/1970212421 learned_addr learned my addr 172.21.15.71:0/1970212421 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b48c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410f6b0 0x7f1b441a59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36320/0 (socket says 172.21.15.71:36320) 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.017+0000 7f1b43400700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b4410b100 0x7f1b441a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b48c00700 1 -- 172.21.15.71:0/1970212421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b4410b100 msgr2=0x7f1b441a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b48c00700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b4410b100 0x7f1b441a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b48c00700 1 -- 172.21.15.71:0/1970212421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4410a7b0 msgr2=0x7f1b441a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b48c00700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4410a7b0 0x7f1b441a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b48c00700 1 -- 172.21.15.71:0/1970212421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b441a6040 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b43400700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b4410b100 0x7f1b441a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b48c00700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410f6b0 0x7f1b441a59a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00b070 tx=0x7f1b3c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.018+0000 7f1b40c00700 1 -- 172.21.15.71:0/1970212421 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c021070 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.019+0000 7f1b40c00700 1 -- 172.21.15.71:0/1970212421 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b3c007e30 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.019+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b441a62d0 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.019+0000 7f1b40c00700 1 -- 172.21.15.71:0/1970212421 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0045f0 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.019+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b441adc50 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.020+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b440512b0 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.023+0000 7f1b40c00700 1 -- 172.21.15.71:0/1970212421 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1b3c007980 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.024+0000 7f1b40c00700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b280b2900 0x7f1b280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.025+0000 7f1b40c00700 1 -- 172.21.15.71:0/1970212421 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1b3c00f020 con 0x7f1b4410f6b0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.025+0000 7f1b43e00700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b280b2900 0x7f1b280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.025+0000 7f1b43e00700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b280b2900 0x7f1b280b4e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009ca0 tx=0x7f1b34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.027+0000 7f1b40c00700 1 -- 172.21.15.71:0/1970212421 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1b3c02a020 con 0x7f1b4410f6b0 2024-05-27T09:45:56.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.269+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1b4402e5e0 con 0x7f1b4410f6b0 2024-05-27T09:45:56.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.270+0000 7f1b40c00700 1 -- 172.21.15.71:0/1970212421 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b3c0ab660 con 0x7f1b4410f6b0 2024-05-27T09:45:56.272 INFO:teuthology.orchestra.run.smithi071.stdout:34359738474 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.273+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b280b2900 msgr2=0x7f1b280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.273+0000 7f1b49600700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b280b2900 0x7f1b280b4e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009ca0 tx=0x7f1b34009260 comp rx=0 tx=0).stop 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.273+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410f6b0 msgr2=0x7f1b441a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.273+0000 7f1b49600700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410f6b0 0x7f1b441a59a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00b070 tx=0x7f1b3c004c80 comp rx=0 tx=0).stop 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 shutdown_connections 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1b280b2900 0x7f1b280b4e10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b4410f6b0 0x7f1b441a59a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4410a7b0 0x7f1b441a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 --2- 172.21.15.71:0/1970212421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b4410b100 0x7f1b441a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:56.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 >> 172.21.15.71:0/1970212421 conn(0x7f1b44076af0 msgr2=0x7f1b441087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:56.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 shutdown_connections 2024-05-27T09:45:56.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:56.274+0000 7f1b49600700 1 -- 172.21.15.71:0/1970212421 wait complete. 2024-05-27T09:45:56.567 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397564 got 210453397570 for osd.7 2024-05-27T09:45:56.567 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:56.846 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:56 smithi071 ceph-mon[31451]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:45:56.846 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:56 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1970212421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-27T09:45:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:56 smithi072 ceph-mon[35951]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:45:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:56 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1970212421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-27T09:45:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:56 smithi122 ceph-mon[36436]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:45:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:56 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1970212421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-27T09:45:57.329 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149779 got 111669149784 for osd.3 2024-05-27T09:45:57.329 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:57.967 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612646 got 313532612651 for osd.11 2024-05-27T09:45:57.968 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:58.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 -- 172.21.15.71:0/3847831479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 msgr2=0x7f29b8110720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:58.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 --2- 172.21.15.71:0/3847831479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 0x7f29b8110720 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009990 tx=0x7f29a0009ca0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 -- 172.21.15.71:0/3847831479 shutdown_connections 2024-05-27T09:45:58.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 --2- 172.21.15.71:0/3847831479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b8110c60 0x7f29b8113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 --2- 172.21.15.71:0/3847831479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29b81030b0 0x7f29b81034c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 --2- 172.21.15.71:0/3847831479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 0x7f29b8110720 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 -- 172.21.15.71:0/3847831479 >> 172.21.15.71:0/3847831479 conn(0x7f29b80fedb0 msgr2=0x7f29b81011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:58.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.296+0000 7f29bee00700 1 -- 172.21.15.71:0/3847831479 shutdown_connections 2024-05-27T09:45:58.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.297+0000 7f29bee00700 1 -- 172.21.15.71:0/3847831479 wait complete. 2024-05-27T09:45:58.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.298+0000 7f29bee00700 1 Processor -- start 2024-05-27T09:45:58.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.298+0000 7f29bee00700 1 -- start start 2024-05-27T09:45:58.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29bee00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b81030b0 0x7f29b819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:58.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29bee00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 0x7f29b819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:58.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29bee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29b8110c60 0x7f29b81a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29bee00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81166b0 con 0x7f29b81030b0 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29bee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8116530 con 0x7f29b8110c60 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29bee00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8116830 con 0x7f29b8103a00 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29b7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b81030b0 0x7f29b819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29b7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b81030b0 0x7f29b819d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36352/0 (socket says 172.21.15.71:36352) 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29b7e00700 1 -- 172.21.15.71:0/852859500 learned_addr learned my addr 172.21.15.71:0/852859500 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29bce00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29b8110c60 0x7f29b81a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:58.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.299+0000 7f29afe00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 0x7f29b819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:58.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b7e00700 1 -- 172.21.15.71:0/852859500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 msgr2=0x7f29b819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:58.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b7e00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 0x7f29b819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b7e00700 1 -- 172.21.15.71:0/852859500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29b8110c60 msgr2=0x7f29b81a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:58.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b7e00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29b8110c60 0x7f29b81a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b7e00700 1 -- 172.21.15.71:0/852859500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b81a1f50 con 0x7f29b81030b0 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29bce00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29b8110c60 0x7f29b81a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b7e00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b81030b0 0x7f29b819d080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29a800e9c0 tx=0x7f29a800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b5600700 1 -- 172.21.15.71:0/852859500 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a800cbd0 con 0x7f29b81030b0 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b5600700 1 -- 172.21.15.71:0/852859500 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a800ee60 con 0x7f29b81030b0 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b81a2240 con 0x7f29b81030b0 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.300+0000 7f29b5600700 1 -- 172.21.15.71:0/852859500 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a80055c0 con 0x7f29b81030b0 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.301+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81a9b60 con 0x7f29b81030b0 2024-05-27T09:45:58.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.302+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b80512b0 con 0x7f29b81030b0 2024-05-27T09:45:58.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.304+0000 7f29b5600700 1 -- 172.21.15.71:0/852859500 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f29a8004750 con 0x7f29b81030b0 2024-05-27T09:45:58.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.306+0000 7f29b5600700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f299c0b2880 0x7f299c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:45:58.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.306+0000 7f29b5600700 1 -- 172.21.15.71:0/852859500 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f29a80e2750 con 0x7f29b81030b0 2024-05-27T09:45:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.306+0000 7f29afe00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f299c0b2880 0x7f299c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:45:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.307+0000 7f29afe00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f299c0b2880 0x7f299c0b4d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f29b8112330 tx=0x7f29a0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:45:58.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.310+0000 7f29b5600700 1 -- 172.21.15.71:0/852859500 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f29a8054df0 con 0x7f29b81030b0 2024-05-27T09:45:58.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.543+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f29b819e3e0 con 0x7f29b81030b0 2024-05-27T09:45:58.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.543+0000 7f29b5600700 1 -- 172.21.15.71:0/852859500 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f29a80aa420 con 0x7f29b81030b0 2024-05-27T09:45:58.545 INFO:teuthology.orchestra.run.smithi071.stdout:236223201341 2024-05-27T09:45:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f299c0b2880 msgr2=0x7f299c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f299c0b2880 0x7f299c0b4d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f29b8112330 tx=0x7f29a0005fd0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b81030b0 msgr2=0x7f29b819d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:45:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b81030b0 0x7f29b819d080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29a800e9c0 tx=0x7f29a800ecd0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 shutdown_connections 2024-05-27T09:45:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29b8110c60 0x7f29b81a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f299c0b2880 0x7f299c0b4d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29b81030b0 0x7f29b819d080 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 --2- 172.21.15.71:0/852859500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29b8103a00 0x7f29b819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:45:58.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.547+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 >> 172.21.15.71:0/852859500 conn(0x7f29b80fedb0 msgr2=0x7f29b81127b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:45:58.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.548+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 shutdown_connections 2024-05-27T09:45:58.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:45:58.548+0000 7f29bee00700 1 -- 172.21.15.71:0/852859500 wait complete. 2024-05-27T09:45:58.763 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738467 got 34359738474 for osd.0 2024-05-27T09:45:58.764 DEBUG:teuthology.parallel:result is None 2024-05-27T09:45:58.955 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:58.956 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:58.971 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:45:59.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:58 smithi071 ceph-mon[31451]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:45:59.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:45:58 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/852859500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-27T09:45:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:58 smithi072 ceph-mon[35951]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:45:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:45:58 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/852859500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-27T09:45:59.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:58 smithi122 ceph-mon[36436]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:45:59.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:45:58 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/852859500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-27T09:45:59.534 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201335 got 236223201341 for osd.8 2024-05-27T09:45:59.534 DEBUG:teuthology.parallel:result is None 2024-05-27T09:46:01.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:00 smithi071 ceph-mon[31451]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:46:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:00 smithi072 ceph-mon[35951]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:46:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:00 smithi122 ceph-mon[36436]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:46:03.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:02 smithi071 ceph-mon[31451]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:46:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:02 smithi072 ceph-mon[35951]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:46:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:02 smithi122 ceph-mon[36436]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-27T09:46:05.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:04 smithi071 ceph-mon[31451]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:46:05.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:04 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2985698440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-27T09:46:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:04 smithi072 ceph-mon[35951]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:46:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:04 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2985698440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-27T09:46:05.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 -- 172.21.15.71:0/493804195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42641045e0 msgr2=0x7f42641049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 --2- 172.21.15.71:0/493804195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42641045e0 0x7f42641049f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42540099c0 tx=0x7f4254009cd0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 -- 172.21.15.71:0/493804195 shutdown_connections 2024-05-27T09:46:05.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 --2- 172.21.15.71:0/493804195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4264109860 0x7f42641111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 --2- 172.21.15.71:0/493804195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42641045e0 0x7f42641049f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 --2- 172.21.15.71:0/493804195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4264108f10 0x7f4264109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 -- 172.21.15.71:0/493804195 >> 172.21.15.71:0/493804195 conn(0x7f4264100030 msgr2=0x7f4264102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 -- 172.21.15.71:0/493804195 shutdown_connections 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.074+0000 7f4269800700 1 -- 172.21.15.71:0/493804195 wait complete. 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.075+0000 7f4269800700 1 Processor -- start 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.075+0000 7f4269800700 1 -- start start 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4269800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42641045e0 0x7f4264075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4269800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4264108f10 0x7f4264075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4269800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4264109860 0x7f4264076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4269800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f42641144e0 con 0x7f4264108f10 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4269800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4264114360 con 0x7f4264109860 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4269800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4264114660 con 0x7f42641045e0 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4262000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4264108f10 0x7f4264075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4262a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42641045e0 0x7f4264075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4262a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42641045e0 0x7f4264075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53902/0 (socket says 172.21.15.71:53902) 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4262a00700 1 -- 172.21.15.71:0/2380761996 learned_addr learned my addr 172.21.15.71:0/2380761996 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.076+0000 7f4263400700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4264109860 0x7f4264076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4262a00700 1 -- 172.21.15.71:0/2380761996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4264109860 msgr2=0x7f4264076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4262a00700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4264109860 0x7f4264076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4262a00700 1 -- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4264108f10 msgr2=0x7f4264075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4262a00700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4264108f10 0x7f4264075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4262a00700 1 -- 172.21.15.71:0/2380761996 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42641a9210 con 0x7f42641045e0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4262a00700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42641045e0 0x7f4264075ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4254005910 tx=0x7f4254004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f425b400700 1 -- 172.21.15.71:0/2380761996 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254026070 con 0x7f42641045e0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42641a94a0 con 0x7f42641045e0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f425b400700 1 -- 172.21.15.71:0/2380761996 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4254003c70 con 0x7f42641045e0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f425b400700 1 -- 172.21.15.71:0/2380761996 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425400fae0 con 0x7f42641045e0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.077+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42641a9950 con 0x7f42641045e0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.078+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42640512b0 con 0x7f42641045e0 2024-05-27T09:46:05.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.081+0000 7f425b400700 1 -- 172.21.15.71:0/2380761996 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4254029070 con 0x7f42641045e0 2024-05-27T09:46:05.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.082+0000 7f425b400700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42480b2880 0x7f42480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.083+0000 7f425b400700 1 -- 172.21.15.71:0/2380761996 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f42540e2f90 con 0x7f42641045e0 2024-05-27T09:46:05.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.083+0000 7f4262000700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42480b2880 0x7f42480b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.084+0000 7f4262000700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42480b2880 0x7f42480b4d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4264107a00 tx=0x7f4250009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:05.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.085+0000 7f425b400700 1 -- 172.21.15.71:0/2380761996 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f425405edf0 con 0x7f42641045e0 2024-05-27T09:46:05.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 -- 172.21.15.71:0/3667076251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 msgr2=0x7efcb8109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 --2- 172.21.15.71:0/3667076251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8109320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efca40098f0 tx=0x7efca4009c00 comp rx=0 tx=0).stop 2024-05-27T09:46:05.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 -- 172.21.15.71:0/3667076251 shutdown_connections 2024-05-27T09:46:05.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 --2- 172.21.15.71:0/3667076251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efcb8109860 0x7efcb81111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 --2- 172.21.15.71:0/3667076251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcb81045e0 0x7efcb81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 --2- 172.21.15.71:0/3667076251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8109320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 -- 172.21.15.71:0/3667076251 >> 172.21.15.71:0/3667076251 conn(0x7efcb8100030 msgr2=0x7efcb8102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.189+0000 7efcbf200700 1 -- 172.21.15.71:0/3667076251 shutdown_connections 2024-05-27T09:46:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.190+0000 7efcbf200700 1 -- 172.21.15.71:0/3667076251 wait complete. 2024-05-27T09:46:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 Processor -- start 2024-05-27T09:46:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 -- start start 2024-05-27T09:46:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcb81045e0 0x7efcb8075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efcb8109860 0x7efcb8076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efcb81144c0 con 0x7efcb81045e0 2024-05-27T09:46:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efcb8114340 con 0x7efcb8108f10 2024-05-27T09:46:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.191+0000 7efcbf200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efcb8114640 con 0x7efcb8109860 2024-05-27T09:46:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcb81045e0 0x7efcb8075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcbd200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efcb8109860 0x7efcb8076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8075ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53348/0 (socket says 172.21.15.71:53348) 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 -- 172.21.15.71:0/178983468 learned_addr learned my addr 172.21.15.71:0/178983468 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 -- 172.21.15.71:0/178983468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efcb8109860 msgr2=0x7efcb8076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efcb8109860 0x7efcb8076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 -- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcb81045e0 msgr2=0x7efcb8075ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcb81045e0 0x7efcb8075ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.192+0000 7efcb7400700 1 -- 172.21.15.71:0/178983468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb81a92d0 con 0x7efcb8108f10 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.193+0000 7efcb7400700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8075ff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efca400c010 tx=0x7efca400f9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.193+0000 7efcb4c00700 1 -- 172.21.15.71:0/178983468 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4027070 con 0x7efcb8108f10 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.193+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb81a9560 con 0x7efcb8108f10 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.193+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb81a9a10 con 0x7efcb8108f10 2024-05-27T09:46:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.193+0000 7efcb4c00700 1 -- 172.21.15.71:0/178983468 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efca40055f0 con 0x7efcb8108f10 2024-05-27T09:46:05.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.193+0000 7efcb4c00700 1 -- 172.21.15.71:0/178983468 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4004dc0 con 0x7efcb8108f10 2024-05-27T09:46:05.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.195+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc98005330 con 0x7efcb8108f10 2024-05-27T09:46:05.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.198+0000 7efcb4c00700 1 -- 172.21.15.71:0/178983468 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efca402a070 con 0x7efcb8108f10 2024-05-27T09:46:05.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.199+0000 7efcb4c00700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efc9c0b2900 0x7efc9c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.199+0000 7efcb4c00700 1 -- 172.21.15.71:0/178983468 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7efca40e2e20 con 0x7efcb8108f10 2024-05-27T09:46:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.199+0000 7efcb7e00700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efc9c0b2900 0x7efc9c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.200+0000 7efcb7e00700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efc9c0b2900 0x7efc9c0b4e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efca8005fd0 tx=0x7efca8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:05.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.201+0000 7efcb4c00700 1 -- 172.21.15.71:0/178983468 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efca4031080 con 0x7efcb8108f10 2024-05-27T09:46:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:04 smithi122 ceph-mon[36436]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-27T09:46:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:04 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2985698440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-27T09:46:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.315+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f426402e5e0 con 0x7f42641045e0 2024-05-27T09:46:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.316+0000 7f425b400700 1 -- 172.21.15.71:0/2380761996 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4254013070 con 0x7f42641045e0 2024-05-27T09:46:05.317 INFO:teuthology.orchestra.run.smithi071.stdout:77309411425 2024-05-27T09:46:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42480b2880 msgr2=0x7f42480b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42480b2880 0x7f42480b4d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4264107a00 tx=0x7f4250009260 comp rx=0 tx=0).stop 2024-05-27T09:46:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42641045e0 msgr2=0x7f4264075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42641045e0 0x7f4264075ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4254005910 tx=0x7f4254004270 comp rx=0 tx=0).stop 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 shutdown_connections 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4264109860 0x7f4264076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42641045e0 0x7f4264075ab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f42480b2880 0x7f42480b4d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 --2- 172.21.15.71:0/2380761996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4264108f10 0x7f4264075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 >> 172.21.15.71:0/2380761996 conn(0x7f4264100030 msgr2=0x7f426410a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 shutdown_connections 2024-05-27T09:46:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.319+0000 7f4269800700 1 -- 172.21.15.71:0/2380761996 wait complete. 2024-05-27T09:46:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 -- 172.21.15.71:0/435721412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f4109860 msgr2=0x7fc7f41111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/435721412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f4109860 0x7fc7f41111c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00b0d0 tx=0x7fc7ec00b3e0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 -- 172.21.15.71:0/435721412 shutdown_connections 2024-05-27T09:46:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/435721412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f4109860 0x7fc7f41111c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/435721412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f41045e0 0x7fc7f41049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/435721412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7f4108f10 0x7fc7f4109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 -- 172.21.15.71:0/435721412 >> 172.21.15.71:0/435721412 conn(0x7fc7f4100030 msgr2=0x7fc7f4102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 -- 172.21.15.71:0/435721412 shutdown_connections 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.984+0000 7fc7f8e00700 1 -- 172.21.15.71:0/435721412 wait complete. 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.985+0000 7fc7f8e00700 1 Processor -- start 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.985+0000 7fc7f8e00700 1 -- start start 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f8e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41045e0 0x7fc7f419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f8e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f4108f10 0x7fc7f419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f8e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7f4109860 0x7fc7f419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f8e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4114490 con 0x7fc7f4109860 2024-05-27T09:46:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f8e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4114310 con 0x7fc7f4108f10 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f8e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4114610 con 0x7fc7f41045e0 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f1e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41045e0 0x7fc7f419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7f4109860 0x7fc7f419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f1e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41045e0 0x7fc7f419adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53890/0 (socket says 172.21.15.71:53890) 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7f1e00700 1 -- 172.21.15.71:0/2985698440 learned_addr learned my addr 172.21.15.71:0/2985698440 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.986+0000 7fc7e9400700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f4108f10 0x7fc7f419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7f1e00700 1 -- 172.21.15.71:0/2985698440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f4108f10 msgr2=0x7fc7f419b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7f1e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f4108f10 0x7fc7f419b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7f1e00700 1 -- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7f4109860 msgr2=0x7fc7f419f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7f1e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7f4109860 0x7fc7f419f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7f1e00700 1 -- 172.21.15.71:0/2985698440 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f419fc90 con 0x7fc7f41045e0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7e9400700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f4108f10 0x7fc7f419b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7f1e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41045e0 0x7fc7f419adc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400e9a0 tx=0x7fc7e400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7eb400700 1 -- 172.21.15.71:0/2985698440 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e400ca10 con 0x7fc7f41045e0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7eb400700 1 -- 172.21.15.71:0/2985698440 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e400cbb0 con 0x7fc7f41045e0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f419ff80 con 0x7fc7f41045e0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.987+0000 7fc7eb400700 1 -- 172.21.15.71:0/2985698440 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4018680 con 0x7fc7f41045e0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.988+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f41a78a0 con 0x7fc7f41045e0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.989+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f40512b0 con 0x7fc7f41045e0 2024-05-27T09:46:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.991+0000 7fc7eb400700 1 -- 172.21.15.71:0/2985698440 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc7e4010430 con 0x7fc7f41045e0 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.992+0000 7fc7eb400700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc7d40b2900 0x7fc7d40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.993+0000 7fc7eb400700 1 -- 172.21.15.71:0/2985698440 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fc7e40e2350 con 0x7fc7f41045e0 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.993+0000 7fc7e9400700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc7d40b2900 0x7fc7d40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.993+0000 7fc7e9400700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc7d40b2900 0x7fc7d40b4e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4103a60 tx=0x7fc7dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:03.997+0000 7fc7eb400700 1 -- 172.21.15.71:0/2985698440 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc7e40aa020 con 0x7fc7f41045e0 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.235+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc7f402e5e0 con 0x7fc7f41045e0 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.236+0000 7fc7eb400700 1 -- 172.21.15.71:0/2985698440 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc7e40b20a0 con 0x7fc7f41045e0 2024-05-27T09:46:05.327 INFO:teuthology.orchestra.run.smithi071.stdout:261993005110 2024-05-27T09:46:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc7d40b2900 msgr2=0x7fc7d40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc7d40b2900 0x7fc7d40b4e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4103a60 tx=0x7fc7dc009260 comp rx=0 tx=0).stop 2024-05-27T09:46:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41045e0 msgr2=0x7fc7f419adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41045e0 0x7fc7f419adc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400e9a0 tx=0x7fc7e400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 shutdown_connections 2024-05-27T09:46:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc7d40b2900 0x7fc7d40b4e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7f4109860 0x7fc7f419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41045e0 0x7fc7f419adc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 --2- 172.21.15.71:0/2985698440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f4108f10 0x7fc7f419b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 >> 172.21.15.71:0/2985698440 conn(0x7fc7f4100030 msgr2=0x7fc7f4108650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 shutdown_connections 2024-05-27T09:46:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:04.239+0000 7fc7f8e00700 1 -- 172.21.15.71:0/2985698440 wait complete. 2024-05-27T09:46:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.463+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efc980058f0 con 0x7efcb8108f10 2024-05-27T09:46:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.464+0000 7efcb4c00700 1 -- 172.21.15.71:0/178983468 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7efca4013030 con 0x7efcb8108f10 2024-05-27T09:46:05.465 INFO:teuthology.orchestra.run.smithi071.stdout:287762808882 2024-05-27T09:46:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efc9c0b2900 msgr2=0x7efc9c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efc9c0b2900 0x7efc9c0b4e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efca8005fd0 tx=0x7efca8009310 comp rx=0 tx=0).stop 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 msgr2=0x7efcb8075ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8075ff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efca400c010 tx=0x7efca400f9b0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 shutdown_connections 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efcb8109860 0x7efcb8076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efc9c0b2900 0x7efc9c0b4e10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcb81045e0 0x7efcb8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 --2- 172.21.15.71:0/178983468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcb8108f10 0x7efcb8075ff0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 >> 172.21.15.71:0/178983468 conn(0x7efcb8100030 msgr2=0x7efcb81086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 shutdown_connections 2024-05-27T09:46:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:05.467+0000 7efcbf200700 1 -- 172.21.15.71:0/178983468 wait complete. 2024-05-27T09:46:06.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:05 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2380761996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-27T09:46:06.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:05 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/178983468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-27T09:46:06.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:05 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2380761996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-27T09:46:06.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:05 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/178983468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-27T09:46:06.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:05 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2380761996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-27T09:46:06.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:05 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/178983468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-27T09:46:06.714 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005104 got 261993005110 for osd.9 2024-05-27T09:46:06.714 DEBUG:teuthology.parallel:result is None 2024-05-27T09:46:06.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:06 smithi071 ceph-mon[31451]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-27T09:46:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:06 smithi072 ceph-mon[35951]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-27T09:46:07.057 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808877 got 287762808882 for osd.10 2024-05-27T09:46:07.058 DEBUG:teuthology.parallel:result is None 2024-05-27T09:46:07.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:06 smithi122 ceph-mon[36436]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-27T09:46:07.698 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411419 got 77309411425 for osd.2 2024-05-27T09:46:07.699 DEBUG:teuthology.parallel:result is None 2024-05-27T09:46:07.699 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-27T09:46:07.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-27T09:46:08.123 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:08 smithi071 ceph-mon[31451]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:46:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:08 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:08 smithi072 ceph-mon[35951]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:46:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:08 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:09.032 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:08 smithi122 ceph-mon[36436]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:46:09.032 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:09.032 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:08 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:10.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:46:10.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:46:10.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:09 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:46:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:46:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:09 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:46:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:46:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:09 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:46:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.319+0000 7fe5c7200700 1 -- 172.21.15.71:0/4213994752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 msgr2=0x7fe5c01131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.319+0000 7fe5c7200700 1 --2- 172.21.15.71:0/4213994752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 0x7fe5c01131c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00b0d0 tx=0x7fe5bc00b3e0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.319+0000 7fe5c7200700 1 -- 172.21.15.71:0/4213994752 shutdown_connections 2024-05-27T09:46:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.319+0000 7fe5c7200700 1 --2- 172.21.15.71:0/4213994752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 0x7fe5c01131c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.319+0000 7fe5c7200700 1 --2- 172.21.15.71:0/4213994752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c0106630 0x7fe5c0106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.319+0000 7fe5c7200700 1 --2- 172.21.15.71:0/4213994752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c010af10 0x7fe5c010b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.319+0000 7fe5c7200700 1 -- 172.21.15.71:0/4213994752 >> 172.21.15.71:0/4213994752 conn(0x7fe5c0102020 msgr2=0x7fe5c0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.320+0000 7fe5c7200700 1 -- 172.21.15.71:0/4213994752 shutdown_connections 2024-05-27T09:46:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.320+0000 7fe5c7200700 1 -- 172.21.15.71:0/4213994752 wait complete. 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 Processor -- start 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 -- start start 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c0106630 0x7fe5c019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c010af10 0x7fe5c019d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 0x7fe5c01a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01164e0 con 0x7fe5c010b860 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0116360 con 0x7fe5c0106630 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.321+0000 7fe5c7200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0116660 con 0x7fe5c010af10 2024-05-27T09:46:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c0106630 0x7fe5c019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c0106630 0x7fe5c019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53372/0 (socket says 172.21.15.71:53372) 2024-05-27T09:46:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c010af10 0x7fe5c019d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 -- 172.21.15.71:0/624311840 learned_addr learned my addr 172.21.15.71:0/624311840 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 0x7fe5c01a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 -- 172.21.15.71:0/624311840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c010af10 msgr2=0x7fe5c019d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c010af10 0x7fe5c019d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 -- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 msgr2=0x7fe5c01a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 0x7fe5c01a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.322+0000 7fe5c5e00700 1 -- 172.21.15.71:0/624311840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c01a1cc0 con 0x7fe5c0106630 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.323+0000 7fe5c5e00700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c0106630 0x7fe5c019cdf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e9a0 tx=0x7fe5b400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.323+0000 7fe5baa00700 1 -- 172.21.15.71:0/624311840 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400ca10 con 0x7fe5c0106630 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.323+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c01a1fb0 con 0x7fe5c0106630 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.323+0000 7fe5baa00700 1 -- 172.21.15.71:0/624311840 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5b400cbb0 con 0x7fe5c0106630 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.323+0000 7fe5baa00700 1 -- 172.21.15.71:0/624311840 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4018680 con 0x7fe5c0106630 2024-05-27T09:46:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.323+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c01a98d0 con 0x7fe5c0106630 2024-05-27T09:46:10.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.324+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c00512b0 con 0x7fe5c0106630 2024-05-27T09:46:10.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.327+0000 7fe5baa00700 1 -- 172.21.15.71:0/624311840 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe5b4010430 con 0x7fe5c0106630 2024-05-27T09:46:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.328+0000 7fe5baa00700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe5a80b2880 0x7fe5a80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.328+0000 7fe5baa00700 1 -- 172.21.15.71:0/624311840 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe5b40e2710 con 0x7fe5c0106630 2024-05-27T09:46:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.329+0000 7fe5c5400700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe5a80b2880 0x7fe5a80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.329+0000 7fe5c5400700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe5a80b2880 0x7fe5a80b4d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0105a00 tx=0x7fe5b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:10.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.330+0000 7fe5baa00700 1 -- 172.21.15.71:0/624311840 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe5b40aa3e0 con 0x7fe5c0106630 2024-05-27T09:46:10.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.556+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5c0063bf0 con 0x7fe5a80b2880 2024-05-27T09:46:10.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.578+0000 7fe5baa00700 1 -- 172.21.15.71:0/624311840 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258829 (secure 0 0 0) 0x7fe5c0063bf0 con 0x7fe5a80b2880 2024-05-27T09:46:10.584 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:46:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.583+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe5a80b2880 msgr2=0x7fe5a80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.583+0000 7fe5c7200700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe5a80b2880 0x7fe5a80b4d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0105a00 tx=0x7fe5b0009260 comp rx=0 tx=0).stop 2024-05-27T09:46:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.583+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c0106630 msgr2=0x7fe5c019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.583+0000 7fe5c7200700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c0106630 0x7fe5c019cdf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e9a0 tx=0x7fe5b400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 shutdown_connections 2024-05-27T09:46:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fe5a80b2880 0x7fe5a80b4d90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c010b860 0x7fe5c01a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5c0106630 0x7fe5c019cdf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 --2- 172.21.15.71:0/624311840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c010af10 0x7fe5c019d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 >> 172.21.15.71:0/624311840 conn(0x7fe5c0102020 msgr2=0x7fe5c010a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 shutdown_connections 2024-05-27T09:46:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:10.584+0000 7fe5c7200700 1 -- 172.21.15.71:0/624311840 wait complete. 2024-05-27T09:46:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:46:10.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:10 smithi071 ceph-mon[31451]: pgmap v396: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-27T09:46:11.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:10 smithi122 ceph-mon[36436]: pgmap v396: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-27T09:46:11.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:10 smithi072 ceph-mon[35951]: pgmap v396: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-27T09:46:11.474 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2024-05-27T09:46:09.206069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659775,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":808,"num_read_kb":505,"num_write":298,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390920,"kb_used_data":12648,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550904,"statfs":{"total":1151940427776,"available":1151540125696,"internally_reserved":0,"allocated":12951552,"data_stored":7254573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":387233085},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004548"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156268+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:45:53.156268+0000","last_peered":"2024-05-27T09:45:53.156268+0000","last_clean":"2024-05-27T09:45:53.156268+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:45:53.156268+0000","last_undegraded":"2024-05-27T09:45:53.156268+0000","last_fullsized":"2024-05-27T09:45:53.156268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.157039+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:45:53.157039+0000","last_peered":"2024-05-27T09:45:53.157039+0000","last_clean":"2024-05-27T09:45:53.157039+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:45:53.157039+0000","last_undegraded":"2024-05-27T09:45:53.157039+0000","last_fullsized":"2024-05-27T09:45:53.157039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155066+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:45:53.155066+0000","last_peered":"2024-05-27T09:45:53.155066+0000","last_clean":"2024-05-27T09:45:53.155066+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:45:53.155066+0000","last_undegraded":"2024-05-27T09:45:53.155066+0000","last_fullsized":"2024-05-27T09:45:53.155066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.134047+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:45:53.134047+0000","last_peered":"2024-05-27T09:45:53.134047+0000","last_clean":"2024-05-27T09:45:53.134047+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:45:53.134047+0000","last_undegraded":"2024-05-27T09:45:53.134047+0000","last_fullsized":"2024-05-27T09:45:53.134047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.137010+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:45:53.137010+0000","last_peered":"2024-05-27T09:45:53.137010+0000","last_clean":"2024-05-27T09:45:53.137010+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:45:53.137010+0000","last_undegraded":"2024-05-27T09:45:53.137010+0000","last_fullsized":"2024-05-27T09:45:53.137010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152775+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:45:53.152775+0000","last_peered":"2024-05-27T09:45:53.152775+0000","last_clean":"2024-05-27T09:45:53.152775+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:45:53.152775+0000","last_undegraded":"2024-05-27T09:45:53.152775+0000","last_fullsized":"2024-05-27T09:45:53.152775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151368+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:45:53.151368+0000","last_peered":"2024-05-27T09:45:53.151368+0000","last_clean":"2024-05-27T09:45:53.151368+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:45:53.151368+0000","last_undegraded":"2024-05-27T09:45:53.151368+0000","last_fullsized":"2024-05-27T09:45:53.151368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155314+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:45:53.155314+0000","last_peered":"2024-05-27T09:45:53.155314+0000","last_clean":"2024-05-27T09:45:53.155314+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:45:53.155314+0000","last_undegraded":"2024-05-27T09:45:53.155314+0000","last_fullsized":"2024-05-27T09:45:53.155314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153391+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:45:53.153391+0000","last_peered":"2024-05-27T09:45:53.153391+0000","last_clean":"2024-05-27T09:45:53.153391+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:45:53.153391+0000","last_undegraded":"2024-05-27T09:45:53.153391+0000","last_fullsized":"2024-05-27T09:45:53.153391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.125789+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:45:53.125789+0000","last_peered":"2024-05-27T09:45:53.125789+0000","last_clean":"2024-05-27T09:45:53.125789+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:45:53.125789+0000","last_undegraded":"2024-05-27T09:45:53.125789+0000","last_fullsized":"2024-05-27T09:45:53.125789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.150467+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:45:53.150467+0000","last_peered":"2024-05-27T09:45:53.150467+0000","last_clean":"2024-05-27T09:45:53.150467+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:45:53.150467+0000","last_undegraded":"2024-05-27T09:45:53.150467+0000","last_fullsized":"2024-05-27T09:45:53.150467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.133071+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:45:53.133071+0000","last_peered":"2024-05-27T09:45:53.133071+0000","last_clean":"2024-05-27T09:45:53.133071+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:45:53.133071+0000","last_undegraded":"2024-05-27T09:45:53.133071+0000","last_fullsized":"2024-05-27T09:45:53.133071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.138579+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:45:53.138579+0000","last_peered":"2024-05-27T09:45:53.138579+0000","last_clean":"2024-05-27T09:45:53.138579+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:45:53.138579+0000","last_undegraded":"2024-05-27T09:45:53.138579+0000","last_fullsized":"2024-05-27T09:45:53.138579+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151408+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:45:53.151408+0000","last_peered":"2024-05-27T09:45:53.151408+0000","last_clean":"2024-05-27T09:45:53.151408+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:45:53.151408+0000","last_undegraded":"2024-05-27T09:45:53.151408+0000","last_fullsized":"2024-05-27T09:45:53.151408+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154445+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:45:53.154445+0000","last_peered":"2024-05-27T09:45:53.154445+0000","last_clean":"2024-05-27T09:45:53.154445+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:45:53.154445+0000","last_undegraded":"2024-05-27T09:45:53.154445+0000","last_fullsized":"2024-05-27T09:45:53.154445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.157973+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:45:53.157973+0000","last_peered":"2024-05-27T09:45:53.157973+0000","last_clean":"2024-05-27T09:45:53.157973+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:45:53.157973+0000","last_undegraded":"2024-05-27T09:45:53.157973+0000","last_fullsized":"2024-05-27T09:45:53.157973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156328+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:45:53.156328+0000","last_peered":"2024-05-27T09:45:53.156328+0000","last_clean":"2024-05-27T09:45:53.156328+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:45:53.156328+0000","last_undegraded":"2024-05-27T09:45:53.156328+0000","last_fullsized":"2024-05-27T09:45:53.156328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151239+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:45:53.151239+0000","last_peered":"2024-05-27T09:45:53.151239+0000","last_clean":"2024-05-27T09:45:53.151239+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:45:53.151239+0000","last_undegraded":"2024-05-27T09:45:53.151239+0000","last_fullsized":"2024-05-27T09:45:53.151239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.135451+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:45:53.135451+0000","last_peered":"2024-05-27T09:45:53.135451+0000","last_clean":"2024-05-27T09:45:53.135451+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:45:53.135451+0000","last_undegraded":"2024-05-27T09:45:53.135451+0000","last_fullsized":"2024-05-27T09:45:53.135451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366840+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:44:24.366840+0000","last_peered":"2024-05-27T09:44:24.366840+0000","last_clean":"2024-05-27T09:44:24.366840+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:44:24.366840+0000","last_undegraded":"2024-05-27T09:44:24.366840+0000","last_fullsized":"2024-05-27T09:44:24.366840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.142153+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:45:53.142153+0000","last_peered":"2024-05-27T09:45:53.142153+0000","last_clean":"2024-05-27T09:45:53.142153+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:45:53.142153+0000","last_undegraded":"2024-05-27T09:45:53.142153+0000","last_fullsized":"2024-05-27T09:45:53.142153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372516+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:44:24.372516+0000","last_peered":"2024-05-27T09:44:24.372516+0000","last_clean":"2024-05-27T09:44:24.372516+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:44:24.372516+0000","last_undegraded":"2024-05-27T09:44:24.372516+0000","last_fullsized":"2024-05-27T09:44:24.372516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156874+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:45:53.156874+0000","last_peered":"2024-05-27T09:45:53.156874+0000","last_clean":"2024-05-27T09:45:53.156874+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:45:53.156874+0000","last_undegraded":"2024-05-27T09:45:53.156874+0000","last_fullsized":"2024-05-27T09:45:53.156874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366485+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:44:24.366485+0000","last_peered":"2024-05-27T09:44:24.366485+0000","last_clean":"2024-05-27T09:44:24.366485+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:44:24.366485+0000","last_undegraded":"2024-05-27T09:44:24.366485+0000","last_fullsized":"2024-05-27T09:44:24.366485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156389+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:45:53.156389+0000","last_peered":"2024-05-27T09:45:53.156389+0000","last_clean":"2024-05-27T09:45:53.156389+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:45:53.156389+0000","last_undegraded":"2024-05-27T09:45:53.156389+0000","last_fullsized":"2024-05-27T09:45:53.156389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366281+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:44:24.366281+0000","last_peered":"2024-05-27T09:44:24.366281+0000","last_clean":"2024-05-27T09:44:24.366281+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:44:24.366281+0000","last_undegraded":"2024-05-27T09:44:24.366281+0000","last_fullsized":"2024-05-27T09:44:24.366281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.143050+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:45:53.143050+0000","last_peered":"2024-05-27T09:45:53.143050+0000","last_clean":"2024-05-27T09:45:53.143050+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:45:53.143050+0000","last_undegraded":"2024-05-27T09:45:53.143050+0000","last_fullsized":"2024-05-27T09:45:53.143050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:05.511749+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:46:05.511749+0000","last_peered":"2024-05-27T09:46:05.511749+0000","last_clean":"2024-05-27T09:46:05.511749+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:46:05.511749+0000","last_undegraded":"2024-05-27T09:46:05.511749+0000","last_fullsized":"2024-05-27T09:46:05.511749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.144562+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:45:53.144562+0000","last_peered":"2024-05-27T09:45:53.144562+0000","last_clean":"2024-05-27T09:45:53.144562+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:45:53.144562+0000","last_undegraded":"2024-05-27T09:45:53.144562+0000","last_fullsized":"2024-05-27T09:45:53.144562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368660+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:44:24.368660+0000","last_peered":"2024-05-27T09:44:24.368660+0000","last_clean":"2024-05-27T09:44:24.368660+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:44:24.368660+0000","last_undegraded":"2024-05-27T09:44:24.368660+0000","last_fullsized":"2024-05-27T09:44:24.368660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154550+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:45:53.154550+0000","last_peered":"2024-05-27T09:45:53.154550+0000","last_clean":"2024-05-27T09:45:53.154550+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:45:53.154550+0000","last_undegraded":"2024-05-27T09:45:53.154550+0000","last_fullsized":"2024-05-27T09:45:53.154550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361697+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:44:24.361697+0000","last_peered":"2024-05-27T09:44:24.361697+0000","last_clean":"2024-05-27T09:44:24.361697+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:44:24.361697+0000","last_undegraded":"2024-05-27T09:44:24.361697+0000","last_fullsized":"2024-05-27T09:44:24.361697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152178+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:45:53.152178+0000","last_peered":"2024-05-27T09:45:53.152178+0000","last_clean":"2024-05-27T09:45:53.152178+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:45:53.152178+0000","last_undegraded":"2024-05-27T09:45:53.152178+0000","last_fullsized":"2024-05-27T09:45:53.152178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514010+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:44:24.514010+0000","last_peered":"2024-05-27T09:44:24.514010+0000","last_clean":"2024-05-27T09:44:24.514010+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:44:24.514010+0000","last_undegraded":"2024-05-27T09:44:24.514010+0000","last_fullsized":"2024-05-27T09:44:24.514010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156346+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:45:53.156346+0000","last_peered":"2024-05-27T09:45:53.156346+0000","last_clean":"2024-05-27T09:45:53.156346+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:45:53.156346+0000","last_undegraded":"2024-05-27T09:45:53.156346+0000","last_fullsized":"2024-05-27T09:45:53.156346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:05.511155+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:46:05.511155+0000","last_peered":"2024-05-27T09:46:05.511155+0000","last_clean":"2024-05-27T09:46:05.511155+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:46:05.511155+0000","last_undegraded":"2024-05-27T09:46:05.511155+0000","last_fullsized":"2024-05-27T09:46:05.511155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154287+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:45:53.154287+0000","last_peered":"2024-05-27T09:45:53.154287+0000","last_clean":"2024-05-27T09:45:53.154287+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:45:53.154287+0000","last_undegraded":"2024-05-27T09:45:53.154287+0000","last_fullsized":"2024-05-27T09:45:53.154287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368993+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:44:24.368993+0000","last_peered":"2024-05-27T09:44:24.368993+0000","last_clean":"2024-05-27T09:44:24.368993+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:44:24.368993+0000","last_undegraded":"2024-05-27T09:44:24.368993+0000","last_fullsized":"2024-05-27T09:44:24.368993+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156493+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:45:53.156493+0000","last_peered":"2024-05-27T09:45:53.156493+0000","last_clean":"2024-05-27T09:45:53.156493+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:45:53.156493+0000","last_undegraded":"2024-05-27T09:45:53.156493+0000","last_fullsized":"2024-05-27T09:45:53.156493+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514473+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:44:24.514473+0000","last_peered":"2024-05-27T09:44:24.514473+0000","last_clean":"2024-05-27T09:44:24.514473+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:44:24.514473+0000","last_undegraded":"2024-05-27T09:44:24.514473+0000","last_fullsized":"2024-05-27T09:44:24.514473+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155535+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:45:53.155535+0000","last_peered":"2024-05-27T09:45:53.155535+0000","last_clean":"2024-05-27T09:45:53.155535+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:45:53.155535+0000","last_undegraded":"2024-05-27T09:45:53.155535+0000","last_fullsized":"2024-05-27T09:45:53.155535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":302,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:06.593578+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:46:06.593578+0000","last_peered":"2024-05-27T09:46:06.593578+0000","last_clean":"2024-05-27T09:46:06.593578+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:46:06.593578+0000","last_undegraded":"2024-05-27T09:46:06.593578+0000","last_fullsized":"2024-05-27T09:46:06.593578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65031,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":242,"num_read_kb":185,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.142829+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:45:53.142829+0000","last_peered":"2024-05-27T09:45:53.142829+0000","last_clean":"2024-05-27T09:45:53.142829+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:45:53.142829+0000","last_undegraded":"2024-05-27T09:45:53.142829+0000","last_fullsized":"2024-05-27T09:45:53.142829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361898+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:44:24.361898+0000","last_peered":"2024-05-27T09:44:24.361898+0000","last_clean":"2024-05-27T09:44:24.361898+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:44:24.361898+0000","last_undegraded":"2024-05-27T09:44:24.361898+0000","last_fullsized":"2024-05-27T09:44:24.361898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152822+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:45:53.152822+0000","last_peered":"2024-05-27T09:45:53.152822+0000","last_clean":"2024-05-27T09:45:53.152822+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:45:53.152822+0000","last_undegraded":"2024-05-27T09:45:53.152822+0000","last_fullsized":"2024-05-27T09:45:53.152822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514591+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:44:24.514591+0000","last_peered":"2024-05-27T09:44:24.514591+0000","last_clean":"2024-05-27T09:44:24.514591+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:44:24.514591+0000","last_undegraded":"2024-05-27T09:44:24.514591+0000","last_fullsized":"2024-05-27T09:44:24.514591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.148685+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:45:53.148685+0000","last_peered":"2024-05-27T09:45:53.148685+0000","last_clean":"2024-05-27T09:45:53.148685+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:45:53.148685+0000","last_undegraded":"2024-05-27T09:45:53.148685+0000","last_fullsized":"2024-05-27T09:45:53.148685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:07.547805+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:46:07.547805+0000","last_peered":"2024-05-27T09:46:07.547805+0000","last_clean":"2024-05-27T09:46:07.547805+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:46:07.547805+0000","last_undegraded":"2024-05-27T09:46:07.547805+0000","last_fullsized":"2024-05-27T09:46:07.547805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.144896+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:45:53.144896+0000","last_peered":"2024-05-27T09:45:53.144896+0000","last_clean":"2024-05-27T09:45:53.144896+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:45:53.144896+0000","last_undegraded":"2024-05-27T09:45:53.144896+0000","last_fullsized":"2024-05-27T09:45:53.144896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.388761+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:44:24.388761+0000","last_peered":"2024-05-27T09:44:24.388761+0000","last_clean":"2024-05-27T09:44:24.388761+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:44:24.388761+0000","last_undegraded":"2024-05-27T09:44:24.388761+0000","last_fullsized":"2024-05-27T09:44:24.388761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.130696+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:45:53.130696+0000","last_peered":"2024-05-27T09:45:53.130696+0000","last_clean":"2024-05-27T09:45:53.130696+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:45:53.130696+0000","last_undegraded":"2024-05-27T09:45:53.130696+0000","last_fullsized":"2024-05-27T09:45:53.130696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366685+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:44:24.366685+0000","last_peered":"2024-05-27T09:44:24.366685+0000","last_clean":"2024-05-27T09:44:24.366685+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:44:24.366685+0000","last_undegraded":"2024-05-27T09:44:24.366685+0000","last_fullsized":"2024-05-27T09:44:24.366685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.135877+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:45:53.135877+0000","last_peered":"2024-05-27T09:45:53.135877+0000","last_clean":"2024-05-27T09:45:53.135877+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:45:53.135877+0000","last_undegraded":"2024-05-27T09:45:53.135877+0000","last_fullsized":"2024-05-27T09:45:53.135877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366912+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:44:24.366912+0000","last_peered":"2024-05-27T09:44:24.366912+0000","last_clean":"2024-05-27T09:44:24.366912+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:44:24.366912+0000","last_undegraded":"2024-05-27T09:44:24.366912+0000","last_fullsized":"2024-05-27T09:44:24.366912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.146189+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:45:53.146189+0000","last_peered":"2024-05-27T09:45:53.146189+0000","last_clean":"2024-05-27T09:45:53.146189+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:45:53.146189+0000","last_undegraded":"2024-05-27T09:45:53.146189+0000","last_fullsized":"2024-05-27T09:45:53.146189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368905+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:44:24.368905+0000","last_peered":"2024-05-27T09:44:24.368905+0000","last_clean":"2024-05-27T09:44:24.368905+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:44:24.368905+0000","last_undegraded":"2024-05-27T09:44:24.368905+0000","last_fullsized":"2024-05-27T09:44:24.368905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154463+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:45:53.154463+0000","last_peered":"2024-05-27T09:45:53.154463+0000","last_clean":"2024-05-27T09:45:53.154463+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:45:53.154463+0000","last_undegraded":"2024-05-27T09:45:53.154463+0000","last_fullsized":"2024-05-27T09:45:53.154463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.126848+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:45:53.126848+0000","last_peered":"2024-05-27T09:45:53.126848+0000","last_clean":"2024-05-27T09:45:53.126848+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:45:53.126848+0000","last_undegraded":"2024-05-27T09:45:53.126848+0000","last_fullsized":"2024-05-27T09:45:53.126848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:05.543169+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:46:05.543169+0000","last_peered":"2024-05-27T09:46:05.543169+0000","last_clean":"2024-05-27T09:46:05.543169+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:46:05.543169+0000","last_undegraded":"2024-05-27T09:46:05.543169+0000","last_fullsized":"2024-05-27T09:46:05.543169+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154935+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:45:53.154935+0000","last_peered":"2024-05-27T09:45:53.154935+0000","last_clean":"2024-05-27T09:45:53.154935+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:45:53.154935+0000","last_undegraded":"2024-05-27T09:45:53.154935+0000","last_fullsized":"2024-05-27T09:45:53.154935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535360+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:44:24.535360+0000","last_peered":"2024-05-27T09:44:24.535360+0000","last_clean":"2024-05-27T09:44:24.535360+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:44:24.535360+0000","last_undegraded":"2024-05-27T09:44:24.535360+0000","last_fullsized":"2024-05-27T09:44:24.535360+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369400+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:44:24.369400+0000","last_peered":"2024-05-27T09:44:24.369400+0000","last_clean":"2024-05-27T09:44:24.369400+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:44:24.369400+0000","last_undegraded":"2024-05-27T09:44:24.369400+0000","last_fullsized":"2024-05-27T09:44:24.369400+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.137280+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:45:53.137280+0000","last_peered":"2024-05-27T09:45:53.137280+0000","last_clean":"2024-05-27T09:45:53.137280+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:45:53.137280+0000","last_undegraded":"2024-05-27T09:45:53.137280+0000","last_fullsized":"2024-05-27T09:45:53.137280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369579+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:44:24.369579+0000","last_peered":"2024-05-27T09:44:24.369579+0000","last_clean":"2024-05-27T09:44:24.369579+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:44:24.369579+0000","last_undegraded":"2024-05-27T09:44:24.369579+0000","last_fullsized":"2024-05-27T09:44:24.369579+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366421+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:44:24.366421+0000","last_peered":"2024-05-27T09:44:24.366421+0000","last_clean":"2024-05-27T09:44:24.366421+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:44:24.366421+0000","last_undegraded":"2024-05-27T09:44:24.366421+0000","last_fullsized":"2024-05-27T09:44:24.366421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152214+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:45:53.152214+0000","last_peered":"2024-05-27T09:45:53.152214+0000","last_clean":"2024-05-27T09:45:53.152214+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:45:53.152214+0000","last_undegraded":"2024-05-27T09:45:53.152214+0000","last_fullsized":"2024-05-27T09:45:53.152214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'13","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.857738+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:45:53.857738+0000","last_peered":"2024-05-27T09:45:53.857738+0000","last_clean":"2024-05-27T09:45:53.857738+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:45:53.857738+0000","last_undegraded":"2024-05-27T09:45:53.857738+0000","last_fullsized":"2024-05-27T09:45:53.857738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.143427+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:45:53.143427+0000","last_peered":"2024-05-27T09:45:53.143427+0000","last_clean":"2024-05-27T09:45:53.143427+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:45:53.143427+0000","last_undegraded":"2024-05-27T09:45:53.143427+0000","last_fullsized":"2024-05-27T09:45:53.143427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535513+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:44:24.535513+0000","last_peered":"2024-05-27T09:44:24.535513+0000","last_clean":"2024-05-27T09:44:24.535513+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:44:24.535513+0000","last_undegraded":"2024-05-27T09:44:24.535513+0000","last_fullsized":"2024-05-27T09:44:24.535513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156273+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:45:53.156273+0000","last_peered":"2024-05-27T09:45:53.156273+0000","last_clean":"2024-05-27T09:45:53.156273+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:45:53.156273+0000","last_undegraded":"2024-05-27T09:45:53.156273+0000","last_fullsized":"2024-05-27T09:45:53.156273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364109+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:44:24.364109+0000","last_peered":"2024-05-27T09:44:24.364109+0000","last_clean":"2024-05-27T09:44:24.364109+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:44:24.364109+0000","last_undegraded":"2024-05-27T09:44:24.364109+0000","last_fullsized":"2024-05-27T09:44:24.364109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.133159+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:45:53.133159+0000","last_peered":"2024-05-27T09:45:53.133159+0000","last_clean":"2024-05-27T09:45:53.133159+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:45:53.133159+0000","last_undegraded":"2024-05-27T09:45:53.133159+0000","last_fullsized":"2024-05-27T09:45:53.133159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.370206+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:44:24.370206+0000","last_peered":"2024-05-27T09:44:24.370206+0000","last_clean":"2024-05-27T09:44:24.370206+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:44:24.370206+0000","last_undegraded":"2024-05-27T09:44:24.370206+0000","last_fullsized":"2024-05-27T09:44:24.370206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155001+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:45:53.155001+0000","last_peered":"2024-05-27T09:45:53.155001+0000","last_clean":"2024-05-27T09:45:53.155001+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:45:53.155001+0000","last_undegraded":"2024-05-27T09:45:53.155001+0000","last_fullsized":"2024-05-27T09:45:53.155001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.376759+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:44:24.376759+0000","last_peered":"2024-05-27T09:44:24.376759+0000","last_clean":"2024-05-27T09:44:24.376759+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:44:24.376759+0000","last_undegraded":"2024-05-27T09:44:24.376759+0000","last_fullsized":"2024-05-27T09:44:24.376759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.157855+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:45:53.157855+0000","last_peered":"2024-05-27T09:45:53.157855+0000","last_clean":"2024-05-27T09:45:53.157855+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:45:53.157855+0000","last_undegraded":"2024-05-27T09:45:53.157855+0000","last_fullsized":"2024-05-27T09:45:53.157855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366147+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:44:24.366147+0000","last_peered":"2024-05-27T09:44:24.366147+0000","last_clean":"2024-05-27T09:44:24.366147+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:44:24.366147+0000","last_undegraded":"2024-05-27T09:44:24.366147+0000","last_fullsized":"2024-05-27T09:44:24.366147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151571+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:45:53.151571+0000","last_peered":"2024-05-27T09:45:53.151571+0000","last_clean":"2024-05-27T09:45:53.151571+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:45:53.151571+0000","last_undegraded":"2024-05-27T09:45:53.151571+0000","last_fullsized":"2024-05-27T09:45:53.151571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363035+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:44:24.363035+0000","last_peered":"2024-05-27T09:44:24.363035+0000","last_clean":"2024-05-27T09:44:24.363035+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:44:24.363035+0000","last_undegraded":"2024-05-27T09:44:24.363035+0000","last_fullsized":"2024-05-27T09:44:24.363035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153545+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:45:53.153545+0000","last_peered":"2024-05-27T09:45:53.153545+0000","last_clean":"2024-05-27T09:45:53.153545+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:45:53.153545+0000","last_undegraded":"2024-05-27T09:45:53.153545+0000","last_fullsized":"2024-05-27T09:45:53.153545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514387+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:44:24.514387+0000","last_peered":"2024-05-27T09:44:24.514387+0000","last_clean":"2024-05-27T09:44:24.514387+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:44:24.514387+0000","last_undegraded":"2024-05-27T09:44:24.514387+0000","last_fullsized":"2024-05-27T09:44:24.514387+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153806+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:45:53.153806+0000","last_peered":"2024-05-27T09:45:53.153806+0000","last_clean":"2024-05-27T09:45:53.153806+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:45:53.153806+0000","last_undegraded":"2024-05-27T09:45:53.153806+0000","last_fullsized":"2024-05-27T09:45:53.153806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361911+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:44:24.361911+0000","last_peered":"2024-05-27T09:44:24.361911+0000","last_clean":"2024-05-27T09:44:24.361911+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:44:24.361911+0000","last_undegraded":"2024-05-27T09:44:24.361911+0000","last_fullsized":"2024-05-27T09:44:24.361911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.146926+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:45:53.146926+0000","last_peered":"2024-05-27T09:45:53.146926+0000","last_clean":"2024-05-27T09:45:53.146926+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:45:53.146926+0000","last_undegraded":"2024-05-27T09:45:53.146926+0000","last_fullsized":"2024-05-27T09:45:53.146926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.141791+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:45:53.141791+0000","last_peered":"2024-05-27T09:45:53.141791+0000","last_clean":"2024-05-27T09:45:53.141791+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:45:53.141791+0000","last_undegraded":"2024-05-27T09:45:53.141791+0000","last_fullsized":"2024-05-27T09:45:53.141791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.130893+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:45:53.130893+0000","last_peered":"2024-05-27T09:45:53.130893+0000","last_clean":"2024-05-27T09:45:53.130893+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:45:53.130893+0000","last_undegraded":"2024-05-27T09:45:53.130893+0000","last_fullsized":"2024-05-27T09:45:53.130893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155043+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:45:53.155043+0000","last_peered":"2024-05-27T09:45:53.155043+0000","last_clean":"2024-05-27T09:45:53.155043+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:45:53.155043+0000","last_undegraded":"2024-05-27T09:45:53.155043+0000","last_fullsized":"2024-05-27T09:45:53.155043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153970+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:45:53.153970+0000","last_peered":"2024-05-27T09:45:53.153970+0000","last_clean":"2024-05-27T09:45:53.153970+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:45:53.153970+0000","last_undegraded":"2024-05-27T09:45:53.153970+0000","last_fullsized":"2024-05-27T09:45:53.153970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155218+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:45:53.155218+0000","last_peered":"2024-05-27T09:45:53.155218+0000","last_clean":"2024-05-27T09:45:53.155218+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:45:53.155218+0000","last_undegraded":"2024-05-27T09:45:53.155218+0000","last_fullsized":"2024-05-27T09:45:53.155218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.133439+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:45:53.133439+0000","last_peered":"2024-05-27T09:45:53.133439+0000","last_clean":"2024-05-27T09:45:53.133439+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:45:53.133439+0000","last_undegraded":"2024-05-27T09:45:53.133439+0000","last_fullsized":"2024-05-27T09:45:53.133439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.136081+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:45:53.136081+0000","last_peered":"2024-05-27T09:45:53.136081+0000","last_clean":"2024-05-27T09:45:53.136081+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:45:53.136081+0000","last_undegraded":"2024-05-27T09:45:53.136081+0000","last_fullsized":"2024-05-27T09:45:53.136081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.145544+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:45:53.145544+0000","last_peered":"2024-05-27T09:45:53.145544+0000","last_clean":"2024-05-27T09:45:53.145544+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:45:53.145544+0000","last_undegraded":"2024-05-27T09:45:53.145544+0000","last_fullsized":"2024-05-27T09:45:53.145544+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154477+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:45:53.154477+0000","last_peered":"2024-05-27T09:45:53.154477+0000","last_clean":"2024-05-27T09:45:53.154477+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:45:53.154477+0000","last_undegraded":"2024-05-27T09:45:53.154477+0000","last_fullsized":"2024-05-27T09:45:53.154477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151955+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:45:53.151955+0000","last_peered":"2024-05-27T09:45:53.151955+0000","last_clean":"2024-05-27T09:45:53.151955+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:45:53.151955+0000","last_undegraded":"2024-05-27T09:45:53.151955+0000","last_fullsized":"2024-05-27T09:45:53.151955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.157014+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:45:53.157014+0000","last_peered":"2024-05-27T09:45:53.157014+0000","last_clean":"2024-05-27T09:45:53.157014+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:45:53.157014+0000","last_undegraded":"2024-05-27T09:45:53.157014+0000","last_fullsized":"2024-05-27T09:45:53.157014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156549+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:45:53.156549+0000","last_peered":"2024-05-27T09:45:53.156549+0000","last_clean":"2024-05-27T09:45:53.156549+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:45:53.156549+0000","last_undegraded":"2024-05-27T09:45:53.156549+0000","last_fullsized":"2024-05-27T09:45:53.156549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.136655+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:45:53.136655+0000","last_peered":"2024-05-27T09:45:53.136655+0000","last_clean":"2024-05-27T09:45:53.136655+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:45:53.136655+0000","last_undegraded":"2024-05-27T09:45:53.136655+0000","last_fullsized":"2024-05-27T09:45:53.136655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69173,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":727,"num_read_kb":436,"num_write":173,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":440298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1597440,"data_stored":1097230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005111,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":440422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201344,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":440230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1507328,"data_stored":1032413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593801,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":439811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":966656,"data_stored":504635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":921600,"data_stored":441082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":505985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149787,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":440122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953558,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":440780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1519616,"data_stored":1031565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:46:11.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-27T09:46:11.961 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:12.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:11 smithi071 ceph-mon[31451]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:46:12.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:11 smithi122 ceph-mon[36436]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:46:12.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:11 smithi072 ceph-mon[35951]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:46:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:12 smithi071 ceph-mon[31451]: pgmap v397: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-27T09:46:13.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:12 smithi122 ceph-mon[36436]: pgmap v397: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-27T09:46:13.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:12 smithi072 ceph-mon[35951]: pgmap v397: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-27T09:46:14.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 -- 172.21.15.71:0/3887242632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a740764a0 msgr2=0x7f1a74114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:14.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 --2- 172.21.15.71:0/3887242632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a740764a0 0x7f1a74114e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009990 tx=0x7f1a60009ca0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 -- 172.21.15.71:0/3887242632 shutdown_connections 2024-05-27T09:46:14.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 --2- 172.21.15.71:0/3887242632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a74115360 0x7f1a74117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 --2- 172.21.15.71:0/3887242632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 0x7f1a74075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 --2- 172.21.15.71:0/3887242632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a740764a0 0x7f1a74114e20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 -- 172.21.15.71:0/3887242632 >> 172.21.15.71:0/3887242632 conn(0x7f1a74100030 msgr2=0x7f1a74102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:14.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 -- 172.21.15.71:0/3887242632 shutdown_connections 2024-05-27T09:46:14.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.139+0000 7f1a7c400700 1 -- 172.21.15.71:0/3887242632 wait complete. 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.140+0000 7f1a7c400700 1 Processor -- start 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.140+0000 7f1a7c400700 1 -- start start 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a7c400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 0x7f1a741a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a7c400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a740764a0 0x7f1a741a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a7c400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a74115360 0x7f1a741a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a7c400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7411aab0 con 0x7f1a74115360 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a7c400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7411a930 con 0x7f1a74075b50 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a7c400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7411ac30 con 0x7f1a740764a0 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a79a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 0x7f1a741a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a79a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 0x7f1a741a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46906/0 (socket says 172.21.15.71:46906) 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a79a00700 1 -- 172.21.15.71:0/2439139886 learned_addr learned my addr 172.21.15.71:0/2439139886 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:14.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a7a400700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a74115360 0x7f1a741a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.141+0000 7f1a79000700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a740764a0 0x7f1a741a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a79a00700 1 -- 172.21.15.71:0/2439139886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a740764a0 msgr2=0x7f1a741a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a79a00700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a740764a0 0x7f1a741a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a79a00700 1 -- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a74115360 msgr2=0x7f1a741a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a79a00700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a74115360 0x7f1a741a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a79a00700 1 -- 172.21.15.71:0/2439139886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a741a6310 con 0x7f1a74075b50 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a79a00700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 0x7f1a741a1440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800ef10 tx=0x7f1a6800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a72000700 1 -- 172.21.15.71:0/2439139886 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800c9c0 con 0x7f1a74075b50 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a72000700 1 -- 172.21.15.71:0/2439139886 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a68019070 con 0x7f1a74075b50 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a741a65a0 con 0x7f1a74075b50 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.142+0000 7f1a72000700 1 -- 172.21.15.71:0/2439139886 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68014480 con 0x7f1a74075b50 2024-05-27T09:46:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.143+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a741adf20 con 0x7f1a74075b50 2024-05-27T09:46:14.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.144+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a74077290 con 0x7f1a74075b50 2024-05-27T09:46:14.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.147+0000 7f1a72000700 1 -- 172.21.15.71:0/2439139886 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1a68012050 con 0x7f1a74075b50 2024-05-27T09:46:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.147+0000 7f1a72000700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1a5c0b2880 0x7f1a5c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.148+0000 7f1a72000700 1 -- 172.21.15.71:0/2439139886 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1a680e21d0 con 0x7f1a74075b50 2024-05-27T09:46:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.148+0000 7f1a79000700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1a5c0b2880 0x7f1a5c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.148+0000 7f1a79000700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1a5c0b2880 0x7f1a5c0b4d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1a741034e0 tx=0x7f1a6000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.153+0000 7f1a72000700 1 -- 172.21.15.71:0/2439139886 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a68010040 con 0x7f1a74075b50 2024-05-27T09:46:14.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.379+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a741a27a0 con 0x7f1a5c0b2880 2024-05-27T09:46:14.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.392+0000 7f1a72000700 1 -- 172.21.15.71:0/2439139886 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258827 (secure 0 0 0) 0x7f1a60067320 con 0x7f1a5c0b2880 2024-05-27T09:46:14.398 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1a5c0b2880 msgr2=0x7f1a5c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1a5c0b2880 0x7f1a5c0b4d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1a741034e0 tx=0x7f1a6000b260 comp rx=0 tx=0).stop 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 msgr2=0x7f1a741a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 0x7f1a741a1440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800ef10 tx=0x7f1a6800c3a0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 shutdown_connections 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f1a5c0b2880 0x7f1a5c0b4d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a74115360 0x7f1a741a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a74075b50 0x7f1a741a1440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 --2- 172.21.15.71:0/2439139886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a740764a0 0x7f1a741a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 >> 172.21.15.71:0/2439139886 conn(0x7f1a74100030 msgr2=0x7f1a74100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:14.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 shutdown_connections 2024-05-27T09:46:14.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:14.398+0000 7f1a7c400700 1 -- 172.21.15.71:0/2439139886 wait complete. 2024-05-27T09:46:14.402 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:46:15.113 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:14 smithi071 ceph-mon[31451]: pgmap v398: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:46:15.192 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-05-27T09:46:13.207927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659775,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":833,"num_read_kb":520,"num_write":298,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390920,"kb_used_data":12648,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550904,"statfs":{"total":1151940427776,"available":1151540125696,"internally_reserved":0,"allocated":12951552,"data_stored":7254573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":387233085},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004735"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156268+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:45:53.156268+0000","last_peered":"2024-05-27T09:45:53.156268+0000","last_clean":"2024-05-27T09:45:53.156268+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:45:53.156268+0000","last_undegraded":"2024-05-27T09:45:53.156268+0000","last_fullsized":"2024-05-27T09:45:53.156268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.157039+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:45:53.157039+0000","last_peered":"2024-05-27T09:45:53.157039+0000","last_clean":"2024-05-27T09:45:53.157039+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:45:53.157039+0000","last_undegraded":"2024-05-27T09:45:53.157039+0000","last_fullsized":"2024-05-27T09:45:53.157039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155066+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:45:53.155066+0000","last_peered":"2024-05-27T09:45:53.155066+0000","last_clean":"2024-05-27T09:45:53.155066+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:45:53.155066+0000","last_undegraded":"2024-05-27T09:45:53.155066+0000","last_fullsized":"2024-05-27T09:45:53.155066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.134047+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:45:53.134047+0000","last_peered":"2024-05-27T09:45:53.134047+0000","last_clean":"2024-05-27T09:45:53.134047+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:45:53.134047+0000","last_undegraded":"2024-05-27T09:45:53.134047+0000","last_fullsized":"2024-05-27T09:45:53.134047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.137010+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:45:53.137010+0000","last_peered":"2024-05-27T09:45:53.137010+0000","last_clean":"2024-05-27T09:45:53.137010+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:45:53.137010+0000","last_undegraded":"2024-05-27T09:45:53.137010+0000","last_fullsized":"2024-05-27T09:45:53.137010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152775+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:45:53.152775+0000","last_peered":"2024-05-27T09:45:53.152775+0000","last_clean":"2024-05-27T09:45:53.152775+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:45:53.152775+0000","last_undegraded":"2024-05-27T09:45:53.152775+0000","last_fullsized":"2024-05-27T09:45:53.152775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151368+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:45:53.151368+0000","last_peered":"2024-05-27T09:45:53.151368+0000","last_clean":"2024-05-27T09:45:53.151368+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:45:53.151368+0000","last_undegraded":"2024-05-27T09:45:53.151368+0000","last_fullsized":"2024-05-27T09:45:53.151368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155314+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:45:53.155314+0000","last_peered":"2024-05-27T09:45:53.155314+0000","last_clean":"2024-05-27T09:45:53.155314+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:45:53.155314+0000","last_undegraded":"2024-05-27T09:45:53.155314+0000","last_fullsized":"2024-05-27T09:45:53.155314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153391+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:45:53.153391+0000","last_peered":"2024-05-27T09:45:53.153391+0000","last_clean":"2024-05-27T09:45:53.153391+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:45:53.153391+0000","last_undegraded":"2024-05-27T09:45:53.153391+0000","last_fullsized":"2024-05-27T09:45:53.153391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.125789+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:45:53.125789+0000","last_peered":"2024-05-27T09:45:53.125789+0000","last_clean":"2024-05-27T09:45:53.125789+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:45:53.125789+0000","last_undegraded":"2024-05-27T09:45:53.125789+0000","last_fullsized":"2024-05-27T09:45:53.125789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.150467+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:45:53.150467+0000","last_peered":"2024-05-27T09:45:53.150467+0000","last_clean":"2024-05-27T09:45:53.150467+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:45:53.150467+0000","last_undegraded":"2024-05-27T09:45:53.150467+0000","last_fullsized":"2024-05-27T09:45:53.150467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.133071+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:45:53.133071+0000","last_peered":"2024-05-27T09:45:53.133071+0000","last_clean":"2024-05-27T09:45:53.133071+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:45:53.133071+0000","last_undegraded":"2024-05-27T09:45:53.133071+0000","last_fullsized":"2024-05-27T09:45:53.133071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.138579+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:45:53.138579+0000","last_peered":"2024-05-27T09:45:53.138579+0000","last_clean":"2024-05-27T09:45:53.138579+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:45:53.138579+0000","last_undegraded":"2024-05-27T09:45:53.138579+0000","last_fullsized":"2024-05-27T09:45:53.138579+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151408+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:45:53.151408+0000","last_peered":"2024-05-27T09:45:53.151408+0000","last_clean":"2024-05-27T09:45:53.151408+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:45:53.151408+0000","last_undegraded":"2024-05-27T09:45:53.151408+0000","last_fullsized":"2024-05-27T09:45:53.151408+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154445+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:45:53.154445+0000","last_peered":"2024-05-27T09:45:53.154445+0000","last_clean":"2024-05-27T09:45:53.154445+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:45:53.154445+0000","last_undegraded":"2024-05-27T09:45:53.154445+0000","last_fullsized":"2024-05-27T09:45:53.154445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.158053+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:45:53.158053+0000","last_peered":"2024-05-27T09:45:53.158053+0000","last_clean":"2024-05-27T09:45:53.158053+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:45:53.158053+0000","last_undegraded":"2024-05-27T09:45:53.158053+0000","last_fullsized":"2024-05-27T09:45:53.158053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156399+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:45:53.156399+0000","last_peered":"2024-05-27T09:45:53.156399+0000","last_clean":"2024-05-27T09:45:53.156399+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:45:53.156399+0000","last_undegraded":"2024-05-27T09:45:53.156399+0000","last_fullsized":"2024-05-27T09:45:53.156399+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154086+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:45:53.154086+0000","last_peered":"2024-05-27T09:45:53.154086+0000","last_clean":"2024-05-27T09:45:53.154086+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:45:53.154086+0000","last_undegraded":"2024-05-27T09:45:53.154086+0000","last_fullsized":"2024-05-27T09:45:53.154086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.135451+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:45:53.135451+0000","last_peered":"2024-05-27T09:45:53.135451+0000","last_clean":"2024-05-27T09:45:53.135451+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:45:53.135451+0000","last_undegraded":"2024-05-27T09:45:53.135451+0000","last_fullsized":"2024-05-27T09:45:53.135451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366840+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:44:24.366840+0000","last_peered":"2024-05-27T09:44:24.366840+0000","last_clean":"2024-05-27T09:44:24.366840+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:44:24.366840+0000","last_undegraded":"2024-05-27T09:44:24.366840+0000","last_fullsized":"2024-05-27T09:44:24.366840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.142153+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:45:53.142153+0000","last_peered":"2024-05-27T09:45:53.142153+0000","last_clean":"2024-05-27T09:45:53.142153+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:45:53.142153+0000","last_undegraded":"2024-05-27T09:45:53.142153+0000","last_fullsized":"2024-05-27T09:45:53.142153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.372516+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:44:24.372516+0000","last_peered":"2024-05-27T09:44:24.372516+0000","last_clean":"2024-05-27T09:44:24.372516+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:44:24.372516+0000","last_undegraded":"2024-05-27T09:44:24.372516+0000","last_fullsized":"2024-05-27T09:44:24.372516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156874+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:45:53.156874+0000","last_peered":"2024-05-27T09:45:53.156874+0000","last_clean":"2024-05-27T09:45:53.156874+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:45:53.156874+0000","last_undegraded":"2024-05-27T09:45:53.156874+0000","last_fullsized":"2024-05-27T09:45:53.156874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366485+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:44:24.366485+0000","last_peered":"2024-05-27T09:44:24.366485+0000","last_clean":"2024-05-27T09:44:24.366485+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:44:24.366485+0000","last_undegraded":"2024-05-27T09:44:24.366485+0000","last_fullsized":"2024-05-27T09:44:24.366485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156389+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:45:53.156389+0000","last_peered":"2024-05-27T09:45:53.156389+0000","last_clean":"2024-05-27T09:45:53.156389+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:45:53.156389+0000","last_undegraded":"2024-05-27T09:45:53.156389+0000","last_fullsized":"2024-05-27T09:45:53.156389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366281+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:44:24.366281+0000","last_peered":"2024-05-27T09:44:24.366281+0000","last_clean":"2024-05-27T09:44:24.366281+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:44:24.366281+0000","last_undegraded":"2024-05-27T09:44:24.366281+0000","last_fullsized":"2024-05-27T09:44:24.366281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.143050+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:45:53.143050+0000","last_peered":"2024-05-27T09:45:53.143050+0000","last_clean":"2024-05-27T09:45:53.143050+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:45:53.143050+0000","last_undegraded":"2024-05-27T09:45:53.143050+0000","last_fullsized":"2024-05-27T09:45:53.143050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:10.520213+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:46:10.520213+0000","last_peered":"2024-05-27T09:46:10.520213+0000","last_clean":"2024-05-27T09:46:10.520213+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:46:10.520213+0000","last_undegraded":"2024-05-27T09:46:10.520213+0000","last_fullsized":"2024-05-27T09:46:10.520213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.144562+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:45:53.144562+0000","last_peered":"2024-05-27T09:45:53.144562+0000","last_clean":"2024-05-27T09:45:53.144562+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:45:53.144562+0000","last_undegraded":"2024-05-27T09:45:53.144562+0000","last_fullsized":"2024-05-27T09:45:53.144562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368660+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:44:24.368660+0000","last_peered":"2024-05-27T09:44:24.368660+0000","last_clean":"2024-05-27T09:44:24.368660+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:44:24.368660+0000","last_undegraded":"2024-05-27T09:44:24.368660+0000","last_fullsized":"2024-05-27T09:44:24.368660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154550+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:45:53.154550+0000","last_peered":"2024-05-27T09:45:53.154550+0000","last_clean":"2024-05-27T09:45:53.154550+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:45:53.154550+0000","last_undegraded":"2024-05-27T09:45:53.154550+0000","last_fullsized":"2024-05-27T09:45:53.154550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361747+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:44:24.361747+0000","last_peered":"2024-05-27T09:44:24.361747+0000","last_clean":"2024-05-27T09:44:24.361747+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:44:24.361747+0000","last_undegraded":"2024-05-27T09:44:24.361747+0000","last_fullsized":"2024-05-27T09:44:24.361747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152178+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:45:53.152178+0000","last_peered":"2024-05-27T09:45:53.152178+0000","last_clean":"2024-05-27T09:45:53.152178+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:45:53.152178+0000","last_undegraded":"2024-05-27T09:45:53.152178+0000","last_fullsized":"2024-05-27T09:45:53.152178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514072+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:44:24.514072+0000","last_peered":"2024-05-27T09:44:24.514072+0000","last_clean":"2024-05-27T09:44:24.514072+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:44:24.514072+0000","last_undegraded":"2024-05-27T09:44:24.514072+0000","last_fullsized":"2024-05-27T09:44:24.514072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156346+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:45:53.156346+0000","last_peered":"2024-05-27T09:45:53.156346+0000","last_clean":"2024-05-27T09:45:53.156346+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:45:53.156346+0000","last_undegraded":"2024-05-27T09:45:53.156346+0000","last_fullsized":"2024-05-27T09:45:53.156346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:11.521505+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:46:11.521505+0000","last_peered":"2024-05-27T09:46:11.521505+0000","last_clean":"2024-05-27T09:46:11.521505+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:46:11.521505+0000","last_undegraded":"2024-05-27T09:46:11.521505+0000","last_fullsized":"2024-05-27T09:46:11.521505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154287+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:45:53.154287+0000","last_peered":"2024-05-27T09:45:53.154287+0000","last_clean":"2024-05-27T09:45:53.154287+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:45:53.154287+0000","last_undegraded":"2024-05-27T09:45:53.154287+0000","last_fullsized":"2024-05-27T09:45:53.154287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369053+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:44:24.369053+0000","last_peered":"2024-05-27T09:44:24.369053+0000","last_clean":"2024-05-27T09:44:24.369053+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:44:24.369053+0000","last_undegraded":"2024-05-27T09:44:24.369053+0000","last_fullsized":"2024-05-27T09:44:24.369053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156493+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:45:53.156493+0000","last_peered":"2024-05-27T09:45:53.156493+0000","last_clean":"2024-05-27T09:45:53.156493+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:45:53.156493+0000","last_undegraded":"2024-05-27T09:45:53.156493+0000","last_fullsized":"2024-05-27T09:45:53.156493+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514533+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:44:24.514533+0000","last_peered":"2024-05-27T09:44:24.514533+0000","last_clean":"2024-05-27T09:44:24.514533+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:44:24.514533+0000","last_undegraded":"2024-05-27T09:44:24.514533+0000","last_fullsized":"2024-05-27T09:44:24.514533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155726+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:45:53.155726+0000","last_peered":"2024-05-27T09:45:53.155726+0000","last_clean":"2024-05-27T09:45:53.155726+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:45:53.155726+0000","last_undegraded":"2024-05-27T09:45:53.155726+0000","last_fullsized":"2024-05-27T09:45:53.155726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":312,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:11.604029+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:46:11.604029+0000","last_peered":"2024-05-27T09:46:11.604029+0000","last_clean":"2024-05-27T09:46:11.604029+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:46:11.604029+0000","last_undegraded":"2024-05-27T09:46:11.604029+0000","last_fullsized":"2024-05-27T09:46:11.604029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65031,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":252,"num_read_kb":190,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.142829+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:45:53.142829+0000","last_peered":"2024-05-27T09:45:53.142829+0000","last_clean":"2024-05-27T09:45:53.142829+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:45:53.142829+0000","last_undegraded":"2024-05-27T09:45:53.142829+0000","last_fullsized":"2024-05-27T09:45:53.142829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361898+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:44:24.361898+0000","last_peered":"2024-05-27T09:44:24.361898+0000","last_clean":"2024-05-27T09:44:24.361898+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:44:24.361898+0000","last_undegraded":"2024-05-27T09:44:24.361898+0000","last_fullsized":"2024-05-27T09:44:24.361898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152975+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:45:53.152975+0000","last_peered":"2024-05-27T09:45:53.152975+0000","last_clean":"2024-05-27T09:45:53.152975+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:45:53.152975+0000","last_undegraded":"2024-05-27T09:45:53.152975+0000","last_fullsized":"2024-05-27T09:45:53.152975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514591+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:44:24.514591+0000","last_peered":"2024-05-27T09:44:24.514591+0000","last_clean":"2024-05-27T09:44:24.514591+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:44:24.514591+0000","last_undegraded":"2024-05-27T09:44:24.514591+0000","last_fullsized":"2024-05-27T09:44:24.514591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.148814+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:45:53.148814+0000","last_peered":"2024-05-27T09:45:53.148814+0000","last_clean":"2024-05-27T09:45:53.148814+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:45:53.148814+0000","last_undegraded":"2024-05-27T09:45:53.148814+0000","last_fullsized":"2024-05-27T09:45:53.148814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:07.547805+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:46:07.547805+0000","last_peered":"2024-05-27T09:46:07.547805+0000","last_clean":"2024-05-27T09:46:07.547805+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:46:07.547805+0000","last_undegraded":"2024-05-27T09:46:07.547805+0000","last_fullsized":"2024-05-27T09:46:07.547805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.145021+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:45:53.145021+0000","last_peered":"2024-05-27T09:45:53.145021+0000","last_clean":"2024-05-27T09:45:53.145021+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:45:53.145021+0000","last_undegraded":"2024-05-27T09:45:53.145021+0000","last_fullsized":"2024-05-27T09:45:53.145021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.388761+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:44:24.388761+0000","last_peered":"2024-05-27T09:44:24.388761+0000","last_clean":"2024-05-27T09:44:24.388761+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:44:24.388761+0000","last_undegraded":"2024-05-27T09:44:24.388761+0000","last_fullsized":"2024-05-27T09:44:24.388761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.141613+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:45:53.141613+0000","last_peered":"2024-05-27T09:45:53.141613+0000","last_clean":"2024-05-27T09:45:53.141613+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:45:53.141613+0000","last_undegraded":"2024-05-27T09:45:53.141613+0000","last_fullsized":"2024-05-27T09:45:53.141613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366685+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:44:24.366685+0000","last_peered":"2024-05-27T09:44:24.366685+0000","last_clean":"2024-05-27T09:44:24.366685+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:44:24.366685+0000","last_undegraded":"2024-05-27T09:44:24.366685+0000","last_fullsized":"2024-05-27T09:44:24.366685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.135877+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:45:53.135877+0000","last_peered":"2024-05-27T09:45:53.135877+0000","last_clean":"2024-05-27T09:45:53.135877+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:45:53.135877+0000","last_undegraded":"2024-05-27T09:45:53.135877+0000","last_fullsized":"2024-05-27T09:45:53.135877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366912+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:44:24.366912+0000","last_peered":"2024-05-27T09:44:24.366912+0000","last_clean":"2024-05-27T09:44:24.366912+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:44:24.366912+0000","last_undegraded":"2024-05-27T09:44:24.366912+0000","last_fullsized":"2024-05-27T09:44:24.366912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.146189+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:45:53.146189+0000","last_peered":"2024-05-27T09:45:53.146189+0000","last_clean":"2024-05-27T09:45:53.146189+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:45:53.146189+0000","last_undegraded":"2024-05-27T09:45:53.146189+0000","last_fullsized":"2024-05-27T09:45:53.146189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.368905+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:44:24.368905+0000","last_peered":"2024-05-27T09:44:24.368905+0000","last_clean":"2024-05-27T09:44:24.368905+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:44:24.368905+0000","last_undegraded":"2024-05-27T09:44:24.368905+0000","last_fullsized":"2024-05-27T09:44:24.368905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154463+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:45:53.154463+0000","last_peered":"2024-05-27T09:45:53.154463+0000","last_clean":"2024-05-27T09:45:53.154463+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:45:53.154463+0000","last_undegraded":"2024-05-27T09:45:53.154463+0000","last_fullsized":"2024-05-27T09:45:53.154463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.126848+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:45:53.126848+0000","last_peered":"2024-05-27T09:45:53.126848+0000","last_clean":"2024-05-27T09:45:53.126848+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:45:53.126848+0000","last_undegraded":"2024-05-27T09:45:53.126848+0000","last_fullsized":"2024-05-27T09:45:53.126848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:46:10.553855+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:46:10.553855+0000","last_peered":"2024-05-27T09:46:10.553855+0000","last_clean":"2024-05-27T09:46:10.553855+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:46:10.553855+0000","last_undegraded":"2024-05-27T09:46:10.553855+0000","last_fullsized":"2024-05-27T09:46:10.553855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154935+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:45:53.154935+0000","last_peered":"2024-05-27T09:45:53.154935+0000","last_clean":"2024-05-27T09:45:53.154935+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:45:53.154935+0000","last_undegraded":"2024-05-27T09:45:53.154935+0000","last_fullsized":"2024-05-27T09:45:53.154935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535360+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:44:24.535360+0000","last_peered":"2024-05-27T09:44:24.535360+0000","last_clean":"2024-05-27T09:44:24.535360+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:44:24.535360+0000","last_undegraded":"2024-05-27T09:44:24.535360+0000","last_fullsized":"2024-05-27T09:44:24.535360+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369400+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:44:24.369400+0000","last_peered":"2024-05-27T09:44:24.369400+0000","last_clean":"2024-05-27T09:44:24.369400+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:44:24.369400+0000","last_undegraded":"2024-05-27T09:44:24.369400+0000","last_fullsized":"2024-05-27T09:44:24.369400+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.137280+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:45:53.137280+0000","last_peered":"2024-05-27T09:45:53.137280+0000","last_clean":"2024-05-27T09:45:53.137280+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:45:53.137280+0000","last_undegraded":"2024-05-27T09:45:53.137280+0000","last_fullsized":"2024-05-27T09:45:53.137280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.369579+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:44:24.369579+0000","last_peered":"2024-05-27T09:44:24.369579+0000","last_clean":"2024-05-27T09:44:24.369579+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:44:24.369579+0000","last_undegraded":"2024-05-27T09:44:24.369579+0000","last_fullsized":"2024-05-27T09:44:24.369579+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366421+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:44:24.366421+0000","last_peered":"2024-05-27T09:44:24.366421+0000","last_clean":"2024-05-27T09:44:24.366421+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:44:24.366421+0000","last_undegraded":"2024-05-27T09:44:24.366421+0000","last_fullsized":"2024-05-27T09:44:24.366421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.152214+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:45:53.152214+0000","last_peered":"2024-05-27T09:45:53.152214+0000","last_clean":"2024-05-27T09:45:53.152214+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:45:53.152214+0000","last_undegraded":"2024-05-27T09:45:53.152214+0000","last_fullsized":"2024-05-27T09:45:53.152214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'13","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.857738+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:45:53.857738+0000","last_peered":"2024-05-27T09:45:53.857738+0000","last_clean":"2024-05-27T09:45:53.857738+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:45:53.857738+0000","last_undegraded":"2024-05-27T09:45:53.857738+0000","last_fullsized":"2024-05-27T09:45:53.857738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.143427+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:45:53.143427+0000","last_peered":"2024-05-27T09:45:53.143427+0000","last_clean":"2024-05-27T09:45:53.143427+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:45:53.143427+0000","last_undegraded":"2024-05-27T09:45:53.143427+0000","last_fullsized":"2024-05-27T09:45:53.143427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.535513+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:44:24.535513+0000","last_peered":"2024-05-27T09:44:24.535513+0000","last_clean":"2024-05-27T09:44:24.535513+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:44:24.535513+0000","last_undegraded":"2024-05-27T09:44:24.535513+0000","last_fullsized":"2024-05-27T09:44:24.535513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156273+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:45:53.156273+0000","last_peered":"2024-05-27T09:45:53.156273+0000","last_clean":"2024-05-27T09:45:53.156273+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:45:53.156273+0000","last_undegraded":"2024-05-27T09:45:53.156273+0000","last_fullsized":"2024-05-27T09:45:53.156273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.364109+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:44:24.364109+0000","last_peered":"2024-05-27T09:44:24.364109+0000","last_clean":"2024-05-27T09:44:24.364109+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:44:24.364109+0000","last_undegraded":"2024-05-27T09:44:24.364109+0000","last_fullsized":"2024-05-27T09:44:24.364109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.133159+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:45:53.133159+0000","last_peered":"2024-05-27T09:45:53.133159+0000","last_clean":"2024-05-27T09:45:53.133159+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:45:53.133159+0000","last_undegraded":"2024-05-27T09:45:53.133159+0000","last_fullsized":"2024-05-27T09:45:53.133159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.370206+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:44:24.370206+0000","last_peered":"2024-05-27T09:44:24.370206+0000","last_clean":"2024-05-27T09:44:24.370206+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:44:24.370206+0000","last_undegraded":"2024-05-27T09:44:24.370206+0000","last_fullsized":"2024-05-27T09:44:24.370206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155001+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:45:53.155001+0000","last_peered":"2024-05-27T09:45:53.155001+0000","last_clean":"2024-05-27T09:45:53.155001+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:45:53.155001+0000","last_undegraded":"2024-05-27T09:45:53.155001+0000","last_fullsized":"2024-05-27T09:45:53.155001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.376759+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:44:24.376759+0000","last_peered":"2024-05-27T09:44:24.376759+0000","last_clean":"2024-05-27T09:44:24.376759+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:44:24.376759+0000","last_undegraded":"2024-05-27T09:44:24.376759+0000","last_fullsized":"2024-05-27T09:44:24.376759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.157855+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:45:53.157855+0000","last_peered":"2024-05-27T09:45:53.157855+0000","last_clean":"2024-05-27T09:45:53.157855+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:45:53.157855+0000","last_undegraded":"2024-05-27T09:45:53.157855+0000","last_fullsized":"2024-05-27T09:45:53.157855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.366147+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:44:24.366147+0000","last_peered":"2024-05-27T09:44:24.366147+0000","last_clean":"2024-05-27T09:44:24.366147+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:44:24.366147+0000","last_undegraded":"2024-05-27T09:44:24.366147+0000","last_fullsized":"2024-05-27T09:44:24.366147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151571+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:45:53.151571+0000","last_peered":"2024-05-27T09:45:53.151571+0000","last_clean":"2024-05-27T09:45:53.151571+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:45:53.151571+0000","last_undegraded":"2024-05-27T09:45:53.151571+0000","last_fullsized":"2024-05-27T09:45:53.151571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.363035+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:44:24.363035+0000","last_peered":"2024-05-27T09:44:24.363035+0000","last_clean":"2024-05-27T09:44:24.363035+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:44:24.363035+0000","last_undegraded":"2024-05-27T09:44:24.363035+0000","last_fullsized":"2024-05-27T09:44:24.363035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153545+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:45:53.153545+0000","last_peered":"2024-05-27T09:45:53.153545+0000","last_clean":"2024-05-27T09:45:53.153545+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:45:53.153545+0000","last_undegraded":"2024-05-27T09:45:53.153545+0000","last_fullsized":"2024-05-27T09:45:53.153545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.514387+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:44:24.514387+0000","last_peered":"2024-05-27T09:44:24.514387+0000","last_clean":"2024-05-27T09:44:24.514387+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:44:24.514387+0000","last_undegraded":"2024-05-27T09:44:24.514387+0000","last_fullsized":"2024-05-27T09:44:24.514387+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153806+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:45:53.153806+0000","last_peered":"2024-05-27T09:45:53.153806+0000","last_clean":"2024-05-27T09:45:53.153806+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:45:53.153806+0000","last_undegraded":"2024-05-27T09:45:53.153806+0000","last_fullsized":"2024-05-27T09:45:53.153806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:44:24.361911+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:44:24.361911+0000","last_peered":"2024-05-27T09:44:24.361911+0000","last_clean":"2024-05-27T09:44:24.361911+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:44:24.361911+0000","last_undegraded":"2024-05-27T09:44:24.361911+0000","last_fullsized":"2024-05-27T09:44:24.361911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.146926+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:45:53.146926+0000","last_peered":"2024-05-27T09:45:53.146926+0000","last_clean":"2024-05-27T09:45:53.146926+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:45:53.146926+0000","last_undegraded":"2024-05-27T09:45:53.146926+0000","last_fullsized":"2024-05-27T09:45:53.146926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.141791+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:45:53.141791+0000","last_peered":"2024-05-27T09:45:53.141791+0000","last_clean":"2024-05-27T09:45:53.141791+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:45:53.141791+0000","last_undegraded":"2024-05-27T09:45:53.141791+0000","last_fullsized":"2024-05-27T09:45:53.141791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.130893+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:45:53.130893+0000","last_peered":"2024-05-27T09:45:53.130893+0000","last_clean":"2024-05-27T09:45:53.130893+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:45:53.130893+0000","last_undegraded":"2024-05-27T09:45:53.130893+0000","last_fullsized":"2024-05-27T09:45:53.130893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155043+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:45:53.155043+0000","last_peered":"2024-05-27T09:45:53.155043+0000","last_clean":"2024-05-27T09:45:53.155043+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:45:53.155043+0000","last_undegraded":"2024-05-27T09:45:53.155043+0000","last_fullsized":"2024-05-27T09:45:53.155043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.153970+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:45:53.153970+0000","last_peered":"2024-05-27T09:45:53.153970+0000","last_clean":"2024-05-27T09:45:53.153970+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:45:53.153970+0000","last_undegraded":"2024-05-27T09:45:53.153970+0000","last_fullsized":"2024-05-27T09:45:53.153970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.155218+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:45:53.155218+0000","last_peered":"2024-05-27T09:45:53.155218+0000","last_clean":"2024-05-27T09:45:53.155218+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:45:53.155218+0000","last_undegraded":"2024-05-27T09:45:53.155218+0000","last_fullsized":"2024-05-27T09:45:53.155218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.133439+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:45:53.133439+0000","last_peered":"2024-05-27T09:45:53.133439+0000","last_clean":"2024-05-27T09:45:53.133439+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:45:53.133439+0000","last_undegraded":"2024-05-27T09:45:53.133439+0000","last_fullsized":"2024-05-27T09:45:53.133439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.136081+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:45:53.136081+0000","last_peered":"2024-05-27T09:45:53.136081+0000","last_clean":"2024-05-27T09:45:53.136081+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:45:53.136081+0000","last_undegraded":"2024-05-27T09:45:53.136081+0000","last_fullsized":"2024-05-27T09:45:53.136081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.145544+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:45:53.145544+0000","last_peered":"2024-05-27T09:45:53.145544+0000","last_clean":"2024-05-27T09:45:53.145544+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:45:53.145544+0000","last_undegraded":"2024-05-27T09:45:53.145544+0000","last_fullsized":"2024-05-27T09:45:53.145544+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.154477+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:45:53.154477+0000","last_peered":"2024-05-27T09:45:53.154477+0000","last_clean":"2024-05-27T09:45:53.154477+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:45:53.154477+0000","last_undegraded":"2024-05-27T09:45:53.154477+0000","last_fullsized":"2024-05-27T09:45:53.154477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.151955+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:45:53.151955+0000","last_peered":"2024-05-27T09:45:53.151955+0000","last_clean":"2024-05-27T09:45:53.151955+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:45:53.151955+0000","last_undegraded":"2024-05-27T09:45:53.151955+0000","last_fullsized":"2024-05-27T09:45:53.151955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.157014+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:45:53.157014+0000","last_peered":"2024-05-27T09:45:53.157014+0000","last_clean":"2024-05-27T09:45:53.157014+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:45:53.157014+0000","last_undegraded":"2024-05-27T09:45:53.157014+0000","last_fullsized":"2024-05-27T09:45:53.157014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.156549+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:45:53.156549+0000","last_peered":"2024-05-27T09:45:53.156549+0000","last_clean":"2024-05-27T09:45:53.156549+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:45:53.156549+0000","last_undegraded":"2024-05-27T09:45:53.156549+0000","last_fullsized":"2024-05-27T09:45:53.156549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-27T09:45:53.136655+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:45:53.136655+0000","last_peered":"2024-05-27T09:45:53.136655+0000","last_clean":"2024-05-27T09:45:53.136655+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:45:53.136655+0000","last_undegraded":"2024-05-27T09:45:53.136655+0000","last_fullsized":"2024-05-27T09:45:53.136655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69173,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":752,"num_read_kb":451,"num_write":173,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612656,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":440298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1597440,"data_stored":1097230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005112,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":440422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201344,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":440230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1507328,"data_stored":1032413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593802,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":439811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":966656,"data_stored":504635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":921600,"data_stored":441082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":505985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149788,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":440122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953558,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":440780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790034,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1519616,"data_stored":1031565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:46:15.196 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-27T09:46:15.196 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-27T09:46:15.196 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-27T09:46:15.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-05-27T09:46:15.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:14 smithi122 ceph-mon[36436]: pgmap v398: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:46:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:14 smithi072 ceph-mon[35951]: pgmap v398: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-27T09:46:15.675 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:16.228 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:15 smithi071 ceph-mon[31451]: from='client.24836 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:46:16.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:15 smithi122 ceph-mon[36436]: from='client.24836 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:46:16.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:15 smithi072 ceph-mon[35951]: from='client.24836 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:46:16.996 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:16 smithi071 ceph-mon[31451]: pgmap v399: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:17.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:16 smithi122 ceph-mon[36436]: pgmap v399: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:17.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:16 smithi072 ceph-mon[35951]: pgmap v399: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 -- 172.21.15.71:0/138572047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358109860 msgr2=0x7f43581111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 --2- 172.21.15.71:0/138572047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358109860 0x7f43581111c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f435000b0d0 tx=0x7f435000b3e0 comp rx=0 tx=0).stop 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 -- 172.21.15.71:0/138572047 shutdown_connections 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 --2- 172.21.15.71:0/138572047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358109860 0x7f43581111c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 --2- 172.21.15.71:0/138572047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43581045e0 0x7f43581049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 --2- 172.21.15.71:0/138572047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4358108f10 0x7f4358109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 -- 172.21.15.71:0/138572047 >> 172.21.15.71:0/138572047 conn(0x7f43580ffeb0 msgr2=0x7f4358102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 -- 172.21.15.71:0/138572047 shutdown_connections 2024-05-27T09:46:17.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.934+0000 7f435da00700 1 -- 172.21.15.71:0/138572047 wait complete. 2024-05-27T09:46:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.935+0000 7f435da00700 1 Processor -- start 2024-05-27T09:46:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f435da00700 1 -- start start 2024-05-27T09:46:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f435da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43581045e0 0x7f435819add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f435da00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358108f10 0x7f435819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f435da00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4358109860 0x7f435819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f435da00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f43581144e0 con 0x7f4358108f10 2024-05-27T09:46:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f435da00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4358114360 con 0x7f43581045e0 2024-05-27T09:46:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f435da00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4358114660 con 0x7f4358109860 2024-05-27T09:46:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f4356000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358108f10 0x7f435819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f4356a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43581045e0 0x7f435819add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f4356000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358108f10 0x7f435819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40748/0 (socket says 172.21.15.71:40748) 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.936+0000 7f4356000700 1 -- 172.21.15.71:0/1523531517 learned_addr learned my addr 172.21.15.71:0/1523531517 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4357400700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4358109860 0x7f435819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4356a00700 1 -- 172.21.15.71:0/1523531517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4358109860 msgr2=0x7f435819f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4356a00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4358109860 0x7f435819f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4356a00700 1 -- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358108f10 msgr2=0x7f435819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4356a00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358108f10 0x7f435819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4356a00700 1 -- 172.21.15.71:0/1523531517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435819fca0 con 0x7f43581045e0 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4357400700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4358109860 0x7f435819f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4356000700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358108f10 0x7f435819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.937+0000 7f4356a00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43581045e0 0x7f435819add0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f434800e9f0 tx=0x7f434800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.938+0000 7f434f400700 1 -- 172.21.15.71:0/1523531517 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434800cbd0 con 0x7f43581045e0 2024-05-27T09:46:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.938+0000 7f434f400700 1 -- 172.21.15.71:0/1523531517 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f434800cd70 con 0x7f43581045e0 2024-05-27T09:46:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.938+0000 7f434f400700 1 -- 172.21.15.71:0/1523531517 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348018680 con 0x7f43581045e0 2024-05-27T09:46:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.938+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435819ff90 con 0x7f43581045e0 2024-05-27T09:46:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.938+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4358076af0 con 0x7f43581045e0 2024-05-27T09:46:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.939+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4358105a90 con 0x7f43581045e0 2024-05-27T09:46:17.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.941+0000 7f434f400700 1 -- 172.21.15.71:0/1523531517 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4348010430 con 0x7f43581045e0 2024-05-27T09:46:17.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.943+0000 7f434f400700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f433c0b2900 0x7f433c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:17.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.943+0000 7f434f400700 1 -- 172.21.15.71:0/1523531517 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f43480e2870 con 0x7f43581045e0 2024-05-27T09:46:17.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.943+0000 7f4356000700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f433c0b2900 0x7f433c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:17.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.944+0000 7f4356000700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f433c0b2900 0x7f433c0b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4358103960 tx=0x7f4340009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:17.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:17.945+0000 7f434f400700 1 -- 172.21.15.71:0/1523531517 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f43480aa540 con 0x7f43581045e0 2024-05-27T09:46:18.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.226+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f435819c130 con 0x7f43581045e0 2024-05-27T09:46:18.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.227+0000 7f434f400700 1 -- 172.21.15.71:0/1523531517 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f43480a9e40 con 0x7f43581045e0 2024-05-27T09:46:18.228 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:46:18.228 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-27T09:46:18.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f433c0b2900 msgr2=0x7f433c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:18.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f433c0b2900 0x7f433c0b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4358103960 tx=0x7f4340009260 comp rx=0 tx=0).stop 2024-05-27T09:46:18.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43581045e0 msgr2=0x7f435819add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:18.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43581045e0 0x7f435819add0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f434800e9f0 tx=0x7f434800ed00 comp rx=0 tx=0).stop 2024-05-27T09:46:18.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 shutdown_connections 2024-05-27T09:46:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4358109860 0x7f435819f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43581045e0 0x7f435819add0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f433c0b2900 0x7f433c0b4e10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 --2- 172.21.15.71:0/1523531517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4358108f10 0x7f435819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 >> 172.21.15.71:0/1523531517 conn(0x7f43580ffeb0 msgr2=0x7f4358108680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 shutdown_connections 2024-05-27T09:46:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:18.231+0000 7f435da00700 1 -- 172.21.15.71:0/1523531517 wait complete. 2024-05-27T09:46:19.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:18 smithi071 ceph-mon[31451]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:19.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:18 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1523531517' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-27T09:46:19.199 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-27T09:46:19.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:46:19.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:18 smithi122 ceph-mon[36436]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:19.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:18 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1523531517' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-27T09:46:19.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:18 smithi072 ceph-mon[35951]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:19.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:18 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1523531517' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-27T09:46:19.651 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:21.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:20 smithi071 ceph-mon[31451]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:21.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:20 smithi122 ceph-mon[36436]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:21.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:20 smithi072 ceph-mon[35951]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 -- 172.21.15.71:0/2430150970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810b2d0 msgr2=0x7eff08117800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 --2- 172.21.15.71:0/2430150970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810b2d0 0x7eff08117800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff0000b0a0 tx=0x7eff0000b3b0 comp rx=0 tx=0).stop 2024-05-27T09:46:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 -- 172.21.15.71:0/2430150970 shutdown_connections 2024-05-27T09:46:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 --2- 172.21.15.71:0/2430150970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810b2d0 0x7eff08117800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 --2- 172.21.15.71:0/2430150970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 0x7eff08110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 --2- 172.21.15.71:0/2430150970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810a980 0x7eff0810ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 -- 172.21.15.71:0/2430150970 >> 172.21.15.71:0/2430150970 conn(0x7eff08077c70 msgr2=0x7eff080780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 -- 172.21.15.71:0/2430150970 shutdown_connections 2024-05-27T09:46:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.966+0000 7eff10000700 1 -- 172.21.15.71:0/2430150970 wait complete. 2024-05-27T09:46:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.968+0000 7eff10000700 1 Processor -- start 2024-05-27T09:46:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.968+0000 7eff10000700 1 -- start start 2024-05-27T09:46:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff10000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810a980 0x7eff081a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff10000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810b2d0 0x7eff081a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff10000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 0x7eff081a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff10000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff0811aad0 con 0x7eff0810b2d0 2024-05-27T09:46:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff10000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff0811a950 con 0x7eff08110960 2024-05-27T09:46:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff10000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff0811ac50 con 0x7eff0810a980 2024-05-27T09:46:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff0cc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810b2d0 0x7eff081a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff0e000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 0x7eff081a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff0cc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810b2d0 0x7eff081a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40774/0 (socket says 172.21.15.71:40774) 2024-05-27T09:46:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff0e000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 0x7eff081a5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46926/0 (socket says 172.21.15.71:46926) 2024-05-27T09:46:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff0cc00700 1 -- 172.21.15.71:0/243458736 learned_addr learned my addr 172.21.15.71:0/243458736 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.969+0000 7eff0d600700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810a980 0x7eff081a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff0cc00700 1 -- 172.21.15.71:0/243458736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810a980 msgr2=0x7eff081a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff0cc00700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810a980 0x7eff081a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff0cc00700 1 -- 172.21.15.71:0/243458736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 msgr2=0x7eff081a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff0cc00700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 0x7eff081a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff0cc00700 1 -- 172.21.15.71:0/243458736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff081a62b0 con 0x7eff0810b2d0 2024-05-27T09:46:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff0e000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 0x7eff081a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff0cc00700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810b2d0 0x7eff081a1980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efef400e970 tx=0x7efef400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff06000700 1 -- 172.21.15.71:0/243458736 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4004a30 con 0x7eff0810b2d0 2024-05-27T09:46:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff06000700 1 -- 172.21.15.71:0/243458736 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef400cc90 con 0x7eff0810b2d0 2024-05-27T09:46:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff081a65a0 con 0x7eff0810b2d0 2024-05-27T09:46:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff06000700 1 -- 172.21.15.71:0/243458736 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4005610 con 0x7eff0810b2d0 2024-05-27T09:46:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.970+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff081adec0 con 0x7eff0810b2d0 2024-05-27T09:46:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.971+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff080512b0 con 0x7eff0810b2d0 2024-05-27T09:46:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.974+0000 7eff06000700 1 -- 172.21.15.71:0/243458736 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efef400c7e0 con 0x7eff0810b2d0 2024-05-27T09:46:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.975+0000 7eff06000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2880 0x7efef00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.976+0000 7eff06000700 1 -- 172.21.15.71:0/243458736 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7efef40e2560 con 0x7eff0810b2d0 2024-05-27T09:46:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.976+0000 7eff0d600700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2880 0x7efef00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.976+0000 7eff0d600700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2880 0x7efef00b4d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff0807d0e0 tx=0x7efefc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:21.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:21.980+0000 7eff06000700 1 -- 172.21.15.71:0/243458736 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efef40aa230 con 0x7eff0810b2d0 2024-05-27T09:46:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.260+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff0802e5e0 con 0x7eff0810b2d0 2024-05-27T09:46:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.262+0000 7eff06000700 1 -- 172.21.15.71:0/243458736 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11854 (secure 0 0 0) 0x7efef40a9b30 con 0x7eff0810b2d0 2024-05-27T09:46:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:46:22.263 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:44:15.200351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:46:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2880 msgr2=0x7efef00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2880 0x7efef00b4d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff0807d0e0 tx=0x7efefc009260 comp rx=0 tx=0).stop 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810b2d0 msgr2=0x7eff081a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810b2d0 0x7eff081a1980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efef400e970 tx=0x7efef400ec80 comp rx=0 tx=0).stop 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 shutdown_connections 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff08110960 0x7eff081a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0810a980 0x7eff081a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7efef00b2880 0x7efef00b4d90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 --2- 172.21.15.71:0/243458736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0810b2d0 0x7eff081a1980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.265+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 >> 172.21.15.71:0/243458736 conn(0x7eff08077c70 msgr2=0x7eff0807b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.266+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 shutdown_connections 2024-05-27T09:46:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:22.266+0000 7eff10000700 1 -- 172.21.15.71:0/243458736 wait complete. 2024-05-27T09:46:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-05-27T09:46:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:22 smithi122 ceph-mon[36436]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:22 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/243458736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:23.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:22 smithi071 ceph-mon[31451]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:23.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:22 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/243458736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:22 smithi072 ceph-mon[35951]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:22 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/243458736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:23.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:46:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:25.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:24 smithi122 ceph-mon[36436]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:25.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:24 smithi071 ceph-mon[31451]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:24 smithi072 ceph-mon[35951]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 -- 172.21.15.71:0/1105732798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee341045e0 msgr2=0x7fee341049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 --2- 172.21.15.71:0/1105732798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee341045e0 0x7fee341049f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee240098f0 tx=0x7fee24009c00 comp rx=0 tx=0).stop 2024-05-27T09:46:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 -- 172.21.15.71:0/1105732798 shutdown_connections 2024-05-27T09:46:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 --2- 172.21.15.71:0/1105732798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee34109860 0x7fee341111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 --2- 172.21.15.71:0/1105732798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee341045e0 0x7fee341049f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 --2- 172.21.15.71:0/1105732798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee34108f10 0x7fee34109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 -- 172.21.15.71:0/1105732798 >> 172.21.15.71:0/1105732798 conn(0x7fee34100030 msgr2=0x7fee34102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 -- 172.21.15.71:0/1105732798 shutdown_connections 2024-05-27T09:46:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.159+0000 7fee3a000700 1 -- 172.21.15.71:0/1105732798 wait complete. 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.160+0000 7fee3a000700 1 Processor -- start 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.161+0000 7fee3a000700 1 -- start start 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.161+0000 7fee3a000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee341045e0 0x7fee34075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.161+0000 7fee3a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee34108f10 0x7fee34075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.161+0000 7fee3a000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee34109860 0x7fee34076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.161+0000 7fee3a000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fee341144e0 con 0x7fee341045e0 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.161+0000 7fee3a000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fee34114360 con 0x7fee34108f10 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.161+0000 7fee3a000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fee34114660 con 0x7fee34109860 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee341045e0 0x7fee34075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee341045e0 0x7fee34075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53512/0 (socket says 172.21.15.71:53512) 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33400700 1 -- 172.21.15.71:0/2826902349 learned_addr learned my addr 172.21.15.71:0/2826902349 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33e00700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee34109860 0x7fee34076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee2be00700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee34108f10 0x7fee34075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33e00700 1 -- 172.21.15.71:0/2826902349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee34108f10 msgr2=0x7fee34075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33e00700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee34108f10 0x7fee34075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33e00700 1 -- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee341045e0 msgr2=0x7fee34075ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33e00700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee341045e0 0x7fee34075ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33e00700 1 -- 172.21.15.71:0/2826902349 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee341a9290 con 0x7fee34109860 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33400700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee341045e0 0x7fee34075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.162+0000 7fee33e00700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee34109860 0x7fee34076530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00efb0 tx=0x7fee2c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.163+0000 7fee30c00700 1 -- 172.21.15.71:0/2826902349 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c003a00 con 0x7fee34109860 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.163+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee341a9580 con 0x7fee34109860 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.163+0000 7fee30c00700 1 -- 172.21.15.71:0/2826902349 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee2c00ce40 con 0x7fee34109860 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.163+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee341a9ac0 con 0x7fee34109860 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.163+0000 7fee30c00700 1 -- 172.21.15.71:0/2826902349 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0046d0 con 0x7fee34109860 2024-05-27T09:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.164+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee340512b0 con 0x7fee34109860 2024-05-27T09:46:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.166+0000 7fee30c00700 1 -- 172.21.15.71:0/2826902349 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fee2c012050 con 0x7fee34109860 2024-05-27T09:46:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.168+0000 7fee30c00700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fee180b2880 0x7fee180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.168+0000 7fee30c00700 1 -- 172.21.15.71:0/2826902349 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fee2c0e1a20 con 0x7fee34109860 2024-05-27T09:46:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.168+0000 7fee33400700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fee180b2880 0x7fee180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.169+0000 7fee33400700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fee180b2880 0x7fee180b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fee24009fd0 tx=0x7fee24019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.170+0000 7fee30c00700 1 -- 172.21.15.71:0/2826902349 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee2c022060 con 0x7fee34109860 2024-05-27T09:46:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.449+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee3402e5e0 con 0x7fee34109860 2024-05-27T09:46:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.451+0000 7fee30c00700 1 -- 172.21.15.71:0/2826902349 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11854 (secure 0 0 0) 0x7fee2c010040 con 0x7fee34109860 2024-05-27T09:46:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:46:26.452 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:44:15.200351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:46:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fee180b2880 msgr2=0x7fee180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fee180b2880 0x7fee180b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fee24009fd0 tx=0x7fee24019040 comp rx=0 tx=0).stop 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee34109860 msgr2=0x7fee34076530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee34109860 0x7fee34076530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00efb0 tx=0x7fee2c00c3a0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 shutdown_connections 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee34109860 0x7fee34076530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fee180b2880 0x7fee180b4d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee341045e0 0x7fee34075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 --2- 172.21.15.71:0/2826902349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee34108f10 0x7fee34075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 >> 172.21.15.71:0/2826902349 conn(0x7fee34100030 msgr2=0x7fee34102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.454+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 shutdown_connections 2024-05-27T09:46:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:26.455+0000 7fee3a000700 1 -- 172.21.15.71:0/2826902349 wait complete. 2024-05-27T09:46:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-05-27T09:46:27.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:26 smithi122 ceph-mon[36436]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:27.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:26 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2826902349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:26 smithi071 ceph-mon[31451]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:26 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2826902349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:27.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:26 smithi072 ceph-mon[35951]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:27.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:26 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2826902349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:27.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:46:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:29.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:28 smithi071 ceph-mon[31451]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:28 smithi122 ceph-mon[36436]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:29.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:28 smithi072 ceph-mon[35951]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 -- 172.21.15.71:0/2848503424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa810a980 msgr2=0x7f0fa810ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 --2- 172.21.15.71:0/2848503424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa810a980 0x7f0fa810ad90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009990 tx=0x7f0f94009ca0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 -- 172.21.15.71:0/2848503424 shutdown_connections 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 --2- 172.21.15.71:0/2848503424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa810b2d0 0x7f0fa8117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 --2- 172.21.15.71:0/2848503424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fa8110960 0x7f0fa8110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 --2- 172.21.15.71:0/2848503424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa810a980 0x7f0fa810ad90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 -- 172.21.15.71:0/2848503424 >> 172.21.15.71:0/2848503424 conn(0x7f0fa8077c70 msgr2=0x7f0fa80780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 -- 172.21.15.71:0/2848503424 shutdown_connections 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.094+0000 7f0faca00700 1 -- 172.21.15.71:0/2848503424 wait complete. 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.095+0000 7f0faca00700 1 Processor -- start 2024-05-27T09:46:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.095+0000 7f0faca00700 1 -- start start 2024-05-27T09:46:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0faca00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fa810a980 0x7f0fa81a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0faca00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa810b2d0 0x7f0fa81a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0faca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa8110960 0x7f0fa81a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0faca00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa811aad0 con 0x7f0fa810b2d0 2024-05-27T09:46:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0faca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa811a950 con 0x7f0fa8110960 2024-05-27T09:46:30.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0faca00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa811ac50 con 0x7f0fa810a980 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0fa5e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fa810a980 0x7f0fa81a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa5400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa810b2d0 0x7f0fa81a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa6800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa8110960 0x7f0fa81a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.096+0000 7f0fa5e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fa810a980 0x7f0fa81a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:43560/0 (socket says 172.21.15.71:43560) 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa5e00700 1 -- 172.21.15.71:0/2573457179 learned_addr learned my addr 172.21.15.71:0/2573457179 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa6800700 1 -- 172.21.15.71:0/2573457179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fa810a980 msgr2=0x7f0fa81a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa6800700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fa810a980 0x7f0fa81a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa6800700 1 -- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa810b2d0 msgr2=0x7f0fa81a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa6800700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa810b2d0 0x7f0fa81a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa6800700 1 -- 172.21.15.71:0/2573457179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa81a6370 con 0x7f0fa8110960 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.097+0000 7f0fa6800700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa8110960 0x7f0fa81a5cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000efc0 tx=0x7f0fa000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:30.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.098+0000 7f0f9ea00700 1 -- 172.21.15.71:0/2573457179 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00092e0 con 0x7f0fa8110960 2024-05-27T09:46:30.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.098+0000 7f0f9ea00700 1 -- 172.21.15.71:0/2573457179 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fa0004bb0 con 0x7f0fa8110960 2024-05-27T09:46:30.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.098+0000 7f0f9ea00700 1 -- 172.21.15.71:0/2573457179 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0004020 con 0x7f0fa8110960 2024-05-27T09:46:30.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.098+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa81a6600 con 0x7f0fa8110960 2024-05-27T09:46:30.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.098+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa81a6af0 con 0x7f0fa8110960 2024-05-27T09:46:30.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.099+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa80512b0 con 0x7f0fa8110960 2024-05-27T09:46:30.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.101+0000 7f0f9ea00700 1 -- 172.21.15.71:0/2573457179 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0fa001b030 con 0x7f0fa8110960 2024-05-27T09:46:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.103+0000 7f0f9ea00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.103+0000 7f0f9ea00700 1 -- 172.21.15.71:0/2573457179 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0fa00e26f0 con 0x7f0fa8110960 2024-05-27T09:46:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.103+0000 7f0fa5e00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.104+0000 7f0fa5e00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0f98005950 tx=0x7f0f98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.105+0000 7f0f9ea00700 1 -- 172.21.15.71:0/2573457179 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0fa0022020 con 0x7f0fa8110960 2024-05-27T09:46:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.339+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fa802e5e0 con 0x7f0fa8110960 2024-05-27T09:46:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.341+0000 7f0f9ea00700 1 -- 172.21.15.71:0/2573457179 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22603 (secure 0 0 0) 0x7f0fa0010040 con 0x7f0fa8110960 2024-05-27T09:46:30.342 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:46:30.343 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":83,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:44:24.357115+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:46:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f8c0b2900 msgr2=0x7f0f8c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0f98005950 tx=0x7f0f98009260 comp rx=0 tx=0).stop 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa8110960 msgr2=0x7f0fa81a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa8110960 0x7f0fa81a5cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000efc0 tx=0x7f0fa000c3a0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 shutdown_connections 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa8110960 0x7f0fa81a5cd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fa810a980 0x7f0fa81a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 --2- 172.21.15.71:0/2573457179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa810b2d0 0x7f0fa81a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 >> 172.21.15.71:0/2573457179 conn(0x7f0fa8077c70 msgr2=0x7f0fa807b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.345+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 shutdown_connections 2024-05-27T09:46:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:30.346+0000 7f0faca00700 1 -- 172.21.15.71:0/2573457179 wait complete. 2024-05-27T09:46:31.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:30 smithi071 ceph-mon[31451]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:31.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:30 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2573457179' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:46:31.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:30 smithi122 ceph-mon[36436]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:31.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:30 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2573457179' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:46:31.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:46:31.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:30 smithi072 ceph-mon[35951]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:31.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:30 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2573457179' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:46:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:32.989 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:32 smithi071 ceph-mon[31451]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:33.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:32 smithi122 ceph-mon[36436]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:33.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:32 smithi072 ceph-mon[35951]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:33.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.946+0000 7f5cca200700 1 -- 172.21.15.71:0/2238466930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410b140 msgr2=0x7f5cc4117670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:33.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.946+0000 7f5cca200700 1 --2- 172.21.15.71:0/2238466930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410b140 0x7f5cc4117670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00b0a0 tx=0x7f5cbc00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:46:33.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.946+0000 7f5cca200700 1 -- 172.21.15.71:0/2238466930 shutdown_connections 2024-05-27T09:46:33.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.946+0000 7f5cca200700 1 --2- 172.21.15.71:0/2238466930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410b140 0x7f5cc4117670 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:33.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.946+0000 7f5cca200700 1 --2- 172.21.15.71:0/2238466930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc41107d0 0x7f5cc4110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:33.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.946+0000 7f5cca200700 1 --2- 172.21.15.71:0/2238466930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5cc410a7f0 0x7f5cc410ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:33.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.946+0000 7f5cca200700 1 -- 172.21.15.71:0/2238466930 >> 172.21.15.71:0/2238466930 conn(0x7f5cc4076af0 msgr2=0x7f5cc4076f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:33.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.947+0000 7f5cca200700 1 -- 172.21.15.71:0/2238466930 shutdown_connections 2024-05-27T09:46:33.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.947+0000 7f5cca200700 1 -- 172.21.15.71:0/2238466930 wait complete. 2024-05-27T09:46:33.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 Processor -- start 2024-05-27T09:46:33.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 -- start start 2024-05-27T09:46:33.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410a7f0 0x7f5cc41a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:33.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5cc410b140 0x7f5cc41a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:33.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc41107d0 0x7f5cc41a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc411a940 con 0x7f5cc41107d0 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc411a7c0 con 0x7f5cc410a7f0 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.948+0000 7f5cca200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc411aac0 con 0x7f5cc410b140 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410a7f0 0x7f5cc41a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc9800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc41107d0 0x7f5cc41a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc3e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5cc410b140 0x7f5cc41a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410a7f0 0x7f5cc41a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:44186/0 (socket says 172.21.15.71:44186) 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 -- 172.21.15.71:0/616547677 learned_addr learned my addr 172.21.15.71:0/616547677 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 -- 172.21.15.71:0/616547677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5cc410b140 msgr2=0x7f5cc41a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5cc410b140 0x7f5cc41a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 -- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc41107d0 msgr2=0x7f5cc41a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:33.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc41107d0 0x7f5cc41a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:33.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc8e00700 1 -- 172.21.15.71:0/616547677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc41a6100 con 0x7f5cc410a7f0 2024-05-27T09:46:33.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc3e00700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5cc410b140 0x7f5cc41a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:33.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.949+0000 7f5cc9800700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc41107d0 0x7f5cc41a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:33.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.950+0000 7f5cc8e00700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410a7f0 0x7f5cc41a1230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800e970 tx=0x7f5cb800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:33.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.950+0000 7f5cc1600700 1 -- 172.21.15.71:0/616547677 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8004a30 con 0x7f5cc410a7f0 2024-05-27T09:46:33.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.950+0000 7f5cc1600700 1 -- 172.21.15.71:0/616547677 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb800cc90 con 0x7f5cc410a7f0 2024-05-27T09:46:33.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.950+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc41a63f0 con 0x7f5cc410a7f0 2024-05-27T09:46:33.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.950+0000 7f5cc1600700 1 -- 172.21.15.71:0/616547677 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8005610 con 0x7f5cc410a7f0 2024-05-27T09:46:33.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.950+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc41add10 con 0x7f5cc410a7f0 2024-05-27T09:46:33.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.951+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc40512b0 con 0x7f5cc410a7f0 2024-05-27T09:46:33.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.953+0000 7f5cc1600700 1 -- 172.21.15.71:0/616547677 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5cb800c7e0 con 0x7f5cc410a7f0 2024-05-27T09:46:33.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.955+0000 7f5cc1600700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5cac0b2900 0x7f5cac0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:33.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.955+0000 7f5cc1600700 1 -- 172.21.15.71:0/616547677 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f5cb80e2300 con 0x7f5cc410a7f0 2024-05-27T09:46:33.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.955+0000 7f5cc3e00700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5cac0b2900 0x7f5cac0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:33.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.956+0000 7f5cc3e00700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5cac0b2900 0x7f5cac0b4e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5cc410a730 tx=0x7f5cb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:33.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:33.959+0000 7f5cc1600700 1 -- 172.21.15.71:0/616547677 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5cb80a9fd0 con 0x7f5cc410a7f0 2024-05-27T09:46:34.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:33 smithi122 ceph-mon[36436]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:34.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.239+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cc402e5e0 con 0x7f5cc410a7f0 2024-05-27T09:46:34.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:33 smithi071 ceph-mon[31451]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:34.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.241+0000 7f5cc1600700 1 -- 172.21.15.71:0/616547677 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11854 (secure 0 0 0) 0x7f5cb80a98d0 con 0x7f5cc410a7f0 2024-05-27T09:46:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:46:34.243 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:44:15.200351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:46:34.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5cac0b2900 msgr2=0x7f5cac0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:34.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5cac0b2900 0x7f5cac0b4e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5cc410a730 tx=0x7f5cb0009260 comp rx=0 tx=0).stop 2024-05-27T09:46:34.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410a7f0 msgr2=0x7f5cc41a1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:34.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410a7f0 0x7f5cc41a1230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800e970 tx=0x7f5cb800ec80 comp rx=0 tx=0).stop 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 shutdown_connections 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5cac0b2900 0x7f5cac0b4e10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc41107d0 0x7f5cc41a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc410a7f0 0x7f5cc41a1230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 --2- 172.21.15.71:0/616547677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5cc410b140 0x7f5cc41a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 >> 172.21.15.71:0/616547677 conn(0x7f5cc4076af0 msgr2=0x7f5cc41087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 shutdown_connections 2024-05-27T09:46:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:34.245+0000 7f5cca200700 1 -- 172.21.15.71:0/616547677 wait complete. 2024-05-27T09:46:34.247 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-05-27T09:46:34.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:33 smithi072 ceph-mon[35951]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:35.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-27T09:43:51.731640+0000', 'modified': '2024-05-27T09:44:15.200351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24530, 'mds_1': 24518, 'mds_2': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.72:6837/4192538973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 4192538973}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 4192538973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6837/1257572460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 1257572460}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1257572460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'g', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6839/2510446999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 2510446999}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 2510446999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.122:6839/3712813671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 3712813671}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 3712813671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.71:6841/1086406252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6840', 'nonce': 1086406252}, {'type': 'v1', 'addr': '172.21.15.71:6841', 'nonce': 1086406252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24530': {'gid': 24530, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.72:6839/1043512787', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6838', 'nonce': 1043512787}, {'type': 'v1', 'addr': '172.21.15.72:6839', 'nonce': 1043512787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24530, 'qdb_cluster': [24518, 24530, 24508]} 2024-05-27T09:46:35.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-27T09:46:35.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-05-27T09:46:35.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:34 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/616547677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:35.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:34 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/616547677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:35.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:34 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/616547677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:46:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:36.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:35 smithi122 ceph-mon[36436]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:36.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:35 smithi071 ceph-mon[31451]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:36.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:35 smithi072 ceph-mon[35951]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 -- 172.21.15.71:0/3133773040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d410af40 msgr2=0x7f28d410b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 --2- 172.21.15.71:0/3133773040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d410af40 0x7f28d410b350 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f28c00099c0 tx=0x7f28c0009cd0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 -- 172.21.15.71:0/3133773040 shutdown_connections 2024-05-27T09:46:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 --2- 172.21.15.71:0/3133773040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d410b890 0x7f28d41131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 --2- 172.21.15.71:0/3133773040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28d4106610 0x7f28d4106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 --2- 172.21.15.71:0/3133773040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d410af40 0x7f28d410b350 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 -- 172.21.15.71:0/3133773040 >> 172.21.15.71:0/3133773040 conn(0x7f28d4102020 msgr2=0x7f28d4104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.903+0000 7f28db000700 1 -- 172.21.15.71:0/3133773040 shutdown_connections 2024-05-27T09:46:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.904+0000 7f28db000700 1 -- 172.21.15.71:0/3133773040 wait complete. 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.905+0000 7f28db000700 1 Processor -- start 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.905+0000 7f28db000700 1 -- start start 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28db000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d4106610 0x7f28d419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28db000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d410af40 0x7f28d419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28db000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28d410b890 0x7f28d41a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28db000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28d41164f0 con 0x7f28d410b890 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28db000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f28d4116370 con 0x7f28d410af40 2024-05-27T09:46:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28db000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f28d4116670 con 0x7f28d4106610 2024-05-27T09:46:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28d9c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d4106610 0x7f28d419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28d9c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d4106610 0x7f28d419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54680/0 (socket says 172.21.15.71:54680) 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28d9c00700 1 -- 172.21.15.71:0/2589922641 learned_addr learned my addr 172.21.15.71:0/2589922641 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28da600700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28d410b890 0x7f28d41a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28d9200700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d410af40 0x7f28d419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28d9c00700 1 -- 172.21.15.71:0/2589922641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d410af40 msgr2=0x7f28d419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.906+0000 7f28d9c00700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d410af40 0x7f28d419d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28d9c00700 1 -- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28d410b890 msgr2=0x7f28d41a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28d9c00700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28d410b890 0x7f28d41a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28d9c00700 1 -- 172.21.15.71:0/2589922641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d41a1d30 con 0x7f28d4106610 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28d9c00700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d4106610 0x7f28d419ce60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28c800ef10 tx=0x7f28c800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28d2000700 1 -- 172.21.15.71:0/2589922641 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c800c9c0 con 0x7f28d4106610 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d41a1fc0 con 0x7f28d4106610 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28d2000700 1 -- 172.21.15.71:0/2589922641 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c8019070 con 0x7f28d4106610 2024-05-27T09:46:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28d2000700 1 -- 172.21.15.71:0/2589922641 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8014480 con 0x7f28d4106610 2024-05-27T09:46:37.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.907+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d41a9940 con 0x7f28d4106610 2024-05-27T09:46:37.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.911+0000 7f28d2000700 1 -- 172.21.15.71:0/2589922641 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f28c8012050 con 0x7f28d4106610 2024-05-27T09:46:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.913+0000 7f28eb152b80 1 Processor -- start 2024-05-27T09:46:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.913+0000 7f28eb152b80 1 -- start start 2024-05-27T09:46:37.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.913+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceb1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.913+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fceb1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.913+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcebd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.913+0000 7f28eb152b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5595fcddedf0 con 0x5595fcd31df0 2024-05-27T09:46:37.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.913+0000 7f28eb152b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5595fcdce990 con 0x5595fce1d9a0 2024-05-27T09:46:37.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28eb152b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5595fcdd29d0 con 0x5595fcebb270 2024-05-27T09:46:37.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28d2000700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28bc0b2900 0x7f28bc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28d9c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fceb1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28d9c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fceb1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36128/0 (socket says 172.21.15.71:36128) 2024-05-27T09:46:37.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28d9c00700 1 -- 172.21.15.71:0/1789833854 learned_addr learned my addr 172.21.15.71:0/1789833854 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:37.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28d2000700 1 -- 172.21.15.71:0/2589922641 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f28c80e2110 con 0x7f28d4106610 2024-05-27T09:46:37.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28da600700 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceb1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28d9200700 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcebd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.914+0000 7f28da600700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28bc0b2900 0x7f28bc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28d9c00700 1 -- 172.21.15.71:0/1789833854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 msgr2=0x5595fcebd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28d9c00700 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcebd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28d9c00700 1 -- 172.21.15.71:0/1789833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 msgr2=0x5595fceb1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28d9c00700 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceb1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28d9c00700 1 -- 172.21.15.71:0/1789833854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fcd973d0 con 0x5595fcd31df0 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28da600700 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceb1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28d9c00700 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fceb1c40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28c80dfbc0 tx=0x7f28c8077300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cda66b839b39116 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.915+0000 7f28c6a00700 1 -- 172.21.15.71:0/1789833854 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80a8e50 con 0x5595fcd31df0 2024-05-27T09:46:37.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.916+0000 7f28da600700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28bc0b2900 0x7f28bc0b4e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0097a0 tx=0x7f28cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:37.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.916+0000 7f28c6a00700 1 -- 172.21.15.71:0/1789833854 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c80a91f0 con 0x5595fcd31df0 2024-05-27T09:46:37.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.916+0000 7f28c6a00700 1 -- 172.21.15.71:0/1789833854 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80b2540 con 0x5595fcd31df0 2024-05-27T09:46:37.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 -- 172.21.15.71:0/1789833854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 msgr2=0x5595fceb1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fceb1c40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28c80dfbc0 tx=0x7f28c8077300 comp rx=0 tx=0).stop 2024-05-27T09:46:37.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 -- 172.21.15.71:0/1789833854 shutdown_connections 2024-05-27T09:46:37.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcebd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceb1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 --2- 172.21.15.71:0/1789833854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fceb1c40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 -- 172.21.15.71:0/1789833854 >> 172.21.15.71:0/1789833854 conn(0x5595fcdcb340 msgr2=0x5595fceac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:37.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 -- 172.21.15.71:0/1789833854 shutdown_connections 2024-05-27T09:46:37.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.917+0000 7f28eb152b80 1 -- 172.21.15.71:0/1789833854 wait complete. 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.918+0000 7f28eb152b80 1 -- start start 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.918+0000 7f28eb152b80 1 Processor -- start 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fceb8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceb87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28eb152b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5595fccd4f50 con 0x5595fce1d9a0 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28eb152b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5595fcd6f710 con 0x5595fcd31df0 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28eb152b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5595fcebdcf0 con 0x5595fcebb270 2024-05-27T09:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28eb152b80 10 client.0 _ll_register_callbacks cb 0x5595fcd78c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28da600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28d9c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fceb8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28da600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54688/0 (socket says 172.21.15.71:54688) 2024-05-27T09:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28da600700 1 -- 172.21.15.71:0/2928339841 learned_addr learned my addr 172.21.15.71:0/2928339841 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28d9200700 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceb87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28d9c00700 1 -- 172.21.15.71:0/2928339841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 msgr2=0x5595fceb8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28d9c00700 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28d9c00700 1 -- 172.21.15.71:0/2928339841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 msgr2=0x5595fceb87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28d9c00700 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceb87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.919+0000 7f28d9c00700 1 -- 172.21.15.71:0/2928339841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595fcd1e880 con 0x5595fcd31df0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28d9c00700 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fceb8290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28c801d000 tx=0x7f28c80a3c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c4fad7494cc7885 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28bb400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28bb400700 1 -- 172.21.15.71:0/2928339841 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80a9de0 con 0x5595fcd31df0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c80a91f0 con 0x5595fcd31df0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28bb400700 1 -- 172.21.15.71:0/2928339841 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f28c80a3e00 con 0x5595fcd31df0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28bb400700 1 -- 172.21.15.71:0/2928339841 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f28c80b2540 con 0x5595fcd31df0 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28eb152b80 10 client.24878 fetch_fsmap learned FSMap version 25 2024-05-27T09:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.920+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5595fcd9f010 con 0x5595fcd31df0 2024-05-27T09:46:37.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28bb400700 1 -- 172.21.15.71:0/2928339841 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c80a91f0 con 0x5595fcd31df0 2024-05-27T09:46:37.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28bb400700 1 -- 172.21.15.71:0/2928339841 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f28c80b20b0 con 0x5595fcd31df0 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28eb152b80 10 client.24878 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28eb152b80 10 client.24878 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28eb152b80 20 client.24878 populate_metadata read hostname 'smithi071' 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28eb152b80 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcec9970 0x5595fcecbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28eb152b80 4 client.24878 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.921+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595fcde0d40 con 0x5595fcec9970 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.922+0000 7f28d9200700 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcec9970 0x5595fcecbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.922+0000 7f28d9200700 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcec9970 0x5595fcecbb00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea21d352fcee514a server_cookie=615d00563c0fc6f9 in_seq=0 out_seq=0 2024-05-27T09:46:37.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.922+0000 7f28bb400700 10 client.24878 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:46:37.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.923+0000 7f28bb400700 1 -- 172.21.15.71:0/2928339841 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5595fcde0d40 con 0x5595fcec9970 2024-05-27T09:46:37.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.923+0000 7f28bb400700 10 client.24878 handle_command_reply: tid=0 2024-05-27T09:46:37.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.923+0000 7f28eb152b80 1 client.24878 shutdown 2024-05-27T09:46:37.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 msgr2=0x5595fceb8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fceb8290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28c801d000 tx=0x7f28c80a3c90 comp rx=0 tx=0).stop 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 shutdown_connections 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcec9970 0x5595fcecbb00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fceb8290 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 --2- 172.21.15.71:0/2928339841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceb87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 >> 172.21.15.71:0/2928339841 conn(0x5595fcdcb340 msgr2=0x5595fceac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28bb400700 0 client.24878 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 shutdown_connections 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 1 -- 172.21.15.71:0/2928339841 wait complete. 2024-05-27T09:46:37.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.924+0000 7f28eb152b80 20 client.24878 trim_cache size 0 max 16384 2024-05-27T09:46:37.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 Processor -- start 2024-05-27T09:46:37.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 -- start start 2024-05-27T09:46:37.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fcec6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5595fcec9e40 con 0x5595fcd31df0 2024-05-27T09:46:37.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5595fceca510 con 0x5595fce1d9a0 2024-05-27T09:46:37.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.948+0000 7f28eb152b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5595fcecabe0 con 0x5595fcebb270 2024-05-27T09:46:37.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fcec6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28da600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fcec6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36138/0 (socket says 172.21.15.71:36138) 2024-05-27T09:46:37.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 -- 172.21.15.71:0/70729705 learned_addr learned my addr 172.21.15.71:0/70729705 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:37.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9200700 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 -- 172.21.15.71:0/70729705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 msgr2=0x5595fceb00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 -- 172.21.15.71:0/70729705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 msgr2=0x5595fceac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9c00700 1 -- 172.21.15.71:0/70729705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fceb9080 con 0x5595fcd31df0 2024-05-27T09:46:37.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.949+0000 7f28d9200700 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:46:37.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.950+0000 7f28d9c00700 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fcec6f90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f28c800cfd0 tx=0x7f28c80cc170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3321a29dfdf0936b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.950+0000 7f28c6000700 1 -- 172.21.15.71:0/70729705 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80a91f0 con 0x5595fcd31df0 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.950+0000 7f28c6000700 1 -- 172.21.15.71:0/70729705 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c80cae50 con 0x5595fcd31df0 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.950+0000 7f28c6000700 1 -- 172.21.15.71:0/70729705 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80b20b0 con 0x5595fcd31df0 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 -- 172.21.15.71:0/70729705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 msgr2=0x5595fcec6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fcec6f90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f28c800cfd0 tx=0x7f28c80cc170 comp rx=0 tx=0).stop 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 -- 172.21.15.71:0/70729705 shutdown_connections 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fceb00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fcd31df0 0x5595fcec6f90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 --2- 172.21.15.71:0/70729705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fce1d9a0 0x5595fceac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 -- 172.21.15.71:0/70729705 >> 172.21.15.71:0/70729705 conn(0x5595fcdcb340 msgr2=0x5595fceabfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 -- 172.21.15.71:0/70729705 shutdown_connections 2024-05-27T09:46:37.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 -- 172.21.15.71:0/70729705 wait complete. 2024-05-27T09:46:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.951+0000 7f28eb152b80 1 -- start start 2024-05-27T09:46:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 1 Processor -- start 2024-05-27T09:46:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fced56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcecf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5595fcecb980 con 0x5595fce1d9a0 2024-05-27T09:46:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5595fcecb2b0 con 0x5595fcd31df0 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5595fcecc050 con 0x5595fcebb270 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28eb152b80 10 client.0 _ll_register_callbacks cb 0x5595fcd78c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28d9200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28d9200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36150/0 (socket says 172.21.15.71:36150) 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.952+0000 7f28d9200700 1 -- 172.21.15.71:0/3549202 learned_addr learned my addr 172.21.15.71:0/3549202 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28da600700 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcecf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28d9c00700 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fced56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28d9200700 1 -- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 msgr2=0x5595fcecf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28d9200700 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcecf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28d9200700 1 -- 172.21.15.71:0/3549202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 msgr2=0x5595fced56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28d9200700 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fced56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28d9200700 1 -- 172.21.15.71:0/3549202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595fcecf7d0 con 0x5595fce1d9a0 2024-05-27T09:46:37.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28d9200700 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceceab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009990 tx=0x7f28c00058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd6a246611abcc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.953+0000 7f28bb400700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28bb400700 1 -- 172.21.15.71:0/3549202 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0005630 con 0x5595fce1d9a0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28bb400700 1 -- 172.21.15.71:0/3549202 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f28c00037c0 con 0x5595fce1d9a0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c80cae50 con 0x5595fce1d9a0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28bb400700 1 -- 172.21.15.71:0/3549202 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f28c00039c0 con 0x5595fce1d9a0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28eb152b80 10 client.14772 fetch_fsmap learned FSMap version 25 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5595fcf35e20 con 0x5595fce1d9a0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28bb400700 1 -- 172.21.15.71:0/3549202 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c80cae50 con 0x5595fce1d9a0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28bb400700 1 -- 172.21.15.71:0/3549202 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f28c002d070 con 0x5595fce1d9a0 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28eb152b80 10 client.14772 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.954+0000 7f28eb152b80 10 client.14772 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.955+0000 7f28eb152b80 20 client.14772 populate_metadata read hostname 'smithi071' 2024-05-27T09:46:37.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.955+0000 7f28eb152b80 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcf38270 0x5595fcf396e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:37.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.955+0000 7f28eb152b80 4 client.14772 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:46:37.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.955+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "status"}) -- 0x5595fcdda520 con 0x5595fcf38270 2024-05-27T09:46:37.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.955+0000 7f28d9c00700 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcf38270 0x5595fcf396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.955+0000 7f28bb400700 10 client.14772 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.955+0000 7f28d9c00700 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcf38270 0x5595fcf396e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=79db3b50e8bb5da7 server_cookie=7ce5b7b4276a4009 in_seq=0 out_seq=0 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28bb400700 1 -- 172.21.15.71:0/3549202 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5595fcdda520 con 0x5595fcf38270 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28bb400700 10 client.14772 handle_command_reply: tid=0 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 client.14772 shutdown 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 msgr2=0x5595fceceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceceab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009990 tx=0x7f28c00058e0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 shutdown_connections 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5595fcf38270 0x5595fcf396e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595fcebb270 0x5595fcecf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5595fcd31df0 0x5595fced56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28bb400700 0 client.14772 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 --2- 172.21.15.71:0/3549202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595fce1d9a0 0x5595fceceab0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 >> 172.21.15.71:0/3549202 conn(0x5595fcdcb340 msgr2=0x5595fceb6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 shutdown_connections 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 1 -- 172.21.15.71:0/3549202 wait complete. 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.956+0000 7f28eb152b80 20 client.14772 trim_cache size 0 max 16384 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:46:37.960 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 2, 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24508, 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 149.686458219, 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 25, 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 83, 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 81, 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 201.51373964499999 2024-05-27T09:46:37.961 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28bc0b2900 msgr2=0x7f28bc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28bc0b2900 0x7f28bc0b4e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0097a0 tx=0x7f28cc009260 comp rx=0 tx=0).stop 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d4106610 msgr2=0x7f28d419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d4106610 0x7f28d419ce60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28c800ef10 tx=0x7f28c800c3a0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 shutdown_connections 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28bc0b2900 0x7f28bc0b4e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28d410b890 0x7f28d41a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d4106610 0x7f28d419ce60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 --2- 172.21.15.71:0/2589922641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d410af40 0x7f28d419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:37.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 >> 172.21.15.71:0/2589922641 conn(0x7f28d4102020 msgr2=0x7f28d410a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:37.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 shutdown_connections 2024-05-27T09:46:37.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:37.957+0000 7f28db000700 1 -- 172.21.15.71:0/2589922641 wait complete. 2024-05-27T09:46:38.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:38 smithi072 ceph-mon[35951]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:38.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:38 smithi122 ceph-mon[36436]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:38.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:38 smithi071 ceph-mon[31451]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:38.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.a status 2024-05-27T09:46:39.278 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:40.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:40 smithi071 ceph-mon[31451]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:40.532 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:40 smithi122 ceph-mon[36436]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:40.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:40 smithi072 ceph-mon[35951]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:41.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 -- 172.21.15.71:0/1275289030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 msgr2=0x7fcd00109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 --2- 172.21.15.71:0/1275289030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 0x7fcd00109320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcce80099c0 tx=0x7fcce8009cd0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 -- 172.21.15.71:0/1275289030 shutdown_connections 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 --2- 172.21.15.71:0/1275289030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00109860 0x7fcd001111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 --2- 172.21.15.71:0/1275289030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd001045e0 0x7fcd001049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 --2- 172.21.15.71:0/1275289030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 0x7fcd00109320 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 -- 172.21.15.71:0/1275289030 >> 172.21.15.71:0/1275289030 conn(0x7fcd00100030 msgr2=0x7fcd00102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 -- 172.21.15.71:0/1275289030 shutdown_connections 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.577+0000 7fcd07000700 1 -- 172.21.15.71:0/1275289030 wait complete. 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.578+0000 7fcd07000700 1 Processor -- start 2024-05-27T09:46:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.578+0000 7fcd07000700 1 -- start start 2024-05-27T09:46:41.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fcd07000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd001045e0 0x7fcd00075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fcd07000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 0x7fcd00075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fcd07000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd00109860 0x7fcd00076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fcd07000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd001144c0 con 0x7fcd00108f10 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fcd07000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcd00114340 con 0x7fcd00109860 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fcd07000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd00114640 con 0x7fcd001045e0 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fccf7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 0x7fcd00075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fccf7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 0x7fcd00075ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36160/0 (socket says 172.21.15.71:36160) 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fccf7e00700 1 -- 172.21.15.71:0/1871122828 learned_addr learned my addr 172.21.15.71:0/1871122828 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fccffe00700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd001045e0 0x7fcd00075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.579+0000 7fcd05000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd00109860 0x7fcd00076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccffe00700 1 -- 172.21.15.71:0/1871122828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd00109860 msgr2=0x7fcd00076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccffe00700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd00109860 0x7fcd00076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccffe00700 1 -- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 msgr2=0x7fcd00075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccffe00700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 0x7fcd00075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccffe00700 1 -- 172.21.15.71:0/1871122828 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd001a9210 con 0x7fcd001045e0 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fcd05000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd00109860 0x7fcd00076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccffe00700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd001045e0 0x7fcd00075ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e9f0 tx=0x7fccf000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccfd600700 1 -- 172.21.15.71:0/1871122828 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf000c9c0 con 0x7fcd001045e0 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.580+0000 7fccfd600700 1 -- 172.21.15.71:0/1871122828 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccf000cb60 con 0x7fcd001045e0 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.581+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd001a9500 con 0x7fcd001045e0 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.581+0000 7fccfd600700 1 -- 172.21.15.71:0/1871122828 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0018680 con 0x7fcd001045e0 2024-05-27T09:46:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.581+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd001a9a40 con 0x7fcd001045e0 2024-05-27T09:46:41.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.584+0000 7fccfd600700 1 -- 172.21.15.71:0/1871122828 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fccf0010430 con 0x7fcd001045e0 2024-05-27T09:46:41.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.586+0000 7fccfd600700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fcce40b2880 0x7fcce40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.586+0000 7fcd15c09b80 1 Processor -- start 2024-05-27T09:46:41.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.586+0000 7fccfd600700 1 -- 172.21.15.71:0/1871122828 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fccf00e23b0 con 0x7fcd001045e0 2024-05-27T09:46:41.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.586+0000 7fcd15c09b80 1 -- start start 2024-05-27T09:46:41.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.586+0000 7fccf7e00700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fcce40b2880 0x7fcce40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487eb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e487f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558e48719df0 con 0x558e487589a0 2024-05-27T09:46:41.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558e48709990 con 0x558e487ebe20 2024-05-27T09:46:41.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558e4870d9d0 con 0x558e4866cdf0 2024-05-27T09:46:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fccffe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fccf7e00700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fcce40b2880 0x7fcce40b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcce8003760 tx=0x7fcce801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fccffe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36170/0 (socket says 172.21.15.71:36170) 2024-05-27T09:46:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fccffe00700 1 -- 172.21.15.71:0/3213561347 learned_addr learned my addr 172.21.15.71:0/3213561347 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.587+0000 7fcd05000700 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e487f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.588+0000 7fccf7e00700 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487eb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.588+0000 7fccffe00700 1 -- 172.21.15.71:0/3213561347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 msgr2=0x558e487eb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.588+0000 7fccffe00700 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487eb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.588+0000 7fccffe00700 1 -- 172.21.15.71:0/3213561347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 msgr2=0x558e487f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.588+0000 7fccffe00700 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e487f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.588+0000 7fccffe00700 1 -- 172.21.15.71:0/3213561347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e486d23d0 con 0x558e487589a0 2024-05-27T09:46:41.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.588+0000 7fccffe00700 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb2e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fccf000c5b0 tx=0x7fccf00a9490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1903402264c28cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:41.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.589+0000 7fccf5600700 1 -- 172.21.15.71:0/3213561347 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf00a9980 con 0x558e487589a0 2024-05-27T09:46:41.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.589+0000 7fccf5600700 1 -- 172.21.15.71:0/3213561347 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccf00add30 con 0x558e487589a0 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.589+0000 7fccf5600700 1 -- 172.21.15.71:0/3213561347 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf00cc2e0 con 0x558e487589a0 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3213561347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 msgr2=0x558e487eb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb2e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fccf000c5b0 tx=0x7fccf00a9490 comp rx=0 tx=0).stop 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3213561347 shutdown_connections 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e487f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb2e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3213561347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487eb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3213561347 >> 172.21.15.71:0/3213561347 conn(0x558e48706340 msgr2=0x558e487e7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:41.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3213561347 shutdown_connections 2024-05-27T09:46:41.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.590+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3213561347 wait complete. 2024-05-27T09:46:41.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 -- start start 2024-05-27T09:46:41.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 Processor -- start 2024-05-27T09:46:41.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e487f5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487589a0 0x558e487f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487ebe20 0x558e487f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558e4860ff50 con 0x558e487ebe20 2024-05-27T09:46:41.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558e486aa710 con 0x558e4866cdf0 2024-05-27T09:46:41.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.591+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558e487f8ad0 con 0x558e487589a0 2024-05-27T09:46:41.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fcd15c09b80 10 client.0 _ll_register_callbacks cb 0x558e486b3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:46:41.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e487f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fcd05000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487ebe20 0x558e487f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e487f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:44272/0 (socket says 172.21.15.71:44272) 2024-05-27T09:46:41.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 -- 172.21.15.71:0/4136431696 learned_addr learned my addr 172.21.15.71:0/4136431696 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:41.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccf7e00700 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487589a0 0x558e487f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 -- 172.21.15.71:0/4136431696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487589a0 msgr2=0x558e487f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487589a0 0x558e487f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 -- 172.21.15.71:0/4136431696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487ebe20 msgr2=0x558e487f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487ebe20 0x558e487f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.592+0000 7fccffe00700 1 -- 172.21.15.71:0/4136431696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e48659880 con 0x558e4866cdf0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fccffe00700 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e487f5720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fccf00a5a00 tx=0x7fccf00cc140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e973f640528bb019 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fccee000700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fccee000700 1 -- 172.21.15.71:0/4136431696 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf006e060 con 0x558e4866cdf0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fccee000700 1 -- 172.21.15.71:0/4136431696 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fccf00a8be0 con 0x558e4866cdf0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccf00add30 con 0x558e4866cdf0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fccee000700 1 -- 172.21.15.71:0/4136431696 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fccf00c4070 con 0x558e4866cdf0 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fcd15c09b80 10 client.24896 fetch_fsmap learned FSMap version 25 2024-05-27T09:46:41.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.593+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e486da010 con 0x558e4866cdf0 2024-05-27T09:46:41.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fccee000700 1 -- 172.21.15.71:0/4136431696 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccf0087080 con 0x558e4866cdf0 2024-05-27T09:46:41.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fccee000700 1 -- 172.21.15.71:0/4136431696 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fccf00a52f0 con 0x558e4866cdf0 2024-05-27T09:46:41.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fcd15c09b80 10 client.24896 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:46:41.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fcd15c09b80 10 client.24896 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T09:46:41.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fcd15c09b80 20 client.24896 populate_metadata read hostname 'smithi071' 2024-05-27T09:46:41.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e48805580 0x558e488069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fcd15c09b80 4 client.24896 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e4871bd40 con 0x558e48805580 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.594+0000 7fccf7e00700 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e48805580 0x558e488069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.595+0000 7fccee000700 10 client.24896 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.595+0000 7fccf7e00700 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e48805580 0x558e488069f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b474cb8a6ded7bd4 server_cookie=5a22e07fe6f7c80e in_seq=0 out_seq=0 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.596+0000 7fccee000700 1 -- 172.21.15.71:0/4136431696 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x558e4871bd40 con 0x558e48805580 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.596+0000 7fccee000700 10 client.24896 handle_command_reply: tid=0 2024-05-27T09:46:41.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.596+0000 7fcd15c09b80 1 client.24896 shutdown 2024-05-27T09:46:41.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.596+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 msgr2=0x558e487f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.596+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e487f5720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fccf00a5a00 tx=0x7fccf00cc140 comp rx=0 tx=0).stop 2024-05-27T09:46:41.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 shutdown_connections 2024-05-27T09:46:41.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e48805580 0x558e488069f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487ebe20 0x558e487f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e487f5720 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/4136431696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487589a0 0x558e487f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 >> 172.21.15.71:0/4136431696 conn(0x558e48706340 msgr2=0x558e487eb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:41.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fccee000700 0 client.24896 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:46:41.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 shutdown_connections 2024-05-27T09:46:41.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 1 -- 172.21.15.71:0/4136431696 wait complete. 2024-05-27T09:46:41.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.597+0000 7fcd15c09b80 20 client.24896 trim_cache size 0 max 16384 2024-05-27T09:46:41.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.620+0000 7fcd15c09b80 1 Processor -- start 2024-05-27T09:46:41.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.620+0000 7fcd15c09b80 1 -- start start 2024-05-27T09:46:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e48801d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558e48804d30 con 0x558e487589a0 2024-05-27T09:46:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558e48805400 con 0x558e487ebe20 2024-05-27T09:46:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558e48805ad0 con 0x558e4866cdf0 2024-05-27T09:46:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fccf7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fccffe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fccf7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36178/0 (socket says 172.21.15.71:36178) 2024-05-27T09:46:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fccf7e00700 1 -- 172.21.15.71:0/272755700 learned_addr learned my addr 172.21.15.71:0/272755700 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fcd05000700 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e48801d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fccffe00700 1 -- 172.21.15.71:0/272755700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 msgr2=0x558e48801d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fccffe00700 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e48801d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.621+0000 7fccffe00700 1 -- 172.21.15.71:0/272755700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 msgr2=0x558e487eb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fccffe00700 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fccffe00700 1 -- 172.21.15.71:0/272755700 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e488022b0 con 0x558e4866cdf0 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fcd05000700 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e48801d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fccf7e00700 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fccffe00700 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487f0f40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fccf00a5740 tx=0x7fccf00a9490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350e739fbb5905f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fccf4c00700 1 -- 172.21.15.71:0/272755700 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf00a9980 con 0x558e4866cdf0 2024-05-27T09:46:41.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fccf4c00700 1 -- 172.21.15.71:0/272755700 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccf00add30 con 0x558e4866cdf0 2024-05-27T09:46:41.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.622+0000 7fccf4c00700 1 -- 172.21.15.71:0/272755700 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf00a52f0 con 0x558e4866cdf0 2024-05-27T09:46:41.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 -- 172.21.15.71:0/272755700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 msgr2=0x558e487f0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487f0f40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fccf00a5740 tx=0x7fccf00a9490 comp rx=0 tx=0).stop 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 -- 172.21.15.71:0/272755700 shutdown_connections 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e487ebe20 0x558e48801d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e4866cdf0 0x558e487f0f40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/272755700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e487eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 -- 172.21.15.71:0/272755700 >> 172.21.15.71:0/272755700 conn(0x558e48706340 msgr2=0x558e487eb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 -- 172.21.15.71:0/272755700 shutdown_connections 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.623+0000 7fcd15c09b80 1 -- 172.21.15.71:0/272755700 wait complete. 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.624+0000 7fcd15c09b80 1 -- start start 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.624+0000 7fcd15c09b80 1 Processor -- start 2024-05-27T09:46:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e48810510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e48809850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd15c09b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487ebe20 0x558e48809d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558e48806870 con 0x558e487589a0 2024-05-27T09:46:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558e488061a0 con 0x558e4866cdf0 2024-05-27T09:46:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd15c09b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558e48806f40 con 0x558e487ebe20 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd15c09b80 10 client.0 _ll_register_callbacks cb 0x558e486b3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e48809850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e48809850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36190/0 (socket says 172.21.15.71:36190) 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 -- 172.21.15.71:0/3867629256 learned_addr learned my addr 172.21.15.71:0/3867629256 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccffe00700 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e48810510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fcd05000700 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487ebe20 0x558e48809d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 -- 172.21.15.71:0/3867629256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487ebe20 msgr2=0x558e48809d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487ebe20 0x558e48809d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 -- 172.21.15.71:0/3867629256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 msgr2=0x558e48810510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e48810510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.625+0000 7fccf7e00700 1 -- 172.21.15.71:0/3867629256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e4880a4c0 con 0x558e487589a0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.626+0000 7fccf7e00700 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e48809850 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcce8005710 tx=0x7fcce8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc940e8586585fa server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.626+0000 7fccee000700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.626+0000 7fccee000700 1 -- 172.21.15.71:0/3867629256 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce800b790 con 0x558e487589a0 2024-05-27T09:46:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.626+0000 7fccee000700 1 -- 172.21.15.71:0/3867629256 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fcce800b930 con 0x558e487589a0 2024-05-27T09:46:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.626+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccf00add30 con 0x558e487589a0 2024-05-27T09:46:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fccee000700 1 -- 172.21.15.71:0/3867629256 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcce800bb30 con 0x558e487589a0 2024-05-27T09:46:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 10 client.14790 fetch_fsmap learned FSMap version 25 2024-05-27T09:46:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e48870d10 con 0x558e487589a0 2024-05-27T09:46:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fccee000700 1 -- 172.21.15.71:0/3867629256 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccf00add30 con 0x558e487589a0 2024-05-27T09:46:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fccee000700 1 -- 172.21.15.71:0/3867629256 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fcce800fcc0 con 0x558e487589a0 2024-05-27T09:46:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 10 client.14790 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:46:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 10 client.14790 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 20 client.14790 populate_metadata read hostname 'smithi071' 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e488730e0 0x558e48874550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 4 client.14790 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.627+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "status"}) -- 0x558e48715520 con 0x558e488730e0 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.628+0000 7fccffe00700 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e488730e0 0x558e48874550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.628+0000 7fccffe00700 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e488730e0 0x558e48874550 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae2b739294b6e4b server_cookie=97712623ad3bd94b in_seq=0 out_seq=0 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.628+0000 7fccee000700 10 client.14790 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.628+0000 7fccee000700 1 -- 172.21.15.71:0/3867629256 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558e48715520 con 0x558e488730e0 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.628+0000 7fccee000700 10 client.14790 handle_command_reply: tid=0 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.628+0000 7fcd15c09b80 1 client.14790 shutdown 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 msgr2=0x558e48809850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e48809850 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcce8005710 tx=0x7fcce8005040 comp rx=0 tx=0).stop 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 shutdown_connections 2024-05-27T09:46:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x558e488730e0 0x558e48874550 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e487ebe20 0x558e48809d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558e4866cdf0 0x558e48810510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 --2- 172.21.15.71:0/3867629256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e487589a0 0x558e48809850 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 >> 172.21.15.71:0/3867629256 conn(0x558e48706340 msgr2=0x558e487f3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fccee000700 0 client.14790 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 shutdown_connections 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 1 -- 172.21.15.71:0/3867629256 wait complete. 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.629+0000 7fcd15c09b80 20 client.14790 trim_cache size 0 max 16384 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:46:41.632 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 1, 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24518, 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 154.370175977, 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 25, 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 83, 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 81, 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 196.01173169699999 2024-05-27T09:46:41.633 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fcce40b2880 msgr2=0x7fcce40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fcce40b2880 0x7fcce40b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcce8003760 tx=0x7fcce801a040 comp rx=0 tx=0).stop 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd001045e0 msgr2=0x7fcd00075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd001045e0 0x7fcd00075ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e9f0 tx=0x7fccf000ed00 comp rx=0 tx=0).stop 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 shutdown_connections 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd00109860 0x7fcd00076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd001045e0 0x7fcd00075ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fcce40b2880 0x7fcce40b4d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 --2- 172.21.15.71:0/1871122828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd00108f10 0x7fcd00075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 >> 172.21.15.71:0/1871122828 conn(0x7fcd00100030 msgr2=0x7fcd0010a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:41.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 shutdown_connections 2024-05-27T09:46:41.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:41.630+0000 7fcd07000700 1 -- 172.21.15.71:0/1871122828 wait complete. 2024-05-27T09:46:42.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-05-27T09:46:42.559 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:42 smithi071 ceph-mon[31451]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:42.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:42 smithi122 ceph-mon[36436]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:42.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:42 smithi072 ceph-mon[35951]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:44.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:44 smithi071 ceph-mon[31451]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:44.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:44 smithi122 ceph-mon[36436]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:44.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:44 smithi072 ceph-mon[35951]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 -- 172.21.15.71:0/590310566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8076be0 msgr2=0x7f20c8076ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 --2- 172.21.15.71:0/590310566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8076be0 0x7f20c8076ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009990 tx=0x7f20bc009ca0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 -- 172.21.15.71:0/590310566 shutdown_connections 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 --2- 172.21.15.71:0/590310566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8110bf0 0x7f20c8113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 --2- 172.21.15.71:0/590310566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8076be0 0x7f20c8076ff0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 --2- 172.21.15.71:0/590310566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20c8077530 0x7f20c81106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 -- 172.21.15.71:0/590310566 >> 172.21.15.71:0/590310566 conn(0x7f20c80ffe90 msgr2=0x7f20c81022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 -- 172.21.15.71:0/590310566 shutdown_connections 2024-05-27T09:46:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.197+0000 7f20d0200700 1 -- 172.21.15.71:0/590310566 wait complete. 2024-05-27T09:46:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.198+0000 7f20d0200700 1 Processor -- start 2024-05-27T09:46:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.198+0000 7f20d0200700 1 -- start start 2024-05-27T09:46:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20d0200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8076be0 0x7f20c819d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20d0200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20c8077530 0x7f20c819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20d0200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8110bf0 0x7f20c81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20d0200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81166c0 con 0x7f20c8110bf0 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20d0200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8116540 con 0x7f20c8076be0 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20d0200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8116840 con 0x7f20c8077530 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8076be0 0x7f20c819d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20ce200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8110bf0 0x7f20c81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cce00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20c8077530 0x7f20c819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8076be0 0x7f20c819d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52346/0 (socket says 172.21.15.71:52346) 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 -- 172.21.15.71:0/2471209212 learned_addr learned my addr 172.21.15.71:0/2471209212 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 -- 172.21.15.71:0/2471209212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20c8077530 msgr2=0x7f20c819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20c8077530 0x7f20c819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 -- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8110bf0 msgr2=0x7f20c81a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8110bf0 0x7f20c81a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.199+0000 7f20cd800700 1 -- 172.21.15.71:0/2471209212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c81a1f60 con 0x7f20c8076be0 2024-05-27T09:46:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.200+0000 7f20cd800700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8076be0 0x7f20c819d090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005910 tx=0x7f20bc00b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.200+0000 7f20c6000700 1 -- 172.21.15.71:0/2471209212 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc027070 con 0x7f20c8076be0 2024-05-27T09:46:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.200+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c81a21f0 con 0x7f20c8076be0 2024-05-27T09:46:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.200+0000 7f20c6000700 1 -- 172.21.15.71:0/2471209212 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc022470 con 0x7f20c8076be0 2024-05-27T09:46:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.200+0000 7f20c6000700 1 -- 172.21.15.71:0/2471209212 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc017650 con 0x7f20c8076be0 2024-05-27T09:46:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.200+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c81a9b70 con 0x7f20c8076be0 2024-05-27T09:46:45.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.204+0000 7f20c6000700 1 -- 172.21.15.71:0/2471209212 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f20bc02a070 con 0x7f20c8076be0 2024-05-27T09:46:45.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.205+0000 7f20decc2b80 1 Processor -- start 2024-05-27T09:46:45.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.205+0000 7f20decc2b80 1 -- start start 2024-05-27T09:46:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84c789a0 0x558c84d0b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20c6000700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20b00b2900 0x7f20b00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d0b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d180c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20decc2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558c84c39df0 con 0x558c84c789a0 2024-05-27T09:46:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20decc2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558c84c29990 con 0x558c84b8cdf0 2024-05-27T09:46:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20decc2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c84c2d9d0 con 0x558c84d0be20 2024-05-27T09:46:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20cce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d0b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20cce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d0b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52356/0 (socket says 172.21.15.71:52356) 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20cce00700 1 -- 172.21.15.71:0/2127908747 learned_addr learned my addr 172.21.15.71:0/2127908747 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20c6000700 1 -- 172.21.15.71:0/2471209212 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f20bc0e2ea0 con 0x7f20c8076be0 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20ce200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20b00b2900 0x7f20b00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20ce200700 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d180c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.206+0000 7f20cd800700 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84c789a0 0x558c84d0b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20cce00700 1 -- 172.21.15.71:0/2127908747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 msgr2=0x558c84d180c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20cce00700 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d180c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20cce00700 1 -- 172.21.15.71:0/2127908747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84c789a0 msgr2=0x558c84d0b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20cce00700 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84c789a0 0x558c84d0b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20cce00700 1 -- 172.21.15.71:0/2127908747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c84bf23d0 con 0x558c84b8cdf0 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20cce00700 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d0b820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009cf0 tx=0x7f20b4011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e003b55ea86316 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20ce200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20b00b2900 0x7f20b00b4e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009ec0 tx=0x7f20c0009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.207+0000 7f20baa00700 1 -- 172.21.15.71:0/2127908747 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4011e30 con 0x558c84b8cdf0 2024-05-27T09:46:45.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.208+0000 7f20baa00700 1 -- 172.21.15.71:0/2127908747 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b4004500 con 0x558c84b8cdf0 2024-05-27T09:46:45.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.208+0000 7f20baa00700 1 -- 172.21.15.71:0/2127908747 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b40053a0 con 0x558c84b8cdf0 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.208+0000 7f20decc2b80 1 -- 172.21.15.71:0/2127908747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 msgr2=0x558c84d0b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.208+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d0b820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009cf0 tx=0x7f20b4011440 comp rx=0 tx=0).stop 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 -- 172.21.15.71:0/2127908747 shutdown_connections 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d180c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84c789a0 0x558c84d0b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2127908747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d0b820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 -- 172.21.15.71:0/2127908747 >> 172.21.15.71:0/2127908747 conn(0x558c84c26340 msgr2=0x558c84d07470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 -- 172.21.15.71:0/2127908747 shutdown_connections 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 -- 172.21.15.71:0/2127908747 wait complete. 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.209+0000 7f20decc2b80 1 -- start start 2024-05-27T09:46:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.210+0000 7f20decc2b80 1 Processor -- start 2024-05-27T09:46:45.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.210+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d15590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.210+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d15ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.210+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d16010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.210+0000 7f20decc2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558c84b2ff50 con 0x558c84d0be20 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.210+0000 7f20decc2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558c84bca710 con 0x558c84b8cdf0 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.210+0000 7f20decc2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c84d18b30 con 0x558c84c789a0 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20decc2b80 10 client.0 _ll_register_callbacks cb 0x558c84bd3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d15590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d15590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52368/0 (socket says 172.21.15.71:52368) 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 -- 172.21.15.71:0/3913813062 learned_addr learned my addr 172.21.15.71:0/3913813062 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cce00700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d15ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20ce200700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d16010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 -- 172.21.15.71:0/3913813062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 msgr2=0x558c84d15ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d15ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 -- 172.21.15.71:0/3913813062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 msgr2=0x558c84d16010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d16010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cd800700 1 -- 172.21.15.71:0/3913813062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c84b79880 con 0x558c84b8cdf0 2024-05-27T09:46:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.211+0000 7f20cce00700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d15ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:46:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20cd800700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d15590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0e0950 tx=0x7f20bc0a9d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92602a718586baff server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20af400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20af400700 1 -- 172.21.15.71:0/3913813062 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0920f0 con 0x558c84b8cdf0 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20af400700 1 -- 172.21.15.71:0/3913813062 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f20bc0a6af0 con 0x558c84b8cdf0 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20b4004500 con 0x558c84b8cdf0 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20af400700 1 -- 172.21.15.71:0/3913813062 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20bc0aac00 con 0x558c84b8cdf0 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20decc2b80 10 client.24914 fetch_fsmap learned FSMap version 25 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.212+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c84bfa010 con 0x558c84b8cdf0 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.213+0000 7f20af400700 1 -- 172.21.15.71:0/3913813062 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b4004500 con 0x558c84b8cdf0 2024-05-27T09:46:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20af400700 1 -- 172.21.15.71:0/3913813062 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f20bc0acce0 con 0x558c84b8cdf0 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20decc2b80 10 client.24914 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20decc2b80 10 client.24914 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20decc2b80 20 client.24914 populate_metadata read hostname 'smithi071' 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d25a40 0x558c84d26eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20decc2b80 4 client.24914 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c84c3bd40 con 0x558c84d25a40 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.214+0000 7f20cce00700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d25a40 0x558c84d26eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.215+0000 7f20af400700 10 client.24914 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:46:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.215+0000 7f20cce00700 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d25a40 0x558c84d26eb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5886e6949f3f6b server_cookie=8fccf0697045da0b in_seq=0 out_seq=0 2024-05-27T09:46:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.216+0000 7f20af400700 1 -- 172.21.15.71:0/3913813062 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x558c84c3bd40 con 0x558c84d25a40 2024-05-27T09:46:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.216+0000 7f20af400700 10 client.24914 handle_command_reply: tid=0 2024-05-27T09:46:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.216+0000 7f20decc2b80 1 client.24914 shutdown 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.216+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 msgr2=0x558c84d15590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.216+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d15590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0e0950 tx=0x7f20bc0a9d60 comp rx=0 tx=0).stop 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 shutdown_connections 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d25a40 0x558c84d26eb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d16010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d15590 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3913813062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d15ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20af400700 0 client.24914 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:46:45.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 >> 172.21.15.71:0/3913813062 conn(0x558c84c26340 msgr2=0x558c84d0b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:45.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 shutdown_connections 2024-05-27T09:46:45.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 1 -- 172.21.15.71:0/3913813062 wait complete. 2024-05-27T09:46:45.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.217+0000 7f20decc2b80 20 client.24914 trim_cache size 0 max 16384 2024-05-27T09:46:45.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 Processor -- start 2024-05-27T09:46:45.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 -- start start 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d21e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d0b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d30310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558c84d251f0 con 0x558c84d0be20 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558c84d258c0 con 0x558c84b8cdf0 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.240+0000 7f20decc2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c84d25f90 con 0x558c84c789a0 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d21e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d21e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52372/0 (socket says 172.21.15.71:52372) 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 -- 172.21.15.71:0/3508890359 learned_addr learned my addr 172.21.15.71:0/3508890359 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20ce200700 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d30310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cce00700 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d0b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 -- 172.21.15.71:0/3508890359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 msgr2=0x558c84d0b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d0b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 -- 172.21.15.71:0/3508890359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 msgr2=0x558c84d30310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d30310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 -- 172.21.15.71:0/3508890359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c84d16380 con 0x558c84b8cdf0 2024-05-27T09:46:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.241+0000 7f20cd800700 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d21e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0a6aa0 tx=0x7f20bc0a9c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8efc51047298539 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.242+0000 7f20ba000700 1 -- 172.21.15.71:0/3508890359 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0aa500 con 0x558c84b8cdf0 2024-05-27T09:46:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.242+0000 7f20ba000700 1 -- 172.21.15.71:0/3508890359 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc0ae8b0 con 0x558c84b8cdf0 2024-05-27T09:46:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.242+0000 7f20ba000700 1 -- 172.21.15.71:0/3508890359 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0aa8c0 con 0x558c84b8cdf0 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 -- 172.21.15.71:0/3508890359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 msgr2=0x558c84d21e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d21e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0a6aa0 tx=0x7f20bc0a9c70 comp rx=0 tx=0).stop 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 -- 172.21.15.71:0/3508890359 shutdown_connections 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84d0be20 0x558c84d30310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84b8cdf0 0x558c84d21e00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 --2- 172.21.15.71:0/3508890359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84c789a0 0x558c84d0b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 -- 172.21.15.71:0/3508890359 >> 172.21.15.71:0/3508890359 conn(0x558c84c26340 msgr2=0x558c84d0b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 -- 172.21.15.71:0/3508890359 shutdown_connections 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 -- 172.21.15.71:0/3508890359 wait complete. 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.243+0000 7f20decc2b80 1 -- start start 2024-05-27T09:46:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 1 Processor -- start 2024-05-27T09:46:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84b8cdf0 0x558c84d304e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84c789a0 0x558c84d30a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d2a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558c84d26d30 con 0x558c84b8cdf0 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558c84d26660 con 0x558c84c789a0 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c84d27400 con 0x558c84d0be20 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20decc2b80 10 client.0 _ll_register_callbacks cb 0x558c84bd3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.244+0000 7f20cd800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84b8cdf0 0x558c84d304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84b8cdf0 0x558c84d304e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34722/0 (socket says 172.21.15.71:34722) 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 -- 172.21.15.71:0/2131216121 learned_addr learned my addr 172.21.15.71:0/2131216121 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20ce200700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d2a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cce00700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84c789a0 0x558c84d30a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 -- 172.21.15.71:0/2131216121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 msgr2=0x558c84d2a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d2a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 -- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84c789a0 msgr2=0x558c84d30a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84c789a0 0x558c84d30a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 -- 172.21.15.71:0/2131216121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c84d2b000 con 0x558c84b8cdf0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cce00700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84c789a0 0x558c84d30a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20cd800700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84b8cdf0 0x558c84d304e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f20bc000c00 tx=0x7f20bc0e09d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa3102cd66d8c5d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.245+0000 7f20af400700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20af400700 1 -- 172.21.15.71:0/2131216121 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0b32d0 con 0x558c84b8cdf0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20af400700 1 -- 172.21.15.71:0/2131216121 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f20bc0a6af0 con 0x558c84b8cdf0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20bc0ae8b0 con 0x558c84b8cdf0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20af400700 1 -- 172.21.15.71:0/2131216121 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20bc0aa500 con 0x558c84b8cdf0 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20decc2b80 10 client.14808 fetch_fsmap learned FSMap version 25 2024-05-27T09:46:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c84d2b000 con 0x558c84b8cdf0 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20af400700 1 -- 172.21.15.71:0/2131216121 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc0ae8b0 con 0x558c84b8cdf0 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20af400700 1 -- 172.21.15.71:0/2131216121 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f20bc0a5f50 con 0x558c84b8cdf0 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20decc2b80 10 client.14808 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20decc2b80 10 client.14808 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.246+0000 7f20decc2b80 20 client.14808 populate_metadata read hostname 'smithi071' 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.247+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d93a80 0x558c84d94ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.247+0000 7f20decc2b80 4 client.14808 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:46:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.247+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "status"}) -- 0x558c84c35520 con 0x558c84d93a80 2024-05-27T09:46:45.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.247+0000 7f20cce00700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d93a80 0x558c84d94ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:45.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.247+0000 7f20cce00700 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d93a80 0x558c84d94ef0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3e93fb0dd3eeaf server_cookie=c0d415e044834908 in_seq=0 out_seq=0 2024-05-27T09:46:45.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.247+0000 7f20af400700 10 client.14808 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20af400700 1 -- 172.21.15.71:0/2131216121 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558c84c35520 con 0x558c84d93a80 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20af400700 10 client.14808 handle_command_reply: tid=0 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 client.14808 shutdown 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84b8cdf0 msgr2=0x558c84d304e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84b8cdf0 0x558c84d304e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f20bc000c00 tx=0x7f20bc0e09d0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 shutdown_connections 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558c84d93a80 0x558c84d94ef0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c84d0be20 0x558c84d2a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c84b8cdf0 0x558c84d304e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 --2- 172.21.15.71:0/2131216121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558c84c789a0 0x558c84d30a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20af400700 0 client.14808 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 >> 172.21.15.71:0/2131216121 conn(0x558c84c26340 msgr2=0x558c84d15370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 shutdown_connections 2024-05-27T09:46:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.248+0000 7f20decc2b80 1 -- 172.21.15.71:0/2131216121 wait complete. 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.249+0000 7f20decc2b80 20 client.14808 trim_cache size 0 max 16384 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24530, 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 173.416486386, 2024-05-27T09:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 25, 2024-05-27T09:46:45.254 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 83, 2024-05-27T09:46:45.254 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 81, 2024-05-27T09:46:45.254 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 197.01748687700001 2024-05-27T09:46:45.254 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:46:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.249+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20b00b2900 msgr2=0x7f20b00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.249+0000 7f20d0200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20b00b2900 0x7f20b00b4e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009ec0 tx=0x7f20c0009920 comp rx=0 tx=0).stop 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.249+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8076be0 msgr2=0x7f20c819d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.249+0000 7f20d0200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8076be0 0x7f20c819d090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005910 tx=0x7f20bc00b670 comp rx=0 tx=0).stop 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 shutdown_connections 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f20b00b2900 0x7f20b00b4e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c8110bf0 0x7f20c81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c8076be0 0x7f20c819d090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 --2- 172.21.15.71:0/2471209212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20c8077530 0x7f20c819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 >> 172.21.15.71:0/2471209212 conn(0x7f20c80ffe90 msgr2=0x7f20c8100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 shutdown_connections 2024-05-27T09:46:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:45.250+0000 7f20d0200700 1 -- 172.21.15.71:0/2471209212 wait complete. 2024-05-27T09:46:46.048 INFO:tasks.cephadm:Setup complete, yielding 2024-05-27T09:46:46.048 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-27T09:46:46.058 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:46:46.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-05-27T09:46:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:46 smithi071 ceph-mon[31451]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:46.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:46 smithi122 ceph-mon[36436]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:46.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:46 smithi072 ceph-mon[35951]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:48.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:48 smithi071 ceph-mon[31451]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:46:48.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:48 smithi122 ceph-mon[36436]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:46:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:48 smithi072 ceph-mon[35951]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:46:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 -- 172.21.15.71:0/2127755198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 msgr2=0x7fa54410bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 --2- 172.21.15.71:0/2127755198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa54410bcc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa5300098f0 tx=0x7fa530009c00 comp rx=0 tx=0).stop 2024-05-27T09:46:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 -- 172.21.15.71:0/2127755198 shutdown_connections 2024-05-27T09:46:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 --2- 172.21.15.71:0/2127755198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa54410c250 0x7fa544112b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 --2- 172.21.15.71:0/2127755198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa54410a780 0x7fa54410ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 --2- 172.21.15.71:0/2127755198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa54410bcc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 -- 172.21.15.71:0/2127755198 >> 172.21.15.71:0/2127755198 conn(0x7fa544079830 msgr2=0x7fa5441085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 -- 172.21.15.71:0/2127755198 shutdown_connections 2024-05-27T09:46:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.813+0000 7fa543200700 1 -- 172.21.15.71:0/2127755198 wait complete. 2024-05-27T09:46:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.815+0000 7fa543200700 1 Processor -- start 2024-05-27T09:46:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.815+0000 7fa543200700 1 -- start start 2024-05-27T09:46:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa543200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa54410a780 0x7fa5441a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa543200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa5441a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa543200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa54410c250 0x7fa5441a8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa543200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa544116240 con 0x7fa54410c250 2024-05-27T09:46:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa543200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa5441160c0 con 0x7fa54410b8b0 2024-05-27T09:46:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa543200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5441163c0 con 0x7fa54410a780 2024-05-27T09:46:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa541400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa5441a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa541e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa54410a780 0x7fa5441a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa541400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa5441a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52406/0 (socket says 172.21.15.71:52406) 2024-05-27T09:46:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa541400700 1 -- 172.21.15.71:0/3442130432 learned_addr learned my addr 172.21.15.71:0/3442130432 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.816+0000 7fa542800700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa54410c250 0x7fa5441a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa541400700 1 -- 172.21.15.71:0/3442130432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa54410a780 msgr2=0x7fa5441a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa541400700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa54410a780 0x7fa5441a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa541400700 1 -- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa54410c250 msgr2=0x7fa5441a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa541400700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa54410c250 0x7fa5441a8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa541400700 1 -- 172.21.15.71:0/3442130432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5441a88e0 con 0x7fa54410b8b0 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa542800700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa54410c250 0x7fa5441a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa541400700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa5441a12c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa530011040 tx=0x7fa530005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa53aa00700 1 -- 172.21.15.71:0/3442130432 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530027070 con 0x7fa54410b8b0 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5441a8b70 con 0x7fa54410b8b0 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.817+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5441a9020 con 0x7fa54410b8b0 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.818+0000 7fa53aa00700 1 -- 172.21.15.71:0/3442130432 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa53000ba10 con 0x7fa54410b8b0 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.818+0000 7fa53aa00700 1 -- 172.21.15.71:0/3442130432 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530004930 con 0x7fa54410b8b0 2024-05-27T09:46:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.818+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5440512b0 con 0x7fa54410b8b0 2024-05-27T09:46:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.821+0000 7fa53aa00700 1 -- 172.21.15.71:0/3442130432 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa53002a070 con 0x7fa54410b8b0 2024-05-27T09:46:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.823+0000 7fa53aa00700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa5280b2900 0x7fa5280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.823+0000 7fa53aa00700 1 -- 172.21.15.71:0/3442130432 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fa5300e2fe0 con 0x7fa54410b8b0 2024-05-27T09:46:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.823+0000 7fa541e00700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa5280b2900 0x7fa5280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.824+0000 7fa541e00700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa5280b2900 0x7fa5280b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa534009750 tx=0x7fa534009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:48.825+0000 7fa53aa00700 1 -- 172.21.15.71:0/3442130432 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa530031080 con 0x7fa54410b8b0 2024-05-27T09:46:49.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.075+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa544063bf0 con 0x7fa5280b2900 2024-05-27T09:46:49.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.077+0000 7fa53aa00700 1 -- 172.21.15.71:0/3442130432 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa544063bf0 con 0x7fa5280b2900 2024-05-27T09:46:49.078 INFO:teuthology.orchestra.run.smithi071.stdout:Backend: cephadm 2024-05-27T09:46:49.079 INFO:teuthology.orchestra.run.smithi071.stdout:Available: Yes 2024-05-27T09:46:49.079 INFO:teuthology.orchestra.run.smithi071.stdout:Paused: No 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa5280b2900 msgr2=0x7fa5280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa5280b2900 0x7fa5280b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa534009750 tx=0x7fa534009310 comp rx=0 tx=0).stop 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 msgr2=0x7fa5441a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa5441a12c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa530011040 tx=0x7fa530005270 comp rx=0 tx=0).stop 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 shutdown_connections 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fa5280b2900 0x7fa5280b4e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa54410c250 0x7fa5441a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa54410a780 0x7fa5441a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 --2- 172.21.15.71:0/3442130432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa54410b8b0 0x7fa5441a12c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.080+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 >> 172.21.15.71:0/3442130432 conn(0x7fa544079830 msgr2=0x7fa54410eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.081+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 shutdown_connections 2024-05-27T09:46:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:49.081+0000 7fa543200700 1 -- 172.21.15.71:0/3442130432 wait complete. 2024-05-27T09:46:49.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-27T09:46:50.394 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:50.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:50 smithi071 ceph-mon[31451]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:50.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:50 smithi071 ceph-mon[31451]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:50 smithi122 ceph-mon[36436]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:50.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:50 smithi122 ceph-mon[36436]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:50.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:50 smithi072 ceph-mon[35951]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:50.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:50 smithi072 ceph-mon[35951]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:52.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.546+0000 7f5e17200700 1 -- 172.21.15.71:0/3089065547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10107e50 msgr2=0x7f5e1010e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:52.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.546+0000 7f5e17200700 1 --2- 172.21.15.71:0/3089065547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10107e50 0x7f5e1010e700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00b0a0 tx=0x7f5e0c00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.547+0000 7f5e17200700 1 -- 172.21.15.71:0/3089065547 shutdown_connections 2024-05-27T09:46:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.547+0000 7f5e17200700 1 --2- 172.21.15.71:0/3089065547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10107e50 0x7f5e1010e700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.547+0000 7f5e17200700 1 --2- 172.21.15.71:0/3089065547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10106380 0x7f5e10106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.547+0000 7f5e17200700 1 --2- 172.21.15.71:0/3089065547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 0x7f5e101078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.547+0000 7f5e17200700 1 -- 172.21.15.71:0/3089065547 >> 172.21.15.71:0/3089065547 conn(0x7f5e10101a00 msgr2=0x7f5e10103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.547+0000 7f5e17200700 1 -- 172.21.15.71:0/3089065547 shutdown_connections 2024-05-27T09:46:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.547+0000 7f5e17200700 1 -- 172.21.15.71:0/3089065547 wait complete. 2024-05-27T09:46:52.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 Processor -- start 2024-05-27T09:46:52.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 -- start start 2024-05-27T09:46:52.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10106380 0x7f5e1019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 0x7f5e1019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10107e50 0x7f5e101a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e10111de0 con 0x7f5e101074b0 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e10111c60 con 0x7f5e10107e50 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.548+0000 7f5e17200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5e10111f60 con 0x7f5e10106380 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 0x7f5e1019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 0x7f5e1019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34762/0 (socket says 172.21.15.71:34762) 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10106380 0x7f5e1019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15400700 1 -- 172.21.15.71:0/3411131167 learned_addr learned my addr 172.21.15.71:0/3411131167 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e16800700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10107e50 0x7f5e101a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15e00700 1 -- 172.21.15.71:0/3411131167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10107e50 msgr2=0x7f5e101a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15e00700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10107e50 0x7f5e101a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15e00700 1 -- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 msgr2=0x7f5e1019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15e00700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 0x7f5e1019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15e00700 1 -- 172.21.15.71:0/3411131167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e101a43d0 con 0x7f5e10106380 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.549+0000 7f5e15400700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 0x7f5e1019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.550+0000 7f5e15e00700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10106380 0x7f5e1019c870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e10106080 tx=0x7f5e0400da20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.550+0000 7f5e0aa00700 1 -- 172.21.15.71:0/3411131167 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04016070 con 0x7f5e10106380 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.550+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e101a46c0 con 0x7f5e10106380 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.550+0000 7f5e0aa00700 1 -- 172.21.15.71:0/3411131167 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e0400f690 con 0x7f5e10106380 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.550+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e101a4c50 con 0x7f5e10106380 2024-05-27T09:46:52.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.550+0000 7f5e0aa00700 1 -- 172.21.15.71:0/3411131167 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0401f060 con 0x7f5e10106380 2024-05-27T09:46:52.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.551+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e100512b0 con 0x7f5e10106380 2024-05-27T09:46:52.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.554+0000 7f5e0aa00700 1 -- 172.21.15.71:0/3411131167 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5e0400fb20 con 0x7f5e10106380 2024-05-27T09:46:52.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.555+0000 7f5e0aa00700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5df80b2880 0x7f5df80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:52.556 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:52 smithi071 ceph-mon[31451]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:52.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.555+0000 7f5e0aa00700 1 -- 172.21.15.71:0/3411131167 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f5e040e2070 con 0x7f5e10106380 2024-05-27T09:46:52.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.555+0000 7f5e15400700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5df80b2880 0x7f5df80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:52.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.556+0000 7f5e15400700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5df80b2880 0x7f5df80b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5e1019d920 tx=0x7f5e00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:52.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.558+0000 7f5e0aa00700 1 -- 172.21.15.71:0/3411131167 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5e040a9d40 con 0x7f5e10106380 2024-05-27T09:46:52.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:52 smithi122 ceph-mon[36436]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:52.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:52 smithi072 ceph-mon[35951]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:46:52.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.801+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5e10063bf0 con 0x7f5df80b2880 2024-05-27T09:46:52.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.846+0000 7f5e0aa00700 1 -- 172.21.15.71:0/3411131167 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f5e10063bf0 con 0x7f5df80b2880 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.a smithi071 running (3m) 44s ago 3m 85.8M - 19.0.0-3868-ga6507388 850a06a84d28 86704f9fb198 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.b smithi072 running (3m) 67s ago 3m 94.1M - 19.0.0-3868-ga6507388 850a06a84d28 5f8559384c0f 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.c smithi122 running (3m) 67s ago 3m 88.6M - 19.0.0-3868-ga6507388 850a06a84d28 c917bd552869 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.d smithi071 running (3m) 44s ago 3m 80.7M - 19.0.0-3868-ga6507388 850a06a84d28 339a9ca34e3e 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.e smithi072 running (3m) 67s ago 3m 81.1M - 19.0.0-3868-ga6507388 850a06a84d28 aa23f9e7c292 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.f smithi122 running (3m) 67s ago 3m 82.4M - 19.0.0-3868-ga6507388 850a06a84d28 2744fe3a12dc 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.g smithi071 running (3m) 44s ago 3m 86.9M - 19.0.0-3868-ga6507388 850a06a84d28 5ea437c5523b 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.h smithi072 running (3m) 67s ago 3m 86.4M - 19.0.0-3868-ga6507388 850a06a84d28 d818b28baf42 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.i smithi122 running (3m) 67s ago 3m 85.5M - 19.0.0-3868-ga6507388 850a06a84d28 c0408e3305e7 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.j smithi071 running (3m) 44s ago 3m 80.7M - 19.0.0-3868-ga6507388 850a06a84d28 3f3b81a867fc 2024-05-27T09:46:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:mds.k smithi072 running (4m) 67s ago 3m 84.4M - 19.0.0-3868-ga6507388 850a06a84d28 1087580b2c1e 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:mds.l smithi122 running (4m) 67s ago 4m 81.9M - 19.0.0-3868-ga6507388 850a06a84d28 8e37ca59b9a5 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi071 *:9283,8765 running (12m) 44s ago 12m 597M - 19.0.0-3868-ga6507388 850a06a84d28 aed1cd15b2fe 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi072 *:8443,8765 running (10m) 67s ago 10m 537M - 19.0.0-3868-ga6507388 850a06a84d28 2bd69f4d1afb 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.z smithi122 *:8443,8765 running (10m) 67s ago 10m 535M - 19.0.0-3868-ga6507388 850a06a84d28 c4ba584c3e78 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (12m) 44s ago 12m 117M 2048M 19.0.0-3868-ga6507388 850a06a84d28 dc62176e2d21 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi072 running (10m) 67s ago 10m 110M 2048M 19.0.0-3868-ga6507388 850a06a84d28 21c841bd7e4c 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi122 running (10m) 67s ago 10m 109M 2048M 19.0.0-3868-ga6507388 850a06a84d28 385673cfaac7 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (9m) 44s ago 9m 123M 4272M 19.0.0-3868-ga6507388 850a06a84d28 43926b252591 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi072 running (9m) 67s ago 9m 124M 4272M 19.0.0-3868-ga6507388 850a06a84d28 437c7fa56287 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi122 running (8m) 67s ago 8m 119M 4272M 19.0.0-3868-ga6507388 850a06a84d28 cd8772c910f3 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (8m) 44s ago 8m 114M 4272M 19.0.0-3868-ga6507388 850a06a84d28 f54e43aed960 2024-05-27T09:46:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi072 running (7m) 67s ago 7m 113M 4272M 19.0.0-3868-ga6507388 850a06a84d28 6e5fa9280e35 2024-05-27T09:46:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi122 running (7m) 67s ago 7m 121M 4272M 19.0.0-3868-ga6507388 850a06a84d28 0d63438dbb69 2024-05-27T09:46:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi071 running (6m) 44s ago 6m 112M 4272M 19.0.0-3868-ga6507388 850a06a84d28 bf5fe6fff2b9 2024-05-27T09:46:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi072 running (6m) 67s ago 6m 121M 4272M 19.0.0-3868-ga6507388 850a06a84d28 cf98d28a2496 2024-05-27T09:46:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8 smithi122 running (5m) 67s ago 5m 122M 4272M 19.0.0-3868-ga6507388 850a06a84d28 8ac46ca9fd6a 2024-05-27T09:46:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9 smithi071 running (5m) 44s ago 5m 113M 4272M 19.0.0-3868-ga6507388 850a06a84d28 d031ed1569f3 2024-05-27T09:46:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10 smithi072 running (4m) 67s ago 4m 123M 4272M 19.0.0-3868-ga6507388 850a06a84d28 7204fe5928f8 2024-05-27T09:46:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11 smithi122 running (4m) 67s ago 4m 121M 4272M 19.0.0-3868-ga6507388 850a06a84d28 81926f23bb90 2024-05-27T09:46:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5df80b2880 msgr2=0x7f5df80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5df80b2880 0x7f5df80b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5e1019d920 tx=0x7f5e00009260 comp rx=0 tx=0).stop 2024-05-27T09:46:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10106380 msgr2=0x7f5e1019c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10106380 0x7f5e1019c870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e10106080 tx=0x7f5e0400da20 comp rx=0 tx=0).stop 2024-05-27T09:46:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 shutdown_connections 2024-05-27T09:46:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10107e50 0x7f5e101a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e10106380 0x7f5e1019c870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f5df80b2880 0x7f5df80b4d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 --2- 172.21.15.71:0/3411131167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e101074b0 0x7f5e1019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.850+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 >> 172.21.15.71:0/3411131167 conn(0x7f5e10101a00 msgr2=0x7f5e1010a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.851+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 shutdown_connections 2024-05-27T09:46:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:52.851+0000 7f5e17200700 1 -- 172.21.15.71:0/3411131167 wait complete. 2024-05-27T09:46:53.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:53 smithi122 ceph-mon[36436]: from='client.24937 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:53.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:53 smithi071 ceph-mon[31451]: from='client.24937 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:53.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:53 smithi072 ceph-mon[35951]: from='client.24937 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:53.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-27T09:46:54.309 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:54.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:54 smithi071 ceph-mon[31451]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:54.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:54 smithi122 ceph-mon[36436]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:54 smithi072 ceph-mon[35951]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:46:56.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 -- 172.21.15.71:0/2967163730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079270 msgr2=0x7f28f4079680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 --2- 172.21.15.71:0/2967163730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079270 0x7f28f4079680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009990 tx=0x7f28e0009ca0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 -- 172.21.15.71:0/2967163730 shutdown_connections 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 --2- 172.21.15.71:0/2967163730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28f4079bc0 0x7f28f407a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 --2- 172.21.15.71:0/2967163730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f40780f0 0x7f28f4078500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 --2- 172.21.15.71:0/2967163730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079270 0x7f28f4079680 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 -- 172.21.15.71:0/2967163730 >> 172.21.15.71:0/2967163730 conn(0x7f28f41019b0 msgr2=0x7f28f4103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 -- 172.21.15.71:0/2967163730 shutdown_connections 2024-05-27T09:46:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.426+0000 7f28fac00700 1 -- 172.21.15.71:0/2967163730 wait complete. 2024-05-27T09:46:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.427+0000 7f28fac00700 1 Processor -- start 2024-05-27T09:46:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.427+0000 7f28fac00700 1 -- start start 2024-05-27T09:46:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28fac00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f40780f0 0x7f28f41a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28fac00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28f4079270 0x7f28f41a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28fac00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079bc0 0x7f28f41a8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28fac00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28f41162b0 con 0x7f28f4079bc0 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28fac00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f28f4116130 con 0x7f28f40780f0 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28fac00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f28f4116430 con 0x7f28f4079270 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28fa200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079bc0 0x7f28f41a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28f9800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f40780f0 0x7f28f41a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28f9800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f40780f0 0x7f28f41a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45176/0 (socket says 172.21.15.71:45176) 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28f9800700 1 -- 172.21.15.71:0/2554743810 learned_addr learned my addr 172.21.15.71:0/2554743810 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:46:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.428+0000 7f28f8e00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28f4079270 0x7f28f41a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:56.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28fa200700 1 -- 172.21.15.71:0/2554743810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28f4079270 msgr2=0x7f28f41a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:56.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28fa200700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28f4079270 0x7f28f41a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28fa200700 1 -- 172.21.15.71:0/2554743810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f40780f0 msgr2=0x7f28f41a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28fa200700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f40780f0 0x7f28f41a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28fa200700 1 -- 172.21.15.71:0/2554743810 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f41a88f0 con 0x7f28f4079bc0 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28f8e00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28f4079270 0x7f28f41a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28fa200700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079bc0 0x7f28f41a8220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00efc0 tx=0x7f28ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28f2000700 1 -- 172.21.15.71:0/2554743810 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec0092e0 con 0x7f28f4079bc0 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28f2000700 1 -- 172.21.15.71:0/2554743810 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28ec004bb0 con 0x7f28f4079bc0 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28f2000700 1 -- 172.21.15.71:0/2554743810 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec004020 con 0x7f28f4079bc0 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.429+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f41a8b80 con 0x7f28f4079bc0 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.430+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f41a9070 con 0x7f28f4079bc0 2024-05-27T09:46:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.431+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f40512b0 con 0x7f28f4079bc0 2024-05-27T09:46:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.433+0000 7f28f2000700 1 -- 172.21.15.71:0/2554743810 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f28ec01b030 con 0x7f28f4079bc0 2024-05-27T09:46:56.434 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:56 smithi071 ceph-mon[31451]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.435+0000 7f28f2000700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28dc0b2880 0x7f28dc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:46:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.435+0000 7f28f2000700 1 -- 172.21.15.71:0/2554743810 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f28ec0e2720 con 0x7f28f4079bc0 2024-05-27T09:46:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.435+0000 7f28f9800700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28dc0b2880 0x7f28dc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:46:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.436+0000 7f28f9800700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28dc0b2880 0x7f28dc0b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28f41a2180 tx=0x7f28e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:46:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.438+0000 7f28f2000700 1 -- 172.21.15.71:0/2554743810 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f28ec022020 con 0x7f28f4079bc0 2024-05-27T09:46:56.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.681+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f28f4063bf0 con 0x7f28dc0b2880 2024-05-27T09:46:56.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.691+0000 7f28f2000700 1 -- 172.21.15.71:0/2554743810 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f28f4063bf0 con 0x7f28dc0b2880 2024-05-27T09:46:56.693 INFO:teuthology.orchestra.run.smithi071.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-27T09:46:56.693 INFO:teuthology.orchestra.run.smithi071.stdout:mds.all 12/12 71s ago 4m smithi071=a;smithi071=d;smithi071=g;smithi071=j;smithi072=b;smithi072=e;smithi072=h;smithi072=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-05-27T09:46:56.693 INFO:teuthology.orchestra.run.smithi071.stdout:mgr 3/3 71s ago 10m smithi071=x;smithi072=y;smithi122=z;count:3 2024-05-27T09:46:56.693 INFO:teuthology.orchestra.run.smithi071.stdout:mon 3/3 71s ago 10m smithi071:172.21.15.71=a;smithi072:172.21.15.72=b;smithi122:172.21.15.122=c;count:3 2024-05-27T09:46:56.693 INFO:teuthology.orchestra.run.smithi071.stdout:osd 12 71s ago - 2024-05-27T09:46:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28dc0b2880 msgr2=0x7f28dc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28dc0b2880 0x7f28dc0b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28f41a2180 tx=0x7f28e8009260 comp rx=0 tx=0).stop 2024-05-27T09:46:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079bc0 msgr2=0x7f28f41a8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:46:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079bc0 0x7f28f41a8220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00efc0 tx=0x7f28ec00c3a0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 shutdown_connections 2024-05-27T09:46:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f28dc0b2880 0x7f28dc0b4d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28f4079bc0 0x7f28f41a8220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f40780f0 0x7f28f41a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 --2- 172.21.15.71:0/2554743810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28f4079270 0x7f28f41a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:46:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 >> 172.21.15.71:0/2554743810 conn(0x7f28f41019b0 msgr2=0x7f28f4101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:46:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 shutdown_connections 2024-05-27T09:46:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:46:56.695+0000 7f28fac00700 1 -- 172.21.15.71:0/2554743810 wait complete. 2024-05-27T09:46:56.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:56 smithi122 ceph-mon[36436]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:56.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:56 smithi072 ceph-mon[35951]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:46:57.446 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:57 smithi071 ceph-mon[31451]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:57.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-27T09:46:57.678 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:57 smithi072 ceph-mon[35951]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:57.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:57 smithi122 ceph-mon[36436]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:46:57.944 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:46:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:46:58 smithi122 ceph-mon[36436]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:46:58.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:46:58 smithi071 ceph-mon[31451]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:46:58.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:46:58 smithi072 ceph-mon[35951]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 -- 172.21.15.71:0/3728907698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2204107790 msgr2=0x7f2204109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 --2- 172.21.15.71:0/3728907698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2204107790 0x7f2204109bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009990 tx=0x7f21ec009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 -- 172.21.15.71:0/3728907698 shutdown_connections 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 --2- 172.21.15.71:0/3728907698 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220410a0f0 0x7f220410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 --2- 172.21.15.71:0/3728907698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2204104e30 0x7f2204107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 --2- 172.21.15.71:0/3728907698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2204107790 0x7f2204109bb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 -- 172.21.15.71:0/3728907698 >> 172.21.15.71:0/3728907698 conn(0x7f22040fe870 msgr2=0x7f2204100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 -- 172.21.15.71:0/3728907698 shutdown_connections 2024-05-27T09:47:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.134+0000 7f220b600700 1 -- 172.21.15.71:0/3728907698 wait complete. 2024-05-27T09:47:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.135+0000 7f220b600700 1 Processor -- start 2024-05-27T09:47:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f220b600700 1 -- start start 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f220b600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2204104e30 0x7f220419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f220b600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2204107790 0x7f220419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f220b600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f220410a0f0 0x7f22041a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f220b600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f220410fd90 con 0x7f2204107790 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f220b600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f220410fc10 con 0x7f220410a0f0 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f220b600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f220410ff10 con 0x7f2204104e30 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f2208c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2204104e30 0x7f220419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f2208c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2204104e30 0x7f220419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:44474/0 (socket says 172.21.15.71:44474) 2024-05-27T09:47:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f2208c00700 1 -- 172.21.15.71:0/3254652761 learned_addr learned my addr 172.21.15.71:0/3254652761 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.136+0000 7f21fbe00700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2204107790 0x7f220419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.137+0000 7f2209600700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f220410a0f0 0x7f22041a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.137+0000 7f2208c00700 1 -- 172.21.15.71:0/3254652761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f220410a0f0 msgr2=0x7f22041a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.137+0000 7f2208c00700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f220410a0f0 0x7f22041a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.137+0000 7f2208c00700 1 -- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2204107790 msgr2=0x7f220419ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.137+0000 7f2208c00700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2204107790 0x7f220419ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.137+0000 7f2208c00700 1 -- 172.21.15.71:0/3254652761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22041a2490 con 0x7f2204104e30 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.137+0000 7f2208c00700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2204104e30 0x7f220419a930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f21f400ea30 tx=0x7f21f400ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.138+0000 7f2202000700 1 -- 172.21.15.71:0/3254652761 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f400cbd0 con 0x7f2204104e30 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.138+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22041a2780 con 0x7f2204104e30 2024-05-27T09:47:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.138+0000 7f2202000700 1 -- 172.21.15.71:0/3254652761 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21f40044d0 con 0x7f2204104e30 2024-05-27T09:47:00.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.138+0000 7f2202000700 1 -- 172.21.15.71:0/3254652761 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4003dc0 con 0x7f2204104e30 2024-05-27T09:47:00.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.138+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22041a2d10 con 0x7f2204104e30 2024-05-27T09:47:00.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.139+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22040512b0 con 0x7f2204104e30 2024-05-27T09:47:00.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.143+0000 7f2202000700 1 -- 172.21.15.71:0/3254652761 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f21f4004000 con 0x7f2204104e30 2024-05-27T09:47:00.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.144+0000 7f2202000700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21e80b2900 0x7f21e80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:00.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.144+0000 7f2202000700 1 -- 172.21.15.71:0/3254652761 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f21f40e23b0 con 0x7f2204104e30 2024-05-27T09:47:00.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.144+0000 7f21fbe00700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21e80b2900 0x7f21e80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:00.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.145+0000 7f2202000700 1 -- 172.21.15.71:0/3254652761 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f21f40042f0 con 0x7f2204104e30 2024-05-27T09:47:00.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.145+0000 7f21fbe00700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21e80b2900 0x7f21e80b4e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b760 tx=0x7f21ec00b680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:00.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.383+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2204063bf0 con 0x7f21e80b2900 2024-05-27T09:47:00.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.385+0000 7f2202000700 1 -- 172.21.15.71:0/3254652761 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f2204063bf0 con 0x7f21e80b2900 2024-05-27T09:47:00.387 INFO:teuthology.orchestra.run.smithi071.stdout:HOST ADDR LABELS STATUS 2024-05-27T09:47:00.387 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071 172.21.15.71 2024-05-27T09:47:00.387 INFO:teuthology.orchestra.run.smithi071.stdout:smithi072 172.21.15.72 2024-05-27T09:47:00.387 INFO:teuthology.orchestra.run.smithi071.stdout:smithi122 172.21.15.122 2024-05-27T09:47:00.387 INFO:teuthology.orchestra.run.smithi071.stdout:3 hosts in cluster 2024-05-27T09:47:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.388+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21e80b2900 msgr2=0x7f21e80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.388+0000 7f220b600700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21e80b2900 0x7f21e80b4e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b760 tx=0x7f21ec00b680 comp rx=0 tx=0).stop 2024-05-27T09:47:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.388+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2204104e30 msgr2=0x7f220419a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.388+0000 7f220b600700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2204104e30 0x7f220419a930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f21f400ea30 tx=0x7f21f400ed40 comp rx=0 tx=0).stop 2024-05-27T09:47:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 shutdown_connections 2024-05-27T09:47:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f220410a0f0 0x7f22041a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2204104e30 0x7f220419a930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21e80b2900 0x7f21e80b4e10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 --2- 172.21.15.71:0/3254652761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2204107790 0x7f220419ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 >> 172.21.15.71:0/3254652761 conn(0x7f22040fe870 msgr2=0x7f2204105900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 shutdown_connections 2024-05-27T09:47:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:00.389+0000 7f220b600700 1 -- 172.21.15.71:0/3254652761 wait complete. 2024-05-27T09:47:00.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:00 smithi071 ceph-mon[31451]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:00.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:00 smithi122 ceph-mon[36436]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:00.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:00 smithi072 ceph-mon[35951]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:01.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-27T09:47:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:01.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:01 smithi122 ceph-mon[36436]: from='client.24949 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:01.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:01 smithi071 ceph-mon[31451]: from='client.24949 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:01.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:01 smithi072 ceph-mon[35951]: from='client.24949 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:02.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:02 smithi122 ceph-mon[36436]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:02.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:02 smithi071 ceph-mon[31451]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:02.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:02 smithi072 ceph-mon[35951]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 -- 172.21.15.71:0/187418691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 msgr2=0x7fb768103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 --2- 172.21.15.71:0/187418691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 0x7fb768103990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb754009990 tx=0x7fb754009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 -- 172.21.15.71:0/187418691 shutdown_connections 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 --2- 172.21.15.71:0/187418691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768103ed0 0x7fb7681042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 --2- 172.21.15.71:0/187418691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb768102c30 0x7fb768103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 --2- 172.21.15.71:0/187418691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 0x7fb768103990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 -- 172.21.15.71:0/187418691 >> 172.21.15.71:0/187418691 conn(0x7fb7680fe880 msgr2=0x7fb768100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 -- 172.21.15.71:0/187418691 shutdown_connections 2024-05-27T09:47:03.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.873+0000 7fb76e600700 1 -- 172.21.15.71:0/187418691 wait complete. 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.874+0000 7fb76e600700 1 Processor -- start 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb76e600700 1 -- start start 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb76e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768102c30 0x7fb76819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb76e600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 0x7fb76819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb76e600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb768103ed0 0x7fb7681a4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb76e600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb768111ff0 con 0x7fb768103580 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb76e600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb768111e70 con 0x7fb768102c30 2024-05-27T09:47:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb76e600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb768112170 con 0x7fb768103ed0 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb766a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 0x7fb76819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb767400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768102c30 0x7fb76819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb767400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768102c30 0x7fb76819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50770/0 (socket says 172.21.15.71:50770) 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb767400700 1 -- 172.21.15.71:0/4114154780 learned_addr learned my addr 172.21.15.71:0/4114154780 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.875+0000 7fb767e00700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb768103ed0 0x7fb7681a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.876+0000 7fb767400700 1 -- 172.21.15.71:0/4114154780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb768103ed0 msgr2=0x7fb7681a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.876+0000 7fb767400700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb768103ed0 0x7fb7681a4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.876+0000 7fb767400700 1 -- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 msgr2=0x7fb76819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.876+0000 7fb767400700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 0x7fb76819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.876+0000 7fb767400700 1 -- 172.21.15.71:0/4114154780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7681a46a0 con 0x7fb768102c30 2024-05-27T09:47:03.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.876+0000 7fb767e00700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb768103ed0 0x7fb7681a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:47:03.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.876+0000 7fb767400700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768102c30 0x7fb76819cb40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb75800e970 tx=0x7fb75800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:03.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.877+0000 7fb75fe00700 1 -- 172.21.15.71:0/4114154780 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75800cbd0 con 0x7fb768102c30 2024-05-27T09:47:03.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.877+0000 7fb75fe00700 1 -- 172.21.15.71:0/4114154780 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb75800cd70 con 0x7fb768102c30 2024-05-27T09:47:03.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.877+0000 7fb75fe00700 1 -- 172.21.15.71:0/4114154780 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758005680 con 0x7fb768102c30 2024-05-27T09:47:03.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.877+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7681a4990 con 0x7fb768102c30 2024-05-27T09:47:03.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.877+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7681a4f20 con 0x7fb768102c30 2024-05-27T09:47:03.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.878+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7680512b0 con 0x7fb768102c30 2024-05-27T09:47:03.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.881+0000 7fb75fe00700 1 -- 172.21.15.71:0/4114154780 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb758004750 con 0x7fb768102c30 2024-05-27T09:47:03.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.882+0000 7fb75fe00700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb74c0b2900 0x7fb74c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:03.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.882+0000 7fb75fe00700 1 -- 172.21.15.71:0/4114154780 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fb7580e2930 con 0x7fb768102c30 2024-05-27T09:47:03.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.882+0000 7fb766a00700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb74c0b2900 0x7fb74c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:03.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.883+0000 7fb766a00700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb74c0b2900 0x7fb74c0b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb76819dbf0 tx=0x7fb75400b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:03.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:03.884+0000 7fb75fe00700 1 -- 172.21.15.71:0/4114154780 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb7580aa600 con 0x7fb768102c30 2024-05-27T09:47:04.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.127+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fb768063bf0 con 0x7fb74c0b2900 2024-05-27T09:47:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.132+0000 7fb75fe00700 1 -- 172.21.15.71:0/4114154780 <== mgr.14152 v2:172.21.15.71:6800/1797397372 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fb768063bf0 con 0x7fb74c0b2900 2024-05-27T09:47:04.134 INFO:teuthology.orchestra.run.smithi071.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-27T09:47:04.134 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040172400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-27T09:47:04.134 INFO:teuthology.orchestra.run.smithi071.stdout:smithi072 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V7400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-27T09:47:04.134 INFO:teuthology.orchestra.run.smithi071.stdout:smithi122 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010U400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-27T09:47:04.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb74c0b2900 msgr2=0x7fb74c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:04.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb74c0b2900 0x7fb74c0b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb76819dbf0 tx=0x7fb75400b2a0 comp rx=0 tx=0).stop 2024-05-27T09:47:04.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768102c30 msgr2=0x7fb76819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:04.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768102c30 0x7fb76819cb40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb75800e970 tx=0x7fb75800ec80 comp rx=0 tx=0).stop 2024-05-27T09:47:04.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 shutdown_connections 2024-05-27T09:47:04.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb768103ed0 0x7fb7681a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:04.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb768102c30 0x7fb76819cb40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:04.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fb74c0b2900 0x7fb74c0b4e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:04.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 --2- 172.21.15.71:0/4114154780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb768103580 0x7fb76819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:04.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.136+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 >> 172.21.15.71:0/4114154780 conn(0x7fb7680fe880 msgr2=0x7fb76810b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:04.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.137+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 shutdown_connections 2024-05-27T09:47:04.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:04.137+0000 7fb76e600700 1 -- 172.21.15.71:0/4114154780 wait complete. 2024-05-27T09:47:04.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:04 smithi071 ceph-mon[31451]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:04.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:04 smithi122 ceph-mon[36436]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:04.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:04 smithi072 ceph-mon[35951]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:04.968 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-27T09:47:04.977 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:47:04.977 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-27T09:47:05.428 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:05.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:05 smithi122 ceph-mon[36436]: from='client.24950 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:05.742 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:05 smithi071 ceph-mon[31451]: from='client.24950 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:05.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:05 smithi072 ceph-mon[35951]: from='client.24950 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:06.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:06 smithi071 ceph-mon[31451]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:06.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:06 smithi122 ceph-mon[36436]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:06.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:06 smithi072 ceph-mon[35951]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:07.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 -- 172.21.15.71:0/2419801782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc105c30 msgr2=0x7f34dc10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:07.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 --2- 172.21.15.71:0/2419801782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc105c30 0x7f34dc10c4e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f34d400b0a0 tx=0x7f34d400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 -- 172.21.15.71:0/2419801782 shutdown_connections 2024-05-27T09:47:07.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 --2- 172.21.15.71:0/2419801782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc105c30 0x7f34dc10c4e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 --2- 172.21.15.71:0/2419801782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc104160 0x7f34dc104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 --2- 172.21.15.71:0/2419801782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34dc105290 0x7f34dc1056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 -- 172.21.15.71:0/2419801782 >> 172.21.15.71:0/2419801782 conn(0x7f34dc0ff7a0 msgr2=0x7f34dc101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:07.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 -- 172.21.15.71:0/2419801782 shutdown_connections 2024-05-27T09:47:07.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.562+0000 7f34dbe00700 1 -- 172.21.15.71:0/2419801782 wait complete. 2024-05-27T09:47:07.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.563+0000 7f34dbe00700 1 Processor -- start 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34dbe00700 1 -- start start 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34dbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc104160 0x7f34dc19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34dbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34dc105290 0x7f34dc19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34dbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc105c30 0x7f34dc1a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34dbe00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc10fc30 con 0x7f34dc105c30 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34dbe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc10fab0 con 0x7f34dc105290 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34dbe00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc10fdb0 con 0x7f34dc104160 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34daa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc104160 0x7f34dc19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34daa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc104160 0x7f34dc19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:43118/0 (socket says 172.21.15.71:43118) 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34daa00700 1 -- 172.21.15.71:0/3950252501 learned_addr learned my addr 172.21.15.71:0/3950252501 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34d3e00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34dc105290 0x7f34dc19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.564+0000 7f34db400700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc105c30 0x7f34dc1a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34daa00700 1 -- 172.21.15.71:0/3950252501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34dc105290 msgr2=0x7f34dc19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34daa00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34dc105290 0x7f34dc19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34daa00700 1 -- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc105c30 msgr2=0x7f34dc1a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34daa00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc105c30 0x7f34dc1a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34daa00700 1 -- 172.21.15.71:0/3950252501 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc1a2270 con 0x7f34dc104160 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34d3e00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34dc105290 0x7f34dc19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34daa00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc104160 0x7f34dc19a710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00e940 tx=0x7f34cc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34d3400700 1 -- 172.21.15.71:0/3950252501 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc004220 con 0x7f34dc104160 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34d3400700 1 -- 172.21.15.71:0/3950252501 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34cc0043c0 con 0x7f34dc104160 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34dc1a2560 con 0x7f34dc104160 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.565+0000 7f34d3400700 1 -- 172.21.15.71:0/3950252501 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc003c60 con 0x7f34dc104160 2024-05-27T09:47:07.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.566+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34dc1a2af0 con 0x7f34dc104160 2024-05-27T09:47:07.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.567+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34dc0512b0 con 0x7f34dc104160 2024-05-27T09:47:07.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.569+0000 7f34d3400700 1 -- 172.21.15.71:0/3950252501 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f34cc046910 con 0x7f34dc104160 2024-05-27T09:47:07.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.571+0000 7f34d3400700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f34c00b2900 0x7f34c00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:07.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.571+0000 7f34d3400700 1 -- 172.21.15.71:0/3950252501 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f34cc0e2330 con 0x7f34dc104160 2024-05-27T09:47:07.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.571+0000 7f34d3e00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f34c00b2900 0x7f34c00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:07.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.572+0000 7f34d3e00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f34c00b2900 0x7f34c00b4e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34dc19b7c0 tx=0x7f34c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:07.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.573+0000 7f34d3400700 1 -- 172.21.15.71:0/3950252501 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f34cc0aa000 con 0x7f34dc104160 2024-05-27T09:47:07.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.853+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f34dc02e5e0 con 0x7f34dc104160 2024-05-27T09:47:07.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.854+0000 7f34d3400700 1 -- 172.21.15.71:0/3950252501 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3040 (secure 0 0 0) 0x7f34cc003e40 con 0x7f34dc104160 2024-05-27T09:47:07.855 INFO:teuthology.orchestra.run.smithi071.stdout:e25 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 25 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-05-27T09:43:51.731640+0000 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-05-27T09:44:15.200351+0000 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 300 2024-05-27T09:47:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 0 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 3 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1,2 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=24530,1=24518,2=24508} 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-05-27T09:47:07.857 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 0 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 24530 members: 24518,24530,24508 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b{0:24530} state up:active seq 7 addr [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.g{0:24506} state up:standby-replay seq 1 addr [v2:172.21.15.71:6838/2510446999,v1:172.21.15.71:6839/2510446999] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a{1:24518} state up:active seq 12 addr [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c{1:24496} state up:standby-replay seq 1 addr [v2:172.21.15.122:6836/1257572460,v1:172.21.15.122:6837/1257572460] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.i{2:24508} state up:active seq 14 addr [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.h{2:24488} state up:standby-replay seq 1 addr [v2:172.21.15.72:6836/4192538973,v1:172.21.15.72:6837/4192538973] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout:Standby daemons: 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.j{-1:14373} state up:standby seq 1 addr [v2:172.21.15.71:6834/947679216,v1:172.21.15.71:6835/947679216] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d{-1:14379} state up:standby seq 1 addr [v2:172.21.15.71:6836/95773383,v1:172.21.15.71:6837/95773383] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.k{-1:24443} state up:standby seq 1 addr [v2:172.21.15.72:6832/840166541,v1:172.21.15.72:6833/840166541] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.l{-1:24445} state up:standby seq 1 addr [v2:172.21.15.122:6832/1541332524,v1:172.21.15.122:6833/1541332524] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.e{-1:24473} state up:standby seq 1 addr [v2:172.21.15.72:6834/730426075,v1:172.21.15.72:6835/730426075] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.859 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.f{-1:24484} state up:standby seq 1 addr [v2:172.21.15.122:6834/132326532,v1:172.21.15.122:6835/132326532] compat {c=[1],r=[1],i=[1fff]}] 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f34c00b2900 msgr2=0x7f34c00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f34c00b2900 0x7f34c00b4e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34dc19b7c0 tx=0x7f34c4009260 comp rx=0 tx=0).stop 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc104160 msgr2=0x7f34dc19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc104160 0x7f34dc19a710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00e940 tx=0x7f34cc00ec50 comp rx=0 tx=0).stop 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 shutdown_connections 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f34c00b2900 0x7f34c00b4e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc105c30 0x7f34dc1a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc104160 0x7f34dc19a710 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 --2- 172.21.15.71:0/3950252501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34dc105290 0x7f34dc19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:07.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 >> 172.21.15.71:0/3950252501 conn(0x7f34dc0ff7a0 msgr2=0x7f34dc1084c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:07.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 shutdown_connections 2024-05-27T09:47:07.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:07.857+0000 7f34dbe00700 1 -- 172.21.15.71:0/3950252501 wait complete. 2024-05-27T09:47:07.861 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-05-27T09:47:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:08 smithi071 ceph-mon[31451]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:08.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:08 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3950252501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-27T09:47:08.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-27T09:47:08.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:08 smithi122 ceph-mon[36436]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:08.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:08 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3950252501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-27T09:47:08.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:08 smithi072 ceph-mon[35951]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:08.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:08 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3950252501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-27T09:47:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:10.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:10 smithi122 ceph-mon[36436]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:10 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:10 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:10 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:10.752 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:10 smithi071 ceph-mon[31451]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:10.752 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:10 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:10.752 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:10 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:10.752 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:10 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:10 smithi072 ceph-mon[35951]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:10 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:10 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:10 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 -- 172.21.15.71:0/2802684680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 msgr2=0x7f19ec10be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 --2- 172.21.15.71:0/2802684680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec10be80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009990 tx=0x7f19d8009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 -- 172.21.15.71:0/2802684680 shutdown_connections 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 --2- 172.21.15.71:0/2802684680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19ec10c410 0x7f19ec112cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 --2- 172.21.15.71:0/2802684680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19ec10ab00 0x7f19ec10af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 --2- 172.21.15.71:0/2802684680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec10be80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 -- 172.21.15.71:0/2802684680 >> 172.21.15.71:0/2802684680 conn(0x7f19ec0799b0 msgr2=0x7f19ec07be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 -- 172.21.15.71:0/2802684680 shutdown_connections 2024-05-27T09:47:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.391+0000 7f19f4200700 1 -- 172.21.15.71:0/2802684680 wait complete. 2024-05-27T09:47:11.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 Processor -- start 2024-05-27T09:47:11.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 -- start start 2024-05-27T09:47:11.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19ec10ab00 0x7f19ec1a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec1a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19ec10c410 0x7f19ec1a83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1163b0 con 0x7f19ec10c410 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec116230 con 0x7f19ec10ba70 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.393+0000 7f19f4200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec116530 con 0x7f19ec10ab00 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec1a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f2200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19ec10c410 0x7f19ec1a83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec1a1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50810/0 (socket says 172.21.15.71:50810) 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 -- 172.21.15.71:0/224210396 learned_addr learned my addr 172.21.15.71:0/224210396 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f1800700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19ec10ab00 0x7f19ec1a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:11.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 -- 172.21.15.71:0/224210396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19ec10ab00 msgr2=0x7f19ec1a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:11.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19ec10ab00 0x7f19ec1a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 -- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19ec10c410 msgr2=0x7f19ec1a83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:11.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19ec10c410 0x7f19ec1a83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 -- 172.21.15.71:0/224210396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec1a8a20 con 0x7f19ec10ba70 2024-05-27T09:47:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.394+0000 7f19f0e00700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec1a1400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b760 tx=0x7f19d8009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.395+0000 7f19ea000700 1 -- 172.21.15.71:0/224210396 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8026070 con 0x7f19ec10ba70 2024-05-27T09:47:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.395+0000 7f19ea000700 1 -- 172.21.15.71:0/224210396 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d8021410 con 0x7f19ec10ba70 2024-05-27T09:47:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.395+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec1a8cb0 con 0x7f19ec10ba70 2024-05-27T09:47:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.395+0000 7f19ea000700 1 -- 172.21.15.71:0/224210396 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8017650 con 0x7f19ec10ba70 2024-05-27T09:47:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.395+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec1a9160 con 0x7f19ec10ba70 2024-05-27T09:47:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.396+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ec0512b0 con 0x7f19ec10ba70 2024-05-27T09:47:11.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.398+0000 7f19ea000700 1 -- 172.21.15.71:0/224210396 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f19d8029070 con 0x7f19ec10ba70 2024-05-27T09:47:11.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.400+0000 7f19ea000700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f19d40b2900 0x7f19d40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:11.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.400+0000 7f19ea000700 1 -- 172.21.15.71:0/224210396 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f19d80e2ff0 con 0x7f19ec10ba70 2024-05-27T09:47:11.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.400+0000 7f19f1800700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f19d40b2900 0x7f19d40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:11.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.401+0000 7f19f1800700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f19d40b2900 0x7f19d40b4e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19ec10b9a0 tx=0x7f19e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.404+0000 7f19ea000700 1 -- 172.21.15.71:0/224210396 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f19d8013070 con 0x7f19ec10ba70 2024-05-27T09:47:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.641+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f19ec0643c0 con 0x7f19ec10ba70 2024-05-27T09:47:11.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:11.644 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:11.644 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:11 smithi071 ceph-mon[31451]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.643+0000 7f19ea000700 1 -- 172.21.15.71:0/224210396 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5266 (secure 0 0 0) 0x7f19d80aad70 con 0x7f19ec10ba70 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 83 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-05-27T09:34:13.084307+0000 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-05-27T09:44:24.357115+0000 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:crush_version 26 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:full_ratio 0.95 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:backfillfull_ratio 0.9 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:nearfull_ratio 0.85 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:require_min_compat_client luminous 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:min_compat_client luminous 2024-05-27T09:47:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:require_osd_release squid 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:stretch_mode_enabled false 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:max_osd 12 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6802/335199757,v1:172.21.15.71:6803/335199757] [v2:172.21.15.71:6804/335199757,v1:172.21.15.71:6805/335199757] exists,up a0188f94-bc15-4782-acb2-e6934d1f09b4 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6800/936392023,v1:172.21.15.72:6801/936392023] [v2:172.21.15.72:6802/936392023,v1:172.21.15.72:6803/936392023] exists,up 1cc3fd0a-077b-4a70-9463-2793467d8a99 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 up in weight 1 up_from 18 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/631250224,v1:172.21.15.122:6801/631250224] [v2:172.21.15.122:6802/631250224,v1:172.21.15.122:6803/631250224] exists,up 9e67be5c-649c-4120-8108-deed9131b2fd 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 up in weight 1 up_from 26 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6810/4167682826,v1:172.21.15.71:6811/4167682826] [v2:172.21.15.71:6812/4167682826,v1:172.21.15.71:6813/4167682826] exists,up a813baa5-456d-4d6c-9c1f-3ff8f850ecba 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 up in weight 1 up_from 32 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6808/3529630414,v1:172.21.15.72:6809/3529630414] [v2:172.21.15.72:6810/3529630414,v1:172.21.15.72:6811/3529630414] exists,up 48ad0f18-5577-4ed4-b5d7-ee731834d30c 2024-05-27T09:47:11.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 up in weight 1 up_from 37 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/3344426333,v1:172.21.15.122:6809/3344426333] [v2:172.21.15.122:6810/3344426333,v1:172.21.15.122:6811/3344426333] exists,up 5d87f6a2-4ba3-46be-8f09-2e33f90b49dc 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 up in weight 1 up_from 43 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6818/1007330832,v1:172.21.15.71:6819/1007330832] [v2:172.21.15.71:6820/1007330832,v1:172.21.15.71:6821/1007330832] exists,up e5c500cb-9e6e-4e19-86a4-854af29aa3c7 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6816/2828879424,v1:172.21.15.72:6817/2828879424] [v2:172.21.15.72:6818/2828879424,v1:172.21.15.72:6819/2828879424] exists,up 32d0220b-a785-43b4-901a-d503071d14e4 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8 up in weight 1 up_from 55 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/2821031673,v1:172.21.15.122:6817/2821031673] [v2:172.21.15.122:6818/2821031673,v1:172.21.15.122:6819/2821031673] exists,up d3f8c4a1-f8eb-4c5c-b274-c09bf383869d 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9 up in weight 1 up_from 61 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6826/3462604941,v1:172.21.15.71:6827/3462604941] [v2:172.21.15.71:6828/3462604941,v1:172.21.15.71:6829/3462604941] exists,up 4c875335-1ab1-4f1d-9ffd-895c97f78d56 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10 up in weight 1 up_from 67 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6824/3492113822,v1:172.21.15.72:6825/3492113822] [v2:172.21.15.72:6826/3492113822,v1:172.21.15.72:6827/3492113822] exists,up d03bc669-3810-4dd5-897c-3672443f1671 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11 up in weight 1 up_from 73 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/1471732856,v1:172.21.15.122:6825/1471732856] [v2:172.21.15.122:6826/1471732856,v1:172.21.15.122:6827/1471732856] exists,up bc33924e-d7e4-4173-95f8-a72e6cc81e04 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 2.a [2,11] 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 2.10 [8,11] 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 3.2 [3,9] 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 3.3 [4,9] 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 3.6 [4,7] 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 3.10 [5,9] 2024-05-27T09:47:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 3.17 [4,8] 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:pg_upmap_items 3.39 [5,6] 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:0/705076844 expires 2024-05-28T09:35:22.974518+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:0/2074945861 expires 2024-05-28T09:35:22.974518+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:0/2822189872 expires 2024-05-28T09:34:47.199375+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:0/1615143192 expires 2024-05-28T09:34:47.199375+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:0/3742035998 expires 2024-05-28T09:35:22.974518+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:0/226136634 expires 2024-05-28T09:34:47.199375+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:6801/1853756508 expires 2024-05-28T09:35:22.974518+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:6800/1853756508 expires 2024-05-28T09:35:22.974518+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:6800/1765745384 expires 2024-05-28T09:34:47.199375+0000 2024-05-27T09:47:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:blocklist 172.21.15.71:6801/1765745384 expires 2024-05-28T09:34:47.199375+0000 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f19d40b2900 msgr2=0x7f19d40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f19d40b2900 0x7f19d40b4e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19ec10b9a0 tx=0x7f19e0009260 comp rx=0 tx=0).stop 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 msgr2=0x7f19ec1a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec1a1400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b760 tx=0x7f19d8009580 comp rx=0 tx=0).stop 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 shutdown_connections 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f19d40b2900 0x7f19d40b4e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19ec10c410 0x7f19ec1a83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19ec10ab00 0x7f19ec1a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 --2- 172.21.15.71:0/224210396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19ec10ba70 0x7f19ec1a1400 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.646+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 >> 172.21.15.71:0/224210396 conn(0x7f19ec0799b0 msgr2=0x7f19ec10eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.647+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 shutdown_connections 2024-05-27T09:47:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:11.647+0000 7f19f4200700 1 -- 172.21.15.71:0/224210396 wait complete. 2024-05-27T09:47:11.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:11.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:11.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:11 smithi122 ceph-mon[36436]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:11 smithi072 ceph-mon[35951]: from='mgr.14152 172.21.15.71:0/112996322' entity='mgr.x' 2024-05-27T09:47:12.420 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-27T09:47:12.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:47:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:12 smithi122 ceph-mon[36436]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:12.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:12 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/224210396' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-27T09:47:12.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:12 smithi071 ceph-mon[31451]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:12.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:12 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/224210396' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-27T09:47:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:12 smithi072 ceph-mon[35951]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:12 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/224210396' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-27T09:47:12.890 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:14.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:14 smithi071 ceph-mon[31451]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:14.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:14 smithi122 ceph-mon[36436]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:14.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:14 smithi072 ceph-mon[35951]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 -- 172.21.15.71:0/1950254797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc1043f0 msgr2=0x7f35dc104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 --2- 172.21.15.71:0/1950254797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc1043f0 0x7f35dc104800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009f90 tx=0x7f35cc00b330 comp rx=0 tx=0).stop 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 -- 172.21.15.71:0/1950254797 shutdown_connections 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 --2- 172.21.15.71:0/1950254797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35dc109670 0x7f35dc110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 --2- 172.21.15.71:0/1950254797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc1043f0 0x7f35dc104800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 --2- 172.21.15.71:0/1950254797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35dc108d20 0x7f35dc109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 -- 172.21.15.71:0/1950254797 >> 172.21.15.71:0/1950254797 conn(0x7f35dc079d00 msgr2=0x7f35dc07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 -- 172.21.15.71:0/1950254797 shutdown_connections 2024-05-27T09:47:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.054+0000 7f35e1200700 1 -- 172.21.15.71:0/1950254797 wait complete. 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.055+0000 7f35e1200700 1 Processor -- start 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.055+0000 7f35e1200700 1 -- start start 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35e1200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35dc1043f0 0x7f35dc1a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35e1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc108d20 0x7f35dc1a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35e1200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35dc109670 0x7f35dc19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35e1200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc1142f0 con 0x7f35dc1043f0 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35e1200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc114170 con 0x7f35dc108d20 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35e1200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc114470 con 0x7f35dc109670 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35db400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35dc1043f0 0x7f35dc1a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35d2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc108d20 0x7f35dc1a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35db400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35dc1043f0 0x7f35dc1a0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38174/0 (socket says 172.21.15.71:38174) 2024-05-27T09:47:15.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35db400700 1 -- 172.21.15.71:0/4209834314 learned_addr learned my addr 172.21.15.71:0/4209834314 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35d2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc108d20 0x7f35dc1a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49174/0 (socket says 172.21.15.71:49174) 2024-05-27T09:47:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.056+0000 7f35dbe00700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35dc109670 0x7f35dc19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.057+0000 7f35d2a00700 1 -- 172.21.15.71:0/4209834314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35dc109670 msgr2=0x7f35dc19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.057+0000 7f35d2a00700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35dc109670 0x7f35dc19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.057+0000 7f35d2a00700 1 -- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35dc1043f0 msgr2=0x7f35dc1a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.057+0000 7f35d2a00700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35dc1043f0 0x7f35dc1a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.057+0000 7f35d2a00700 1 -- 172.21.15.71:0/4209834314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc19b120 con 0x7f35dc108d20 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.057+0000 7f35d2a00700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc108d20 0x7f35dc1a0d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35c4005fd0 tx=0x7f35c400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.057+0000 7f35d8c00700 1 -- 172.21.15.71:0/4209834314 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c4010900 con 0x7f35dc108d20 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.058+0000 7f35d8c00700 1 -- 172.21.15.71:0/4209834314 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35c4018420 con 0x7f35dc108d20 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.058+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc19b410 con 0x7f35dc108d20 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.058+0000 7f35d8c00700 1 -- 172.21.15.71:0/4209834314 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c400f680 con 0x7f35dc108d20 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.058+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1a76e0 con 0x7f35dc108d20 2024-05-27T09:47:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.059+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc0512b0 con 0x7f35dc108d20 2024-05-27T09:47:15.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.061+0000 7f35d8c00700 1 -- 172.21.15.71:0/4209834314 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f35c4010aa0 con 0x7f35dc108d20 2024-05-27T09:47:15.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.063+0000 7f35d8c00700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f35c00b2900 0x7f35c00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:15.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.063+0000 7f35d8c00700 1 -- 172.21.15.71:0/4209834314 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f35c40e2460 con 0x7f35dc108d20 2024-05-27T09:47:15.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.063+0000 7f35db400700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f35c00b2900 0x7f35c00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:15.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.064+0000 7f35db400700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f35c00b2900 0x7f35c00b4e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009840 tx=0x7f35cc009700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:15.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.065+0000 7f35d8c00700 1 -- 172.21.15.71:0/4209834314 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f35c40aa130 con 0x7f35dc108d20 2024-05-27T09:47:15.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.346+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35dc19bfa0 con 0x7f35dc108d20 2024-05-27T09:47:15.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.347+0000 7f35d8c00700 1 -- 172.21.15.71:0/4209834314 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11854 (secure 0 0 0) 0x7f35c40a9a30 con 0x7f35dc108d20 2024-05-27T09:47:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:15.348 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:44:15.200351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:47:15.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f35c00b2900 msgr2=0x7f35c00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:15.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f35c00b2900 0x7f35c00b4e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009840 tx=0x7f35cc009700 comp rx=0 tx=0).stop 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc108d20 msgr2=0x7f35dc1a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc108d20 0x7f35dc1a0d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35c4005fd0 tx=0x7f35c400eca0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 shutdown_connections 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35dc109670 0x7f35dc19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f35c00b2900 0x7f35c00b4e10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35dc1043f0 0x7f35dc1a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 --2- 172.21.15.71:0/4209834314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35dc108d20 0x7f35dc1a0d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 >> 172.21.15.71:0/4209834314 conn(0x7f35dc079d00 msgr2=0x7f35dc1027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 shutdown_connections 2024-05-27T09:47:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:15.351+0000 7f35e1200700 1 -- 172.21.15.71:0/4209834314 wait complete. 2024-05-27T09:47:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-05-27T09:47:15.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:15 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4209834314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:15.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:15 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4209834314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:15.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:15 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4209834314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:16.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:47:16.547 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:16.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:16 smithi071 ceph-mon[31451]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:16.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:16 smithi122 ceph-mon[36436]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:16.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:16 smithi072 ceph-mon[35951]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:18.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 -- 172.21.15.71:0/2429733716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c106ec0 msgr2=0x7f448c113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 --2- 172.21.15.71:0/2429733716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c106ec0 0x7f448c113350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f448400b0a0 tx=0x7f448400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 -- 172.21.15.71:0/2429733716 shutdown_connections 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 --2- 172.21.15.71:0/2429733716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c106ec0 0x7f448c113350 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 --2- 172.21.15.71:0/2429733716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c10c5b0 0x7f448c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 --2- 172.21.15.71:0/2429733716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f448c106570 0x7f448c106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 -- 172.21.15.71:0/2429733716 >> 172.21.15.71:0/2429733716 conn(0x7f448c102070 msgr2=0x7f448c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 -- 172.21.15.71:0/2429733716 shutdown_connections 2024-05-27T09:47:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.680+0000 7f4493a00700 1 -- 172.21.15.71:0/2429733716 wait complete. 2024-05-27T09:47:18.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.681+0000 7f4493a00700 1 Processor -- start 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.681+0000 7f4493a00700 1 -- start start 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4493a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c106570 0x7f448c078dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4493a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f448c106ec0 0x7f448c079310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4493a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c10c5b0 0x7f448c079850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4493a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f448c116730 con 0x7f448c106570 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4493a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f448c1165b0 con 0x7f448c10c5b0 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4493a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f448c1168b0 con 0x7f448c106ec0 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4491000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c106570 0x7f448c078dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4491000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c106570 0x7f448c078dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38184/0 (socket says 172.21.15.71:38184) 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4491000700 1 -- 172.21.15.71:0/1750424052 learned_addr learned my addr 172.21.15.71:0/1750424052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f448be00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f448c106ec0 0x7f448c079310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.682+0000 7f4491a00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c10c5b0 0x7f448c079850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:18.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f448be00700 1 -- 172.21.15.71:0/1750424052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c10c5b0 msgr2=0x7f448c079850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f448be00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c10c5b0 0x7f448c079850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f448be00700 1 -- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c106570 msgr2=0x7f448c078dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f448be00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c106570 0x7f448c078dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f448be00700 1 -- 172.21.15.71:0/1750424052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c1ad5c0 con 0x7f448c106ec0 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f4491000700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c106570 0x7f448c078dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f448be00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f448c106ec0 0x7f448c079310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f448c075b70 tx=0x7f447800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f4489600700 1 -- 172.21.15.71:0/1750424052 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478010900 con 0x7f448c106ec0 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f4489600700 1 -- 172.21.15.71:0/1750424052 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447800c430 con 0x7f448c106ec0 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448c1ad850 con 0x7f448c106ec0 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f4489600700 1 -- 172.21.15.71:0/1750424052 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478018680 con 0x7f448c106ec0 2024-05-27T09:47:18.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.683+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448c1add90 con 0x7f448c106ec0 2024-05-27T09:47:18.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.684+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448c107c90 con 0x7f448c106ec0 2024-05-27T09:47:18.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.687+0000 7f4489600700 1 -- 172.21.15.71:0/1750424052 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f447804aab0 con 0x7f448c106ec0 2024-05-27T09:47:18.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:18 smithi071 ceph-mon[31451]: pgmap v430: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:18.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.689+0000 7f4489600700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f44740b2880 0x7f44740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:18.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.689+0000 7f4489600700 1 -- 172.21.15.71:0/1750424052 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f44780e2320 con 0x7f448c106ec0 2024-05-27T09:47:18.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.689+0000 7f4491000700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f44740b2880 0x7f44740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:18.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.690+0000 7f4491000700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f44740b2880 0x7f44740b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4480005950 tx=0x7f4480009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:18.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.691+0000 7f4489600700 1 -- 172.21.15.71:0/1750424052 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f44780a9ff0 con 0x7f448c106ec0 2024-05-27T09:47:18.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:18 smithi122 ceph-mon[36436]: pgmap v430: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:18.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:18 smithi072 ceph-mon[35951]: pgmap v430: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.973+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f448c02e5e0 con 0x7f448c106ec0 2024-05-27T09:47:18.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.974+0000 7f4489600700 1 -- 172.21.15.71:0/1750424052 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11854 (secure 0 0 0) 0x7f44780a98f0 con 0x7f448c106ec0 2024-05-27T09:47:18.975 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:18.975 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:44:15.200351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f44740b2880 msgr2=0x7f44740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f44740b2880 0x7f44740b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4480005950 tx=0x7f4480009260 comp rx=0 tx=0).stop 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f448c106ec0 msgr2=0x7f448c079310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f448c106ec0 0x7f448c079310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f448c075b70 tx=0x7f447800eca0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 shutdown_connections 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c10c5b0 0x7f448c079850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f44740b2880 0x7f44740b4d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f448c106570 0x7f448c078dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 --2- 172.21.15.71:0/1750424052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f448c106ec0 0x7f448c079310 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.977+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 >> 172.21.15.71:0/1750424052 conn(0x7f448c102070 msgr2=0x7f448c1045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.978+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 shutdown_connections 2024-05-27T09:47:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:18.978+0000 7f4493a00700 1 -- 172.21.15.71:0/1750424052 wait complete. 2024-05-27T09:47:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-05-27T09:47:19.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:19 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1750424052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:19.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:47:19.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:19 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1750424052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:19.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:19 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1750424052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:20.141 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:20.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:20 smithi071 ceph-mon[31451]: pgmap v431: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:20 smithi122 ceph-mon[36436]: pgmap v431: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:20 smithi072 ceph-mon[35951]: pgmap v431: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.231+0000 7fc000600700 1 -- 172.21.15.71:0/353204235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff81030b0 msgr2=0x7fbff81034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.231+0000 7fc000600700 1 --2- 172.21.15.71:0/353204235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff81030b0 0x7fbff81034c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009990 tx=0x7fbfec009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.232+0000 7fc000600700 1 -- 172.21.15.71:0/353204235 shutdown_connections 2024-05-27T09:47:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.232+0000 7fc000600700 1 --2- 172.21.15.71:0/353204235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbff8110c60 0x7fbff8113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.232+0000 7fc000600700 1 --2- 172.21.15.71:0/353204235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff81030b0 0x7fbff81034c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.232+0000 7fc000600700 1 --2- 172.21.15.71:0/353204235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff8103a00 0x7fbff8110720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.232+0000 7fc000600700 1 -- 172.21.15.71:0/353204235 >> 172.21.15.71:0/353204235 conn(0x7fbff80fedb0 msgr2=0x7fbff81011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.232+0000 7fc000600700 1 -- 172.21.15.71:0/353204235 shutdown_connections 2024-05-27T09:47:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.232+0000 7fc000600700 1 -- 172.21.15.71:0/353204235 wait complete. 2024-05-27T09:47:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.233+0000 7fc000600700 1 Processor -- start 2024-05-27T09:47:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fc000600700 1 -- start start 2024-05-27T09:47:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fc000600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff81030b0 0x7fbff819d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fc000600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff8103a00 0x7fbff819d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fc000600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbff8110c60 0x7fbff81a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fc000600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81166c0 con 0x7fbff8110c60 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fc000600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbff8116540 con 0x7fbff81030b0 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fc000600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbff8116840 con 0x7fbff8103a00 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fbffdc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff81030b0 0x7fbff819d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fbffe600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbff8110c60 0x7fbff81a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fbffdc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff81030b0 0x7fbff819d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49200/0 (socket says 172.21.15.71:49200) 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fbffdc00700 1 -- 172.21.15.71:0/2120376688 learned_addr learned my addr 172.21.15.71:0/2120376688 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.234+0000 7fbffd200700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff8103a00 0x7fbff819d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.235+0000 7fbffdc00700 1 -- 172.21.15.71:0/2120376688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff8103a00 msgr2=0x7fbff819d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.235+0000 7fbffdc00700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff8103a00 0x7fbff819d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.235+0000 7fbffdc00700 1 -- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbff8110c60 msgr2=0x7fbff81a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.235+0000 7fbffdc00700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbff8110c60 0x7fbff81a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.235+0000 7fbffdc00700 1 -- 172.21.15.71:0/2120376688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff81a1ee0 con 0x7fbff81030b0 2024-05-27T09:47:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.235+0000 7fbffdc00700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff81030b0 0x7fbff819d010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbfec000c00 tx=0x7fbfec0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.236+0000 7fbff6000700 1 -- 172.21.15.71:0/2120376688 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec027070 con 0x7fbff81030b0 2024-05-27T09:47:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.236+0000 7fbff6000700 1 -- 172.21.15.71:0/2120376688 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfec022470 con 0x7fbff81030b0 2024-05-27T09:47:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.236+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff81a2170 con 0x7fbff81030b0 2024-05-27T09:47:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.236+0000 7fbff6000700 1 -- 172.21.15.71:0/2120376688 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec017650 con 0x7fbff81030b0 2024-05-27T09:47:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.236+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81a2650 con 0x7fbff81030b0 2024-05-27T09:47:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.237+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff80512b0 con 0x7fbff81030b0 2024-05-27T09:47:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.240+0000 7fbff6000700 1 -- 172.21.15.71:0/2120376688 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbfec02a070 con 0x7fbff81030b0 2024-05-27T09:47:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.241+0000 7fbff6000700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fbfe00b2880 0x7fbfe00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.241+0000 7fbff6000700 1 -- 172.21.15.71:0/2120376688 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fbfec0e31e0 con 0x7fbff81030b0 2024-05-27T09:47:22.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.241+0000 7fbffd200700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fbfe00b2880 0x7fbfe00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:22.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.242+0000 7fbffd200700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fbfe00b2880 0x7fbfe00b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbff81122f0 tx=0x7fbfe4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:22.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.244+0000 7fbff6000700 1 -- 172.21.15.71:0/2120376688 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbfec013070 con 0x7fbff81030b0 2024-05-27T09:47:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.481+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbff802e5e0 con 0x7fbff81030b0 2024-05-27T09:47:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.484+0000 7fbff6000700 1 -- 172.21.15.71:0/2120376688 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22603 (secure 0 0 0) 0x7fbfec0aaf40 con 0x7fbff81030b0 2024-05-27T09:47:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:22.485 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":83,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:44:24.357115+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.486+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fbfe00b2880 msgr2=0x7fbfe00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.486+0000 7fc000600700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fbfe00b2880 0x7fbfe00b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbff81122f0 tx=0x7fbfe4009260 comp rx=0 tx=0).stop 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff81030b0 msgr2=0x7fbff819d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff81030b0 0x7fbff819d010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbfec000c00 tx=0x7fbfec0057c0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 shutdown_connections 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fbfe00b2880 0x7fbfe00b4d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbff8110c60 0x7fbff81a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff81030b0 0x7fbff819d010 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 --2- 172.21.15.71:0/2120376688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff8103a00 0x7fbff819d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:22.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 >> 172.21.15.71:0/2120376688 conn(0x7fbff80fedb0 msgr2=0x7fbff8112730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:22.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 shutdown_connections 2024-05-27T09:47:22.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:22.487+0000 7fc000600700 1 -- 172.21.15.71:0/2120376688 wait complete. 2024-05-27T09:47:22.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:22 smithi071 ceph-mon[31451]: pgmap v432: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:22.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:22 smithi122 ceph-mon[36436]: pgmap v432: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:22.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:22 smithi072 ceph-mon[35951]: pgmap v432: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:23.260 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-27T09:43:51.731640+0000', 'modified': '2024-05-27T09:44:15.200351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24530, 'mds_1': 24518, 'mds_2': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.72:6837/4192538973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 4192538973}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 4192538973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6837/1257572460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 1257572460}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1257572460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'g', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6839/2510446999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 2510446999}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 2510446999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.122:6839/3712813671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 3712813671}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 3712813671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.71:6841/1086406252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6840', 'nonce': 1086406252}, {'type': 'v1', 'addr': '172.21.15.71:6841', 'nonce': 1086406252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24530': {'gid': 24530, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.72:6839/1043512787', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6838', 'nonce': 1043512787}, {'type': 'v1', 'addr': '172.21.15.72:6839', 'nonce': 1043512787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24530, 'qdb_cluster': [24518, 24530, 24508]} 2024-05-27T09:47:23.261 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-27T09:47:23.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-05-27T09:47:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:23.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:23 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2120376688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:47:23.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:23 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2120376688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:47:23.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:23 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2120376688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:47:24.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:24 smithi122 ceph-mon[36436]: pgmap v433: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:24.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:24 smithi071 ceph-mon[31451]: pgmap v433: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:24.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:24 smithi072 ceph-mon[35951]: pgmap v433: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 -- 172.21.15.71:0/482886760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac10a980 msgr2=0x7f0fac10ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 --2- 172.21.15.71:0/482886760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac10a980 0x7f0fac10ad90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f980098f0 tx=0x7f0f98009c00 comp rx=0 tx=0).stop 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 -- 172.21.15.71:0/482886760 shutdown_connections 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 --2- 172.21.15.71:0/482886760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10b2d0 0x7f0fac117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 --2- 172.21.15.71:0/482886760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac110960 0x7f0fac110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 --2- 172.21.15.71:0/482886760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac10a980 0x7f0fac10ad90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 -- 172.21.15.71:0/482886760 >> 172.21.15.71:0/482886760 conn(0x7f0fac077c70 msgr2=0x7f0fac0780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 -- 172.21.15.71:0/482886760 shutdown_connections 2024-05-27T09:47:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.933+0000 7f0fb2200700 1 -- 172.21.15.71:0/482886760 wait complete. 2024-05-27T09:47:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.934+0000 7f0fb2200700 1 Processor -- start 2024-05-27T09:47:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fb2200700 1 -- start start 2024-05-27T09:47:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fb2200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10a980 0x7f0fac1a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fb2200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac10b2d0 0x7f0fac1a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fb2200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac110960 0x7f0fac1a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fb2200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac11aa60 con 0x7f0fac10a980 2024-05-27T09:47:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fb2200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac11a8e0 con 0x7f0fac110960 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fb2200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac11abe0 con 0x7f0fac10b2d0 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fab400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10a980 0x7f0fac1a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fab400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10a980 0x7f0fac1a1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53644/0 (socket says 172.21.15.71:53644) 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fab400700 1 -- 172.21.15.71:0/3101561225 learned_addr learned my addr 172.21.15.71:0/3101561225 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0faaa00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac10b2d0 0x7f0fac1a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.935+0000 7f0fabe00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac110960 0x7f0fac1a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fabe00700 1 -- 172.21.15.71:0/3101561225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac10b2d0 msgr2=0x7f0fac1a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fabe00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac10b2d0 0x7f0fac1a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fabe00700 1 -- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10a980 msgr2=0x7f0fac1a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fabe00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10a980 0x7f0fac1a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fabe00700 1 -- 172.21.15.71:0/3101561225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac1a6340 con 0x7f0fac110960 2024-05-27T09:47:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fab400700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10a980 0x7f0fac1a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fabe00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac110960 0x7f0fac1a5ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009cd0 tx=0x7f0fa400c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.936+0000 7f0fa3e00700 1 -- 172.21.15.71:0/3101561225 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400cd10 con 0x7f0fac110960 2024-05-27T09:47:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.937+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fac1a65d0 con 0x7f0fac110960 2024-05-27T09:47:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.937+0000 7f0fa3e00700 1 -- 172.21.15.71:0/3101561225 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fa4003a00 con 0x7f0fac110960 2024-05-27T09:47:25.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.937+0000 7f0fa3e00700 1 -- 172.21.15.71:0/3101561225 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4004520 con 0x7f0fac110960 2024-05-27T09:47:25.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.937+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fac1a6a90 con 0x7f0fac110960 2024-05-27T09:47:25.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.940+0000 7f0fa3e00700 1 -- 172.21.15.71:0/3101561225 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0fa401a020 con 0x7f0fac110960 2024-05-27T09:47:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.942+0000 7f0fc0c6cb80 1 Processor -- start 2024-05-27T09:47:25.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.942+0000 7f0fc0c6cb80 1 -- start start 2024-05-27T09:47:25.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec046f9a0 0x562ec05022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0502820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ec0430df0 con 0x562ec0502e20 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562ec0420990 con 0x562ec046f9a0 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ec04249d0 con 0x562ec0383df0 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fa3e00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f900b2880 0x7f0f900b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0faaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec046f9a0 0x562ec05022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0faaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec046f9a0 0x562ec05022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34656/0 (socket says 172.21.15.71:34656) 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0faaa00700 1 -- 172.21.15.71:0/2800165785 learned_addr learned my addr 172.21.15.71:0/2800165785 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0faaa00700 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fa3e00700 1 -- 172.21.15.71:0/3101561225 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0fa40e1b20 con 0x7f0fac110960 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.943+0000 7f0fab400700 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0502820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0fabe00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f900b2880 0x7f0f900b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0faaa00700 1 -- 172.21.15.71:0/2800165785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 msgr2=0x562ec0502820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0faaa00700 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0502820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0faaa00700 1 -- 172.21.15.71:0/2800165785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 msgr2=0x562ec050f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0faaa00700 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0faaa00700 1 -- 172.21.15.71:0/2800165785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec03e93d0 con 0x562ec046f9a0 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0fab400700 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0502820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.944+0000 7f0faaa00700 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec046f9a0 0x562ec05022e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f980098f0 tx=0x7f0f98019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851537cc53b1d905 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:25.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.945+0000 7f0fa0c00700 1 -- 172.21.15.71:0/2800165785 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800f460 con 0x562ec046f9a0 2024-05-27T09:47:25.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.945+0000 7f0fabe00700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f900b2880 0x7f0f900b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40a8df0 tx=0x7f0fa4009f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:25.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.945+0000 7f0fa0c00700 1 -- 172.21.15.71:0/2800165785 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f98005030 con 0x562ec046f9a0 2024-05-27T09:47:25.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.945+0000 7f0fa0c00700 1 -- 172.21.15.71:0/2800165785 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800b7c0 con 0x562ec046f9a0 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/2800165785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec046f9a0 msgr2=0x562ec05022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec046f9a0 0x562ec05022e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f980098f0 tx=0x7f0f98019040 comp rx=0 tx=0).stop 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/2800165785 shutdown_connections 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec046f9a0 0x562ec05022e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/2800165785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0502820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/2800165785 >> 172.21.15.71:0/2800165785 conn(0x562ec041d340 msgr2=0x562ec04fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/2800165785 shutdown_connections 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.946+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/2800165785 wait complete. 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.947+0000 7f0fc0c6cb80 1 -- start start 2024-05-27T09:47:25.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.947+0000 7f0fc0c6cb80 1 Processor -- start 2024-05-27T09:47:25.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec050c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec046f9a0 0x562ec050cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ec0326f50 con 0x562ec0502e20 2024-05-27T09:47:25.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562ec03c1710 con 0x562ec0383df0 2024-05-27T09:47:25.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ec050fad0 con 0x562ec046f9a0 2024-05-27T09:47:25.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fc0c6cb80 10 client.0 _ll_register_callbacks cb 0x562ec03cac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fab400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec046f9a0 0x562ec050cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0faaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec050c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fab400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec046f9a0 0x562ec050cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50806/0 (socket says 172.21.15.71:50806) 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0faaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec050c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34672/0 (socket says 172.21.15.71:34672) 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0fab400700 1 -- 172.21.15.71:0/1279811424 learned_addr learned my addr 172.21.15.71:0/1279811424 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.948+0000 7f0faaa00700 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0fab400700 1 -- 172.21.15.71:0/1279811424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 msgr2=0x562ec050c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0fab400700 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec050c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0fab400700 1 -- 172.21.15.71:0/1279811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 msgr2=0x562ec050d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0fab400700 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0fab400700 1 -- 172.21.15.71:0/1279811424 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec0370880 con 0x562ec046f9a0 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0fab400700 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec046f9a0 0x562ec050cb70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c011d10 tx=0x7f0f9c00f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f100251b3d0b95cb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:25.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0f95600700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:47:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.949+0000 7f0f95600700 1 -- 172.21.15.71:0/1279811424 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c01e020 con 0x562ec046f9a0 2024-05-27T09:47:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.950+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f98005030 con 0x562ec046f9a0 2024-05-27T09:47:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.950+0000 7f0f95600700 1 -- 172.21.15.71:0/1279811424 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0f9c004830 con 0x562ec046f9a0 2024-05-27T09:47:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.950+0000 7f0f95600700 1 -- 172.21.15.71:0/1279811424 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f9c00fe50 con 0x562ec046f9a0 2024-05-27T09:47:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.950+0000 7f0fc0c6cb80 10 client.24997 fetch_fsmap learned FSMap version 25 2024-05-27T09:47:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.950+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ec03f1010 con 0x562ec046f9a0 2024-05-27T09:47:25.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.950+0000 7f0f95600700 1 -- 172.21.15.71:0/1279811424 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f98005030 con 0x562ec046f9a0 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0f95600700 1 -- 172.21.15.71:0/1279811424 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f0f9c019070 con 0x562ec046f9a0 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0fc0c6cb80 10 client.24997 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0fc0c6cb80 10 client.24997 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0fc0c6cb80 20 client.24997 populate_metadata read hostname 'smithi071' 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec051cbd0 0x562ec051e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0fc0c6cb80 4 client.24997 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ec0432d40 con 0x562ec051cbd0 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.951+0000 7f0faaa00700 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec051cbd0 0x562ec051e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.952+0000 7f0f95600700 10 client.24997 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.952+0000 7f0faaa00700 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec051cbd0 0x562ec051e040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=32a4cb98f7d5f05 server_cookie=6b8ca88410e5f8b8 in_seq=0 out_seq=0 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0f95600700 1 -- 172.21.15.71:0/1279811424 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x562ec0432d40 con 0x562ec051cbd0 2024-05-27T09:47:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0f95600700 10 client.24997 handle_command_reply: tid=0 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 client.24997 shutdown 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec046f9a0 msgr2=0x562ec050cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec046f9a0 0x562ec050cb70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c011d10 tx=0x7f0f9c00f6a0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 shutdown_connections 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec051cbd0 0x562ec051e040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec0502e20 0x562ec050d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec050c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/1279811424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec046f9a0 0x562ec050cb70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 >> 172.21.15.71:0/1279811424 conn(0x562ec041d340 msgr2=0x562ec05022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0f95600700 0 client.24997 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 shutdown_connections 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.953+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/1279811424 wait complete. 2024-05-27T09:47:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.954+0000 7f0fc0c6cb80 20 client.24997 trim_cache size 0 max 16384 2024-05-27T09:47:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 Processor -- start 2024-05-27T09:47:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 -- start start 2024-05-27T09:47:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec0507e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec050b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0502e20 0x562ec0518e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ec051c380 con 0x562ec046f9a0 2024-05-27T09:47:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562ec051ca50 con 0x562ec0383df0 2024-05-27T09:47:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.977+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ec051d120 con 0x562ec0502e20 2024-05-27T09:47:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0faaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec0507e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec050b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec050b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53670/0 (socket says 172.21.15.71:53670) 2024-05-27T09:47:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 -- 172.21.15.71:0/3869614724 learned_addr learned my addr 172.21.15.71:0/3869614724 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0faaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec0507e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34686/0 (socket says 172.21.15.71:34686) 2024-05-27T09:47:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0faaa00700 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0502e20 0x562ec0518e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 -- 172.21.15.71:0/3869614724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0502e20 msgr2=0x562ec0518e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0502e20 0x562ec0518e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 -- 172.21.15.71:0/3869614724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 msgr2=0x562ec0507e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec0507e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.978+0000 7f0fab400700 1 -- 172.21.15.71:0/3869614724 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec051a5c0 con 0x562ec046f9a0 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.979+0000 7f0faaa00700 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0502e20 0x562ec0518e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.979+0000 7f0fab400700 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec050b590 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009690 tx=0x7f0f9c00fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97460bd1924e05c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.979+0000 7f0f97e00700 1 -- 172.21.15.71:0/3869614724 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c01a9a0 con 0x562ec046f9a0 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.979+0000 7f0f97e00700 1 -- 172.21.15.71:0/3869614724 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f9c0054f0 con 0x562ec046f9a0 2024-05-27T09:47:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.979+0000 7f0f97e00700 1 -- 172.21.15.71:0/3869614724 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c003d80 con 0x562ec046f9a0 2024-05-27T09:47:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.980+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/3869614724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 msgr2=0x562ec050b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.980+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec050b590 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009690 tx=0x7f0f9c00fa70 comp rx=0 tx=0).stop 2024-05-27T09:47:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.980+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/3869614724 shutdown_connections 2024-05-27T09:47:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.980+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0502e20 0x562ec0518e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.980+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0383df0 0x562ec0507e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.980+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/3869614724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec050b590 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.980+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/3869614724 >> 172.21.15.71:0/3869614724 conn(0x562ec041d340 msgr2=0x562ec0502060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.981+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/3869614724 shutdown_connections 2024-05-27T09:47:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.981+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/3869614724 wait complete. 2024-05-27T09:47:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.981+0000 7f0fc0c6cb80 1 -- start start 2024-05-27T09:47:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.981+0000 7f0fc0c6cb80 1 Processor -- start 2024-05-27T09:47:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0527c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec0524910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fc0c6cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0502e20 0x562ec0524ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ec051dec0 con 0x562ec046f9a0 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562ec051d7f0 con 0x562ec0502e20 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fc0c6cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ec051e590 con 0x562ec0383df0 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fc0c6cb80 10 client.0 _ll_register_callbacks cb 0x562ec03cac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fab400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec0524910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fab400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec0524910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53674/0 (socket says 172.21.15.71:53674) 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0fab400700 1 -- 172.21.15.71:0/4267062975 learned_addr learned my addr 172.21.15.71:0/4267062975 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0faaa00700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0527c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.982+0000 7f0faaa00700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0502e20 0x562ec0524ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0faaa00700 1 -- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 msgr2=0x562ec0527c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0faaa00700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0527c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0faaa00700 1 -- 172.21.15.71:0/4267062975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 msgr2=0x562ec0524910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0faaa00700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec0524910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0faaa00700 1 -- 172.21.15.71:0/4267062975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec0525690 con 0x562ec0502e20 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0fab400700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec0524910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0faaa00700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0502e20 0x562ec0524ef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f98005cd0 tx=0x7f0f98005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2adca9b2cea0145c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0f95600700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0f95600700 1 -- 172.21.15.71:0/4267062975 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9803e070 con 0x562ec0502e20 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f9c0054f0 con 0x562ec0502e20 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.983+0000 7f0f95600700 1 -- 172.21.15.71:0/4267062975 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0f98020040 con 0x562ec0502e20 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0f95600700 1 -- 172.21.15.71:0/4267062975 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f9800fbc0 con 0x562ec0502e20 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0fc0c6cb80 10 client.24998 fetch_fsmap learned FSMap version 25 2024-05-27T09:47:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ec0588360 con 0x562ec0502e20 2024-05-27T09:47:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0f95600700 1 -- 172.21.15.71:0/4267062975 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f9c0054f0 con 0x562ec0502e20 2024-05-27T09:47:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0f95600700 1 -- 172.21.15.71:0/4267062975 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f0f98026040 con 0x562ec0502e20 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0fc0c6cb80 10 client.24998 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0fc0c6cb80 10 client.24998 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0fc0c6cb80 20 client.24998 populate_metadata read hostname 'smithi071' 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.984+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec058a200 0x562ec058b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.985+0000 7f0fc0c6cb80 4 client.24998 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.985+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "status"}) -- 0x562ec042c520 con 0x562ec058a200 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.985+0000 7f0fab400700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec058a200 0x562ec058b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.985+0000 7f0f95600700 10 client.24998 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.985+0000 7f0fab400700 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec058a200 0x562ec058b670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ea0cd6d839c44c server_cookie=5ef0b95aa0708d4a in_seq=0 out_seq=0 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0f95600700 1 -- 172.21.15.71:0/4267062975 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x562ec042c520 con 0x562ec058a200 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0f95600700 10 client.24998 handle_command_reply: tid=0 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 client.24998 shutdown 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0502e20 msgr2=0x562ec0524ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0502e20 0x562ec0524ef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f98005cd0 tx=0x7f0f98005dc0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 shutdown_connections 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x562ec058a200 0x562ec058b670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ec0502e20 0x562ec0524ef0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ec0383df0 0x562ec0527c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0f95600700 0 client.24998 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 --2- 172.21.15.71:0/4267062975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ec046f9a0 0x562ec0524910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 >> 172.21.15.71:0/4267062975 conn(0x562ec041d340 msgr2=0x562ec0503e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 shutdown_connections 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 1 -- 172.21.15.71:0/4267062975 wait complete. 2024-05-27T09:47:25.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.986+0000 7f0fc0c6cb80 20 client.24998 trim_cache size 0 max 16384 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 2, 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24508, 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 197.71644916, 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 25, 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 83, 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 81, 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 249.54369815800001 2024-05-27T09:47:25.990 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:47:25.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f900b2880 msgr2=0x7f0f900b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f900b2880 0x7f0f900b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40a8df0 tx=0x7f0fa4009f30 comp rx=0 tx=0).stop 2024-05-27T09:47:25.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac110960 msgr2=0x7f0fac1a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:25.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac110960 0x7f0fac1a5ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009cd0 tx=0x7f0fa400c620 comp rx=0 tx=0).stop 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 shutdown_connections 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac110960 0x7f0fac1a5ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f0f900b2880 0x7f0f900b4d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fac10a980 0x7f0fac1a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 --2- 172.21.15.71:0/3101561225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac10b2d0 0x7f0fac1a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 >> 172.21.15.71:0/3101561225 conn(0x7f0fac077c70 msgr2=0x7f0fac07b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 shutdown_connections 2024-05-27T09:47:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:25.987+0000 7f0fb2200700 1 -- 172.21.15.71:0/3101561225 wait complete. 2024-05-27T09:47:26.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:26 smithi122 ceph-mon[36436]: pgmap v434: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:26.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:26 smithi071 ceph-mon[31451]: pgmap v434: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:26.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:26 smithi072 ceph-mon[35951]: pgmap v434: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-27T09:47:26.860 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.a status 2024-05-27T09:47:27.303 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:28 smithi071 ceph-mon[31451]: pgmap v435: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:28.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:28 smithi122 ceph-mon[36436]: pgmap v435: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:28.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:28 smithi072 ceph-mon[35951]: pgmap v435: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 -- 172.21.15.71:0/817421338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8108d20 msgr2=0x7f21f8109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 --2- 172.21.15.71:0/817421338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8108d20 0x7f21f8109130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009990 tx=0x7f21e4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 -- 172.21.15.71:0/817421338 shutdown_connections 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 --2- 172.21.15.71:0/817421338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f8109670 0x7f21f8110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 --2- 172.21.15.71:0/817421338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21f81043f0 0x7f21f8104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 --2- 172.21.15.71:0/817421338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8108d20 0x7f21f8109130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 -- 172.21.15.71:0/817421338 >> 172.21.15.71:0/817421338 conn(0x7f21f8079d00 msgr2=0x7f21f807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 -- 172.21.15.71:0/817421338 shutdown_connections 2024-05-27T09:47:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.481+0000 7f21f7e00700 1 -- 172.21.15.71:0/817421338 wait complete. 2024-05-27T09:47:29.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 Processor -- start 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 -- start start 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f81043f0 0x7f21f819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21f8108d20 0x7f21f819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8109670 0x7f21f81a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21f81142f0 con 0x7f21f8108d20 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8114170 con 0x7f21f8109670 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.483+0000 7f21f7e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8114470 con 0x7f21f81043f0 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f81043f0 0x7f21f819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21f8108d20 0x7f21f819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f81043f0 0x7f21f819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50854/0 (socket says 172.21.15.71:50854) 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 -- 172.21.15.71:0/1911498072 learned_addr learned my addr 172.21.15.71:0/1911498072 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:29.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f7400700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8109670 0x7f21f81a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 -- 172.21.15.71:0/1911498072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8109670 msgr2=0x7f21f81a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8109670 0x7f21f81a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 -- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21f8108d20 msgr2=0x7f21f819d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21f8108d20 0x7f21f819d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 -- 172.21.15.71:0/1911498072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f81a1d30 con 0x7f21f81043f0 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.484+0000 7f21f6a00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f81043f0 0x7f21f819ce60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f21e800d950 tx=0x7f21e800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.485+0000 7f21fca00700 1 -- 172.21.15.71:0/1911498072 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8016070 con 0x7f21f81043f0 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.485+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f81a2020 con 0x7f21f81043f0 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.485+0000 7f21fca00700 1 -- 172.21.15.71:0/1911498072 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e800fd40 con 0x7f21f81043f0 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.485+0000 7f21fca00700 1 -- 172.21.15.71:0/1911498072 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e800e3b0 con 0x7f21f81043f0 2024-05-27T09:47:29.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.485+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f81a9940 con 0x7f21f81043f0 2024-05-27T09:47:29.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.488+0000 7f21fca00700 1 -- 172.21.15.71:0/1911498072 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f21e8019070 con 0x7f21f81043f0 2024-05-27T09:47:29.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.491+0000 7f21fca00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21dc0b2880 0x7f21dc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.491+0000 7f220c92cb80 1 Processor -- start 2024-05-27T09:47:29.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.491+0000 7f21fca00700 1 -- 172.21.15.71:0/1911498072 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f21e80e1f80 con 0x7f21f81043f0 2024-05-27T09:47:29.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.491+0000 7f220c92cb80 1 -- start start 2024-05-27T09:47:29.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.491+0000 7f21f6000700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21dc0b2880 0x7f21dc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328eda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e37d0 0x55f4328effd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f220c92cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f432811df0 con 0x55f432764df0 2024-05-27T09:47:29.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f220c92cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f432801990 con 0x55f4328e33c0 2024-05-27T09:47:29.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f220c92cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f4328059d0 con 0x55f4328e37d0 2024-05-27T09:47:29.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f21f6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f21f6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f21f6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328e2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53694/0 (socket says 172.21.15.71:53694) 2024-05-27T09:47:29.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f21f6a00700 1 -- 172.21.15.71:0/259049085 learned_addr learned my addr 172.21.15.71:0/259049085 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:29.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f21f6000700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21dc0b2880 0x7f21dc0b4d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f21f807a150 tx=0x7f21e400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:29.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.492+0000 7f21f7400700 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e37d0 0x55f4328effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f6000700 1 -- 172.21.15.71:0/259049085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e37d0 msgr2=0x55f4328effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f6000700 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e37d0 0x55f4328effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f6000700 1 -- 172.21.15.71:0/259049085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 msgr2=0x55f4328e2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f6000700 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328e2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f6000700 1 -- 172.21.15.71:0/259049085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4327ca3d0 con 0x55f4328e33c0 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f7400700 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e37d0 0x55f4328effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f6a00700 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328e2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21f6000700 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328eda80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21e40098e0 tx=0x7f21e401e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c3ecda5ad657dbd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21ecc00700 1 -- 172.21.15.71:0/259049085 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4003680 con 0x55f4328e33c0 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21ecc00700 1 -- 172.21.15.71:0/259049085 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e4003cd0 con 0x55f4328e33c0 2024-05-27T09:47:29.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.493+0000 7f21ecc00700 1 -- 172.21.15.71:0/259049085 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e400fc00 con 0x55f4328e33c0 2024-05-27T09:47:29.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 -- 172.21.15.71:0/259049085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 msgr2=0x55f4328eda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328eda80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21e40098e0 tx=0x7f21e401e000 comp rx=0 tx=0).stop 2024-05-27T09:47:29.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 -- 172.21.15.71:0/259049085 shutdown_connections 2024-05-27T09:47:29.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e37d0 0x55f4328effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328e2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 --2- 172.21.15.71:0/259049085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328eda80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 -- 172.21.15.71:0/259049085 >> 172.21.15.71:0/259049085 conn(0x55f4327c4f70 msgr2=0x55f4328dece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:29.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 -- 172.21.15.71:0/259049085 shutdown_connections 2024-05-27T09:47:29.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.494+0000 7f220c92cb80 1 -- 172.21.15.71:0/259049085 wait complete. 2024-05-27T09:47:29.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.495+0000 7f220c92cb80 1 -- start start 2024-05-27T09:47:29.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.495+0000 7f220c92cb80 1 Processor -- start 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328ed590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e33c0 0x55f4328edad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e37d0 0x55f4328ee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f220c92cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f432707f50 con 0x55f432764df0 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f220c92cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f4327a2710 con 0x55f4328e37d0 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f220c92cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f4328f08e0 con 0x55f4328e33c0 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f220c92cb80 10 client.0 _ll_register_callbacks cb 0x55f4327abc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f21f7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e37d0 0x55f4328ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f21f6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f21f7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e37d0 0x55f4328ee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34726/0 (socket says 172.21.15.71:34726) 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f21f7400700 1 -- 172.21.15.71:0/1626244365 learned_addr learned my addr 172.21.15.71:0/1626244365 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.496+0000 7f21f6000700 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e33c0 0x55f4328edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21f7400700 1 -- 172.21.15.71:0/1626244365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e33c0 msgr2=0x55f4328edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21f7400700 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e33c0 0x55f4328edad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21f7400700 1 -- 172.21.15.71:0/1626244365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 msgr2=0x55f4328ed590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21f7400700 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328ed590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21f7400700 1 -- 172.21.15.71:0/1626244365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f432751880 con 0x55f4328e37d0 2024-05-27T09:47:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21f7400700 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e37d0 0x55f4328ee010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21f0007be0 tx=0x7f21f0007c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db6c251dc45eae6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21e1600700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:47:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21e1600700 1 -- 172.21.15.71:0/1626244365 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f001a030 con 0x55f4328e37d0 2024-05-27T09:47:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f21e1600700 1 -- 172.21.15.71:0/1626244365 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f21f0004bb0 con 0x55f4328e37d0 2024-05-27T09:47:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.497+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21e4003cd0 con 0x55f4328e37d0 2024-05-27T09:47:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f21e1600700 1 -- 172.21.15.71:0/1626244365 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21f0026050 con 0x55f4328e37d0 2024-05-27T09:47:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 10 client.25010 fetch_fsmap learned FSMap version 25 2024-05-27T09:47:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f4327d2010 con 0x55f4328e37d0 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f21e1600700 1 -- 172.21.15.71:0/1626244365 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e4003cd0 con 0x55f4328e37d0 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f21e1600700 1 -- 172.21.15.71:0/1626244365 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f21f0016970 con 0x55f4328e37d0 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 10 client.25010 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 10 client.25010 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 20 client.25010 populate_metadata read hostname 'smithi071' 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f4328fd900 0x55f4328fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 4 client.25010 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.498+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f432813d40 con 0x55f4328fd900 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.499+0000 7f21f6a00700 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f4328fd900 0x55f4328fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.499+0000 7f21f6a00700 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f4328fd900 0x55f4328fed70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9e77c04896055e32 server_cookie=ad368e59fc9ff2e1 in_seq=0 out_seq=0 2024-05-27T09:47:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.499+0000 7f21e1600700 10 client.25010 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:47:29.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f21e1600700 1 -- 172.21.15.71:0/1626244365 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f432813d40 con 0x55f4328fd900 2024-05-27T09:47:29.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f21e1600700 10 client.25010 handle_command_reply: tid=0 2024-05-27T09:47:29.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 client.25010 shutdown 2024-05-27T09:47:29.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e37d0 msgr2=0x55f4328ee010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e37d0 0x55f4328ee010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21f0007be0 tx=0x7f21f0007c10 comp rx=0 tx=0).stop 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 shutdown_connections 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f4328fd900 0x55f4328fed70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e37d0 0x55f4328ee010 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f432764df0 0x55f4328ed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 --2- 172.21.15.71:0/1626244365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f4328e33c0 0x55f4328edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f21e1600700 0 client.25010 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.500+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 >> 172.21.15.71:0/1626244365 conn(0x55f4327c4f70 msgr2=0x55f4328ddfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.501+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 shutdown_connections 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.501+0000 7f220c92cb80 1 -- 172.21.15.71:0/1626244365 wait complete. 2024-05-27T09:47:29.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.501+0000 7f220c92cb80 20 client.25010 trim_cache size 0 max 16384 2024-05-27T09:47:29.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 Processor -- start 2024-05-27T09:47:29.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 -- start start 2024-05-27T09:47:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f4328e8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f4328de770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f4328fd0b0 con 0x55f4328e37d0 2024-05-27T09:47:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f4328fd780 con 0x55f4328e33c0 2024-05-27T09:47:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f220c92cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f4328fde50 con 0x55f432764df0 2024-05-27T09:47:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.525+0000 7f21f6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328e7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34742/0 (socket says 172.21.15.71:34742) 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 -- 172.21.15.71:0/2928676066 learned_addr learned my addr 172.21.15.71:0/2928676066 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6a00700 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f4328e8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f7400700 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f4328de770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 -- 172.21.15.71:0/2928676066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 msgr2=0x55f4328e8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f4328e8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 -- 172.21.15.71:0/2928676066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 msgr2=0x55f4328de770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f4328de770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 -- 172.21.15.71:0/2928676066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4328d9180 con 0x55f4328e33c0 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f7400700 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f4328de770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:47:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.526+0000 7f21f6000700 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328e7750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55f4328e0000 tx=0x7f21e4009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd56b06417624f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.527+0000 7f21e3e00700 1 -- 172.21.15.71:0/2928676066 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4037070 con 0x55f4328e33c0 2024-05-27T09:47:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.527+0000 7f21e3e00700 1 -- 172.21.15.71:0/2928676066 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e4003bb0 con 0x55f4328e33c0 2024-05-27T09:47:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.527+0000 7f21e3e00700 1 -- 172.21.15.71:0/2928676066 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e400fc50 con 0x55f4328e33c0 2024-05-27T09:47:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 -- 172.21.15.71:0/2928676066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 msgr2=0x55f4328e7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328e7750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55f4328e0000 tx=0x7f21e4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 -- 172.21.15.71:0/2928676066 shutdown_connections 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f4328de770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f4328e8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 --2- 172.21.15.71:0/2928676066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f4328e7750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 -- 172.21.15.71:0/2928676066 >> 172.21.15.71:0/2928676066 conn(0x55f4327c4f70 msgr2=0x55f4328ebe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 -- 172.21.15.71:0/2928676066 shutdown_connections 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 -- 172.21.15.71:0/2928676066 wait complete. 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.528+0000 7f220c92cb80 1 -- start start 2024-05-27T09:47:29.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 1 Processor -- start 2024-05-27T09:47:29.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f432906020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f432906560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f432901770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f4328febf0 con 0x55f4328e37d0 2024-05-27T09:47:29.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f4328fe520 con 0x55f4328e33c0 2024-05-27T09:47:29.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f4328ff2c0 con 0x55f432764df0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f220c92cb80 10 client.0 _ll_register_callbacks cb 0x55f4327abc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f21f6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f432906560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f21f6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f432906560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34758/0 (socket says 172.21.15.71:34758) 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f21f6000700 1 -- 172.21.15.71:0/4063952385 learned_addr learned my addr 172.21.15.71:0/4063952385 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.529+0000 7f21f7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f432901770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6a00700 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f432906020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6000700 1 -- 172.21.15.71:0/4063952385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 msgr2=0x55f432906020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6000700 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f432906020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6000700 1 -- 172.21.15.71:0/4063952385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 msgr2=0x55f432901770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6000700 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f432901770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6000700 1 -- 172.21.15.71:0/4063952385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f432901d60 con 0x55f4328e33c0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6a00700 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f432906020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21f6000700 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f432906560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f21e40056f0 tx=0x7f21e400bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f90ab9b27c0d20 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21e1600700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:47:29.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21e1600700 1 -- 172.21.15.71:0/4063952385 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4040070 con 0x55f4328e33c0 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f21e1600700 1 -- 172.21.15.71:0/4063952385 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f21e400f7f0 con 0x55f4328e33c0 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.530+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21e4003bb0 con 0x55f4328e33c0 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f21e1600700 1 -- 172.21.15.71:0/4063952385 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21e4037040 con 0x55f4328e33c0 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 10 client.25016 fetch_fsmap learned FSMap version 25 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f4329055c0 con 0x55f4328e33c0 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f21e1600700 1 -- 172.21.15.71:0/4063952385 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e4003bb0 con 0x55f4328e33c0 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f21e1600700 1 -- 172.21.15.71:0/4063952385 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f21e4022070 con 0x55f4328e33c0 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 10 client.25016 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 10 client.25016 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 20 client.25016 populate_metadata read hostname 'smithi071' 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f432905850 0x55f432974290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 4 client.25016 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:47:29.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.531+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "status"}) -- 0x55f43280d520 con 0x55f432905850 2024-05-27T09:47:29.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.532+0000 7f21f6a00700 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f432905850 0x55f432974290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.532+0000 7f21e1600700 10 client.25016 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.532+0000 7f21f6a00700 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f432905850 0x55f432974290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cd0f4d441b1ef6 server_cookie=82f94e57ef29bdae in_seq=0 out_seq=0 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.532+0000 7f21e1600700 1 -- 172.21.15.71:0/4063952385 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f43280d520 con 0x55f432905850 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.532+0000 7f21e1600700 10 client.25016 handle_command_reply: tid=0 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.532+0000 7f220c92cb80 1 client.25016 shutdown 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 msgr2=0x55f432906560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f432906560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f21e40056f0 tx=0x7f21e400bef0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 shutdown_connections 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55f432905850 0x55f432974290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4328e37d0 0x55f432901770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f432764df0 0x55f432906020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 --2- 172.21.15.71:0/4063952385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f4328e33c0 0x55f432906560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 >> 172.21.15.71:0/4063952385 conn(0x55f4327c4f70 msgr2=0x55f4328eba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f21e1600700 0 client.25016 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 shutdown_connections 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 1 -- 172.21.15.71:0/4063952385 wait complete. 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.533+0000 7f220c92cb80 20 client.25016 trim_cache size 0 max 16384 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 1, 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24518, 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 202.27330795699999, 2024-05-27T09:47:29.536 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 25, 2024-05-27T09:47:29.537 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 83, 2024-05-27T09:47:29.537 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 81, 2024-05-27T09:47:29.537 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 243.91486354099999 2024-05-27T09:47:29.537 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:47:29.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21dc0b2880 msgr2=0x7f21dc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21dc0b2880 0x7f21dc0b4d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f21f807a150 tx=0x7f21e400b260 comp rx=0 tx=0).stop 2024-05-27T09:47:29.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f81043f0 msgr2=0x7f21f819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f81043f0 0x7f21f819ce60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f21e800d950 tx=0x7f21e800dc60 comp rx=0 tx=0).stop 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 shutdown_connections 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f8109670 0x7f21f81a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21f81043f0 0x7f21f819ce60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f21dc0b2880 0x7f21dc0b4d90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 --2- 172.21.15.71:0/1911498072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21f8108d20 0x7f21f819d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 >> 172.21.15.71:0/1911498072 conn(0x7f21f8079d00 msgr2=0x7f21f8101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 shutdown_connections 2024-05-27T09:47:29.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:29.534+0000 7f21f7e00700 1 -- 172.21.15.71:0/1911498072 wait complete. 2024-05-27T09:47:30.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-05-27T09:47:30.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:30 smithi122 ceph-mon[36436]: pgmap v436: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:30.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:30 smithi071 ceph-mon[31451]: pgmap v436: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:30.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:30 smithi072 ceph-mon[35951]: pgmap v436: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-27T09:47:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:32.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:32 smithi071 ceph-mon[31451]: pgmap v437: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:32.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:32 smithi072 ceph-mon[35951]: pgmap v437: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:32 smithi122 ceph-mon[36436]: pgmap v437: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 -- 172.21.15.71:0/4057541558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014076440 msgr2=0x7fb0141106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 --2- 172.21.15.71:0/4057541558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014076440 0x7fb0141106d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb000009990 tx=0x7fb000009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 -- 172.21.15.71:0/4057541558 shutdown_connections 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 --2- 172.21.15.71:0/4057541558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014110c10 0x7fb014113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 --2- 172.21.15.71:0/4057541558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014075af0 0x7fb014075f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 --2- 172.21.15.71:0/4057541558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014076440 0x7fb0141106d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 -- 172.21.15.71:0/4057541558 >> 172.21.15.71:0/4057541558 conn(0x7fb01407af60 msgr2=0x7fb01407b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 -- 172.21.15.71:0/4057541558 shutdown_connections 2024-05-27T09:47:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.211+0000 7fb01b800700 1 -- 172.21.15.71:0/4057541558 wait complete. 2024-05-27T09:47:33.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.212+0000 7fb01b800700 1 Processor -- start 2024-05-27T09:47:33.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.213+0000 7fb01b800700 1 -- start start 2024-05-27T09:47:33.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.213+0000 7fb01b800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014075af0 0x7fb01419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.213+0000 7fb01b800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014076440 0x7fb01419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.213+0000 7fb01b800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014110c10 0x7fb0141a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.213+0000 7fb01b800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb014116670 con 0x7fb014076440 2024-05-27T09:47:33.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.213+0000 7fb01b800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb0141164f0 con 0x7fb014075af0 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.213+0000 7fb01b800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0141167f0 con 0x7fb014110c10 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb013e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014076440 0x7fb01419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014075af0 0x7fb01419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014075af0 0x7fb01419d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34772/0 (socket says 172.21.15.71:34772) 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 -- 172.21.15.71:0/4167554005 learned_addr learned my addr 172.21.15.71:0/4167554005 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb019800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014110c10 0x7fb0141a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 -- 172.21.15.71:0/4167554005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014110c10 msgr2=0x7fb0141a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014110c10 0x7fb0141a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 -- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014076440 msgr2=0x7fb01419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014076440 0x7fb01419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 -- 172.21.15.71:0/4167554005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0141a1f10 con 0x7fb014075af0 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb013e00700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014076440 0x7fb01419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.214+0000 7fb018e00700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014075af0 0x7fb01419d040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e9a0 tx=0x7fb00800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.215+0000 7fb011600700 1 -- 172.21.15.71:0/4167554005 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00800ca10 con 0x7fb014075af0 2024-05-27T09:47:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.215+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0141a2200 con 0x7fb014075af0 2024-05-27T09:47:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.215+0000 7fb011600700 1 -- 172.21.15.71:0/4167554005 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb00800cbb0 con 0x7fb014075af0 2024-05-27T09:47:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.215+0000 7fb011600700 1 -- 172.21.15.71:0/4167554005 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008018680 con 0x7fb014075af0 2024-05-27T09:47:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.215+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0141a9b20 con 0x7fb014075af0 2024-05-27T09:47:33.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.219+0000 7fb011600700 1 -- 172.21.15.71:0/4167554005 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb008010430 con 0x7fb014075af0 2024-05-27T09:47:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.220+0000 7fb02a2c3b80 1 Processor -- start 2024-05-27T09:47:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.220+0000 7fb02a2c3b80 1 -- start start 2024-05-27T09:47:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c366b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36780c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5607c3599df0 con 0x5607c366be20 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5607c3589990 con 0x5607c35d89a0 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5607c358d9d0 con 0x5607c34ecdf0 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb013e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb019800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb018e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c366b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb011600700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7faffc0b2880 0x7faffc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb019800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34786/0 (socket says 172.21.15.71:34786) 2024-05-27T09:47:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.221+0000 7fb019800700 1 -- 172.21.15.71:0/2139932082 learned_addr learned my addr 172.21.15.71:0/2139932082 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb011600700 1 -- 172.21.15.71:0/4167554005 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fb0080e23b0 con 0x7fb014075af0 2024-05-27T09:47:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb013e00700 1 -- 172.21.15.71:0/2139932082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 msgr2=0x5607c366b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb013e00700 1 --2- 172.21.15.71:0/2139932082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c366b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb013e00700 1 -- 172.21.15.71:0/2139932082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 msgr2=0x5607c366b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb019800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7faffc0b2880 0x7faffc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb013e00700 1 --2- 172.21.15.71:0/2139932082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb013e00700 1 -- 172.21.15.71:0/2139932082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607c35523d0 con 0x5607c366be20 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.222+0000 7fb013e00700 1 --2- 172.21.15.71:0/2139932082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36780c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb000006010 tx=0x7fb0000096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2634bdfc08b0775 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.223+0000 7fb006000700 1 -- 172.21.15.71:0/2139932082 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000005270 con 0x5607c366be20 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.223+0000 7fb019800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7faffc0b2880 0x7faffc0b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5607c366dfa0 tx=0x7fb00c004b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.223+0000 7fb006000700 1 -- 172.21.15.71:0/2139932082 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb000005410 con 0x5607c366be20 2024-05-27T09:47:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.223+0000 7fb006000700 1 -- 172.21.15.71:0/2139932082 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00000f660 con 0x5607c366be20 2024-05-27T09:47:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/2139932082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 msgr2=0x5607c36780c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/2139932082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36780c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb000006010 tx=0x7fb0000096a0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/2139932082 shutdown_connections 2024-05-27T09:47:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/2139932082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36780c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/2139932082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/2139932082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c366b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/2139932082 >> 172.21.15.71:0/2139932082 conn(0x5607c3586340 msgr2=0x5607c3667470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/2139932082 shutdown_connections 2024-05-27T09:47:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.224+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/2139932082 wait complete. 2024-05-27T09:47:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.225+0000 7fb02a2c3b80 1 -- start start 2024-05-27T09:47:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.225+0000 7fb02a2c3b80 1 Processor -- start 2024-05-27T09:47:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c3675590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c35d89a0 0x5607c3675ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c366be20 0x5607c3676010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5607c348ff50 con 0x5607c35d89a0 2024-05-27T09:47:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5607c352a710 con 0x5607c34ecdf0 2024-05-27T09:47:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5607c3678a70 con 0x5607c366be20 2024-05-27T09:47:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb02a2c3b80 10 client.0 _ll_register_callbacks cb 0x5607c3533c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:47:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb013e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c35d89a0 0x5607c3675ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb013e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c35d89a0 0x5607c3675ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53754/0 (socket says 172.21.15.71:53754) 2024-05-27T09:47:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb013e00700 1 -- 172.21.15.71:0/3685880722 learned_addr learned my addr 172.21.15.71:0/3685880722 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb019800700 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c366be20 0x5607c3676010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.226+0000 7fb018e00700 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c3675590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7fb018e00700 1 -- 172.21.15.71:0/3685880722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c366be20 msgr2=0x5607c3676010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7fb018e00700 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c366be20 0x5607c3676010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7fb018e00700 1 -- 172.21.15.71:0/3685880722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c35d89a0 msgr2=0x5607c3675ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7fb018e00700 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c35d89a0 0x5607c3675ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7fb018e00700 1 -- 172.21.15.71:0/3685880722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607c34d9880 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7fb018e00700 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c3675590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c2d0 tx=0x7fb0080a9ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e7be0acd3c82bfd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7faffaa00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7faffaa00700 1 -- 172.21.15.71:0/3685880722 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0080aa080 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7faffaa00700 1 -- 172.21.15.71:0/3685880722 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fb0080cc0b0 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb000005410 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.227+0000 7faffaa00700 1 -- 172.21.15.71:0/3685880722 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb0080cc2b0 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 10 client.25028 fetch_fsmap learned FSMap version 25 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5607c355a010 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7faffaa00700 1 -- 172.21.15.71:0/3685880722 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb000005410 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7faffaa00700 1 -- 172.21.15.71:0/3685880722 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fb0080a8d00 con 0x5607c34ecdf0 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 10 client.25028 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 10 client.25028 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 20 client.25028 populate_metadata read hostname 'smithi071' 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36859c0 0x5607c3686e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 4 client.25028 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:47:33.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.228+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607c359bd40 con 0x5607c36859c0 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.229+0000 7fb013e00700 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36859c0 0x5607c3686e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.229+0000 7fb013e00700 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36859c0 0x5607c3686e30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5bcf43799ac6e2 server_cookie=ae32f2466cb9adf in_seq=0 out_seq=0 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.229+0000 7faffaa00700 10 client.25028 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7faffaa00700 1 -- 172.21.15.71:0/3685880722 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5607c359bd40 con 0x5607c36859c0 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7faffaa00700 10 client.25028 handle_command_reply: tid=0 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 client.25028 shutdown 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 msgr2=0x5607c3675590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c3675590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c2d0 tx=0x7fb0080a9ec0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 shutdown_connections 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36859c0 0x5607c3686e30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c366be20 0x5607c3676010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c3675590 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3685880722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c35d89a0 0x5607c3675ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7faffaa00700 0 client.25028 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:47:33.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.230+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 >> 172.21.15.71:0/3685880722 conn(0x5607c3586340 msgr2=0x5607c366b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:33.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.231+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 shutdown_connections 2024-05-27T09:47:33.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.231+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3685880722 wait complete. 2024-05-27T09:47:33.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.231+0000 7fb02a2c3b80 20 client.25028 trim_cache size 0 max 16384 2024-05-27T09:47:33.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.254+0000 7fb02a2c3b80 1 Processor -- start 2024-05-27T09:47:33.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.254+0000 7fb02a2c3b80 1 -- start start 2024-05-27T09:47:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c36744f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c35d89a0 0x5607c3681d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c3670d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5607c3685170 con 0x5607c366be20 2024-05-27T09:47:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5607c3685840 con 0x5607c34ecdf0 2024-05-27T09:47:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5607c3685f10 con 0x5607c35d89a0 2024-05-27T09:47:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb019800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c3670d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb013e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c35d89a0 0x5607c3681d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb019800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c3670d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53766/0 (socket says 172.21.15.71:53766) 2024-05-27T09:47:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb019800700 1 -- 172.21.15.71:0/3214461779 learned_addr learned my addr 172.21.15.71:0/3214461779 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.255+0000 7fb018e00700 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c36744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb013e00700 1 -- 172.21.15.71:0/3214461779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 msgr2=0x5607c36744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb013e00700 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c36744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb013e00700 1 -- 172.21.15.71:0/3214461779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 msgr2=0x5607c3670d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb013e00700 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c3670d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb013e00700 1 -- 172.21.15.71:0/3214461779 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607c366ca00 con 0x5607c35d89a0 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb013e00700 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c35d89a0 0x5607c3681d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0000098e0 tx=0x7fb000000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b60755c15f039657 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb005600700 1 -- 172.21.15.71:0/3214461779 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000005150 con 0x5607c35d89a0 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb005600700 1 -- 172.21.15.71:0/3214461779 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb000003b30 con 0x5607c35d89a0 2024-05-27T09:47:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.256+0000 7fb005600700 1 -- 172.21.15.71:0/3214461779 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00000f910 con 0x5607c35d89a0 2024-05-27T09:47:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3214461779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c35d89a0 msgr2=0x5607c3681d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c35d89a0 0x5607c3681d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0000098e0 tx=0x7fb000000bc0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3214461779 shutdown_connections 2024-05-27T09:47:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c3670d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c34ecdf0 0x5607c36744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/3214461779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c35d89a0 0x5607c3681d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3214461779 >> 172.21.15.71:0/3214461779 conn(0x5607c3586340 msgr2=0x5607c366b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.257+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3214461779 shutdown_connections 2024-05-27T09:47:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.258+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/3214461779 wait complete. 2024-05-27T09:47:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.258+0000 7fb02a2c3b80 1 -- start start 2024-05-27T09:47:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.258+0000 7fb02a2c3b80 1 Processor -- start 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c3690940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb02a2c3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5607c3686cb0 con 0x5607c366be20 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5607c36865e0 con 0x5607c35d89a0 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb02a2c3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5607c3687380 con 0x5607c34ecdf0 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb02a2c3b80 10 client.0 _ll_register_callbacks cb 0x5607c3533c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c3690940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb019800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb013e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c3690940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50952/0 (socket says 172.21.15.71:50952) 2024-05-27T09:47:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 -- 172.21.15.71:0/1966402325 learned_addr learned my addr 172.21.15.71:0/1966402325 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 -- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 msgr2=0x5607c366fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 -- 172.21.15.71:0/1966402325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 msgr2=0x5607c36702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb018e00700 1 -- 172.21.15.71:0/1966402325 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607c36709d0 con 0x5607c34ecdf0 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.259+0000 7fb013e00700 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7fb018e00700 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c3690940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb008000c00 tx=0x7fb0080a8df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5bc5800a97d5f05 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7faffaa00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7faffaa00700 1 -- 172.21.15.71:0/1966402325 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0080aa080 con 0x5607c34ecdf0 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7faffaa00700 1 -- 172.21.15.71:0/1966402325 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fb0080a5f70 con 0x5607c34ecdf0 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb000003b30 con 0x5607c34ecdf0 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7faffaa00700 1 -- 172.21.15.71:0/1966402325 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb0080a9980 con 0x5607c34ecdf0 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7fb02a2c3b80 10 client.25036 fetch_fsmap learned FSMap version 25 2024-05-27T09:47:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5607c36f1150 con 0x5607c34ecdf0 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.260+0000 7faffaa00700 1 -- 172.21.15.71:0/1966402325 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb000003b30 con 0x5607c34ecdf0 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7faffaa00700 1 -- 172.21.15.71:0/1966402325 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fb0080c6080 con 0x5607c34ecdf0 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7fb02a2c3b80 10 client.25036 fetch_fsmap finished waiting for FSMap version 25 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7fb02a2c3b80 10 client.25036 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7fb02a2c3b80 20 client.25036 populate_metadata read hostname 'smithi071' 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36f3280 0x5607c36f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7fb02a2c3b80 4 client.25036 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:47:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "status"}) -- 0x5607c3595520 con 0x5607c36f3280 2024-05-27T09:47:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.261+0000 7fb013e00700 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36f3280 0x5607c36f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7faffaa00700 10 client.25036 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:47:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb013e00700 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36f3280 0x5607c36f46f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9418b8117592819 server_cookie=f9ecd5326f924a98 in_seq=0 out_seq=0 2024-05-27T09:47:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7faffaa00700 1 -- 172.21.15.71:0/1966402325 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5607c3595520 con 0x5607c36f3280 2024-05-27T09:47:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7faffaa00700 10 client.25036 handle_command_reply: tid=0 2024-05-27T09:47:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 client.25036 shutdown 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 msgr2=0x5607c3690940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c3690940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb008000c00 tx=0x7fb0080a8df0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 shutdown_connections 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5607c36f3280 0x5607c36f46f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607c366be20 0x5607c36702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5607c34ecdf0 0x5607c3690940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7faffaa00700 0 client.25036 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 --2- 172.21.15.71:0/1966402325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607c35d89a0 0x5607c366fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.262+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 >> 172.21.15.71:0/1966402325 conn(0x5607c3586340 msgr2=0x5607c366ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.263+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 shutdown_connections 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.263+0000 7fb02a2c3b80 1 -- 172.21.15.71:0/1966402325 wait complete. 2024-05-27T09:47:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.263+0000 7fb02a2c3b80 20 client.25036 trim_cache size 0 max 16384 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24530, 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 221.42972979199999, 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 25, 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 83, 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 81, 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 245.030703526 2024-05-27T09:47:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.263+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7faffc0b2880 msgr2=0x7faffc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.263+0000 7fb01b800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7faffc0b2880 0x7faffc0b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5607c366dfa0 tx=0x7fb00c004b40 comp rx=0 tx=0).stop 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.263+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014075af0 msgr2=0x7fb01419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.263+0000 7fb01b800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014075af0 0x7fb01419d040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e9a0 tx=0x7fb00800ecb0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 shutdown_connections 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb014110c10 0x7fb0141a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb014075af0 0x7fb01419d040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7faffc0b2880 0x7faffc0b4d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 --2- 172.21.15.71:0/4167554005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014076440 0x7fb01419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 >> 172.21.15.71:0/4167554005 conn(0x7fb01407af60 msgr2=0x7fb014101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 shutdown_connections 2024-05-27T09:47:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:33.264+0000 7fb01b800700 1 -- 172.21.15.71:0/4167554005 wait complete. 2024-05-27T09:47:34.069 INFO:teuthology.run_tasks:Running task sequential... 2024-05-27T09:47:34.078 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-27T09:47:34.078 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-27T09:47:34.078 INFO:teuthology.task.print:Enabling mgr modules 2024-05-27T09:47:34.079 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-05-27T09:47:34.079 INFO:teuthology.task.exec:Executing custom commands... 2024-05-27T09:47:34.079 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:47:34.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-05-27T09:47:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 -- 172.21.15.71:0/3239689829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc103b80 msgr2=0x7fc2fc104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 --2- 172.21.15.71:0/3239689829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc103b80 0x7fc2fc104880 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009900 tx=0x7fc2ec02a410 comp rx=0 tx=0).stop 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 -- 172.21.15.71:0/3239689829 shutdown_connections 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 --2- 172.21.15.71:0/3239689829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc109ac0 0x7fc2fc10bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 --2- 172.21.15.71:0/3239689829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2fc104dc0 0x7fc2fc1051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 --2- 172.21.15.71:0/3239689829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc103b80 0x7fc2fc104880 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 -- 172.21.15.71:0/3239689829 >> 172.21.15.71:0/3239689829 conn(0x7fc2fc0fed70 msgr2=0x7fc2fc101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 -- 172.21.15.71:0/3239689829 shutdown_connections 2024-05-27T09:47:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.364+0000 7fc301a00640 1 -- 172.21.15.71:0/3239689829 wait complete. 2024-05-27T09:47:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.365+0000 7fc301a00640 1 Processor -- start 2024-05-27T09:47:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.365+0000 7fc301a00640 1 -- start start 2024-05-27T09:47:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc301a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc103b80 0x7fc2fc19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc301a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc104dc0 0x7fc2fc19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc301a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2fc109ac0 0x7fc2fc1a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc301a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc10f5d0 con 0x7fc2fc104dc0 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc301a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc10f450 con 0x7fc2fc103b80 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc301a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc10f750 con 0x7fc2fc109ac0 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc2f3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc104dc0 0x7fc2fc19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc2f3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc104dc0 0x7fc2fc19c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38080/0 (socket says 172.21.15.71:38080) 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc2f3e00640 1 -- 172.21.15.71:0/3587008923 learned_addr learned my addr 172.21.15.71:0/3587008923 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc301000640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2fc109ac0 0x7fc2fc1a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.366+0000 7fc2fbe00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc103b80 0x7fc2fc19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f3e00640 1 -- 172.21.15.71:0/3587008923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2fc109ac0 msgr2=0x7fc2fc1a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f3e00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2fc109ac0 0x7fc2fc1a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f3e00640 1 -- 172.21.15.71:0/3587008923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc103b80 msgr2=0x7fc2fc19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f3e00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc103b80 0x7fc2fc19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f3e00640 1 -- 172.21.15.71:0/3587008923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc1a3f40 con 0x7fc2fc104dc0 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f3e00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc104dc0 0x7fc2fc19c940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400e9f0 tx=0x7fc2e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f9600640 1 -- 172.21.15.71:0/3587008923 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400cd80 con 0x7fc2fc104dc0 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f9600640 1 -- 172.21.15.71:0/3587008923 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e40108e0 con 0x7fc2fc104dc0 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc2f9600640 1 -- 172.21.15.71:0/3587008923 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4018980 con 0x7fc2fc104dc0 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc1a4230 con 0x7fc2fc104dc0 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.367+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc1a4730 con 0x7fc2fc104dc0 2024-05-27T09:47:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.369+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2fc1a4990 con 0x7fc2fc104dc0 2024-05-27T09:47:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.371+0000 7fc2f9600640 1 -- 172.21.15.71:0/3587008923 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc2e4010430 con 0x7fc2fc104dc0 2024-05-27T09:47:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.373+0000 7fc2f9600640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc2e00b27e0 0x7fc2e00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:34.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.373+0000 7fc2f9600640 1 -- 172.21.15.71:0/3587008923 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fc2e40e2a50 con 0x7fc2fc104dc0 2024-05-27T09:47:34.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.373+0000 7fc2fbe00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc2e00b27e0 0x7fc2e00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:34.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.374+0000 7fc2fbe00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc2e00b27e0 0x7fc2e00b4cf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec02aa00 tx=0x7fc2ec0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.375+0000 7fc2f9600640 1 -- 172.21.15.71:0/3587008923 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc2e40aa0d0 con 0x7fc2fc104dc0 2024-05-27T09:47:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:34.636+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fc2fc1a4b60 con 0x7fc2fc104dc0 2024-05-27T09:47:34.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:34 smithi071 ceph-mon[31451]: pgmap v438: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:34.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:34 smithi072 ceph-mon[35951]: pgmap v438: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:34 smithi122 ceph-mon[36436]: pgmap v438: 97 pgs: 97 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T09:47:35.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.506+0000 7fc2f9600640 1 -- 172.21.15.71:0/3587008923 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fc2e40ae3d0 con 0x7fc2fc104dc0 2024-05-27T09:47:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.510+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc2e00b27e0 msgr2=0x7fc2e00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc2e00b27e0 0x7fc2e00b4cf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec02aa00 tx=0x7fc2ec0314a0 comp rx=0 tx=0).stop 2024-05-27T09:47:35.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc104dc0 msgr2=0x7fc2fc19c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:35.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc104dc0 0x7fc2fc19c940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400e9f0 tx=0x7fc2e400eeb0 comp rx=0 tx=0).stop 2024-05-27T09:47:35.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 shutdown_connections 2024-05-27T09:47:35.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc2e00b27e0 0x7fc2e00b4cf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:35.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2fc109ac0 0x7fc2fc1a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:35.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc104dc0 0x7fc2fc19c940 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:35.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 --2- 172.21.15.71:0/3587008923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc103b80 0x7fc2fc19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:35.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.511+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 >> 172.21.15.71:0/3587008923 conn(0x7fc2fc0fed70 msgr2=0x7fc2fc0ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.515+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 shutdown_connections 2024-05-27T09:47:35.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:35.516+0000 7fc301a00640 1 -- 172.21.15.71:0/3587008923 wait complete. 2024-05-27T09:47:35.549 INFO:teuthology.run_tasks:Running task kclient... 2024-05-27T09:47:35.574 INFO:tasks.kclient:Mounting kernel clients... 2024-05-27T09:47:35.574 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-27T09:47:35.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:35.575 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-05-27T09:47:35.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:35.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-05-27T09:47:35.723 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-05-27T09:47:35.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T09:47:35.726 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-05-27T09:47:35.726 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T09:47:35.727 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T09:47:35.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-05-27T09:47:35.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:35 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3587008923' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-27T09:47:35.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: ignoring --setuser ceph since I am not root 2024-05-27T09:47:35.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: ignoring --setgroup ceph since I am not root 2024-05-27T09:47:35.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:35 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3587008923' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-27T09:47:35.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: ignoring --setuser ceph since I am not root 2024-05-27T09:47:35.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: ignoring --setgroup ceph since I am not root 2024-05-27T09:47:35.777 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:35 smithi072 ceph-mgr[37324]: -- 172.21.15.72:0/3119973063 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646515e85a0 con 0x564656372900 2024-05-27T09:47:35.777 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:35.715+0000 7f4a49ab0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:47:35.907 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:35 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3587008923' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-27T09:47:35.907 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: ignoring --setuser ceph since I am not root 2024-05-27T09:47:35.907 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: ignoring --setgroup ceph since I am not root 2024-05-27T09:47:35.907 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:35 smithi122 ceph-mgr[38298]: -- 172.21.15.122:0/3209722818 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aad62885a0 con 0x55aadb012000 2024-05-27T09:47:35.908 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:35.718+0000 7f2b524b4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:47:35.908 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:35.906+0000 7f2b524b4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:47:36.158 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:36.200 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:35.921+0000 7f2f3164f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T09:47:36.229 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:36.009+0000 7f2b524b4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:47:36.276 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:35.903+0000 7f4a49ab0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:47:36.276 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:36.007+0000 7f4a49ab0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:47:36.463 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:36.200+0000 7f2f3164f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:47:36.463 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:36.342+0000 7f2f3164f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T09:47:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:36 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3587008923' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-27T09:47:36.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:36 smithi122 ceph-mon[36436]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-05-27T09:47:36.730 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:36.316+0000 7f2b524b4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:47:36.730 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:36.402+0000 7f2b524b4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:47:36.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:36 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3587008923' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-27T09:47:36.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:36 smithi071 ceph-mon[31451]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-05-27T09:47:36.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:36 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3587008923' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-27T09:47:36.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:36 smithi072 ceph-mon[35951]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-05-27T09:47:36.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:36.314+0000 7f4a49ab0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:47:36.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:36.401+0000 7f4a49ab0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:47:37.170 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:36.767+0000 7f2f3164f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T09:47:37.170 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:36.886+0000 7f2f3164f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T09:47:37.915 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:37.576+0000 7f2b524b4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:47:37.915 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:37.746+0000 7f2b524b4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:47:37.916 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:37.914+0000 7f2b524b4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:47:37.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:37.578+0000 7f4a49ab0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:47:37.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:37.749+0000 7f4a49ab0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:47:37.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:37.918+0000 7f4a49ab0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:47:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 -- 172.21.15.71:0/1749176090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 msgr2=0x7fc964110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 --2- 172.21.15.71:0/1749176090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 0x7fc964110650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc950009990 tx=0x7fc950009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 -- 172.21.15.71:0/1749176090 shutdown_connections 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 --2- 172.21.15.71:0/1749176090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc964110b90 0x7fc964112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 --2- 172.21.15.71:0/1749176090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 0x7fc964076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 --2- 172.21.15.71:0/1749176090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 0x7fc964110650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 -- 172.21.15.71:0/1749176090 >> 172.21.15.71:0/1749176090 conn(0x7fc964100030 msgr2=0x7fc964102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.382+0000 7fc969400700 1 -- 172.21.15.71:0/1749176090 shutdown_connections 2024-05-27T09:47:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.383+0000 7fc969400700 1 -- 172.21.15.71:0/1749176090 wait complete. 2024-05-27T09:47:38.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 Processor -- start 2024-05-27T09:47:38.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 -- start start 2024-05-27T09:47:38.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 0x7fc96419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:38.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 0x7fc96419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:38.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc964110b90 0x7fc9641a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:38.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc964116690 con 0x7fc964076670 2024-05-27T09:47:38.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc964116510 con 0x7fc964075d20 2024-05-27T09:47:38.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.384+0000 7fc969400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc964116810 con 0x7fc964110b90 2024-05-27T09:47:38.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc961e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 0x7fc96419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:38.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 0x7fc96419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:38.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 0x7fc96419d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:41482/0 (socket says 172.21.15.71:41482) 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 -- 172.21.15.71:0/1034709006 learned_addr learned my addr 172.21.15.71:0/1034709006 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc963200700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc964110b90 0x7fc9641a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 -- 172.21.15.71:0/1034709006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc964110b90 msgr2=0x7fc9641a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc964110b90 0x7fc9641a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 -- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 msgr2=0x7fc96419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 0x7fc96419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.385+0000 7fc962800700 1 -- 172.21.15.71:0/1034709006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9641a1f10 con 0x7fc964075d20 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.386+0000 7fc962800700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 0x7fc96419d040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc95400e9a0 tx=0x7fc95400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.386+0000 7fc95b400700 1 -- 172.21.15.71:0/1034709006 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95400ca10 con 0x7fc964075d20 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.386+0000 7fc95b400700 1 -- 172.21.15.71:0/1034709006 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc95400cbb0 con 0x7fc964075d20 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.386+0000 7fc95b400700 1 -- 172.21.15.71:0/1034709006 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954018680 con 0x7fc964075d20 2024-05-27T09:47:38.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.386+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9641a2200 con 0x7fc964075d20 2024-05-27T09:47:38.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.386+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9641a9b20 con 0x7fc964075d20 2024-05-27T09:47:38.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.387+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc964077290 con 0x7fc964075d20 2024-05-27T09:47:38.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.389+0000 7fc95b400700 1 -- 172.21.15.71:0/1034709006 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7fc954010430 con 0x7fc964075d20 2024-05-27T09:47:38.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.391+0000 7fc95b400700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 0x7fc9480b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:38.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.391+0000 7fc961e00700 1 -- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 msgr2=0x7fc9480b4de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1797397372 2024-05-27T09:47:38.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.391+0000 7fc95b400700 1 -- 172.21.15.71:0/1034709006 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fc9540e2410 con 0x7fc964075d20 2024-05-27T09:47:38.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.391+0000 7fc961e00700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 0x7fc9480b4de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:47:38.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.396+0000 7fc95b400700 1 -- 172.21.15.71:0/1034709006 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc9540aa0e0 con 0x7fc964075d20 2024-05-27T09:47:38.480 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:38.206+0000 7f2b524b4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:47:38.480 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:38.299+0000 7f2b524b4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:47:38.507 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:38.211+0000 7f4a49ab0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:47:38.507 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:38.304+0000 7f4a49ab0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:47:38.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.591+0000 7fc961e00700 1 -- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 msgr2=0x7fc9480b4de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1797397372 2024-05-27T09:47:38.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.591+0000 7fc961e00700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 0x7fc9480b4de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-27T09:47:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.672+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc96402e5e0 con 0x7fc964075d20 2024-05-27T09:47:38.674 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:38.524+0000 7f2f3164f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T09:47:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.673+0000 7fc95b400700 1 -- 172.21.15.71:0/1034709006 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7fc9540b2160 con 0x7fc964075d20 2024-05-27T09:47:38.675 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T09:47:38.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 msgr2=0x7fc9480b4de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:47:38.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 0x7fc9480b4de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 msgr2=0x7fc96419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 0x7fc96419d040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc95400e9a0 tx=0x7fc95400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 shutdown_connections 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc964110b90 0x7fc9641a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964075d20 0x7fc96419d040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7fc9480b28d0 0x7fc9480b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 --2- 172.21.15.71:0/1034709006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc964076670 0x7fc96419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 >> 172.21.15.71:0/1034709006 conn(0x7fc964100030 msgr2=0x7fc964101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 shutdown_connections 2024-05-27T09:47:38.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:38.676+0000 7fc969400700 1 -- 172.21.15.71:0/1034709006 wait complete. 2024-05-27T09:47:38.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:38 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1034709006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-27T09:47:38.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:38.506+0000 7f4a49ab0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:47:38.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:38.703+0000 7f4a49ab0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:47:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:38 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1034709006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-27T09:47:38.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:38.499+0000 7f2b524b4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:47:38.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:38.695+0000 7f2b524b4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:47:39.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:38 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1034709006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-27T09:47:39.006 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:38.774+0000 7f2f3164f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T09:47:39.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:39.004+0000 7f2f3164f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T09:47:39.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:39.307+0000 7f4a49ab0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:47:39.622 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T09:47:39.622 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T09:47:39.623 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-05-27T09:47:39.623 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T09:47:39.623 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T09:47:39.623 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T09:47:39.623 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T09:47:39.623 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T09:47:39.623 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T09:47:39.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:39.623 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-05-27T09:47:39.718 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T09:47:39.718 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T09:47:39.718 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T09:47:39.719 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-05-27T09:47:39.720 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T09:47:39.720 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 41793sec preferred_lft 41793sec 2024-05-27T09:47:39.720 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-05-27T09:47:39.720 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-05-27T09:47:39.720 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T09:47:39.720 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T09:47:39.720 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-05-27T09:47:39.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2024-05-27T09:47:39.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2024-05-27T09:47:39.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2024-05-27T09:47:39.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T09:47:39.721 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-05-27T09:47:39.730 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:39.293+0000 7f2b524b4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:47:39.730 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:39.515+0000 7f2b524b4200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:47:39.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:39.429+0000 7f2f3164f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T09:47:39.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:39.558+0000 7f2f3164f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T09:47:39.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T09:47:39.841 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:39.533+0000 7f4a49ab0200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:47:40.104 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:39.841+0000 7f2f3164f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T09:47:40.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:40.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:40.180 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T09:47:40.229 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:39.938+0000 7f2b524b4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:47:40.229 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:40.035+0000 7f2b524b4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:47:40.276 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:39.968+0000 7f4a49ab0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:47:40.276 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:40.067+0000 7f4a49ab0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:47:40.282 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-05-27T09:47:40.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:40.286 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-05-27T09:47:40.336 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-05-27T09:47:40.336 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T09:47:40.336 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T09:47:40.336 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T09:47:40.337 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T09:47:40.337 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T09:47:40.337 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-05-27T09:47:40.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T09:47:40.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T09:47:40.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T09:47:40.337 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-05-27T09:47:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T09:47:40.448 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:40.114+0000 7f2f3164f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T09:47:40.730 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:40.403+0000 7f2b524b4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:47:40.776 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:40.437+0000 7f4a49ab0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:47:41.007 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:40.959+0000 7f2f3164f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T09:47:41.102 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:40.760+0000 7f2b524b4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:47:41.102 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:40.857+0000 7f2b524b4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:47:41.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:41.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:41.111 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-05-27T09:47:41.136 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:40.793+0000 7f4a49ab0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:47:41.137 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:40.890+0000 7f4a49ab0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:47:41.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:41.157 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-05-27T09:47:41.245 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T09:47:41.245 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-05-27T09:47:41.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T09:47:41.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-27T09:47:41.245 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-05-27T09:47:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T09:47:41.359 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:41 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:41.264+0000 7f2f3164f200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-27T09:47:41.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:41.413 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-27T09:47:41.413 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-05-27T09:47:41.480 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:41.101+0000 7f2b524b4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:47:41.480 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:41.234+0000 7f2b524b4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:47:41.480 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:41.329+0000 7f2b524b4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:47:41.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T09:47:41.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:41.136+0000 7f4a49ab0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:47:41.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:41.272+0000 7f4a49ab0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:47:41.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:41.369+0000 7f4a49ab0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:47:41.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:41.709 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T09:47:41.709 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-05-27T09:47:41.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-05-27T09:47:41.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T09:47:41.709 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-05-27T09:47:41.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T09:47:41.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:41.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T09:47:41.903 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T09:47:41.942 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T09:47:41.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T09:47:41.942 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T09:47:41.979 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:41.651+0000 7f2b524b4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:47:41.980 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:41.744+0000 7f2b524b4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:47:42.026 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:41.694+0000 7f4a49ab0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:47:42.026 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:41.789+0000 7f4a49ab0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:47:42.032 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-27T09:47:42.032 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-27T09:47:42.033 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14 2024-05-27T09:47:42.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:42.033 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-05-27T09:47:42.223 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-05-27T09:47:42.223 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-05-27T09:47:42.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:41 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:41.862+0000 7f2f3164f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T09:47:42.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:41 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:41.997+0000 7f2f3164f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T09:47:42.642 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:42.343+0000 7f2b524b4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:47:42.642 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 09:47:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z[38294]: 2024-05-27T09:47:42.560+0000 7f2b524b4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:47:42.643 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:42 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:42.493+0000 7f2f3164f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T09:47:42.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:42 smithi072 ceph-mon[35951]: Standby manager daemon z restarted 2024-05-27T09:47:42.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:42 smithi072 ceph-mon[35951]: Standby manager daemon z started 2024-05-27T09:47:42.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:42 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-27T09:47:42.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:42 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:47:42.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:42 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-27T09:47:42.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:42 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:47:42.777 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:42.394+0000 7f4a49ab0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:47:42.777 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 09:47:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y[37320]: 2024-05-27T09:47:42.611+0000 7f4a49ab0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:47:42.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:42 smithi071 ceph-mon[31451]: Standby manager daemon z restarted 2024-05-27T09:47:42.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:42 smithi071 ceph-mon[31451]: Standby manager daemon z started 2024-05-27T09:47:42.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:42 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-27T09:47:42.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:42 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:47:42.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:42 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-27T09:47:42.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:42 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:47:42.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:42 smithi122 ceph-mon[36436]: Standby manager daemon z restarted 2024-05-27T09:47:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:42 smithi122 ceph-mon[36436]: Standby manager daemon z started 2024-05-27T09:47:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:42 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-27T09:47:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:42 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:47:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:42 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-27T09:47:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:42 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.122:0/62746709' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:47:42.992 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-05-27T09:47:42.992 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-05-27T09:47:42.992 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:6789,172.21.15.72:6789,172.21.15.122:6789" 2024-05-27T09:47:42.992 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@13785e2a-1c0c-11ef-bc9b-c7b262605968.cephfs=/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14 2024-05-27T09:47:42.992 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.71:6789/172.21.15.72:6789/172.21.15.122:6789" will pass to kernel 2024-05-27T09:47:42.995 INFO:teuthology.orchestra.run.smithi071.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-27T09:47:42.996 INFO:teuthology.orchestra.run.smithi071.stdout: You just mounted a file system that supports labels which does not 2024-05-27T09:47:42.996 INFO:teuthology.orchestra.run.smithi071.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-27T09:47:42.996 INFO:teuthology.orchestra.run.smithi071.stdout: applications will generate AVC messages and not be allowed access to 2024-05-27T09:47:42.996 INFO:teuthology.orchestra.run.smithi071.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-27T09:47:43.000 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-27T09:47:43.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T09:47:43.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T09:47:43.067 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T09:47:43.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T09:47:43.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:43.169 INFO:teuthology.orchestra.run.smithi071.stdout:client14955 2024-05-27T09:47:43.170 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:47:43.170 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T09:47:43.215 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T09:47:43.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:42 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:42.987+0000 7f2f3164f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T09:47:43.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:43.125+0000 7f2f3164f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T09:47:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T09:47:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:43.371 INFO:teuthology.orchestra.run.smithi071.stdout:client14955 2024-05-27T09:47:43.371 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T09:47:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T09:47:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:43.479 INFO:teuthology.orchestra.run.smithi071.stdout:client14955 2024-05-27T09:47:43.479 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968.client14955/status') 2024-05-27T09:47:43.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T09:47:43.596 INFO:teuthology.orchestra.run.smithi071.stdout:instance: client.14955 (3)192.168.0.1:0/3032000475 2024-05-27T09:47:43.596 INFO:teuthology.orchestra.run.smithi071.stdout:blocklisted: false 2024-05-27T09:47:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records in 2024-05-27T09:47:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records out 2024-05-27T09:47:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:70 bytes copied, 8.6098e-05 s, 813 kB/s 2024-05-27T09:47:43.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T09:47:43.608 INFO:teuthology.run_tasks:Running task exec... 2024-05-27T09:47:43.617 INFO:teuthology.task.exec:Executing custom commands... 2024-05-27T09:47:43.617 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:47:43.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-27T09:47:43.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:43.474+0000 7f2f3164f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T09:47:43.757 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:43.668+0000 7f2f3164f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T09:47:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:43 smithi071 ceph-mon[31451]: Standby manager daemon y restarted 2024-05-27T09:47:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:43 smithi071 ceph-mon[31451]: Standby manager daemon y started 2024-05-27T09:47:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:43 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-27T09:47:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:43 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:47:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:43 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-27T09:47:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:43 smithi071 ceph-mon[31451]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:47:43.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:43 smithi071 ceph-mon[31451]: mgrmap e20: x(active, since 12m), standbys: y, z 2024-05-27T09:47:43.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 -- 172.21.15.71:0/1344591863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee81101e0 msgr2=0x7f6ee8112600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:43.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/1344591863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee81101e0 0x7f6ee8112600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009ca0 tx=0x7f6ee002a8c0 comp rx=0 tx=0).stop 2024-05-27T09:47:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 -- 172.21.15.71:0/1344591863 shutdown_connections 2024-05-27T09:47:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/1344591863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee81101e0 0x7f6ee8112600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/1344591863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee8075a00 0x7f6ee810fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/1344591863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ee80750b0 0x7f6ee80754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 -- 172.21.15.71:0/1344591863 >> 172.21.15.71:0/1344591863 conn(0x7f6ee80fec70 msgr2=0x7f6ee8101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 -- 172.21.15.71:0/1344591863 shutdown_connections 2024-05-27T09:47:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.872+0000 7f6ee7e00640 1 -- 172.21.15.71:0/1344591863 wait complete. 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 Processor -- start 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 -- start start 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee80750b0 0x7f6ee81a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee8075a00 0x7f6ee81a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ee81101e0 0x7f6ee81a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8115bc0 con 0x7f6ee81101e0 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8115a40 con 0x7f6ee80750b0 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee7e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8115d40 con 0x7f6ee8075a00 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.874+0000 7f6ee6a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee80750b0 0x7f6ee81a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee80750b0 0x7f6ee81a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50292/0 (socket says 172.21.15.71:50292) 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 -- 172.21.15.71:0/2758357849 learned_addr learned my addr 172.21.15.71:0/2758357849 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6000640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee8075a00 0x7f6ee81a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee7400640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ee81101e0 0x7f6ee81a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 -- 172.21.15.71:0/2758357849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee8075a00 msgr2=0x7f6ee81a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee8075a00 0x7f6ee81a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 -- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ee81101e0 msgr2=0x7f6ee81a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ee81101e0 0x7f6ee81a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 -- 172.21.15.71:0/2758357849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee81a8280 con 0x7f6ee80750b0 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee7400640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ee81101e0 0x7f6ee81a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6ee6a00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee80750b0 0x7f6ee81a0740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9c0 tx=0x7f6ed800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.875+0000 7f6edf400640 1 -- 172.21.15.71:0/2758357849 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800cd80 con 0x7f6ee80750b0 2024-05-27T09:47:43.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.876+0000 7f6edf400640 1 -- 172.21.15.71:0/2758357849 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ed80054d0 con 0x7f6ee80750b0 2024-05-27T09:47:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.876+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee81a8570 con 0x7f6ee80750b0 2024-05-27T09:47:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.876+0000 7f6edf400640 1 -- 172.21.15.71:0/2758357849 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8010430 con 0x7f6ee80750b0 2024-05-27T09:47:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.876+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee81a8ac0 con 0x7f6ee80750b0 2024-05-27T09:47:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.877+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee8105e70 con 0x7f6ee80750b0 2024-05-27T09:47:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.879+0000 7f6edf400640 1 -- 172.21.15.71:0/2758357849 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) ==== 149669+0+0 (secure 0 0 0) 0x7f6ed8004fd0 con 0x7f6ee80750b0 2024-05-27T09:47:43.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.880+0000 7f6edf400640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 0x7f6ecc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:43.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.880+0000 7f6ee6000640 1 -- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 msgr2=0x7f6ecc0b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1797397372 2024-05-27T09:47:43.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.881+0000 7f6edf400640 1 -- 172.21.15.71:0/2758357849 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f6ed80e27d0 con 0x7f6ee80750b0 2024-05-27T09:47:43.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.881+0000 7f6ee6000640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 0x7f6ecc0b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:47:43.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:43.885+0000 7f6edf400640 1 -- 172.21.15.71:0/2758357849 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ed80aa4a0 con 0x7f6ee80750b0 2024-05-27T09:47:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:43 smithi122 ceph-mon[36436]: Standby manager daemon y restarted 2024-05-27T09:47:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:43 smithi122 ceph-mon[36436]: Standby manager daemon y started 2024-05-27T09:47:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:43 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-27T09:47:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:43 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:47:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:43 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-27T09:47:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:43 smithi122 ceph-mon[36436]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:47:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:43 smithi122 ceph-mon[36436]: mgrmap e20: x(active, since 12m), standbys: y, z 2024-05-27T09:47:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:43 smithi072 ceph-mon[35951]: Standby manager daemon y restarted 2024-05-27T09:47:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:43 smithi072 ceph-mon[35951]: Standby manager daemon y started 2024-05-27T09:47:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:43 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-27T09:47:44.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:43 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-27T09:47:44.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:43 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-27T09:47:44.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:43 smithi072 ceph-mon[35951]: from='mgr.? 172.21.15.72:0/2617143587' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-27T09:47:44.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:43 smithi072 ceph-mon[35951]: mgrmap e20: x(active, since 12m), standbys: y, z 2024-05-27T09:47:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.082+0000 7f6ee6000640 1 -- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 msgr2=0x7f6ecc0b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1797397372 2024-05-27T09:47:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.082+0000 7f6ee6000640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 0x7f6ecc0b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-27T09:47:44.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.132+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f6ee802dc20 con 0x7f6ee80750b0 2024-05-27T09:47:44.228 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:43.808+0000 7f2f3164f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T09:47:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.483+0000 7f6ee6000640 1 -- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 msgr2=0x7f6ecc0b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1797397372 2024-05-27T09:47:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.483+0000 7f6ee6000640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 0x7f6ecc0b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-27T09:47:44.507 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:44 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:44.227+0000 7f2f3164f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T09:47:44.507 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:44 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:44.355+0000 7f2f3164f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T09:47:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.661+0000 7f6edf400640 1 -- 172.21.15.71:0/2758357849 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f6ed80a9da0 con 0x7f6ee80750b0 2024-05-27T09:47:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.664+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 msgr2=0x7f6ecc0b4d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:47:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.664+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 0x7f6ecc0b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.664+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee80750b0 msgr2=0x7f6ee81a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.664+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee80750b0 0x7f6ee81a0740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9c0 tx=0x7f6ed800ee80 comp rx=0 tx=0).stop 2024-05-27T09:47:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.664+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 shutdown_connections 2024-05-27T09:47:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.665+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f6ecc0b2830 0x7f6ecc0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.665+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ee81101e0 0x7f6ee81a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.665+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee8075a00 0x7f6ee81a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.665+0000 7f6ee7e00640 1 --2- 172.21.15.71:0/2758357849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee80750b0 0x7f6ee81a0740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.665+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 >> 172.21.15.71:0/2758357849 conn(0x7f6ee80fec70 msgr2=0x7f6ee8103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.665+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 shutdown_connections 2024-05-27T09:47:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.665+0000 7f6ee7e00640 1 -- 172.21.15.71:0/2758357849 wait complete. 2024-05-27T09:47:44.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 -- 172.21.15.71:0/2000112774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5340103c60 msgr2=0x7f5340104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 --2- 172.21.15.71:0/2000112774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5340103c60 0x7f5340104960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f532c009900 tx=0x7f532c02a3f0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 -- 172.21.15.71:0/2000112774 shutdown_connections 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 --2- 172.21.15.71:0/2000112774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5340109ba0 0x7f534010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 --2- 172.21.15.71:0/2000112774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5340104ea0 0x7f53401052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 --2- 172.21.15.71:0/2000112774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5340103c60 0x7f5340104960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 -- 172.21.15.71:0/2000112774 >> 172.21.15.71:0/2000112774 conn(0x7f53400fee50 msgr2=0x7f5340101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.946+0000 7f5347200640 1 -- 172.21.15.71:0/2000112774 shutdown_connections 2024-05-27T09:47:44.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.947+0000 7f5347200640 1 -- 172.21.15.71:0/2000112774 wait complete. 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 Processor -- start 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 -- start start 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5340103c60 0x7f534019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5340104ea0 0x7f534019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5340109ba0 0x7f53401a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f534010f760 con 0x7f5340104ea0 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f534010f5e0 con 0x7f5340109ba0 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f5347200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f534010f8e0 con 0x7f5340103c60 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f533fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5340103c60 0x7f534019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f533fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5340103c60 0x7f534019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59144/0 (socket says 172.21.15.71:59144) 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f533fe00640 1 -- 172.21.15.71:0/831934521 learned_addr learned my addr 172.21.15.71:0/831934521 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.948+0000 7f533f400640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5340104ea0 0x7f534019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f5345200640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5340109ba0 0x7f53401a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f5345200640 1 -- 172.21.15.71:0/831934521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5340103c60 msgr2=0x7f534019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f5345200640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5340103c60 0x7f534019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f5345200640 1 -- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5340104ea0 msgr2=0x7f534019caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f5345200640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5340104ea0 0x7f534019caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f5345200640 1 -- 172.21.15.71:0/831934521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53401a40f0 con 0x7f5340109ba0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f5345200640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5340109ba0 0x7f53401a3a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5338009fd0 tx=0x7f533800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.949+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533800ce20 con 0x7f5340109ba0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.950+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5338005020 con 0x7f5340109ba0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.950+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53401a43e0 con 0x7f5340109ba0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.950+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338010690 con 0x7f5340109ba0 2024-05-27T09:47:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.950+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53401a48e0 con 0x7f5340109ba0 2024-05-27T09:47:44.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.951+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53401a4ba0 con 0x7f5340109ba0 2024-05-27T09:47:44.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.953+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) ==== 149669+0+0 (secure 0 0 0) 0x7f53380054d0 con 0x7f5340109ba0 2024-05-27T09:47:44.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.955+0000 7f533cc00640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f53240b2830 0x7f53240b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:44.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.955+0000 7f533fe00640 1 -- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f53240b2830 msgr2=0x7f53240b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1797397372 2024-05-27T09:47:44.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.955+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f53380e2ca0 con 0x7f5340109ba0 2024-05-27T09:47:44.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.955+0000 7f533fe00640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f53240b2830 0x7f53240b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T09:47:44.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:44.957+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f53380aa970 con 0x7f5340109ba0 2024-05-27T09:47:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:44 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2758357849' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-27T09:47:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:44 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-27T09:47:45.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:44 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2758357849' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-27T09:47:45.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:44 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-27T09:47:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:44 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2758357849' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-27T09:47:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:44 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-27T09:47:45.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:45.156+0000 7f533fe00640 1 -- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f53240b2830 msgr2=0x7f53240b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/1797397372 2024-05-27T09:47:45.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:45.156+0000 7f533fe00640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f53240b2830 0x7f53240b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-27T09:47:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:45.194+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 --> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f5340100980 con 0x7f53240b2830 2024-05-27T09:47:45.451 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.154+0000 7f2f3164f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T09:47:45.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:45.483+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 21) ==== 149337+0+0 (secure 0 0 0) 0x7f53380a6500 con 0x7f5340109ba0 2024-05-27T09:47:45.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:45.483+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f53240b2830 msgr2=0x7f53240b4d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:47:45.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:45.483+0000 7f533cc00640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/1797397372,v1:172.21.15.71:6801/1797397372] conn(0x7f53240b2830 0x7f53240b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:45.758 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.450+0000 7f2f3164f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T09:47:45.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-27T09:47:45.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:47:45.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: Active manager daemon x restarted 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: Activating manager daemon x 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: osdmap e84: 12 total, 12 up, 12 in 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: mgrmap e21: x(active, starting, since 0.0282324s), standbys: y, z 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T09:47:45.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:47:45.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: Manager daemon x is now available 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-27T09:47:45.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:45 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: Active manager daemon x restarted 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: Activating manager daemon x 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: osdmap e84: 12 total, 12 up, 12 in 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: mgrmap e21: x(active, starting, since 0.0282324s), standbys: y, z 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-27T09:47:45.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-27T09:47:45.982 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-27T09:47:45.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-27T09:47:45.984 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: Manager daemon x is now available 2024-05-27T09:47:45.984 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:45.984 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-27T09:47:45.984 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:45 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e86600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e86600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e86600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e86600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e86600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e82a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e82a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.020 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e82a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.021 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e82a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.021 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:45.790+0000 7f2e82a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: Active manager daemon x restarted 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: Activating manager daemon x 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: osdmap e84: 12 total, 12 up, 12 in 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: mgrmap e21: x(active, starting, since 0.0282324s), standbys: y, z 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-27T09:47:46.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-27T09:47:46.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: Manager daemon x is now available 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:46.029 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-27T09:47:46.030 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:45 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-27T09:47:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.495+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mon.2 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7f53380e07d0 con 0x7f5340109ba0 2024-05-27T09:47:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.496+0000 7f533cc00640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5324075590 0x7f53240be270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.496+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f5324042310 con 0x7f5324075590 2024-05-27T09:47:46.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.501+0000 7f533fe00640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5324075590 0x7f53240be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:46.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.508+0000 7f533fe00640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5324075590 0x7f53240be270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f532c031500 tx=0x7f532c009620 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.543+0000 7f533cc00640 1 -- 172.21.15.71:0/831934521 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f5324042310 con 0x7f5324075590 2024-05-27T09:47:46.545 INFO:teuthology.orchestra.run.smithi071.stdout:{} 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.546+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5324075590 msgr2=0x7f53240be270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.546+0000 7f5347200640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5324075590 0x7f53240be270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f532c031500 tx=0x7f532c009620 comp rx=0 tx=0).stop 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.546+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5340109ba0 msgr2=0x7f53401a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.546+0000 7f5347200640 1 --2- 172.21.15.71:0/831934521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5340109ba0 0x7f53401a3a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5338009fd0 tx=0x7f533800ef10 comp rx=0 tx=0).stop 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.546+0000 7f5345200640 1 -- 172.21.15.71:0/831934521 reap_dead start 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.547+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 shutdown_connections 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.547+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 >> 172.21.15.71:0/831934521 conn(0x7f53400fee50 msgr2=0x7f53400ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.547+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 shutdown_connections 2024-05-27T09:47:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.547+0000 7f5347200640 1 -- 172.21.15.71:0/831934521 wait complete. 2024-05-27T09:47:46.573 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-27T09:47:46.584 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-27T09:47:46.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 -- 172.21.15.71:0/1531770565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 msgr2=0x7f0348104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 --2- 172.21.15.71:0/1531770565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f0348104710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0338009ca0 tx=0x7f033802a8c0 comp rx=0 tx=0).stop 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 -- 172.21.15.71:0/1531770565 shutdown_connections 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 --2- 172.21.15.71:0/1531770565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0348109950 0x7f034810bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 --2- 172.21.15.71:0/1531770565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0348104c50 0x7f0348105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 --2- 172.21.15.71:0/1531770565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f0348104710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 -- 172.21.15.71:0/1531770565 >> 172.21.15.71:0/1531770565 conn(0x7f03480fec00 msgr2=0x7f03481010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 -- 172.21.15.71:0/1531770565 shutdown_connections 2024-05-27T09:47:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.905+0000 7f034f000640 1 -- 172.21.15.71:0/1531770565 wait complete. 2024-05-27T09:47:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.906+0000 7f034f000640 1 Processor -- start 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034f000640 1 -- start start 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034f000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f034819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034f000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0348104c50 0x7f034819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034f000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0348109950 0x7f03481a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034f000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f034810f510 con 0x7f0348104c50 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034f000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f034810f390 con 0x7f0348103a10 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034f000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f034810f690 con 0x7f0348109950 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f034819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f034819a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50464/0 (socket says 172.21.15.71:50464) 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034dc00640 1 -- 172.21.15.71:0/1684663230 learned_addr learned my addr 172.21.15.71:0/1684663230 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034d200640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0348104c50 0x7f034819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.907+0000 7f034e600640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0348109950 0x7f03481a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034dc00640 1 -- 172.21.15.71:0/1684663230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0348109950 msgr2=0x7f03481a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034dc00640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0348109950 0x7f03481a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034dc00640 1 -- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0348104c50 msgr2=0x7f034819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034dc00640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0348104c50 0x7f034819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034dc00640 1 -- 172.21.15.71:0/1684663230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03481a1cc0 con 0x7f0348103a10 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034dc00640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f034819a180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03380098d0 tx=0x7f0338031700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f0346000640 1 -- 172.21.15.71:0/1684663230 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338003b70 con 0x7f0348103a10 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f0346000640 1 -- 172.21.15.71:0/1684663230 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0338003d10 con 0x7f0348103a10 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f0346000640 1 -- 172.21.15.71:0/1684663230 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033802f9e0 con 0x7f0348103a10 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03481a1f50 con 0x7f0348103a10 2024-05-27T09:47:46.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.908+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03481a23b0 con 0x7f0348103a10 2024-05-27T09:47:46.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.910+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0348108760 con 0x7f0348103a10 2024-05-27T09:47:46.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.913+0000 7f0346000640 1 -- 172.21.15.71:0/1684663230 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7f033802fb80 con 0x7f0348103a10 2024-05-27T09:47:46.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.914+0000 7f0346000640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f032c0b25e0 0x7f032c0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:46.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.915+0000 7f0346000640 1 -- 172.21.15.71:0/1684663230 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f0338103290 con 0x7f0348103a10 2024-05-27T09:47:46.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.915+0000 7f034d200640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f032c0b25e0 0x7f032c0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:46.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.915+0000 7f034d200640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f032c0b25e0 0x7f032c0b4af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f034819b220 tx=0x7f0334005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:46.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:46.920+0000 7f0346000640 1 -- 172.21.15.71:0/1684663230 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f03380cb170 con 0x7f0348103a10 2024-05-27T09:47:47.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:46.528+0000 7f2e7ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:47.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:46.528+0000 7f2e7ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:47.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:46.528+0000 7f2e7ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:47.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:46.528+0000 7f2e7ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:47.008 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:47:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:47:46.528+0000 7f2e7ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:47:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.136+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f034802de40 con 0x7f0348103a10 2024-05-27T09:47:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.138+0000 7f0346000640 1 -- 172.21.15.71:0/1684663230 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22980 (secure 0 0 0) 0x7f03380caa70 con 0x7f0348103a10 2024-05-27T09:47:47.140 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:47.140 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":84,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:47:45.456731+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6801/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6800/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/1381797399":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/4081778329":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/193022273":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/4261728686":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:47:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f032c0b25e0 msgr2=0x7f032c0b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f032c0b25e0 0x7f032c0b4af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f034819b220 tx=0x7f0334005f90 comp rx=0 tx=0).stop 2024-05-27T09:47:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 msgr2=0x7f034819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f034819a180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03380098d0 tx=0x7f0338031700 comp rx=0 tx=0).stop 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 shutdown_connections 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f032c0b25e0 0x7f032c0b4af0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0348109950 0x7f03481a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0348104c50 0x7f034819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 --2- 172.21.15.71:0/1684663230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0348103a10 0x7f034819a180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 >> 172.21.15.71:0/1684663230 conn(0x7f03480fec00 msgr2=0x7f0348105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 shutdown_connections 2024-05-27T09:47:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.141+0000 7f034f000640 1 -- 172.21.15.71:0/1684663230 wait complete. 2024-05-27T09:47:47.168 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T09:38:13.148765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T09:43:41.957802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T09:43:46.824583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T09:47:47.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T09:47:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 -- 172.21.15.71:0/3982268432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70102130 msgr2=0x7f8d70102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 --2- 172.21.15.71:0/3982268432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70102130 0x7f8d70102540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009ca0 tx=0x7f8d6002a8b0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 -- 172.21.15.71:0/3982268432 shutdown_connections 2024-05-27T09:47:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 --2- 172.21.15.71:0/3982268432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70103670 0x7f8d70103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 --2- 172.21.15.71:0/3982268432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d70102b10 0x7f8d70102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 --2- 172.21.15.71:0/3982268432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70102130 0x7f8d70102540 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 -- 172.21.15.71:0/3982268432 >> 172.21.15.71:0/3982268432 conn(0x7f8d700fdd20 msgr2=0x7f8d701001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 -- 172.21.15.71:0/3982268432 shutdown_connections 2024-05-27T09:47:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.441+0000 7f8d75000640 1 -- 172.21.15.71:0/3982268432 wait complete. 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.442+0000 7f8d75000640 1 Processor -- start 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d75000640 1 -- start start 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d75000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d70102130 0x7f8d7019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d75000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70102b10 0x7f8d7019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d75000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70103670 0x7f8d701a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d75000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701118e0 con 0x7f8d70103670 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d75000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70111760 con 0x7f8d70102b10 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d75000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70111a60 con 0x7f8d70102130 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d65400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70102b10 0x7f8d7019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d6de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d70102130 0x7f8d7019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d65400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70102b10 0x7f8d7019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50480/0 (socket says 172.21.15.71:50480) 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d65400640 1 -- 172.21.15.71:0/2779681229 learned_addr learned my addr 172.21.15.71:0/2779681229 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.443+0000 7f8d6e800640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70103670 0x7f8d701a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d65400640 1 -- 172.21.15.71:0/2779681229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d70102130 msgr2=0x7f8d7019c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d65400640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d70102130 0x7f8d7019c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d65400640 1 -- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70103670 msgr2=0x7f8d701a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d65400640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70103670 0x7f8d701a39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d65400640 1 -- 172.21.15.71:0/2779681229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d701a4050 con 0x7f8d70102b10 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d65400640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70102b10 0x7f8d7019ca50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800ea60 tx=0x7f8d5800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800cde0 con 0x7f8d70102b10 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d580035f0 con 0x7f8d70102b10 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58010690 con 0x7f8d70102b10 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d701a4340 con 0x7f8d70102b10 2024-05-27T09:47:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.444+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d701a48e0 con 0x7f8d70102b10 2024-05-27T09:47:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.446+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7010d590 con 0x7f8d70102b10 2024-05-27T09:47:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.448+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7f8d580037a0 con 0x7f8d70102b10 2024-05-27T09:47:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.449+0000 7f8d67400640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8d540b2660 0x7f8d540b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.449+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8d580e2070 con 0x7f8d70102b10 2024-05-27T09:47:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.450+0000 7f8d6de00640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8d540b2660 0x7f8d540b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.450+0000 7f8d6de00640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8d540b2660 0x7f8d540b4b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d60000f80 tx=0x7f8d60030760 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.454+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8d580aa060 con 0x7f8d70102b10 2024-05-27T09:47:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.503+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 23) ==== 149823+0+0 (secure 0 0 0) 0x7f8d58004000 con 0x7f8d70102b10 2024-05-27T09:47:47.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.702+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d700638c0 con 0x7f8d70102b10 2024-05-27T09:47:47.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.702+0000 7f8d67400640 1 -- 172.21.15.71:0/2779681229 <== mon.2 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f8d5809d800 con 0x7f8d70102b10 2024-05-27T09:47:47.704 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-05-27T09:47:47.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8d540b2660 msgr2=0x7f8d540b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:47.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8d540b2660 0x7f8d540b4b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d60000f80 tx=0x7f8d60030760 comp rx=0 tx=0).stop 2024-05-27T09:47:47.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70102b10 msgr2=0x7f8d7019ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:47.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70102b10 0x7f8d7019ca50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800ea60 tx=0x7f8d5800ef20 comp rx=0 tx=0).stop 2024-05-27T09:47:47.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 shutdown_connections 2024-05-27T09:47:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8d540b2660 0x7f8d540b4b70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d70103670 0x7f8d701a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d70102b10 0x7f8d7019ca50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 --2- 172.21.15.71:0/2779681229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d70102130 0x7f8d7019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 >> 172.21.15.71:0/2779681229 conn(0x7f8d700fdd20 msgr2=0x7f8d7010a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 shutdown_connections 2024-05-27T09:47:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:47.706+0000 7f8d75000640 1 -- 172.21.15.71:0/2779681229 wait complete. 2024-05-27T09:47:47.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T09:47:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: [27/May/2024:09:47:46] ENGINE Bus STARTING 2024-05-27T09:47:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: [27/May/2024:09:47:46] ENGINE Serving on https://172.21.15.71:7150 2024-05-27T09:47:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: [27/May/2024:09:47:46] ENGINE Serving on http://172.21.15.71:8765 2024-05-27T09:47:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: [27/May/2024:09:47:46] ENGINE Bus STARTED 2024-05-27T09:47:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: mgrmap e22: x(active, since 1.04105s), standbys: y, z 2024-05-27T09:47:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: from='client.25073 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:47.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:47.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:47 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1684663230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: [27/May/2024:09:47:46] ENGINE Bus STARTING 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: [27/May/2024:09:47:46] ENGINE Serving on https://172.21.15.71:7150 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: [27/May/2024:09:47:46] ENGINE Serving on http://172.21.15.71:8765 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: [27/May/2024:09:47:46] ENGINE Bus STARTED 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: mgrmap e22: x(active, since 1.04105s), standbys: y, z 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: from='client.25073 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:47.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:47 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1684663230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: [27/May/2024:09:47:46] ENGINE Bus STARTING 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: [27/May/2024:09:47:46] ENGINE Serving on https://172.21.15.71:7150 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: [27/May/2024:09:47:46] ENGINE Serving on http://172.21.15.71:8765 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: [27/May/2024:09:47:46] ENGINE Bus STARTED 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: mgrmap e22: x(active, since 1.04105s), standbys: y, z 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: from='client.25073 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:47.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:47 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1684663230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 -- 172.21.15.71:0/537463186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7100759a0 msgr2=0x7fa71010b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 --2- 172.21.15.71:0/537463186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7100759a0 0x7fa71010b690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc009860 tx=0x7fa6fc02a340 comp rx=0 tx=0).stop 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 -- 172.21.15.71:0/537463186 shutdown_connections 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 --2- 172.21.15.71:0/537463186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa71010bbd0 0x7fa71010dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 --2- 172.21.15.71:0/537463186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7100759a0 0x7fa71010b690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 --2- 172.21.15.71:0/537463186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa710075050 0x7fa710075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 -- 172.21.15.71:0/537463186 >> 172.21.15.71:0/537463186 conn(0x7fa7100fedf0 msgr2=0x7fa7101012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 -- 172.21.15.71:0/537463186 shutdown_connections 2024-05-27T09:47:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.010+0000 7fa714c00640 1 -- 172.21.15.71:0/537463186 wait complete. 2024-05-27T09:47:48.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.011+0000 7fa714c00640 1 Processor -- start 2024-05-27T09:47:48.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.011+0000 7fa714c00640 1 -- start start 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa714c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa710075050 0x7fa71019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa714c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7100759a0 0x7fa71019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa714c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa71010bbd0 0x7fa7101a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa714c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa710111920 con 0x7fa71010bbd0 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa714c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101117a0 con 0x7fa710075050 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa714c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa710111aa0 con 0x7fa7100759a0 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa70e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa71010bbd0 0x7fa7101a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa70de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa710075050 0x7fa71019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa70d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7100759a0 0x7fa71019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa70e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa71010bbd0 0x7fa7101a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49172/0 (socket says 172.21.15.71:49172) 2024-05-27T09:47:48.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa70de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa710075050 0x7fa71019c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50518/0 (socket says 172.21.15.71:50518) 2024-05-27T09:47:48.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa70de00640 1 -- 172.21.15.71:0/626779916 learned_addr learned my addr 172.21.15.71:0/626779916 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.012+0000 7fa70de00640 1 -- 172.21.15.71:0/626779916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7100759a0 msgr2=0x7fa71019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa70de00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7100759a0 0x7fa71019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa70de00640 1 -- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa71010bbd0 msgr2=0x7fa7101a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa70de00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa71010bbd0 0x7fa7101a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa70de00640 1 -- 172.21.15.71:0/626779916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7101a4040 con 0x7fa710075050 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa70e800640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa71010bbd0 0x7fa7101a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa70de00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa710075050 0x7fa71019c550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e9a0 tx=0x7fa70000ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa706a00640 1 -- 172.21.15.71:0/626779916 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70000cd80 con 0x7fa710075050 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa706a00640 1 -- 172.21.15.71:0/626779916 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7000035f0 con 0x7fa710075050 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7101a4330 con 0x7fa710075050 2024-05-27T09:47:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa706a00640 1 -- 172.21.15.71:0/626779916 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700010690 con 0x7fa710075050 2024-05-27T09:47:48.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.013+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7101a4850 con 0x7fa710075050 2024-05-27T09:47:48.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.014+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa71010a4a0 con 0x7fa710075050 2024-05-27T09:47:48.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.017+0000 7fa706a00640 1 -- 172.21.15.71:0/626779916 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 23) ==== 149823+0+0 (secure 0 0 0) 0x7fa700004020 con 0x7fa710075050 2024-05-27T09:47:48.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.019+0000 7fa706a00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa6f40b29f0 0x7fa6f40b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.020+0000 7fa706a00640 1 -- 172.21.15.71:0/626779916 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa7000e2a70 con 0x7fa710075050 2024-05-27T09:47:48.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.020+0000 7fa70d400640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa6f40b29f0 0x7fa6f40b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.021+0000 7fa70d400640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa6f40b29f0 0x7fa6f40b4f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0304b0 tx=0x7fa6fc000bc0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:48.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.023+0000 7fa706a00640 1 -- 172.21.15.71:0/626779916 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa7000aa2b0 con 0x7fa710075050 2024-05-27T09:47:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.275+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa7100638c0 con 0x7fa710075050 2024-05-27T09:47:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.275+0000 7fa706a00640 1 -- 172.21.15.71:0/626779916 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7fa7000b2330 con 0x7fa710075050 2024-05-27T09:47:48.276 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-05-27T09:47:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa6f40b29f0 msgr2=0x7fa6f40b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa6f40b29f0 0x7fa6f40b4f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0304b0 tx=0x7fa6fc000bc0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa710075050 msgr2=0x7fa71019c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa710075050 0x7fa71019c550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e9a0 tx=0x7fa70000ee60 comp rx=0 tx=0).stop 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 shutdown_connections 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa6f40b29f0 0x7fa6f40b4f00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa71010bbd0 0x7fa7101a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7100759a0 0x7fa71019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 --2- 172.21.15.71:0/626779916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa710075050 0x7fa71019c550 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 >> 172.21.15.71:0/626779916 conn(0x7fa7100fedf0 msgr2=0x7fa710107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 shutdown_connections 2024-05-27T09:47:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.278+0000 7fa714c00640 1 -- 172.21.15.71:0/626779916 wait complete. 2024-05-27T09:47:48.307 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T09:47:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.615+0000 7fe7de000640 1 -- 172.21.15.71:0/40009249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 msgr2=0x7fe7d80754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 --2- 172.21.15.71:0/40009249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d80754c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009900 tx=0x7fe7c802a410 comp rx=0 tx=0).stop 2024-05-27T09:47:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 -- 172.21.15.71:0/40009249 shutdown_connections 2024-05-27T09:47:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 --2- 172.21.15.71:0/40009249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d8110360 0x7fe7d8112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 --2- 172.21.15.71:0/40009249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d8075a00 0x7fe7d810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 --2- 172.21.15.71:0/40009249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d80754c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 -- 172.21.15.71:0/40009249 >> 172.21.15.71:0/40009249 conn(0x7fe7d80fedf0 msgr2=0x7fe7d81012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 -- 172.21.15.71:0/40009249 shutdown_connections 2024-05-27T09:47:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.616+0000 7fe7de000640 1 -- 172.21.15.71:0/40009249 wait complete. 2024-05-27T09:47:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 Processor -- start 2024-05-27T09:47:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 -- start start 2024-05-27T09:47:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d81a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d8075a00 0x7fe7d81a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d8110360 0x7fe7d81a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8115d90 con 0x7fe7d8110360 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8115c10 con 0x7fe7d80750b0 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.617+0000 7fe7de000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8115f10 con 0x7fe7d8075a00 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d81a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d81a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50536/0 (socket says 172.21.15.71:50536) 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 -- 172.21.15.71:0/3561724306 learned_addr learned my addr 172.21.15.71:0/3561724306 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d6a00640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d8075a00 0x7fe7d81a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7e00640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d8110360 0x7fe7d81a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 -- 172.21.15.71:0/3561724306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d8075a00 msgr2=0x7fe7d81a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d8075a00 0x7fe7d81a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 -- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d8110360 msgr2=0x7fe7d81a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d8110360 0x7fe7d81a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 -- 172.21.15.71:0/3561724306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d81a84c0 con 0x7fe7d80750b0 2024-05-27T09:47:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7e00640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d8110360 0x7fe7d81a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:47:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.618+0000 7fe7d7400640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d81a0980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8031440 tx=0x7fe7c8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.619+0000 7fe7cfe00640 1 -- 172.21.15.71:0/3561724306 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c803f070 con 0x7fe7d80750b0 2024-05-27T09:47:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.619+0000 7fe7cfe00640 1 -- 172.21.15.71:0/3561724306 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c8031c50 con 0x7fe7d80750b0 2024-05-27T09:47:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.619+0000 7fe7cfe00640 1 -- 172.21.15.71:0/3561724306 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8035030 con 0x7fe7d80750b0 2024-05-27T09:47:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.619+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d81a8750 con 0x7fe7d80750b0 2024-05-27T09:47:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.619+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d81a8c90 con 0x7fe7d80750b0 2024-05-27T09:47:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.620+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d8105ff0 con 0x7fe7d80750b0 2024-05-27T09:47:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.622+0000 7fe7cfe00640 1 -- 172.21.15.71:0/3561724306 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 23) ==== 149823+0+0 (secure 0 0 0) 0x7fe7c8042070 con 0x7fe7d80750b0 2024-05-27T09:47:48.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.624+0000 7fe7cfe00640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe7bc0b2a70 0x7fe7bc0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.624+0000 7fe7cfe00640 1 -- 172.21.15.71:0/3561724306 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fe7c8102fb0 con 0x7fe7d80750b0 2024-05-27T09:47:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.624+0000 7fe7d6a00640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe7bc0b2a70 0x7fe7bc0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.625+0000 7fe7d6a00640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe7bc0b2a70 0x7fe7bc0b4f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe7d81a1a20 tx=0x7fe7c4005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:48.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.628+0000 7fe7cfe00640 1 -- 172.21.15.71:0/3561724306 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe7c80ca850 con 0x7fe7d80750b0 2024-05-27T09:47:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-05-27T09:47:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2779681229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:47:48.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:48 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/626779916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-27T09:47:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-05-27T09:47:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2779681229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:47:48.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:48 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/626779916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-27T09:47:48.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.869+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe7d80638c0 con 0x7fe7d80750b0 2024-05-27T09:47:48.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.869+0000 7fe7cfe00640 1 -- 172.21.15.71:0/3561724306 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7fe7c80ca150 con 0x7fe7d80750b0 2024-05-27T09:47:48.870 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe7bc0b2a70 msgr2=0x7fe7bc0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe7bc0b2a70 0x7fe7bc0b4f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe7d81a1a20 tx=0x7fe7c4005f90 comp rx=0 tx=0).stop 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 msgr2=0x7fe7d81a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d81a0980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8031440 tx=0x7fe7c8003c10 comp rx=0 tx=0).stop 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 shutdown_connections 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe7bc0b2a70 0x7fe7bc0b4f80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d8110360 0x7fe7d81a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d8075a00 0x7fe7d81a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 --2- 172.21.15.71:0/3561724306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d80750b0 0x7fe7d81a0980 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:48.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 >> 172.21.15.71:0/3561724306 conn(0x7fe7d80fedf0 msgr2=0x7fe7d81031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:48.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 shutdown_connections 2024-05-27T09:47:48.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:48.872+0000 7fe7de000640 1 -- 172.21.15.71:0/3561724306 wait complete. 2024-05-27T09:47:48.899 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-27T09:47:48.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:47:48.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-05-27T09:47:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2779681229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:47:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:48 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/626779916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-27T09:47:49.320 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:49.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi072 to 176.1M 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: Unable to set osd_memory_target on smithi072 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.759 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:49 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3561724306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-27T09:47:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi072 to 176.1M 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: Unable to set osd_memory_target on smithi072 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:49.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:49 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3561724306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-27T09:47:50.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:50.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:50.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi072 to 176.1M 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: Unable to set osd_memory_target on smithi072 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:50.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:50.028 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:49 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3561724306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-27T09:47:50.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:50 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-05-27T09:47:50.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:50 smithi071 ceph-mon[31451]: Unable to set osd_memory_target on smithi122 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:47:50.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:50 smithi071 ceph-mon[31451]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:50.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:50 smithi071 ceph-mon[31451]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-05-27T09:47:50.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:50 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-05-27T09:47:50.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:50 smithi122 ceph-mon[36436]: Unable to set osd_memory_target on smithi122 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:47:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:50 smithi122 ceph-mon[36436]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:50 smithi122 ceph-mon[36436]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-05-27T09:47:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:50 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-05-27T09:47:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:50 smithi072 ceph-mon[35951]: Unable to set osd_memory_target on smithi122 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:47:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:50 smithi072 ceph-mon[35951]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:50 smithi072 ceph-mon[35951]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-05-27T09:47:51.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 -- 172.21.15.71:0/3639870031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320103890 msgr2=0x7ff3201105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:51.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 --2- 172.21.15.71:0/3639870031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320103890 0x7ff3201105b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009990 tx=0x7ff30c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 -- 172.21.15.71:0/3639870031 shutdown_connections 2024-05-27T09:47:51.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 --2- 172.21.15.71:0/3639870031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff320110af0 0x7ff320112f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 --2- 172.21.15.71:0/3639870031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff320102f40 0x7ff320103350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 --2- 172.21.15.71:0/3639870031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320103890 0x7ff3201105b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 -- 172.21.15.71:0/3639870031 >> 172.21.15.71:0/3639870031 conn(0x7ff320078ab0 msgr2=0x7ff320078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:51.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 -- 172.21.15.71:0/3639870031 shutdown_connections 2024-05-27T09:47:51.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.535+0000 7ff325e00700 1 -- 172.21.15.71:0/3639870031 wait complete. 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 Processor -- start 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 -- start start 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320102f40 0x7ff32019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff320103890 0x7ff32019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff320110af0 0x7ff3201a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3201164c0 con 0x7ff320103890 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff320116340 con 0x7ff320102f40 2024-05-27T09:47:51.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.537+0000 7ff325e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff320116640 con 0x7ff320110af0 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320102f40 0x7ff32019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320102f40 0x7ff32019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50552/0 (socket says 172.21.15.71:50552) 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 -- 172.21.15.71:0/451276601 learned_addr learned my addr 172.21.15.71:0/451276601 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff325400700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff320110af0 0x7ff3201a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 -- 172.21.15.71:0/451276601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff320110af0 msgr2=0x7ff3201a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff320110af0 0x7ff3201a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 -- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff320103890 msgr2=0x7ff32019d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff320103890 0x7ff32019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 -- 172.21.15.71:0/451276601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3201a1d80 con 0x7ff320102f40 2024-05-27T09:47:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.538+0000 7ff324a00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320102f40 0x7ff32019ceb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e9a0 tx=0x7ff31400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.539+0000 7ff31d600700 1 -- 172.21.15.71:0/451276601 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31400cbd0 con 0x7ff320102f40 2024-05-27T09:47:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.539+0000 7ff31d600700 1 -- 172.21.15.71:0/451276601 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff31400cd70 con 0x7ff320102f40 2024-05-27T09:47:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.539+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3201a2070 con 0x7ff320102f40 2024-05-27T09:47:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.539+0000 7ff31d600700 1 -- 172.21.15.71:0/451276601 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314018680 con 0x7ff320102f40 2024-05-27T09:47:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.539+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3201a9990 con 0x7ff320102f40 2024-05-27T09:47:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.540+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300005330 con 0x7ff320102f40 2024-05-27T09:47:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.543+0000 7ff31d600700 1 -- 172.21.15.71:0/451276601 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7ff314018820 con 0x7ff320102f40 2024-05-27T09:47:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.544+0000 7ff31d600700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3080b2b90 0x7ff3080b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.545+0000 7ff31d600700 1 -- 172.21.15.71:0/451276601 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff3140e2a60 con 0x7ff320102f40 2024-05-27T09:47:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.545+0000 7ff31fe00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3080b2b90 0x7ff3080b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.546+0000 7ff31fe00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3080b2b90 0x7ff3080b50a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0098e0 tx=0x7ff30c005fb0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.548+0000 7ff31d600700 1 -- 172.21.15.71:0/451276601 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff3140aa1c0 con 0x7ff320102f40 2024-05-27T09:47:51.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.880+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3000058f0 con 0x7ff320102f40 2024-05-27T09:47:51.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.880+0000 7ff31d600700 1 -- 172.21.15.71:0/451276601 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7ff3140a9ac0 con 0x7ff320102f40 2024-05-27T09:47:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:51.882 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:47:51.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.883+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3080b2b90 msgr2=0x7ff3080b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:51.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.883+0000 7ff325e00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3080b2b90 0x7ff3080b50a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0098e0 tx=0x7ff30c005fb0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320102f40 msgr2=0x7ff32019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:51.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320102f40 0x7ff32019ceb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e9a0 tx=0x7ff31400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 shutdown_connections 2024-05-27T09:47:51.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3080b2b90 0x7ff3080b50a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff320110af0 0x7ff3201a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320102f40 0x7ff32019ceb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 --2- 172.21.15.71:0/451276601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff320103890 0x7ff32019d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 >> 172.21.15.71:0/451276601 conn(0x7ff320078ab0 msgr2=0x7ff320111ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 shutdown_connections 2024-05-27T09:47:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:51.884+0000 7ff325e00700 1 -- 172.21.15.71:0/451276601 wait complete. 2024-05-27T09:47:51.887 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:47:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi071 to 176.4M 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Unable to set osd_memory_target on smithi071 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi071:/etc/ceph/ceph.conf 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:52.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:52.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:52.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:51 smithi122 ceph-mon[36436]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:52.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:52.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi071 to 176.4M 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Unable to set osd_memory_target on smithi071 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi071:/etc/ceph/ceph.conf 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:52.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:52.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:52.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:52.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:51 smithi071 ceph-mon[31451]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi071 to 176.4M 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Unable to set osd_memory_target on smithi071 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi071:/etc/ceph/ceph.conf 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi072:/etc/ceph/ceph.conf 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi122:/etc/ceph/ceph.conf 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T09:47:52.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:52.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:51 smithi072 ceph-mon[35951]: Updating smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:52.786 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-27T09:47:52.787 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-27T09:47:52.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T09:47:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:52 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/451276601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:52 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:52 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:52 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:52 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:52 smithi071 ceph-mon[31451]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 -- 172.21.15.71:0/140282935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d01065a0 msgr2=0x7fd3d0112970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 --2- 172.21.15.71:0/140282935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d01065a0 0x7fd3d0112970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009ca0 tx=0x7fd3c802a8c0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 -- 172.21.15.71:0/140282935 shutdown_connections 2024-05-27T09:47:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 --2- 172.21.15.71:0/140282935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d01065a0 0x7fd3d0112970 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 --2- 172.21.15.71:0/140282935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d010c2f0 0x7fd3d0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 --2- 172.21.15.71:0/140282935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3d010be50 0x7fd3d01059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 -- 172.21.15.71:0/140282935 >> 172.21.15.71:0/140282935 conn(0x7fd3d0101640 msgr2=0x7fd3d0103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 -- 172.21.15.71:0/140282935 shutdown_connections 2024-05-27T09:47:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.040+0000 7fd3d8000640 1 -- 172.21.15.71:0/140282935 wait complete. 2024-05-27T09:47:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.041+0000 7fd3d8000640 1 Processor -- start 2024-05-27T09:47:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.041+0000 7fd3d8000640 1 -- start start 2024-05-27T09:47:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d8000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3d01065a0 0x7fd3d01a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d8000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d010be50 0x7fd3d01a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d8000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d010c2f0 0x7fd3d019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d8000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0116040 con 0x7fd3d010c2f0 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d8000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0115ec0 con 0x7fd3d010be50 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d8000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d01161c0 con 0x7fd3d01065a0 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d010c2f0 0x7fd3d019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d010c2f0 0x7fd3d019c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49224/0 (socket says 172.21.15.71:49224) 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d6000640 1 -- 172.21.15.71:0/3266565932 learned_addr learned my addr 172.21.15.71:0/3266565932 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d5600640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3d01065a0 0x7fd3d01a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.042+0000 7fd3d4c00640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d010be50 0x7fd3d01a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3d6000640 1 -- 172.21.15.71:0/3266565932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3d01065a0 msgr2=0x7fd3d01a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3d6000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3d01065a0 0x7fd3d01a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3d6000640 1 -- 172.21.15.71:0/3266565932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d010be50 msgr2=0x7fd3d01a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3d6000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d010be50 0x7fd3d01a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3d6000640 1 -- 172.21.15.71:0/3266565932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d019cee0 con 0x7fd3d010c2f0 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3d5600640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3d01065a0 0x7fd3d01a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3d6000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d010c2f0 0x7fd3d019c800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8005cc0 tx=0x7fd3c8031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.043+0000 7fd3ce000640 1 -- 172.21.15.71:0/3266565932 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8003b70 con 0x7fd3d010c2f0 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.044+0000 7fd3ce000640 1 -- 172.21.15.71:0/3266565932 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3c80318f0 con 0x7fd3d010c2f0 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.044+0000 7fd3ce000640 1 -- 172.21.15.71:0/3266565932 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c802f950 con 0x7fd3d010c2f0 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.044+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d019d170 con 0x7fd3d010c2f0 2024-05-27T09:47:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.044+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d019d670 con 0x7fd3d010c2f0 2024-05-27T09:47:53.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.045+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d0107130 con 0x7fd3d010c2f0 2024-05-27T09:47:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.047+0000 7fd3ce000640 1 -- 172.21.15.71:0/3266565932 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fd3c802fb30 con 0x7fd3d010c2f0 2024-05-27T09:47:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.050+0000 7fd3ce000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3b80b2b00 0x7fd3b80b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.050+0000 7fd3ce000640 1 -- 172.21.15.71:0/3266565932 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fd3c8103c50 con 0x7fd3d010c2f0 2024-05-27T09:47:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.050+0000 7fd3d5600640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3b80b2b00 0x7fd3b80b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.051+0000 7fd3d5600640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3b80b2b00 0x7fd3b80b5010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd3d019db30 tx=0x7fd3c4005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.056+0000 7fd3ce000640 1 -- 172.21.15.71:0/3266565932 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd3c80cb4c0 con 0x7fd3d010c2f0 2024-05-27T09:47:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:52 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/451276601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:52 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:52 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:52 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:52 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:52 smithi122 ceph-mon[36436]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:53.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.262+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3d010dfd0 con 0x7fd3b80b2b00 2024-05-27T09:47:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:52 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/451276601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:52 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:52 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:52 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:52 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:53.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:52 smithi072 ceph-mon[35951]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-05-27T09:47:53.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.275+0000 7fd3ce000640 1 -- 172.21.15.71:0/3266565932 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257767 (secure 0 0 0) 0x7fd3c4004030 con 0x7fd3b80b2b00 2024-05-27T09:47:53.280 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:53.281 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:47:53.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3b80b2b00 msgr2=0x7fd3b80b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3b80b2b00 0x7fd3b80b5010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd3d019db30 tx=0x7fd3c4005f90 comp rx=0 tx=0).stop 2024-05-27T09:47:53.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d010c2f0 msgr2=0x7fd3d019c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d010c2f0 0x7fd3d019c800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8005cc0 tx=0x7fd3c8031700 comp rx=0 tx=0).stop 2024-05-27T09:47:53.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 shutdown_connections 2024-05-27T09:47:53.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3b80b2b00 0x7fd3b80b5010 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d010c2f0 0x7fd3d019c800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d010be50 0x7fd3d01a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 --2- 172.21.15.71:0/3266565932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3d01065a0 0x7fd3d01a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 >> 172.21.15.71:0/3266565932 conn(0x7fd3d0101640 msgr2=0x7fd3d0103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 shutdown_connections 2024-05-27T09:47:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.280+0000 7fd3d8000640 1 -- 172.21.15.71:0/3266565932 wait complete. 2024-05-27T09:47:53.307 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-27T09:47:51.498334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192225,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1494,"num_read_kb":888,"num_write":420,"num_write_kb":3595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":825,"ondisk_log_size":825,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392720,"kb_used_data":14412,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549104,"statfs":{"total":1151940427776,"available":1151538282496,"internally_reserved":0,"allocated":14757888,"data_stored":8957092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":387233085},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.964311"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567379+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:47:45.567379+0000","last_peered":"2024-05-27T09:47:45.567379+0000","last_clean":"2024-05-27T09:47:45.567379+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:47:45.567379+0000","last_undegraded":"2024-05-27T09:47:45.567379+0000","last_fullsized":"2024-05-27T09:47:45.567379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568017+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:47:45.568017+0000","last_peered":"2024-05-27T09:47:45.568017+0000","last_clean":"2024-05-27T09:47:45.568017+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:47:45.568017+0000","last_undegraded":"2024-05-27T09:47:45.568017+0000","last_fullsized":"2024-05-27T09:47:45.568017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567728+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:47:45.567728+0000","last_peered":"2024-05-27T09:47:45.567728+0000","last_clean":"2024-05-27T09:47:45.567728+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:47:45.567728+0000","last_undegraded":"2024-05-27T09:47:45.567728+0000","last_fullsized":"2024-05-27T09:47:45.567728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568318+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:47:45.568318+0000","last_peered":"2024-05-27T09:47:45.568318+0000","last_clean":"2024-05-27T09:47:45.568318+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:47:45.568318+0000","last_undegraded":"2024-05-27T09:47:45.568318+0000","last_fullsized":"2024-05-27T09:47:45.568318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611732+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:47:45.611732+0000","last_peered":"2024-05-27T09:47:45.611732+0000","last_clean":"2024-05-27T09:47:45.611732+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:47:45.611732+0000","last_undegraded":"2024-05-27T09:47:45.611732+0000","last_fullsized":"2024-05-27T09:47:45.611732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568665+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:47:45.568665+0000","last_peered":"2024-05-27T09:47:45.568665+0000","last_clean":"2024-05-27T09:47:45.568665+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:47:45.568665+0000","last_undegraded":"2024-05-27T09:47:45.568665+0000","last_fullsized":"2024-05-27T09:47:45.568665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568108+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:47:45.568108+0000","last_peered":"2024-05-27T09:47:45.568108+0000","last_clean":"2024-05-27T09:47:45.568108+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:47:45.568108+0000","last_undegraded":"2024-05-27T09:47:45.568108+0000","last_fullsized":"2024-05-27T09:47:45.568108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.481164+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:47:45.481164+0000","last_peered":"2024-05-27T09:47:45.481164+0000","last_clean":"2024-05-27T09:47:45.481164+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:47:45.481164+0000","last_undegraded":"2024-05-27T09:47:45.481164+0000","last_fullsized":"2024-05-27T09:47:45.481164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568259+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:47:45.568259+0000","last_peered":"2024-05-27T09:47:45.568259+0000","last_clean":"2024-05-27T09:47:45.568259+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:47:45.568259+0000","last_undegraded":"2024-05-27T09:47:45.568259+0000","last_fullsized":"2024-05-27T09:47:45.568259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569551+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:47:45.569551+0000","last_peered":"2024-05-27T09:47:45.569551+0000","last_clean":"2024-05-27T09:47:45.569551+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:47:45.569551+0000","last_undegraded":"2024-05-27T09:47:45.569551+0000","last_fullsized":"2024-05-27T09:47:45.569551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568159+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:47:45.568159+0000","last_peered":"2024-05-27T09:47:45.568159+0000","last_clean":"2024-05-27T09:47:45.568159+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:47:45.568159+0000","last_undegraded":"2024-05-27T09:47:45.568159+0000","last_fullsized":"2024-05-27T09:47:45.568159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471674+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:47:45.471674+0000","last_peered":"2024-05-27T09:47:45.471674+0000","last_clean":"2024-05-27T09:47:45.471674+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:47:45.471674+0000","last_undegraded":"2024-05-27T09:47:45.471674+0000","last_fullsized":"2024-05-27T09:47:45.471674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567201+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:47:45.567201+0000","last_peered":"2024-05-27T09:47:45.567201+0000","last_clean":"2024-05-27T09:47:45.567201+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:47:45.567201+0000","last_undegraded":"2024-05-27T09:47:45.567201+0000","last_fullsized":"2024-05-27T09:47:45.567201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566981+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:47:45.566981+0000","last_peered":"2024-05-27T09:47:45.566981+0000","last_clean":"2024-05-27T09:47:45.566981+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:47:45.566981+0000","last_undegraded":"2024-05-27T09:47:45.566981+0000","last_fullsized":"2024-05-27T09:47:45.566981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567513+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:47:45.567513+0000","last_peered":"2024-05-27T09:47:45.567513+0000","last_clean":"2024-05-27T09:47:45.567513+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:47:45.567513+0000","last_undegraded":"2024-05-27T09:47:45.567513+0000","last_fullsized":"2024-05-27T09:47:45.567513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568602+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:47:45.568602+0000","last_peered":"2024-05-27T09:47:45.568602+0000","last_clean":"2024-05-27T09:47:45.568602+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:47:45.568602+0000","last_undegraded":"2024-05-27T09:47:45.568602+0000","last_fullsized":"2024-05-27T09:47:45.568602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567617+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:47:45.567617+0000","last_peered":"2024-05-27T09:47:45.567617+0000","last_clean":"2024-05-27T09:47:45.567617+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:47:45.567617+0000","last_undegraded":"2024-05-27T09:47:45.567617+0000","last_fullsized":"2024-05-27T09:47:45.567617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568713+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:47:45.568713+0000","last_peered":"2024-05-27T09:47:45.568713+0000","last_clean":"2024-05-27T09:47:45.568713+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:47:45.568713+0000","last_undegraded":"2024-05-27T09:47:45.568713+0000","last_fullsized":"2024-05-27T09:47:45.568713+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485742+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:47:45.485742+0000","last_peered":"2024-05-27T09:47:45.485742+0000","last_clean":"2024-05-27T09:47:45.485742+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:47:45.485742+0000","last_undegraded":"2024-05-27T09:47:45.485742+0000","last_fullsized":"2024-05-27T09:47:45.485742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486052+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:47:45.486052+0000","last_peered":"2024-05-27T09:47:45.486052+0000","last_clean":"2024-05-27T09:47:45.486052+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:47:45.486052+0000","last_undegraded":"2024-05-27T09:47:45.486052+0000","last_fullsized":"2024-05-27T09:47:45.486052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568331+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:47:45.568331+0000","last_peered":"2024-05-27T09:47:45.568331+0000","last_clean":"2024-05-27T09:47:45.568331+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:47:45.568331+0000","last_undegraded":"2024-05-27T09:47:45.568331+0000","last_fullsized":"2024-05-27T09:47:45.568331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612112+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:47:45.612112+0000","last_peered":"2024-05-27T09:47:45.612112+0000","last_clean":"2024-05-27T09:47:45.612112+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:47:45.612112+0000","last_undegraded":"2024-05-27T09:47:45.612112+0000","last_fullsized":"2024-05-27T09:47:45.612112+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567678+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:47:45.567678+0000","last_peered":"2024-05-27T09:47:45.567678+0000","last_clean":"2024-05-27T09:47:45.567678+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:47:45.567678+0000","last_undegraded":"2024-05-27T09:47:45.567678+0000","last_fullsized":"2024-05-27T09:47:45.567678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611921+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:47:45.611921+0000","last_peered":"2024-05-27T09:47:45.611921+0000","last_clean":"2024-05-27T09:47:45.611921+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:47:45.611921+0000","last_undegraded":"2024-05-27T09:47:45.611921+0000","last_fullsized":"2024-05-27T09:47:45.611921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471350+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:47:45.471350+0000","last_peered":"2024-05-27T09:47:45.471350+0000","last_clean":"2024-05-27T09:47:45.471350+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:47:45.471350+0000","last_undegraded":"2024-05-27T09:47:45.471350+0000","last_fullsized":"2024-05-27T09:47:45.471350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":252,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.677401+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:47:45.677401+0000","last_peered":"2024-05-27T09:47:45.677401+0000","last_clean":"2024-05-27T09:47:45.677401+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:47:45.677401+0000","last_undegraded":"2024-05-27T09:47:45.677401+0000","last_fullsized":"2024-05-27T09:47:45.677401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611693+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:47:45.611693+0000","last_peered":"2024-05-27T09:47:45.611693+0000","last_clean":"2024-05-27T09:47:45.611693+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:47:45.611693+0000","last_undegraded":"2024-05-27T09:47:45.611693+0000","last_fullsized":"2024-05-27T09:47:45.611693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569225+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:47:45.569225+0000","last_peered":"2024-05-27T09:47:45.569225+0000","last_clean":"2024-05-27T09:47:45.569225+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:47:45.569225+0000","last_undegraded":"2024-05-27T09:47:45.569225+0000","last_fullsized":"2024-05-27T09:47:45.569225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471089+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:47:45.471089+0000","last_peered":"2024-05-27T09:47:45.471089+0000","last_clean":"2024-05-27T09:47:45.471089+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:47:45.471089+0000","last_undegraded":"2024-05-27T09:47:45.471089+0000","last_fullsized":"2024-05-27T09:47:45.471089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472110+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:47:45.472110+0000","last_peered":"2024-05-27T09:47:45.472110+0000","last_clean":"2024-05-27T09:47:45.472110+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:47:45.472110+0000","last_undegraded":"2024-05-27T09:47:45.472110+0000","last_fullsized":"2024-05-27T09:47:45.472110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.479557+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:47:45.479557+0000","last_peered":"2024-05-27T09:47:45.479557+0000","last_clean":"2024-05-27T09:47:45.479557+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:47:45.479557+0000","last_undegraded":"2024-05-27T09:47:45.479557+0000","last_fullsized":"2024-05-27T09:47:45.479557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470992+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:47:45.470992+0000","last_peered":"2024-05-27T09:47:45.470992+0000","last_clean":"2024-05-27T09:47:45.470992+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:47:45.470992+0000","last_undegraded":"2024-05-27T09:47:45.470992+0000","last_fullsized":"2024-05-27T09:47:45.470992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567594+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:47:45.567594+0000","last_peered":"2024-05-27T09:47:45.567594+0000","last_clean":"2024-05-27T09:47:45.567594+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:47:45.567594+0000","last_undegraded":"2024-05-27T09:47:45.567594+0000","last_fullsized":"2024-05-27T09:47:45.567594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":248,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.677164+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:47:45.677164+0000","last_peered":"2024-05-27T09:47:45.677164+0000","last_clean":"2024-05-27T09:47:45.677164+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:47:45.677164+0000","last_undegraded":"2024-05-27T09:47:45.677164+0000","last_fullsized":"2024-05-27T09:47:45.677164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":215,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568053+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:47:45.568053+0000","last_peered":"2024-05-27T09:47:45.568053+0000","last_clean":"2024-05-27T09:47:45.568053+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:47:45.568053+0000","last_undegraded":"2024-05-27T09:47:45.568053+0000","last_fullsized":"2024-05-27T09:47:45.568053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569720+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:47:45.569720+0000","last_peered":"2024-05-27T09:47:45.569720+0000","last_clean":"2024-05-27T09:47:45.569720+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:47:45.569720+0000","last_undegraded":"2024-05-27T09:47:45.569720+0000","last_fullsized":"2024-05-27T09:47:45.569720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568263+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:47:45.568263+0000","last_peered":"2024-05-27T09:47:45.568263+0000","last_clean":"2024-05-27T09:47:45.568263+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:47:45.568263+0000","last_undegraded":"2024-05-27T09:47:45.568263+0000","last_fullsized":"2024-05-27T09:47:45.568263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471453+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:47:45.471453+0000","last_peered":"2024-05-27T09:47:45.471453+0000","last_clean":"2024-05-27T09:47:45.471453+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:47:45.471453+0000","last_undegraded":"2024-05-27T09:47:45.471453+0000","last_fullsized":"2024-05-27T09:47:45.471453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567808+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:47:45.567808+0000","last_peered":"2024-05-27T09:47:45.567808+0000","last_clean":"2024-05-27T09:47:45.567808+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:47:45.567808+0000","last_undegraded":"2024-05-27T09:47:45.567808+0000","last_fullsized":"2024-05-27T09:47:45.567808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'38","reported_seq":509,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.818991+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:47:45.818991+0000","last_peered":"2024-05-27T09:47:45.818991+0000","last_clean":"2024-05-27T09:47:45.818991+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:47:45.818991+0000","last_undegraded":"2024-05-27T09:47:45.818991+0000","last_fullsized":"2024-05-27T09:47:45.818991+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71492,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":291,"num_write":39,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611862+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:47:45.611862+0000","last_peered":"2024-05-27T09:47:45.611862+0000","last_clean":"2024-05-27T09:47:45.611862+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:47:45.611862+0000","last_undegraded":"2024-05-27T09:47:45.611862+0000","last_fullsized":"2024-05-27T09:47:45.611862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567350+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:47:45.567350+0000","last_peered":"2024-05-27T09:47:45.567350+0000","last_clean":"2024-05-27T09:47:45.567350+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:47:45.567350+0000","last_undegraded":"2024-05-27T09:47:45.567350+0000","last_fullsized":"2024-05-27T09:47:45.567350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471788+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:47:45.471788+0000","last_peered":"2024-05-27T09:47:45.471788+0000","last_clean":"2024-05-27T09:47:45.471788+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:47:45.471788+0000","last_undegraded":"2024-05-27T09:47:45.471788+0000","last_fullsized":"2024-05-27T09:47:45.471788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470915+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:47:45.470915+0000","last_peered":"2024-05-27T09:47:45.470915+0000","last_clean":"2024-05-27T09:47:45.470915+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:47:45.470915+0000","last_undegraded":"2024-05-27T09:47:45.470915+0000","last_fullsized":"2024-05-27T09:47:45.470915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569506+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:47:45.569506+0000","last_peered":"2024-05-27T09:47:45.569506+0000","last_clean":"2024-05-27T09:47:45.569506+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:47:45.569506+0000","last_undegraded":"2024-05-27T09:47:45.569506+0000","last_fullsized":"2024-05-27T09:47:45.569506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'7","reported_seq":255,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.804328+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:47:45.804328+0000","last_peered":"2024-05-27T09:47:45.804328+0000","last_clean":"2024-05-27T09:47:45.804328+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:47:45.804328+0000","last_undegraded":"2024-05-27T09:47:45.804328+0000","last_fullsized":"2024-05-27T09:47:45.804328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566845+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:47:45.566845+0000","last_peered":"2024-05-27T09:47:45.566845+0000","last_clean":"2024-05-27T09:47:45.566845+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:47:45.566845+0000","last_undegraded":"2024-05-27T09:47:45.566845+0000","last_fullsized":"2024-05-27T09:47:45.566845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470885+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:47:45.470885+0000","last_peered":"2024-05-27T09:47:45.470885+0000","last_clean":"2024-05-27T09:47:45.470885+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:47:45.470885+0000","last_undegraded":"2024-05-27T09:47:45.470885+0000","last_fullsized":"2024-05-27T09:47:45.470885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612202+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:47:45.612202+0000","last_peered":"2024-05-27T09:47:45.612202+0000","last_clean":"2024-05-27T09:47:45.612202+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:47:45.612202+0000","last_undegraded":"2024-05-27T09:47:45.612202+0000","last_fullsized":"2024-05-27T09:47:45.612202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567195+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:47:45.567195+0000","last_peered":"2024-05-27T09:47:45.567195+0000","last_clean":"2024-05-27T09:47:45.567195+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:47:45.567195+0000","last_undegraded":"2024-05-27T09:47:45.567195+0000","last_fullsized":"2024-05-27T09:47:45.567195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568334+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:47:45.568334+0000","last_peered":"2024-05-27T09:47:45.568334+0000","last_clean":"2024-05-27T09:47:45.568334+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:47:45.568334+0000","last_undegraded":"2024-05-27T09:47:45.568334+0000","last_fullsized":"2024-05-27T09:47:45.568334+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568914+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:47:45.568914+0000","last_peered":"2024-05-27T09:47:45.568914+0000","last_clean":"2024-05-27T09:47:45.568914+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:47:45.568914+0000","last_undegraded":"2024-05-27T09:47:45.568914+0000","last_fullsized":"2024-05-27T09:47:45.568914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569028+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:47:45.569028+0000","last_peered":"2024-05-27T09:47:45.569028+0000","last_clean":"2024-05-27T09:47:45.569028+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:47:45.569028+0000","last_undegraded":"2024-05-27T09:47:45.569028+0000","last_fullsized":"2024-05-27T09:47:45.569028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568828+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:47:45.568828+0000","last_peered":"2024-05-27T09:47:45.568828+0000","last_clean":"2024-05-27T09:47:45.568828+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:47:45.568828+0000","last_undegraded":"2024-05-27T09:47:45.568828+0000","last_fullsized":"2024-05-27T09:47:45.568828+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471321+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:47:45.471321+0000","last_peered":"2024-05-27T09:47:45.471321+0000","last_clean":"2024-05-27T09:47:45.471321+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:47:45.471321+0000","last_undegraded":"2024-05-27T09:47:45.471321+0000","last_fullsized":"2024-05-27T09:47:45.471321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":250,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.771431+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:47:45.771431+0000","last_peered":"2024-05-27T09:47:45.771431+0000","last_clean":"2024-05-27T09:47:45.771431+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:47:45.771431+0000","last_undegraded":"2024-05-27T09:47:45.771431+0000","last_fullsized":"2024-05-27T09:47:45.771431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":215,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567538+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:47:45.567538+0000","last_peered":"2024-05-27T09:47:45.567538+0000","last_clean":"2024-05-27T09:47:45.567538+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:47:45.567538+0000","last_undegraded":"2024-05-27T09:47:45.567538+0000","last_fullsized":"2024-05-27T09:47:45.567538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567756+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:47:45.567756+0000","last_peered":"2024-05-27T09:47:45.567756+0000","last_clean":"2024-05-27T09:47:45.567756+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:47:45.567756+0000","last_undegraded":"2024-05-27T09:47:45.567756+0000","last_fullsized":"2024-05-27T09:47:45.567756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":105,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568109+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:47:45.568109+0000","last_peered":"2024-05-27T09:47:45.568109+0000","last_clean":"2024-05-27T09:47:45.568109+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:47:45.568109+0000","last_undegraded":"2024-05-27T09:47:45.568109+0000","last_fullsized":"2024-05-27T09:47:45.568109+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471392+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:47:45.471392+0000","last_peered":"2024-05-27T09:47:45.471392+0000","last_clean":"2024-05-27T09:47:45.471392+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:47:45.471392+0000","last_undegraded":"2024-05-27T09:47:45.471392+0000","last_fullsized":"2024-05-27T09:47:45.471392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568413+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:47:45.568413+0000","last_peered":"2024-05-27T09:47:45.568413+0000","last_clean":"2024-05-27T09:47:45.568413+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:47:45.568413+0000","last_undegraded":"2024-05-27T09:47:45.568413+0000","last_fullsized":"2024-05-27T09:47:45.568413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612036+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:47:45.612036+0000","last_peered":"2024-05-27T09:47:45.612036+0000","last_clean":"2024-05-27T09:47:45.612036+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:47:45.612036+0000","last_undegraded":"2024-05-27T09:47:45.612036+0000","last_fullsized":"2024-05-27T09:47:45.612036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472435+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:47:45.472435+0000","last_peered":"2024-05-27T09:47:45.472435+0000","last_clean":"2024-05-27T09:47:45.472435+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:47:45.472435+0000","last_undegraded":"2024-05-27T09:47:45.472435+0000","last_fullsized":"2024-05-27T09:47:45.472435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'48","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.746614+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:47:45.746614+0000","last_peered":"2024-05-27T09:47:45.746614+0000","last_clean":"2024-05-27T09:47:45.746614+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:47:45.746614+0000","last_undegraded":"2024-05-27T09:47:45.746614+0000","last_fullsized":"2024-05-27T09:47:45.746614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486293+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:47:45.486293+0000","last_peered":"2024-05-27T09:47:45.486293+0000","last_clean":"2024-05-27T09:47:45.486293+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:47:45.486293+0000","last_undegraded":"2024-05-27T09:47:45.486293+0000","last_fullsized":"2024-05-27T09:47:45.486293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569098+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:47:45.569098+0000","last_peered":"2024-05-27T09:47:45.569098+0000","last_clean":"2024-05-27T09:47:45.569098+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:47:45.569098+0000","last_undegraded":"2024-05-27T09:47:45.569098+0000","last_fullsized":"2024-05-27T09:47:45.569098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568081+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:47:45.568081+0000","last_peered":"2024-05-27T09:47:45.568081+0000","last_clean":"2024-05-27T09:47:45.568081+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:47:45.568081+0000","last_undegraded":"2024-05-27T09:47:45.568081+0000","last_fullsized":"2024-05-27T09:47:45.568081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567460+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:47:45.567460+0000","last_peered":"2024-05-27T09:47:45.567460+0000","last_clean":"2024-05-27T09:47:45.567460+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:47:45.567460+0000","last_undegraded":"2024-05-27T09:47:45.567460+0000","last_fullsized":"2024-05-27T09:47:45.567460+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611649+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:47:45.611649+0000","last_peered":"2024-05-27T09:47:45.611649+0000","last_clean":"2024-05-27T09:47:45.611649+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:47:45.611649+0000","last_undegraded":"2024-05-27T09:47:45.611649+0000","last_fullsized":"2024-05-27T09:47:45.611649+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483545+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:47:45.483545+0000","last_peered":"2024-05-27T09:47:45.483545+0000","last_clean":"2024-05-27T09:47:45.483545+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:47:45.483545+0000","last_undegraded":"2024-05-27T09:47:45.483545+0000","last_fullsized":"2024-05-27T09:47:45.483545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566902+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:47:45.566902+0000","last_peered":"2024-05-27T09:47:45.566902+0000","last_clean":"2024-05-27T09:47:45.566902+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:47:45.566902+0000","last_undegraded":"2024-05-27T09:47:45.566902+0000","last_fullsized":"2024-05-27T09:47:45.566902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566936+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:47:45.566936+0000","last_peered":"2024-05-27T09:47:45.566936+0000","last_clean":"2024-05-27T09:47:45.566936+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:47:45.566936+0000","last_undegraded":"2024-05-27T09:47:45.566936+0000","last_fullsized":"2024-05-27T09:47:45.566936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485069+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:47:45.485069+0000","last_peered":"2024-05-27T09:47:45.485069+0000","last_clean":"2024-05-27T09:47:45.485069+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:47:45.485069+0000","last_undegraded":"2024-05-27T09:47:45.485069+0000","last_fullsized":"2024-05-27T09:47:45.485069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611750+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:47:45.611750+0000","last_peered":"2024-05-27T09:47:45.611750+0000","last_clean":"2024-05-27T09:47:45.611750+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:47:45.611750+0000","last_undegraded":"2024-05-27T09:47:45.611750+0000","last_fullsized":"2024-05-27T09:47:45.611750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569176+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:47:45.569176+0000","last_peered":"2024-05-27T09:47:45.569176+0000","last_clean":"2024-05-27T09:47:45.569176+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:47:45.569176+0000","last_undegraded":"2024-05-27T09:47:45.569176+0000","last_fullsized":"2024-05-27T09:47:45.569176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567397+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:47:45.567397+0000","last_peered":"2024-05-27T09:47:45.567397+0000","last_clean":"2024-05-27T09:47:45.567397+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:47:45.567397+0000","last_undegraded":"2024-05-27T09:47:45.567397+0000","last_fullsized":"2024-05-27T09:47:45.567397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569739+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:47:45.569739+0000","last_peered":"2024-05-27T09:47:45.569739+0000","last_clean":"2024-05-27T09:47:45.569739+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:47:45.569739+0000","last_undegraded":"2024-05-27T09:47:45.569739+0000","last_fullsized":"2024-05-27T09:47:45.569739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.742943+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:47:45.742943+0000","last_peered":"2024-05-27T09:47:45.742943+0000","last_clean":"2024-05-27T09:47:45.742943+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:47:45.742943+0000","last_undegraded":"2024-05-27T09:47:45.742943+0000","last_fullsized":"2024-05-27T09:47:45.742943+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569485+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:47:45.569485+0000","last_peered":"2024-05-27T09:47:45.569485+0000","last_clean":"2024-05-27T09:47:45.569485+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:47:45.569485+0000","last_undegraded":"2024-05-27T09:47:45.569485+0000","last_fullsized":"2024-05-27T09:47:45.569485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471807+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:47:45.471807+0000","last_peered":"2024-05-27T09:47:45.471807+0000","last_clean":"2024-05-27T09:47:45.471807+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:47:45.471807+0000","last_undegraded":"2024-05-27T09:47:45.471807+0000","last_fullsized":"2024-05-27T09:47:45.471807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569836+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:47:45.569836+0000","last_peered":"2024-05-27T09:47:45.569836+0000","last_clean":"2024-05-27T09:47:45.569836+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:47:45.569836+0000","last_undegraded":"2024-05-27T09:47:45.569836+0000","last_fullsized":"2024-05-27T09:47:45.569836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567079+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:47:45.567079+0000","last_peered":"2024-05-27T09:47:45.567079+0000","last_clean":"2024-05-27T09:47:45.567079+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:47:45.567079+0000","last_undegraded":"2024-05-27T09:47:45.567079+0000","last_fullsized":"2024-05-27T09:47:45.567079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567564+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:47:45.567564+0000","last_peered":"2024-05-27T09:47:45.567564+0000","last_clean":"2024-05-27T09:47:45.567564+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:47:45.567564+0000","last_undegraded":"2024-05-27T09:47:45.567564+0000","last_fullsized":"2024-05-27T09:47:45.567564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566915+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:47:45.566915+0000","last_peered":"2024-05-27T09:47:45.566915+0000","last_clean":"2024-05-27T09:47:45.566915+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:47:45.566915+0000","last_undegraded":"2024-05-27T09:47:45.566915+0000","last_fullsized":"2024-05-27T09:47:45.566915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567424+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:47:45.567424+0000","last_peered":"2024-05-27T09:47:45.567424+0000","last_clean":"2024-05-27T09:47:45.567424+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:47:45.567424+0000","last_undegraded":"2024-05-27T09:47:45.567424+0000","last_fullsized":"2024-05-27T09:47:45.567424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472340+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:47:45.472340+0000","last_peered":"2024-05-27T09:47:45.472340+0000","last_clean":"2024-05-27T09:47:45.472340+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:47:45.472340+0000","last_undegraded":"2024-05-27T09:47:45.472340+0000","last_fullsized":"2024-05-27T09:47:45.472340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567070+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:47:45.567070+0000","last_peered":"2024-05-27T09:47:45.567070+0000","last_clean":"2024-05-27T09:47:45.567070+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:47:45.567070+0000","last_undegraded":"2024-05-27T09:47:45.567070+0000","last_fullsized":"2024-05-27T09:47:45.567070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567527+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:47:45.567527+0000","last_peered":"2024-05-27T09:47:45.567527+0000","last_clean":"2024-05-27T09:47:45.567527+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:47:45.567527+0000","last_undegraded":"2024-05-27T09:47:45.567527+0000","last_fullsized":"2024-05-27T09:47:45.567527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486199+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:47:45.486199+0000","last_peered":"2024-05-27T09:47:45.486199+0000","last_clean":"2024-05-27T09:47:45.486199+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:47:45.486199+0000","last_undegraded":"2024-05-27T09:47:45.486199+0000","last_fullsized":"2024-05-27T09:47:45.486199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471079+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:47:45.471079+0000","last_peered":"2024-05-27T09:47:45.471079+0000","last_clean":"2024-05-27T09:47:45.471079+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:47:45.471079+0000","last_undegraded":"2024-05-27T09:47:45.471079+0000","last_fullsized":"2024-05-27T09:47:45.471079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483079+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:47:45.483079+0000","last_peered":"2024-05-27T09:47:45.483079+0000","last_clean":"2024-05-27T09:47:45.483079+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:47:45.483079+0000","last_undegraded":"2024-05-27T09:47:45.483079+0000","last_fullsized":"2024-05-27T09:47:45.483079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471895+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:47:45.471895+0000","last_peered":"2024-05-27T09:47:45.471895+0000","last_clean":"2024-05-27T09:47:45.471895+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:47:45.471895+0000","last_undegraded":"2024-05-27T09:47:45.471895+0000","last_fullsized":"2024-05-27T09:47:45.471895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566971+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:47:45.566971+0000","last_peered":"2024-05-27T09:47:45.566971+0000","last_clean":"2024-05-27T09:47:45.566971+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:47:45.566971+0000","last_undegraded":"2024-05-27T09:47:45.566971+0000","last_fullsized":"2024-05-27T09:47:45.566971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601623,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1413,"num_read_kb":819,"num_write":295,"num_write_kb":1443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2039808,"data_stored":1804869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612673,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":921600,"data_stored":449225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1757184,"data_stored":1245000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005130,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716840,"statfs":{"total":95995035648,"available":95966044160,"internally_reserved":0,"allocated":1323008,"data_stored":842565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201362,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36624,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708528,"statfs":{"total":95995035648,"available":95957532672,"internally_reserved":0,"allocated":1314816,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397592,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1523712,"data_stored":1041340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593819,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":448738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":991232,"data_stored":519241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738495,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":450009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411444,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":521764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149805,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1462272,"data_stored":973865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953576,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":450489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790051,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1671168,"data_stored":1172483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":393842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":205984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:47:53.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T09:47:53.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 -- 172.21.15.71:0/3087679357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109ee0 msgr2=0x7ffa9c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/3087679357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109ee0 0x7ffa9c103b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009900 tx=0x7ffa8402a410 comp rx=0 tx=0).stop 2024-05-27T09:47:53.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 -- 172.21.15.71:0/3087679357 shutdown_connections 2024-05-27T09:47:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/3087679357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c1041a0 0x7ffa9c1104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/3087679357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109ee0 0x7ffa9c103b30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/3087679357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c109a40 0x7ffa9c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 -- 172.21.15.71:0/3087679357 >> 172.21.15.71:0/3087679357 conn(0x7ffa9c0ff250 msgr2=0x7ffa9c101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 -- 172.21.15.71:0/3087679357 shutdown_connections 2024-05-27T09:47:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.607+0000 7ffaa1a00640 1 -- 172.21.15.71:0/3087679357 wait complete. 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.608+0000 7ffaa1a00640 1 Processor -- start 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.608+0000 7ffaa1a00640 1 -- start start 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffaa1a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c1041a0 0x7ffa9c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffaa1a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109a40 0x7ffa9c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffaa1a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c109ee0 0x7ffa9c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffaa1a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c113c40 con 0x7ffa9c109a40 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffaa1a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c113ac0 con 0x7ffa9c109ee0 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffaa1a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c113dc0 con 0x7ffa9c1041a0 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffa9be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c1041a0 0x7ffa9c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffa9be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c1041a0 0x7ffa9c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59434/0 (socket says 172.21.15.71:59434) 2024-05-27T09:47:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffaa1000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c109ee0 0x7ffa9c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffa9be00640 1 -- 172.21.15.71:0/1867725330 learned_addr learned my addr 172.21.15.71:0/1867725330 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.609+0000 7ffa93e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109a40 0x7ffa9c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa9be00640 1 -- 172.21.15.71:0/1867725330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c109ee0 msgr2=0x7ffa9c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa9be00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c109ee0 0x7ffa9c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa9be00640 1 -- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109a40 msgr2=0x7ffa9c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa9be00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109a40 0x7ffa9c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa9be00640 1 -- 172.21.15.71:0/1867725330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c19f480 con 0x7ffa9c1041a0 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffaa1000640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c109ee0 0x7ffa9c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa9be00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c1041a0 0x7ffa9c19a620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00e9f0 tx=0x7ffa8c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:53.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa99600640 1 -- 172.21.15.71:0/1867725330 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00ccc0 con 0x7ffa9c1041a0 2024-05-27T09:47:53.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa99600640 1 -- 172.21.15.71:0/1867725330 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa8c0108e0 con 0x7ffa9c1041a0 2024-05-27T09:47:53.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9c19f770 con 0x7ffa9c1041a0 2024-05-27T09:47:53.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffa99600640 1 -- 172.21.15.71:0/1867725330 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c018860 con 0x7ffa9c1041a0 2024-05-27T09:47:53.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.610+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9c1a70f0 con 0x7ffa9c1041a0 2024-05-27T09:47:53.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.611+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c104d30 con 0x7ffa9c1041a0 2024-05-27T09:47:53.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.614+0000 7ffa99600640 1 -- 172.21.15.71:0/1867725330 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7ffa8c010430 con 0x7ffa9c1041a0 2024-05-27T09:47:53.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.616+0000 7ffa99600640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ffa800b2a70 0x7ffa800b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:53.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.616+0000 7ffa99600640 1 -- 172.21.15.71:0/1867725330 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ffa8c0e2ff0 con 0x7ffa9c1041a0 2024-05-27T09:47:53.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.616+0000 7ffa93e00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ffa800b2a70 0x7ffa800b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:53.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.617+0000 7ffa93e00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ffa800b2a70 0x7ffa800b4f80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009230 tx=0x7ffa84031400 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:53.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.618+0000 7ffa99600640 1 -- 172.21.15.71:0/1867725330 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffa8c0aa160 con 0x7ffa9c1041a0 2024-05-27T09:47:53.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.844+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa9c0ffd70 con 0x7ffa800b2a70 2024-05-27T09:47:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.868+0000 7ffa99600640 1 -- 172.21.15.71:0/1867725330 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257743 (secure 0 0 0) 0x7ffa9c0ffd70 con 0x7ffa800b2a70 2024-05-27T09:47:53.872 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:53.873 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:47:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ffa800b2a70 msgr2=0x7ffa800b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ffa800b2a70 0x7ffa800b4f80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009230 tx=0x7ffa84031400 comp rx=0 tx=0).stop 2024-05-27T09:47:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c1041a0 msgr2=0x7ffa9c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c1041a0 0x7ffa9c19a620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00e9f0 tx=0x7ffa8c00eeb0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 shutdown_connections 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ffa800b2a70 0x7ffa800b4f80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c109ee0 0x7ffa9c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa9c109a40 0x7ffa9c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 --2- 172.21.15.71:0/1867725330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa9c1041a0 0x7ffa9c19a620 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.873+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 >> 172.21.15.71:0/1867725330 conn(0x7ffa9c0ff250 msgr2=0x7ffa9c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.874+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 shutdown_connections 2024-05-27T09:47:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:53.874+0000 7ffaa1a00640 1 -- 172.21.15.71:0/1867725330 wait complete. 2024-05-27T09:47:53.904 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-05-27T09:47:53.499072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1195918,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1591,"num_read_kb":1089,"num_write":438,"num_write_kb":3602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":837,"ondisk_log_size":837,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396880,"kb_used_data":14424,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544944,"statfs":{"total":1151940427776,"available":1151534022656,"internally_reserved":0,"allocated":14770176,"data_stored":8970126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":391492925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3693,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":201,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.965049"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567379+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:47:45.567379+0000","last_peered":"2024-05-27T09:47:45.567379+0000","last_clean":"2024-05-27T09:47:45.567379+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:47:45.567379+0000","last_undegraded":"2024-05-27T09:47:45.567379+0000","last_fullsized":"2024-05-27T09:47:45.567379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568017+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:47:45.568017+0000","last_peered":"2024-05-27T09:47:45.568017+0000","last_clean":"2024-05-27T09:47:45.568017+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:47:45.568017+0000","last_undegraded":"2024-05-27T09:47:45.568017+0000","last_fullsized":"2024-05-27T09:47:45.568017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567728+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:47:45.567728+0000","last_peered":"2024-05-27T09:47:45.567728+0000","last_clean":"2024-05-27T09:47:45.567728+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:47:45.567728+0000","last_undegraded":"2024-05-27T09:47:45.567728+0000","last_fullsized":"2024-05-27T09:47:45.567728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568371+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:47:45.568371+0000","last_peered":"2024-05-27T09:47:45.568371+0000","last_clean":"2024-05-27T09:47:45.568371+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:47:45.568371+0000","last_undegraded":"2024-05-27T09:47:45.568371+0000","last_fullsized":"2024-05-27T09:47:45.568371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611732+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:47:45.611732+0000","last_peered":"2024-05-27T09:47:45.611732+0000","last_clean":"2024-05-27T09:47:45.611732+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:47:45.611732+0000","last_undegraded":"2024-05-27T09:47:45.611732+0000","last_fullsized":"2024-05-27T09:47:45.611732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568665+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:47:45.568665+0000","last_peered":"2024-05-27T09:47:45.568665+0000","last_clean":"2024-05-27T09:47:45.568665+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:47:45.568665+0000","last_undegraded":"2024-05-27T09:47:45.568665+0000","last_fullsized":"2024-05-27T09:47:45.568665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568108+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:47:45.568108+0000","last_peered":"2024-05-27T09:47:45.568108+0000","last_clean":"2024-05-27T09:47:45.568108+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:47:45.568108+0000","last_undegraded":"2024-05-27T09:47:45.568108+0000","last_fullsized":"2024-05-27T09:47:45.568108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.481164+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:47:45.481164+0000","last_peered":"2024-05-27T09:47:45.481164+0000","last_clean":"2024-05-27T09:47:45.481164+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:47:45.481164+0000","last_undegraded":"2024-05-27T09:47:45.481164+0000","last_fullsized":"2024-05-27T09:47:45.481164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568259+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:47:45.568259+0000","last_peered":"2024-05-27T09:47:45.568259+0000","last_clean":"2024-05-27T09:47:45.568259+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:47:45.568259+0000","last_undegraded":"2024-05-27T09:47:45.568259+0000","last_fullsized":"2024-05-27T09:47:45.568259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569551+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:47:45.569551+0000","last_peered":"2024-05-27T09:47:45.569551+0000","last_clean":"2024-05-27T09:47:45.569551+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:47:45.569551+0000","last_undegraded":"2024-05-27T09:47:45.569551+0000","last_fullsized":"2024-05-27T09:47:45.569551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568159+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:47:45.568159+0000","last_peered":"2024-05-27T09:47:45.568159+0000","last_clean":"2024-05-27T09:47:45.568159+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:47:45.568159+0000","last_undegraded":"2024-05-27T09:47:45.568159+0000","last_fullsized":"2024-05-27T09:47:45.568159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471674+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:47:45.471674+0000","last_peered":"2024-05-27T09:47:45.471674+0000","last_clean":"2024-05-27T09:47:45.471674+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:47:45.471674+0000","last_undegraded":"2024-05-27T09:47:45.471674+0000","last_fullsized":"2024-05-27T09:47:45.471674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567201+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:47:45.567201+0000","last_peered":"2024-05-27T09:47:45.567201+0000","last_clean":"2024-05-27T09:47:45.567201+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:47:45.567201+0000","last_undegraded":"2024-05-27T09:47:45.567201+0000","last_fullsized":"2024-05-27T09:47:45.567201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566981+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:47:45.566981+0000","last_peered":"2024-05-27T09:47:45.566981+0000","last_clean":"2024-05-27T09:47:45.566981+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:47:45.566981+0000","last_undegraded":"2024-05-27T09:47:45.566981+0000","last_fullsized":"2024-05-27T09:47:45.566981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567513+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:47:45.567513+0000","last_peered":"2024-05-27T09:47:45.567513+0000","last_clean":"2024-05-27T09:47:45.567513+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:47:45.567513+0000","last_undegraded":"2024-05-27T09:47:45.567513+0000","last_fullsized":"2024-05-27T09:47:45.567513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568602+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:47:45.568602+0000","last_peered":"2024-05-27T09:47:45.568602+0000","last_clean":"2024-05-27T09:47:45.568602+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:47:45.568602+0000","last_undegraded":"2024-05-27T09:47:45.568602+0000","last_fullsized":"2024-05-27T09:47:45.568602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567617+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:47:45.567617+0000","last_peered":"2024-05-27T09:47:45.567617+0000","last_clean":"2024-05-27T09:47:45.567617+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:47:45.567617+0000","last_undegraded":"2024-05-27T09:47:45.567617+0000","last_fullsized":"2024-05-27T09:47:45.567617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568741+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:47:45.568741+0000","last_peered":"2024-05-27T09:47:45.568741+0000","last_clean":"2024-05-27T09:47:45.568741+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:47:45.568741+0000","last_undegraded":"2024-05-27T09:47:45.568741+0000","last_fullsized":"2024-05-27T09:47:45.568741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485742+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:47:45.485742+0000","last_peered":"2024-05-27T09:47:45.485742+0000","last_clean":"2024-05-27T09:47:45.485742+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:47:45.485742+0000","last_undegraded":"2024-05-27T09:47:45.485742+0000","last_fullsized":"2024-05-27T09:47:45.485742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486083+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:47:45.486083+0000","last_peered":"2024-05-27T09:47:45.486083+0000","last_clean":"2024-05-27T09:47:45.486083+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:47:45.486083+0000","last_undegraded":"2024-05-27T09:47:45.486083+0000","last_fullsized":"2024-05-27T09:47:45.486083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568331+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:47:45.568331+0000","last_peered":"2024-05-27T09:47:45.568331+0000","last_clean":"2024-05-27T09:47:45.568331+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:47:45.568331+0000","last_undegraded":"2024-05-27T09:47:45.568331+0000","last_fullsized":"2024-05-27T09:47:45.568331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612112+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:47:45.612112+0000","last_peered":"2024-05-27T09:47:45.612112+0000","last_clean":"2024-05-27T09:47:45.612112+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:47:45.612112+0000","last_undegraded":"2024-05-27T09:47:45.612112+0000","last_fullsized":"2024-05-27T09:47:45.612112+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567678+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:47:45.567678+0000","last_peered":"2024-05-27T09:47:45.567678+0000","last_clean":"2024-05-27T09:47:45.567678+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:47:45.567678+0000","last_undegraded":"2024-05-27T09:47:45.567678+0000","last_fullsized":"2024-05-27T09:47:45.567678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611921+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:47:45.611921+0000","last_peered":"2024-05-27T09:47:45.611921+0000","last_clean":"2024-05-27T09:47:45.611921+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:47:45.611921+0000","last_undegraded":"2024-05-27T09:47:45.611921+0000","last_fullsized":"2024-05-27T09:47:45.611921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471350+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:47:45.471350+0000","last_peered":"2024-05-27T09:47:45.471350+0000","last_clean":"2024-05-27T09:47:45.471350+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:47:45.471350+0000","last_undegraded":"2024-05-27T09:47:45.471350+0000","last_fullsized":"2024-05-27T09:47:45.471350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":259,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.683857+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:47:49.683857+0000","last_peered":"2024-05-27T09:47:49.683857+0000","last_clean":"2024-05-27T09:47:49.683857+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:47:49.683857+0000","last_undegraded":"2024-05-27T09:47:49.683857+0000","last_fullsized":"2024-05-27T09:47:49.683857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611693+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:47:45.611693+0000","last_peered":"2024-05-27T09:47:45.611693+0000","last_clean":"2024-05-27T09:47:45.611693+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:47:45.611693+0000","last_undegraded":"2024-05-27T09:47:45.611693+0000","last_fullsized":"2024-05-27T09:47:45.611693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569225+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:47:45.569225+0000","last_peered":"2024-05-27T09:47:45.569225+0000","last_clean":"2024-05-27T09:47:45.569225+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:47:45.569225+0000","last_undegraded":"2024-05-27T09:47:45.569225+0000","last_fullsized":"2024-05-27T09:47:45.569225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471089+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:47:45.471089+0000","last_peered":"2024-05-27T09:47:45.471089+0000","last_clean":"2024-05-27T09:47:45.471089+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:47:45.471089+0000","last_undegraded":"2024-05-27T09:47:45.471089+0000","last_fullsized":"2024-05-27T09:47:45.471089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472110+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:47:45.472110+0000","last_peered":"2024-05-27T09:47:45.472110+0000","last_clean":"2024-05-27T09:47:45.472110+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:47:45.472110+0000","last_undegraded":"2024-05-27T09:47:45.472110+0000","last_fullsized":"2024-05-27T09:47:45.472110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.479557+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:47:45.479557+0000","last_peered":"2024-05-27T09:47:45.479557+0000","last_clean":"2024-05-27T09:47:45.479557+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:47:45.479557+0000","last_undegraded":"2024-05-27T09:47:45.479557+0000","last_fullsized":"2024-05-27T09:47:45.479557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470992+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:47:45.470992+0000","last_peered":"2024-05-27T09:47:45.470992+0000","last_clean":"2024-05-27T09:47:45.470992+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:47:45.470992+0000","last_undegraded":"2024-05-27T09:47:45.470992+0000","last_fullsized":"2024-05-27T09:47:45.470992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567594+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:47:45.567594+0000","last_peered":"2024-05-27T09:47:45.567594+0000","last_clean":"2024-05-27T09:47:45.567594+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:47:45.567594+0000","last_undegraded":"2024-05-27T09:47:45.567594+0000","last_fullsized":"2024-05-27T09:47:45.567594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.683354+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:47:49.683354+0000","last_peered":"2024-05-27T09:47:49.683354+0000","last_clean":"2024-05-27T09:47:49.683354+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:47:49.683354+0000","last_undegraded":"2024-05-27T09:47:49.683354+0000","last_fullsized":"2024-05-27T09:47:49.683354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568053+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:47:45.568053+0000","last_peered":"2024-05-27T09:47:45.568053+0000","last_clean":"2024-05-27T09:47:45.568053+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:47:45.568053+0000","last_undegraded":"2024-05-27T09:47:45.568053+0000","last_fullsized":"2024-05-27T09:47:45.568053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569720+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:47:45.569720+0000","last_peered":"2024-05-27T09:47:45.569720+0000","last_clean":"2024-05-27T09:47:45.569720+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:47:45.569720+0000","last_undegraded":"2024-05-27T09:47:45.569720+0000","last_fullsized":"2024-05-27T09:47:45.569720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568263+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:47:45.568263+0000","last_peered":"2024-05-27T09:47:45.568263+0000","last_clean":"2024-05-27T09:47:45.568263+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:47:45.568263+0000","last_undegraded":"2024-05-27T09:47:45.568263+0000","last_fullsized":"2024-05-27T09:47:45.568263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471453+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:47:45.471453+0000","last_peered":"2024-05-27T09:47:45.471453+0000","last_clean":"2024-05-27T09:47:45.471453+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:47:45.471453+0000","last_undegraded":"2024-05-27T09:47:45.471453+0000","last_fullsized":"2024-05-27T09:47:45.471453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567808+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:47:45.567808+0000","last_peered":"2024-05-27T09:47:45.567808+0000","last_clean":"2024-05-27T09:47:45.567808+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:47:45.567808+0000","last_undegraded":"2024-05-27T09:47:45.567808+0000","last_fullsized":"2024-05-27T09:47:45.567808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:50.830644+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:47:50.830644+0000","last_peered":"2024-05-27T09:47:50.830644+0000","last_clean":"2024-05-27T09:47:50.830644+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:47:50.830644+0000","last_undegraded":"2024-05-27T09:47:50.830644+0000","last_fullsized":"2024-05-27T09:47:50.830644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74403,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":300,"num_write":41,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611862+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:47:45.611862+0000","last_peered":"2024-05-27T09:47:45.611862+0000","last_clean":"2024-05-27T09:47:45.611862+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:47:45.611862+0000","last_undegraded":"2024-05-27T09:47:45.611862+0000","last_fullsized":"2024-05-27T09:47:45.611862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567350+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:47:45.567350+0000","last_peered":"2024-05-27T09:47:45.567350+0000","last_clean":"2024-05-27T09:47:45.567350+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:47:45.567350+0000","last_undegraded":"2024-05-27T09:47:45.567350+0000","last_fullsized":"2024-05-27T09:47:45.567350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471788+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:47:45.471788+0000","last_peered":"2024-05-27T09:47:45.471788+0000","last_clean":"2024-05-27T09:47:45.471788+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:47:45.471788+0000","last_undegraded":"2024-05-27T09:47:45.471788+0000","last_fullsized":"2024-05-27T09:47:45.471788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470915+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:47:45.470915+0000","last_peered":"2024-05-27T09:47:45.470915+0000","last_clean":"2024-05-27T09:47:45.470915+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:47:45.470915+0000","last_undegraded":"2024-05-27T09:47:45.470915+0000","last_fullsized":"2024-05-27T09:47:45.470915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569506+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:47:45.569506+0000","last_peered":"2024-05-27T09:47:45.569506+0000","last_clean":"2024-05-27T09:47:45.569506+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:47:45.569506+0000","last_undegraded":"2024-05-27T09:47:45.569506+0000","last_fullsized":"2024-05-27T09:47:45.569506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":262,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.779156+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:47:49.779156+0000","last_peered":"2024-05-27T09:47:49.779156+0000","last_clean":"2024-05-27T09:47:49.779156+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:47:49.779156+0000","last_undegraded":"2024-05-27T09:47:49.779156+0000","last_fullsized":"2024-05-27T09:47:49.779156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":7,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566845+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:47:45.566845+0000","last_peered":"2024-05-27T09:47:45.566845+0000","last_clean":"2024-05-27T09:47:45.566845+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:47:45.566845+0000","last_undegraded":"2024-05-27T09:47:45.566845+0000","last_fullsized":"2024-05-27T09:47:45.566845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470885+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:47:45.470885+0000","last_peered":"2024-05-27T09:47:45.470885+0000","last_clean":"2024-05-27T09:47:45.470885+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:47:45.470885+0000","last_undegraded":"2024-05-27T09:47:45.470885+0000","last_fullsized":"2024-05-27T09:47:45.470885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612202+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:47:45.612202+0000","last_peered":"2024-05-27T09:47:45.612202+0000","last_clean":"2024-05-27T09:47:45.612202+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:47:45.612202+0000","last_undegraded":"2024-05-27T09:47:45.612202+0000","last_fullsized":"2024-05-27T09:47:45.612202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567195+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:47:45.567195+0000","last_peered":"2024-05-27T09:47:45.567195+0000","last_clean":"2024-05-27T09:47:45.567195+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:47:45.567195+0000","last_undegraded":"2024-05-27T09:47:45.567195+0000","last_fullsized":"2024-05-27T09:47:45.567195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568334+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:47:45.568334+0000","last_peered":"2024-05-27T09:47:45.568334+0000","last_clean":"2024-05-27T09:47:45.568334+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:47:45.568334+0000","last_undegraded":"2024-05-27T09:47:45.568334+0000","last_fullsized":"2024-05-27T09:47:45.568334+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568914+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:47:45.568914+0000","last_peered":"2024-05-27T09:47:45.568914+0000","last_clean":"2024-05-27T09:47:45.568914+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:47:45.568914+0000","last_undegraded":"2024-05-27T09:47:45.568914+0000","last_fullsized":"2024-05-27T09:47:45.568914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569028+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:47:45.569028+0000","last_peered":"2024-05-27T09:47:45.569028+0000","last_clean":"2024-05-27T09:47:45.569028+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:47:45.569028+0000","last_undegraded":"2024-05-27T09:47:45.569028+0000","last_fullsized":"2024-05-27T09:47:45.569028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568828+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:47:45.568828+0000","last_peered":"2024-05-27T09:47:45.568828+0000","last_clean":"2024-05-27T09:47:45.568828+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:47:45.568828+0000","last_undegraded":"2024-05-27T09:47:45.568828+0000","last_fullsized":"2024-05-27T09:47:45.568828+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471321+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:47:45.471321+0000","last_peered":"2024-05-27T09:47:45.471321+0000","last_clean":"2024-05-27T09:47:45.471321+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:47:45.471321+0000","last_undegraded":"2024-05-27T09:47:45.471321+0000","last_fullsized":"2024-05-27T09:47:45.471321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":255,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.778151+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:47:49.778151+0000","last_peered":"2024-05-27T09:47:49.778151+0000","last_clean":"2024-05-27T09:47:49.778151+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:47:49.778151+0000","last_undegraded":"2024-05-27T09:47:49.778151+0000","last_fullsized":"2024-05-27T09:47:49.778151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567538+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:47:45.567538+0000","last_peered":"2024-05-27T09:47:45.567538+0000","last_clean":"2024-05-27T09:47:45.567538+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:47:45.567538+0000","last_undegraded":"2024-05-27T09:47:45.567538+0000","last_fullsized":"2024-05-27T09:47:45.567538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567756+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:47:45.567756+0000","last_peered":"2024-05-27T09:47:45.567756+0000","last_clean":"2024-05-27T09:47:45.567756+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:47:45.567756+0000","last_undegraded":"2024-05-27T09:47:45.567756+0000","last_fullsized":"2024-05-27T09:47:45.567756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"84'99","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:47.624529+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:47:47.624529+0000","last_peered":"2024-05-27T09:47:47.624529+0000","last_clean":"2024-05-27T09:47:47.624529+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:47:47.624529+0000","last_undegraded":"2024-05-27T09:47:47.624529+0000","last_fullsized":"2024-05-27T09:47:47.624529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471392+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:47:45.471392+0000","last_peered":"2024-05-27T09:47:45.471392+0000","last_clean":"2024-05-27T09:47:45.471392+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:47:45.471392+0000","last_undegraded":"2024-05-27T09:47:45.471392+0000","last_fullsized":"2024-05-27T09:47:45.471392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568413+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:47:45.568413+0000","last_peered":"2024-05-27T09:47:45.568413+0000","last_clean":"2024-05-27T09:47:45.568413+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:47:45.568413+0000","last_undegraded":"2024-05-27T09:47:45.568413+0000","last_fullsized":"2024-05-27T09:47:45.568413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612036+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:47:45.612036+0000","last_peered":"2024-05-27T09:47:45.612036+0000","last_clean":"2024-05-27T09:47:45.612036+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:47:45.612036+0000","last_undegraded":"2024-05-27T09:47:45.612036+0000","last_fullsized":"2024-05-27T09:47:45.612036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472435+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:47:45.472435+0000","last_peered":"2024-05-27T09:47:45.472435+0000","last_clean":"2024-05-27T09:47:45.472435+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:47:45.472435+0000","last_undegraded":"2024-05-27T09:47:45.472435+0000","last_fullsized":"2024-05-27T09:47:45.472435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'49","reported_seq":101,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.749698+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:47:45.749698+0000","last_peered":"2024-05-27T09:47:45.749698+0000","last_clean":"2024-05-27T09:47:45.749698+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:47:45.749698+0000","last_undegraded":"2024-05-27T09:47:45.749698+0000","last_fullsized":"2024-05-27T09:47:45.749698+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486293+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:47:45.486293+0000","last_peered":"2024-05-27T09:47:45.486293+0000","last_clean":"2024-05-27T09:47:45.486293+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:47:45.486293+0000","last_undegraded":"2024-05-27T09:47:45.486293+0000","last_fullsized":"2024-05-27T09:47:45.486293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569098+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:47:45.569098+0000","last_peered":"2024-05-27T09:47:45.569098+0000","last_clean":"2024-05-27T09:47:45.569098+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:47:45.569098+0000","last_undegraded":"2024-05-27T09:47:45.569098+0000","last_fullsized":"2024-05-27T09:47:45.569098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568081+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:47:45.568081+0000","last_peered":"2024-05-27T09:47:45.568081+0000","last_clean":"2024-05-27T09:47:45.568081+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:47:45.568081+0000","last_undegraded":"2024-05-27T09:47:45.568081+0000","last_fullsized":"2024-05-27T09:47:45.568081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567460+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:47:45.567460+0000","last_peered":"2024-05-27T09:47:45.567460+0000","last_clean":"2024-05-27T09:47:45.567460+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:47:45.567460+0000","last_undegraded":"2024-05-27T09:47:45.567460+0000","last_fullsized":"2024-05-27T09:47:45.567460+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611649+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:47:45.611649+0000","last_peered":"2024-05-27T09:47:45.611649+0000","last_clean":"2024-05-27T09:47:45.611649+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:47:45.611649+0000","last_undegraded":"2024-05-27T09:47:45.611649+0000","last_fullsized":"2024-05-27T09:47:45.611649+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483545+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:47:45.483545+0000","last_peered":"2024-05-27T09:47:45.483545+0000","last_clean":"2024-05-27T09:47:45.483545+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:47:45.483545+0000","last_undegraded":"2024-05-27T09:47:45.483545+0000","last_fullsized":"2024-05-27T09:47:45.483545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566902+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:47:45.566902+0000","last_peered":"2024-05-27T09:47:45.566902+0000","last_clean":"2024-05-27T09:47:45.566902+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:47:45.566902+0000","last_undegraded":"2024-05-27T09:47:45.566902+0000","last_fullsized":"2024-05-27T09:47:45.566902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566936+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:47:45.566936+0000","last_peered":"2024-05-27T09:47:45.566936+0000","last_clean":"2024-05-27T09:47:45.566936+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:47:45.566936+0000","last_undegraded":"2024-05-27T09:47:45.566936+0000","last_fullsized":"2024-05-27T09:47:45.566936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485069+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:47:45.485069+0000","last_peered":"2024-05-27T09:47:45.485069+0000","last_clean":"2024-05-27T09:47:45.485069+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:47:45.485069+0000","last_undegraded":"2024-05-27T09:47:45.485069+0000","last_fullsized":"2024-05-27T09:47:45.485069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611750+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:47:45.611750+0000","last_peered":"2024-05-27T09:47:45.611750+0000","last_clean":"2024-05-27T09:47:45.611750+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:47:45.611750+0000","last_undegraded":"2024-05-27T09:47:45.611750+0000","last_fullsized":"2024-05-27T09:47:45.611750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569176+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:47:45.569176+0000","last_peered":"2024-05-27T09:47:45.569176+0000","last_clean":"2024-05-27T09:47:45.569176+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:47:45.569176+0000","last_undegraded":"2024-05-27T09:47:45.569176+0000","last_fullsized":"2024-05-27T09:47:45.569176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567397+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:47:45.567397+0000","last_peered":"2024-05-27T09:47:45.567397+0000","last_clean":"2024-05-27T09:47:45.567397+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:47:45.567397+0000","last_undegraded":"2024-05-27T09:47:45.567397+0000","last_fullsized":"2024-05-27T09:47:45.567397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569739+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:47:45.569739+0000","last_peered":"2024-05-27T09:47:45.569739+0000","last_clean":"2024-05-27T09:47:45.569739+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:47:45.569739+0000","last_undegraded":"2024-05-27T09:47:45.569739+0000","last_fullsized":"2024-05-27T09:47:45.569739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.742943+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:47:45.742943+0000","last_peered":"2024-05-27T09:47:45.742943+0000","last_clean":"2024-05-27T09:47:45.742943+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:47:45.742943+0000","last_undegraded":"2024-05-27T09:47:45.742943+0000","last_fullsized":"2024-05-27T09:47:45.742943+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569485+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:47:45.569485+0000","last_peered":"2024-05-27T09:47:45.569485+0000","last_clean":"2024-05-27T09:47:45.569485+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:47:45.569485+0000","last_undegraded":"2024-05-27T09:47:45.569485+0000","last_fullsized":"2024-05-27T09:47:45.569485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471807+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:47:45.471807+0000","last_peered":"2024-05-27T09:47:45.471807+0000","last_clean":"2024-05-27T09:47:45.471807+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:47:45.471807+0000","last_undegraded":"2024-05-27T09:47:45.471807+0000","last_fullsized":"2024-05-27T09:47:45.471807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569836+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:47:45.569836+0000","last_peered":"2024-05-27T09:47:45.569836+0000","last_clean":"2024-05-27T09:47:45.569836+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:47:45.569836+0000","last_undegraded":"2024-05-27T09:47:45.569836+0000","last_fullsized":"2024-05-27T09:47:45.569836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567079+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:47:45.567079+0000","last_peered":"2024-05-27T09:47:45.567079+0000","last_clean":"2024-05-27T09:47:45.567079+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:47:45.567079+0000","last_undegraded":"2024-05-27T09:47:45.567079+0000","last_fullsized":"2024-05-27T09:47:45.567079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567564+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:47:45.567564+0000","last_peered":"2024-05-27T09:47:45.567564+0000","last_clean":"2024-05-27T09:47:45.567564+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:47:45.567564+0000","last_undegraded":"2024-05-27T09:47:45.567564+0000","last_fullsized":"2024-05-27T09:47:45.567564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566915+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:47:45.566915+0000","last_peered":"2024-05-27T09:47:45.566915+0000","last_clean":"2024-05-27T09:47:45.566915+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:47:45.566915+0000","last_undegraded":"2024-05-27T09:47:45.566915+0000","last_fullsized":"2024-05-27T09:47:45.566915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567424+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:47:45.567424+0000","last_peered":"2024-05-27T09:47:45.567424+0000","last_clean":"2024-05-27T09:47:45.567424+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:47:45.567424+0000","last_undegraded":"2024-05-27T09:47:45.567424+0000","last_fullsized":"2024-05-27T09:47:45.567424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472340+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:47:45.472340+0000","last_peered":"2024-05-27T09:47:45.472340+0000","last_clean":"2024-05-27T09:47:45.472340+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:47:45.472340+0000","last_undegraded":"2024-05-27T09:47:45.472340+0000","last_fullsized":"2024-05-27T09:47:45.472340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567070+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:47:45.567070+0000","last_peered":"2024-05-27T09:47:45.567070+0000","last_clean":"2024-05-27T09:47:45.567070+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:47:45.567070+0000","last_undegraded":"2024-05-27T09:47:45.567070+0000","last_fullsized":"2024-05-27T09:47:45.567070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567527+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:47:45.567527+0000","last_peered":"2024-05-27T09:47:45.567527+0000","last_clean":"2024-05-27T09:47:45.567527+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:47:45.567527+0000","last_undegraded":"2024-05-27T09:47:45.567527+0000","last_fullsized":"2024-05-27T09:47:45.567527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486199+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:47:45.486199+0000","last_peered":"2024-05-27T09:47:45.486199+0000","last_clean":"2024-05-27T09:47:45.486199+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:47:45.486199+0000","last_undegraded":"2024-05-27T09:47:45.486199+0000","last_fullsized":"2024-05-27T09:47:45.486199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471079+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:47:45.471079+0000","last_peered":"2024-05-27T09:47:45.471079+0000","last_clean":"2024-05-27T09:47:45.471079+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:47:45.471079+0000","last_undegraded":"2024-05-27T09:47:45.471079+0000","last_fullsized":"2024-05-27T09:47:45.471079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483079+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:47:45.483079+0000","last_peered":"2024-05-27T09:47:45.483079+0000","last_clean":"2024-05-27T09:47:45.483079+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:47:45.483079+0000","last_undegraded":"2024-05-27T09:47:45.483079+0000","last_fullsized":"2024-05-27T09:47:45.483079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471895+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:47:45.471895+0000","last_peered":"2024-05-27T09:47:45.471895+0000","last_clean":"2024-05-27T09:47:45.471895+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:47:45.471895+0000","last_undegraded":"2024-05-27T09:47:45.471895+0000","last_fullsized":"2024-05-27T09:47:45.471895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566971+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:47:45.566971+0000","last_peered":"2024-05-27T09:47:45.566971+0000","last_clean":"2024-05-27T09:47:45.566971+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:47:45.566971+0000","last_undegraded":"2024-05-27T09:47:45.566971+0000","last_fullsized":"2024-05-27T09:47:45.566971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":605316,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1447,"num_read_kb":841,"num_write":301,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2052096,"data_stored":1815948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612674,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":921600,"data_stored":449225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37056,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708096,"statfs":{"total":95995035648,"available":95957090304,"internally_reserved":0,"allocated":1761280,"data_stored":1248302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005131,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716840,"statfs":{"total":95995035648,"available":95966044160,"internally_reserved":0,"allocated":1323008,"data_stored":842565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201363,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708532,"statfs":{"total":95995035648,"available":95957536768,"internally_reserved":0,"allocated":1314816,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397593,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1523712,"data_stored":1043295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593820,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":448738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":522934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":450009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":525066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149806,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1462272,"data_stored":973865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953577,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":450880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790052,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1671168,"data_stored":1172874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":76535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":393842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":209286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:47:53.908 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-27T09:47:53.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.223+0000 7f53da000640 1 -- 172.21.15.71:0/599705180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410be50 msgr2=0x7f53d41059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.223+0000 7f53da000640 1 --2- 172.21.15.71:0/599705180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410be50 0x7f53d41059f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009900 tx=0x7f53c402a410 comp rx=0 tx=0).stop 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.223+0000 7f53da000640 1 -- 172.21.15.71:0/599705180 shutdown_connections 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.223+0000 7f53da000640 1 --2- 172.21.15.71:0/599705180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d41065a0 0x7f53d4112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.223+0000 7f53da000640 1 --2- 172.21.15.71:0/599705180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d410c2f0 0x7f53d4105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.223+0000 7f53da000640 1 --2- 172.21.15.71:0/599705180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410be50 0x7f53d41059f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.223+0000 7f53da000640 1 -- 172.21.15.71:0/599705180 >> 172.21.15.71:0/599705180 conn(0x7f53d4101640 msgr2=0x7f53d4103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.224+0000 7f53da000640 1 -- 172.21.15.71:0/599705180 shutdown_connections 2024-05-27T09:47:54.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.224+0000 7f53da000640 1 -- 172.21.15.71:0/599705180 wait complete. 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 Processor -- start 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 -- start start 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d41065a0 0x7f53d41a2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d410be50 0x7f53d41a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410c2f0 0x7f53d419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4116050 con 0x7f53d410c2f0 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4115ed0 con 0x7f53d410be50 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.225+0000 7f53da000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41161d0 con 0x7f53d41065a0 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d41065a0 0x7f53d41a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410c2f0 0x7f53d419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d41065a0 0x7f53d41a2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39938/0 (socket says 172.21.15.71:39938) 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 -- 172.21.15.71:0/4247516041 learned_addr learned my addr 172.21.15.71:0/4247516041 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d2a00640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d410be50 0x7f53d41a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 -- 172.21.15.71:0/4247516041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d410be50 msgr2=0x7f53d41a2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d410be50 0x7f53d41a2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 -- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410c2f0 msgr2=0x7f53d419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410c2f0 0x7f53d419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 -- 172.21.15.71:0/4247516041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d419cf10 con 0x7f53d41065a0 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3e00640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410c2f0 0x7f53d419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.226+0000 7f53d3400640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d41065a0 0x7f53d41a2660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53c4032fd0 tx=0x7f53c4031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.227+0000 7f53cbe00640 1 -- 172.21.15.71:0/4247516041 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c403f030 con 0x7f53d41065a0 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.227+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d419d1a0 con 0x7f53d41065a0 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.227+0000 7f53cbe00640 1 -- 172.21.15.71:0/4247516041 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c4004490 con 0x7f53d41065a0 2024-05-27T09:47:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.227+0000 7f53cbe00640 1 -- 172.21.15.71:0/4247516041 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4035070 con 0x7f53d41065a0 2024-05-27T09:47:54.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.227+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d419d690 con 0x7f53d41065a0 2024-05-27T09:47:54.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.228+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d406a230 con 0x7f53d41065a0 2024-05-27T09:47:54.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.231+0000 7f53cbe00640 1 -- 172.21.15.71:0/4247516041 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f53c4042030 con 0x7f53d41065a0 2024-05-27T09:47:54.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.232+0000 7f53cbe00640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a80 0x7f53b80b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:54.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.232+0000 7f53cbe00640 1 -- 172.21.15.71:0/4247516041 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f53c4102ee0 con 0x7f53d41065a0 2024-05-27T09:47:54.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.232+0000 7f53d2a00640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a80 0x7f53b80b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:54.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.233+0000 7f53d2a00640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a80 0x7f53b80b4f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f53d41032f0 tx=0x7f53bc005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:54.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.234+0000 7f53cbe00640 1 -- 172.21.15.71:0/4247516041 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f53c40ca120 con 0x7f53d41065a0 2024-05-27T09:47:54.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.437+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53d4103aa0 con 0x7f53b80b2a80 2024-05-27T09:47:54.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.458+0000 7f53cbe00640 1 -- 172.21.15.71:0/4247516041 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257743 (secure 0 0 0) 0x7f53d4103aa0 con 0x7f53b80b2a80 2024-05-27T09:47:54.463 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:54.464 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:47:54.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.463+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a80 msgr2=0x7f53b80b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:54.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.463+0000 7f53da000640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a80 0x7f53b80b4f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f53d41032f0 tx=0x7f53bc005f90 comp rx=0 tx=0).stop 2024-05-27T09:47:54.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.463+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d41065a0 msgr2=0x7f53d41a2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.463+0000 7f53da000640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d41065a0 0x7f53d41a2660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53c4032fd0 tx=0x7f53c4031a20 comp rx=0 tx=0).stop 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 shutdown_connections 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a80 0x7f53b80b4f90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d410c2f0 0x7f53d419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d410be50 0x7f53d41a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 --2- 172.21.15.71:0/4247516041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d41065a0 0x7f53d41a2660 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 >> 172.21.15.71:0/4247516041 conn(0x7f53d4101640 msgr2=0x7f53d4103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 shutdown_connections 2024-05-27T09:47:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:54.464+0000 7f53da000640 1 -- 172.21.15.71:0/4247516041 wait complete. 2024-05-27T09:47:54.491 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-05-27T09:47:53.499072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1195918,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1591,"num_read_kb":1089,"num_write":438,"num_write_kb":3602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":837,"ondisk_log_size":837,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396880,"kb_used_data":14424,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544944,"statfs":{"total":1151940427776,"available":1151534022656,"internally_reserved":0,"allocated":14770176,"data_stored":8970126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":391492925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3693,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":201,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.965049"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567379+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:47:45.567379+0000","last_peered":"2024-05-27T09:47:45.567379+0000","last_clean":"2024-05-27T09:47:45.567379+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:47:45.567379+0000","last_undegraded":"2024-05-27T09:47:45.567379+0000","last_fullsized":"2024-05-27T09:47:45.567379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568017+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:47:45.568017+0000","last_peered":"2024-05-27T09:47:45.568017+0000","last_clean":"2024-05-27T09:47:45.568017+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:47:45.568017+0000","last_undegraded":"2024-05-27T09:47:45.568017+0000","last_fullsized":"2024-05-27T09:47:45.568017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567728+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:47:45.567728+0000","last_peered":"2024-05-27T09:47:45.567728+0000","last_clean":"2024-05-27T09:47:45.567728+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:47:45.567728+0000","last_undegraded":"2024-05-27T09:47:45.567728+0000","last_fullsized":"2024-05-27T09:47:45.567728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568371+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:47:45.568371+0000","last_peered":"2024-05-27T09:47:45.568371+0000","last_clean":"2024-05-27T09:47:45.568371+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:47:45.568371+0000","last_undegraded":"2024-05-27T09:47:45.568371+0000","last_fullsized":"2024-05-27T09:47:45.568371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611732+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:47:45.611732+0000","last_peered":"2024-05-27T09:47:45.611732+0000","last_clean":"2024-05-27T09:47:45.611732+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:47:45.611732+0000","last_undegraded":"2024-05-27T09:47:45.611732+0000","last_fullsized":"2024-05-27T09:47:45.611732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568665+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:47:45.568665+0000","last_peered":"2024-05-27T09:47:45.568665+0000","last_clean":"2024-05-27T09:47:45.568665+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:47:45.568665+0000","last_undegraded":"2024-05-27T09:47:45.568665+0000","last_fullsized":"2024-05-27T09:47:45.568665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568108+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:47:45.568108+0000","last_peered":"2024-05-27T09:47:45.568108+0000","last_clean":"2024-05-27T09:47:45.568108+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:47:45.568108+0000","last_undegraded":"2024-05-27T09:47:45.568108+0000","last_fullsized":"2024-05-27T09:47:45.568108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.481164+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:47:45.481164+0000","last_peered":"2024-05-27T09:47:45.481164+0000","last_clean":"2024-05-27T09:47:45.481164+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:47:45.481164+0000","last_undegraded":"2024-05-27T09:47:45.481164+0000","last_fullsized":"2024-05-27T09:47:45.481164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568259+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:47:45.568259+0000","last_peered":"2024-05-27T09:47:45.568259+0000","last_clean":"2024-05-27T09:47:45.568259+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:47:45.568259+0000","last_undegraded":"2024-05-27T09:47:45.568259+0000","last_fullsized":"2024-05-27T09:47:45.568259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569551+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:47:45.569551+0000","last_peered":"2024-05-27T09:47:45.569551+0000","last_clean":"2024-05-27T09:47:45.569551+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:47:45.569551+0000","last_undegraded":"2024-05-27T09:47:45.569551+0000","last_fullsized":"2024-05-27T09:47:45.569551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568159+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:47:45.568159+0000","last_peered":"2024-05-27T09:47:45.568159+0000","last_clean":"2024-05-27T09:47:45.568159+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:47:45.568159+0000","last_undegraded":"2024-05-27T09:47:45.568159+0000","last_fullsized":"2024-05-27T09:47:45.568159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471674+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:47:45.471674+0000","last_peered":"2024-05-27T09:47:45.471674+0000","last_clean":"2024-05-27T09:47:45.471674+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:47:45.471674+0000","last_undegraded":"2024-05-27T09:47:45.471674+0000","last_fullsized":"2024-05-27T09:47:45.471674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567201+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:47:45.567201+0000","last_peered":"2024-05-27T09:47:45.567201+0000","last_clean":"2024-05-27T09:47:45.567201+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:47:45.567201+0000","last_undegraded":"2024-05-27T09:47:45.567201+0000","last_fullsized":"2024-05-27T09:47:45.567201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566981+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:47:45.566981+0000","last_peered":"2024-05-27T09:47:45.566981+0000","last_clean":"2024-05-27T09:47:45.566981+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:47:45.566981+0000","last_undegraded":"2024-05-27T09:47:45.566981+0000","last_fullsized":"2024-05-27T09:47:45.566981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567513+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:47:45.567513+0000","last_peered":"2024-05-27T09:47:45.567513+0000","last_clean":"2024-05-27T09:47:45.567513+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:47:45.567513+0000","last_undegraded":"2024-05-27T09:47:45.567513+0000","last_fullsized":"2024-05-27T09:47:45.567513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568602+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:47:45.568602+0000","last_peered":"2024-05-27T09:47:45.568602+0000","last_clean":"2024-05-27T09:47:45.568602+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:47:45.568602+0000","last_undegraded":"2024-05-27T09:47:45.568602+0000","last_fullsized":"2024-05-27T09:47:45.568602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567617+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:47:45.567617+0000","last_peered":"2024-05-27T09:47:45.567617+0000","last_clean":"2024-05-27T09:47:45.567617+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:47:45.567617+0000","last_undegraded":"2024-05-27T09:47:45.567617+0000","last_fullsized":"2024-05-27T09:47:45.567617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568741+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:47:45.568741+0000","last_peered":"2024-05-27T09:47:45.568741+0000","last_clean":"2024-05-27T09:47:45.568741+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:47:45.568741+0000","last_undegraded":"2024-05-27T09:47:45.568741+0000","last_fullsized":"2024-05-27T09:47:45.568741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485742+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:47:45.485742+0000","last_peered":"2024-05-27T09:47:45.485742+0000","last_clean":"2024-05-27T09:47:45.485742+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:47:45.485742+0000","last_undegraded":"2024-05-27T09:47:45.485742+0000","last_fullsized":"2024-05-27T09:47:45.485742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486083+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:47:45.486083+0000","last_peered":"2024-05-27T09:47:45.486083+0000","last_clean":"2024-05-27T09:47:45.486083+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:47:45.486083+0000","last_undegraded":"2024-05-27T09:47:45.486083+0000","last_fullsized":"2024-05-27T09:47:45.486083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568331+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:47:45.568331+0000","last_peered":"2024-05-27T09:47:45.568331+0000","last_clean":"2024-05-27T09:47:45.568331+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:47:45.568331+0000","last_undegraded":"2024-05-27T09:47:45.568331+0000","last_fullsized":"2024-05-27T09:47:45.568331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612112+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:47:45.612112+0000","last_peered":"2024-05-27T09:47:45.612112+0000","last_clean":"2024-05-27T09:47:45.612112+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:47:45.612112+0000","last_undegraded":"2024-05-27T09:47:45.612112+0000","last_fullsized":"2024-05-27T09:47:45.612112+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567678+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:47:45.567678+0000","last_peered":"2024-05-27T09:47:45.567678+0000","last_clean":"2024-05-27T09:47:45.567678+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:47:45.567678+0000","last_undegraded":"2024-05-27T09:47:45.567678+0000","last_fullsized":"2024-05-27T09:47:45.567678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611921+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:47:45.611921+0000","last_peered":"2024-05-27T09:47:45.611921+0000","last_clean":"2024-05-27T09:47:45.611921+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:47:45.611921+0000","last_undegraded":"2024-05-27T09:47:45.611921+0000","last_fullsized":"2024-05-27T09:47:45.611921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471350+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:47:45.471350+0000","last_peered":"2024-05-27T09:47:45.471350+0000","last_clean":"2024-05-27T09:47:45.471350+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:47:45.471350+0000","last_undegraded":"2024-05-27T09:47:45.471350+0000","last_fullsized":"2024-05-27T09:47:45.471350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":259,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.683857+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:47:49.683857+0000","last_peered":"2024-05-27T09:47:49.683857+0000","last_clean":"2024-05-27T09:47:49.683857+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:47:49.683857+0000","last_undegraded":"2024-05-27T09:47:49.683857+0000","last_fullsized":"2024-05-27T09:47:49.683857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611693+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:47:45.611693+0000","last_peered":"2024-05-27T09:47:45.611693+0000","last_clean":"2024-05-27T09:47:45.611693+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:47:45.611693+0000","last_undegraded":"2024-05-27T09:47:45.611693+0000","last_fullsized":"2024-05-27T09:47:45.611693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569225+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:47:45.569225+0000","last_peered":"2024-05-27T09:47:45.569225+0000","last_clean":"2024-05-27T09:47:45.569225+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:47:45.569225+0000","last_undegraded":"2024-05-27T09:47:45.569225+0000","last_fullsized":"2024-05-27T09:47:45.569225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471089+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:47:45.471089+0000","last_peered":"2024-05-27T09:47:45.471089+0000","last_clean":"2024-05-27T09:47:45.471089+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:47:45.471089+0000","last_undegraded":"2024-05-27T09:47:45.471089+0000","last_fullsized":"2024-05-27T09:47:45.471089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472110+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:47:45.472110+0000","last_peered":"2024-05-27T09:47:45.472110+0000","last_clean":"2024-05-27T09:47:45.472110+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:47:45.472110+0000","last_undegraded":"2024-05-27T09:47:45.472110+0000","last_fullsized":"2024-05-27T09:47:45.472110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.479557+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:47:45.479557+0000","last_peered":"2024-05-27T09:47:45.479557+0000","last_clean":"2024-05-27T09:47:45.479557+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:47:45.479557+0000","last_undegraded":"2024-05-27T09:47:45.479557+0000","last_fullsized":"2024-05-27T09:47:45.479557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470992+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:47:45.470992+0000","last_peered":"2024-05-27T09:47:45.470992+0000","last_clean":"2024-05-27T09:47:45.470992+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:47:45.470992+0000","last_undegraded":"2024-05-27T09:47:45.470992+0000","last_fullsized":"2024-05-27T09:47:45.470992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567594+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:47:45.567594+0000","last_peered":"2024-05-27T09:47:45.567594+0000","last_clean":"2024-05-27T09:47:45.567594+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:47:45.567594+0000","last_undegraded":"2024-05-27T09:47:45.567594+0000","last_fullsized":"2024-05-27T09:47:45.567594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.683354+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:47:49.683354+0000","last_peered":"2024-05-27T09:47:49.683354+0000","last_clean":"2024-05-27T09:47:49.683354+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:47:49.683354+0000","last_undegraded":"2024-05-27T09:47:49.683354+0000","last_fullsized":"2024-05-27T09:47:49.683354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568053+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:47:45.568053+0000","last_peered":"2024-05-27T09:47:45.568053+0000","last_clean":"2024-05-27T09:47:45.568053+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:47:45.568053+0000","last_undegraded":"2024-05-27T09:47:45.568053+0000","last_fullsized":"2024-05-27T09:47:45.568053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569720+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:47:45.569720+0000","last_peered":"2024-05-27T09:47:45.569720+0000","last_clean":"2024-05-27T09:47:45.569720+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:47:45.569720+0000","last_undegraded":"2024-05-27T09:47:45.569720+0000","last_fullsized":"2024-05-27T09:47:45.569720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568263+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:47:45.568263+0000","last_peered":"2024-05-27T09:47:45.568263+0000","last_clean":"2024-05-27T09:47:45.568263+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:47:45.568263+0000","last_undegraded":"2024-05-27T09:47:45.568263+0000","last_fullsized":"2024-05-27T09:47:45.568263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471453+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:47:45.471453+0000","last_peered":"2024-05-27T09:47:45.471453+0000","last_clean":"2024-05-27T09:47:45.471453+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:47:45.471453+0000","last_undegraded":"2024-05-27T09:47:45.471453+0000","last_fullsized":"2024-05-27T09:47:45.471453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567808+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:47:45.567808+0000","last_peered":"2024-05-27T09:47:45.567808+0000","last_clean":"2024-05-27T09:47:45.567808+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:47:45.567808+0000","last_undegraded":"2024-05-27T09:47:45.567808+0000","last_fullsized":"2024-05-27T09:47:45.567808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:50.830644+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:47:50.830644+0000","last_peered":"2024-05-27T09:47:50.830644+0000","last_clean":"2024-05-27T09:47:50.830644+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:47:50.830644+0000","last_undegraded":"2024-05-27T09:47:50.830644+0000","last_fullsized":"2024-05-27T09:47:50.830644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74403,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":300,"num_write":41,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611862+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:47:45.611862+0000","last_peered":"2024-05-27T09:47:45.611862+0000","last_clean":"2024-05-27T09:47:45.611862+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:47:45.611862+0000","last_undegraded":"2024-05-27T09:47:45.611862+0000","last_fullsized":"2024-05-27T09:47:45.611862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567350+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:47:45.567350+0000","last_peered":"2024-05-27T09:47:45.567350+0000","last_clean":"2024-05-27T09:47:45.567350+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:47:45.567350+0000","last_undegraded":"2024-05-27T09:47:45.567350+0000","last_fullsized":"2024-05-27T09:47:45.567350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471788+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:47:45.471788+0000","last_peered":"2024-05-27T09:47:45.471788+0000","last_clean":"2024-05-27T09:47:45.471788+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:47:45.471788+0000","last_undegraded":"2024-05-27T09:47:45.471788+0000","last_fullsized":"2024-05-27T09:47:45.471788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470915+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:47:45.470915+0000","last_peered":"2024-05-27T09:47:45.470915+0000","last_clean":"2024-05-27T09:47:45.470915+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:47:45.470915+0000","last_undegraded":"2024-05-27T09:47:45.470915+0000","last_fullsized":"2024-05-27T09:47:45.470915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569506+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:47:45.569506+0000","last_peered":"2024-05-27T09:47:45.569506+0000","last_clean":"2024-05-27T09:47:45.569506+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:47:45.569506+0000","last_undegraded":"2024-05-27T09:47:45.569506+0000","last_fullsized":"2024-05-27T09:47:45.569506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":262,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.779156+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:47:49.779156+0000","last_peered":"2024-05-27T09:47:49.779156+0000","last_clean":"2024-05-27T09:47:49.779156+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:47:49.779156+0000","last_undegraded":"2024-05-27T09:47:49.779156+0000","last_fullsized":"2024-05-27T09:47:49.779156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":7,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566845+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:47:45.566845+0000","last_peered":"2024-05-27T09:47:45.566845+0000","last_clean":"2024-05-27T09:47:45.566845+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:47:45.566845+0000","last_undegraded":"2024-05-27T09:47:45.566845+0000","last_fullsized":"2024-05-27T09:47:45.566845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470885+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:47:45.470885+0000","last_peered":"2024-05-27T09:47:45.470885+0000","last_clean":"2024-05-27T09:47:45.470885+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:47:45.470885+0000","last_undegraded":"2024-05-27T09:47:45.470885+0000","last_fullsized":"2024-05-27T09:47:45.470885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612202+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:47:45.612202+0000","last_peered":"2024-05-27T09:47:45.612202+0000","last_clean":"2024-05-27T09:47:45.612202+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:47:45.612202+0000","last_undegraded":"2024-05-27T09:47:45.612202+0000","last_fullsized":"2024-05-27T09:47:45.612202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567195+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:47:45.567195+0000","last_peered":"2024-05-27T09:47:45.567195+0000","last_clean":"2024-05-27T09:47:45.567195+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:47:45.567195+0000","last_undegraded":"2024-05-27T09:47:45.567195+0000","last_fullsized":"2024-05-27T09:47:45.567195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568334+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:47:45.568334+0000","last_peered":"2024-05-27T09:47:45.568334+0000","last_clean":"2024-05-27T09:47:45.568334+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:47:45.568334+0000","last_undegraded":"2024-05-27T09:47:45.568334+0000","last_fullsized":"2024-05-27T09:47:45.568334+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568914+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:47:45.568914+0000","last_peered":"2024-05-27T09:47:45.568914+0000","last_clean":"2024-05-27T09:47:45.568914+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:47:45.568914+0000","last_undegraded":"2024-05-27T09:47:45.568914+0000","last_fullsized":"2024-05-27T09:47:45.568914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569028+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:47:45.569028+0000","last_peered":"2024-05-27T09:47:45.569028+0000","last_clean":"2024-05-27T09:47:45.569028+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:47:45.569028+0000","last_undegraded":"2024-05-27T09:47:45.569028+0000","last_fullsized":"2024-05-27T09:47:45.569028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568828+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:47:45.568828+0000","last_peered":"2024-05-27T09:47:45.568828+0000","last_clean":"2024-05-27T09:47:45.568828+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:47:45.568828+0000","last_undegraded":"2024-05-27T09:47:45.568828+0000","last_fullsized":"2024-05-27T09:47:45.568828+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471321+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:47:45.471321+0000","last_peered":"2024-05-27T09:47:45.471321+0000","last_clean":"2024-05-27T09:47:45.471321+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:47:45.471321+0000","last_undegraded":"2024-05-27T09:47:45.471321+0000","last_fullsized":"2024-05-27T09:47:45.471321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":255,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:49.778151+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:47:49.778151+0000","last_peered":"2024-05-27T09:47:49.778151+0000","last_clean":"2024-05-27T09:47:49.778151+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:47:49.778151+0000","last_undegraded":"2024-05-27T09:47:49.778151+0000","last_fullsized":"2024-05-27T09:47:49.778151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567538+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:47:45.567538+0000","last_peered":"2024-05-27T09:47:45.567538+0000","last_clean":"2024-05-27T09:47:45.567538+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:47:45.567538+0000","last_undegraded":"2024-05-27T09:47:45.567538+0000","last_fullsized":"2024-05-27T09:47:45.567538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567756+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:47:45.567756+0000","last_peered":"2024-05-27T09:47:45.567756+0000","last_clean":"2024-05-27T09:47:45.567756+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:47:45.567756+0000","last_undegraded":"2024-05-27T09:47:45.567756+0000","last_fullsized":"2024-05-27T09:47:45.567756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"84'99","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:47.624529+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:47:47.624529+0000","last_peered":"2024-05-27T09:47:47.624529+0000","last_clean":"2024-05-27T09:47:47.624529+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:47:47.624529+0000","last_undegraded":"2024-05-27T09:47:47.624529+0000","last_fullsized":"2024-05-27T09:47:47.624529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471392+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:47:45.471392+0000","last_peered":"2024-05-27T09:47:45.471392+0000","last_clean":"2024-05-27T09:47:45.471392+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:47:45.471392+0000","last_undegraded":"2024-05-27T09:47:45.471392+0000","last_fullsized":"2024-05-27T09:47:45.471392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568413+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:47:45.568413+0000","last_peered":"2024-05-27T09:47:45.568413+0000","last_clean":"2024-05-27T09:47:45.568413+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:47:45.568413+0000","last_undegraded":"2024-05-27T09:47:45.568413+0000","last_fullsized":"2024-05-27T09:47:45.568413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612036+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:47:45.612036+0000","last_peered":"2024-05-27T09:47:45.612036+0000","last_clean":"2024-05-27T09:47:45.612036+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:47:45.612036+0000","last_undegraded":"2024-05-27T09:47:45.612036+0000","last_fullsized":"2024-05-27T09:47:45.612036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472435+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:47:45.472435+0000","last_peered":"2024-05-27T09:47:45.472435+0000","last_clean":"2024-05-27T09:47:45.472435+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:47:45.472435+0000","last_undegraded":"2024-05-27T09:47:45.472435+0000","last_fullsized":"2024-05-27T09:47:45.472435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'49","reported_seq":101,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.749698+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:47:45.749698+0000","last_peered":"2024-05-27T09:47:45.749698+0000","last_clean":"2024-05-27T09:47:45.749698+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:47:45.749698+0000","last_undegraded":"2024-05-27T09:47:45.749698+0000","last_fullsized":"2024-05-27T09:47:45.749698+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486293+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:47:45.486293+0000","last_peered":"2024-05-27T09:47:45.486293+0000","last_clean":"2024-05-27T09:47:45.486293+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:47:45.486293+0000","last_undegraded":"2024-05-27T09:47:45.486293+0000","last_fullsized":"2024-05-27T09:47:45.486293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569098+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:47:45.569098+0000","last_peered":"2024-05-27T09:47:45.569098+0000","last_clean":"2024-05-27T09:47:45.569098+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:47:45.569098+0000","last_undegraded":"2024-05-27T09:47:45.569098+0000","last_fullsized":"2024-05-27T09:47:45.569098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568081+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:47:45.568081+0000","last_peered":"2024-05-27T09:47:45.568081+0000","last_clean":"2024-05-27T09:47:45.568081+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:47:45.568081+0000","last_undegraded":"2024-05-27T09:47:45.568081+0000","last_fullsized":"2024-05-27T09:47:45.568081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567460+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:47:45.567460+0000","last_peered":"2024-05-27T09:47:45.567460+0000","last_clean":"2024-05-27T09:47:45.567460+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:47:45.567460+0000","last_undegraded":"2024-05-27T09:47:45.567460+0000","last_fullsized":"2024-05-27T09:47:45.567460+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611649+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:47:45.611649+0000","last_peered":"2024-05-27T09:47:45.611649+0000","last_clean":"2024-05-27T09:47:45.611649+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:47:45.611649+0000","last_undegraded":"2024-05-27T09:47:45.611649+0000","last_fullsized":"2024-05-27T09:47:45.611649+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483545+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:47:45.483545+0000","last_peered":"2024-05-27T09:47:45.483545+0000","last_clean":"2024-05-27T09:47:45.483545+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:47:45.483545+0000","last_undegraded":"2024-05-27T09:47:45.483545+0000","last_fullsized":"2024-05-27T09:47:45.483545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566902+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:47:45.566902+0000","last_peered":"2024-05-27T09:47:45.566902+0000","last_clean":"2024-05-27T09:47:45.566902+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:47:45.566902+0000","last_undegraded":"2024-05-27T09:47:45.566902+0000","last_fullsized":"2024-05-27T09:47:45.566902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566936+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:47:45.566936+0000","last_peered":"2024-05-27T09:47:45.566936+0000","last_clean":"2024-05-27T09:47:45.566936+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:47:45.566936+0000","last_undegraded":"2024-05-27T09:47:45.566936+0000","last_fullsized":"2024-05-27T09:47:45.566936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485069+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:47:45.485069+0000","last_peered":"2024-05-27T09:47:45.485069+0000","last_clean":"2024-05-27T09:47:45.485069+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:47:45.485069+0000","last_undegraded":"2024-05-27T09:47:45.485069+0000","last_fullsized":"2024-05-27T09:47:45.485069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611750+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:47:45.611750+0000","last_peered":"2024-05-27T09:47:45.611750+0000","last_clean":"2024-05-27T09:47:45.611750+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:47:45.611750+0000","last_undegraded":"2024-05-27T09:47:45.611750+0000","last_fullsized":"2024-05-27T09:47:45.611750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569176+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:47:45.569176+0000","last_peered":"2024-05-27T09:47:45.569176+0000","last_clean":"2024-05-27T09:47:45.569176+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:47:45.569176+0000","last_undegraded":"2024-05-27T09:47:45.569176+0000","last_fullsized":"2024-05-27T09:47:45.569176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567397+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:47:45.567397+0000","last_peered":"2024-05-27T09:47:45.567397+0000","last_clean":"2024-05-27T09:47:45.567397+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:47:45.567397+0000","last_undegraded":"2024-05-27T09:47:45.567397+0000","last_fullsized":"2024-05-27T09:47:45.567397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569739+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:47:45.569739+0000","last_peered":"2024-05-27T09:47:45.569739+0000","last_clean":"2024-05-27T09:47:45.569739+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:47:45.569739+0000","last_undegraded":"2024-05-27T09:47:45.569739+0000","last_fullsized":"2024-05-27T09:47:45.569739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.742943+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:47:45.742943+0000","last_peered":"2024-05-27T09:47:45.742943+0000","last_clean":"2024-05-27T09:47:45.742943+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:47:45.742943+0000","last_undegraded":"2024-05-27T09:47:45.742943+0000","last_fullsized":"2024-05-27T09:47:45.742943+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569485+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:47:45.569485+0000","last_peered":"2024-05-27T09:47:45.569485+0000","last_clean":"2024-05-27T09:47:45.569485+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:47:45.569485+0000","last_undegraded":"2024-05-27T09:47:45.569485+0000","last_fullsized":"2024-05-27T09:47:45.569485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471807+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:47:45.471807+0000","last_peered":"2024-05-27T09:47:45.471807+0000","last_clean":"2024-05-27T09:47:45.471807+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:47:45.471807+0000","last_undegraded":"2024-05-27T09:47:45.471807+0000","last_fullsized":"2024-05-27T09:47:45.471807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569836+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:47:45.569836+0000","last_peered":"2024-05-27T09:47:45.569836+0000","last_clean":"2024-05-27T09:47:45.569836+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:47:45.569836+0000","last_undegraded":"2024-05-27T09:47:45.569836+0000","last_fullsized":"2024-05-27T09:47:45.569836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567079+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:47:45.567079+0000","last_peered":"2024-05-27T09:47:45.567079+0000","last_clean":"2024-05-27T09:47:45.567079+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:47:45.567079+0000","last_undegraded":"2024-05-27T09:47:45.567079+0000","last_fullsized":"2024-05-27T09:47:45.567079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567564+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:47:45.567564+0000","last_peered":"2024-05-27T09:47:45.567564+0000","last_clean":"2024-05-27T09:47:45.567564+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:47:45.567564+0000","last_undegraded":"2024-05-27T09:47:45.567564+0000","last_fullsized":"2024-05-27T09:47:45.567564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566915+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:47:45.566915+0000","last_peered":"2024-05-27T09:47:45.566915+0000","last_clean":"2024-05-27T09:47:45.566915+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:47:45.566915+0000","last_undegraded":"2024-05-27T09:47:45.566915+0000","last_fullsized":"2024-05-27T09:47:45.566915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567424+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:47:45.567424+0000","last_peered":"2024-05-27T09:47:45.567424+0000","last_clean":"2024-05-27T09:47:45.567424+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:47:45.567424+0000","last_undegraded":"2024-05-27T09:47:45.567424+0000","last_fullsized":"2024-05-27T09:47:45.567424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472340+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:47:45.472340+0000","last_peered":"2024-05-27T09:47:45.472340+0000","last_clean":"2024-05-27T09:47:45.472340+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:47:45.472340+0000","last_undegraded":"2024-05-27T09:47:45.472340+0000","last_fullsized":"2024-05-27T09:47:45.472340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567070+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:47:45.567070+0000","last_peered":"2024-05-27T09:47:45.567070+0000","last_clean":"2024-05-27T09:47:45.567070+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:47:45.567070+0000","last_undegraded":"2024-05-27T09:47:45.567070+0000","last_fullsized":"2024-05-27T09:47:45.567070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567527+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:47:45.567527+0000","last_peered":"2024-05-27T09:47:45.567527+0000","last_clean":"2024-05-27T09:47:45.567527+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:47:45.567527+0000","last_undegraded":"2024-05-27T09:47:45.567527+0000","last_fullsized":"2024-05-27T09:47:45.567527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486199+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:47:45.486199+0000","last_peered":"2024-05-27T09:47:45.486199+0000","last_clean":"2024-05-27T09:47:45.486199+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:47:45.486199+0000","last_undegraded":"2024-05-27T09:47:45.486199+0000","last_fullsized":"2024-05-27T09:47:45.486199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471079+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:47:45.471079+0000","last_peered":"2024-05-27T09:47:45.471079+0000","last_clean":"2024-05-27T09:47:45.471079+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:47:45.471079+0000","last_undegraded":"2024-05-27T09:47:45.471079+0000","last_fullsized":"2024-05-27T09:47:45.471079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483079+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:47:45.483079+0000","last_peered":"2024-05-27T09:47:45.483079+0000","last_clean":"2024-05-27T09:47:45.483079+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:47:45.483079+0000","last_undegraded":"2024-05-27T09:47:45.483079+0000","last_fullsized":"2024-05-27T09:47:45.483079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471895+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:47:45.471895+0000","last_peered":"2024-05-27T09:47:45.471895+0000","last_clean":"2024-05-27T09:47:45.471895+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:47:45.471895+0000","last_undegraded":"2024-05-27T09:47:45.471895+0000","last_fullsized":"2024-05-27T09:47:45.471895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566971+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:47:45.566971+0000","last_peered":"2024-05-27T09:47:45.566971+0000","last_clean":"2024-05-27T09:47:45.566971+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:47:45.566971+0000","last_undegraded":"2024-05-27T09:47:45.566971+0000","last_fullsized":"2024-05-27T09:47:45.566971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":605316,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1447,"num_read_kb":841,"num_write":301,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2052096,"data_stored":1815948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612674,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":921600,"data_stored":449225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37056,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708096,"statfs":{"total":95995035648,"available":95957090304,"internally_reserved":0,"allocated":1761280,"data_stored":1248302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005131,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716840,"statfs":{"total":95995035648,"available":95966044160,"internally_reserved":0,"allocated":1323008,"data_stored":842565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201363,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708532,"statfs":{"total":95995035648,"available":95957536768,"internally_reserved":0,"allocated":1314816,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397593,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1523712,"data_stored":1043295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593820,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":448738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":522934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":450009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":525066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149806,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1462272,"data_stored":973865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953577,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":450880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790052,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1671168,"data_stored":1172874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":76535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":393842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":209286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:47:54.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:47:54.600 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:54.600 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:54.600 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.0 KiB/s wr, 16 op/s 2024-05-27T09:47:54.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:54.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:54.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:54.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:54 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:54.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:54.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.0 KiB/s wr, 16 op/s 2024-05-27T09:47:54.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:54.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:54.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:54.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:54 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: Updating smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.0 KiB/s wr, 16 op/s 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:47:54.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:47:54.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:47:54.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:54 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:47:54.962 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:55.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:55 smithi122 ceph-mon[36436]: from='client.25165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:55.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:55 smithi122 ceph-mon[36436]: from='client.25171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:55.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:55 smithi071 ceph-mon[31451]: from='client.25165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:55.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:55 smithi071 ceph-mon[31451]: from='client.25171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:55.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:55 smithi072 ceph-mon[35951]: from='client.25165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:55.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:55 smithi072 ceph-mon[35951]: from='client.25171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:47:56.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:56 smithi071 ceph-mon[31451]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 799 B/s wr, 12 op/s 2024-05-27T09:47:56.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:56 smithi122 ceph-mon[36436]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 799 B/s wr, 12 op/s 2024-05-27T09:47:56.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:56 smithi072 ceph-mon[35951]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 799 B/s wr, 12 op/s 2024-05-27T09:47:57.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 -- 172.21.15.71:0/1662841037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48581045e0 msgr2=0x7f48581049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:57.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 --2- 172.21.15.71:0/1662841037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48581045e0 0x7f48581049f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4848009990 tx=0x7f4848009ca0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 -- 172.21.15.71:0/1662841037 shutdown_connections 2024-05-27T09:47:57.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 --2- 172.21.15.71:0/1662841037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4858109860 0x7f48581111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 --2- 172.21.15.71:0/1662841037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48581045e0 0x7f48581049f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 --2- 172.21.15.71:0/1662841037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4858108f10 0x7f4858109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 -- 172.21.15.71:0/1662841037 >> 172.21.15.71:0/1662841037 conn(0x7f4858100030 msgr2=0x7f4858102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:57.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 -- 172.21.15.71:0/1662841037 shutdown_connections 2024-05-27T09:47:57.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.185+0000 7f485d000700 1 -- 172.21.15.71:0/1662841037 wait complete. 2024-05-27T09:47:57.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.187+0000 7f485d000700 1 Processor -- start 2024-05-27T09:47:57.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.187+0000 7f485d000700 1 -- start start 2024-05-27T09:47:57.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f485d000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48581045e0 0x7f485819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:57.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f485d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4858108f10 0x7f485819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:57.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f485d000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4858109860 0x7f485819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:57.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f485d000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48581144e0 con 0x7f4858109860 2024-05-27T09:47:57.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f485d000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4858114360 con 0x7f4858108f10 2024-05-27T09:47:57.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f485d000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4858114660 con 0x7f48581045e0 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f4855400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4858108f10 0x7f485819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f4855e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48581045e0 0x7f485819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f4855e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48581045e0 0x7f485819ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39968/0 (socket says 172.21.15.71:39968) 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f4855e00700 1 -- 172.21.15.71:0/22113765 learned_addr learned my addr 172.21.15.71:0/22113765 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.188+0000 7f4855400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4858108f10 0x7f485819b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52902/0 (socket says 172.21.15.71:52902) 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f4856800700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4858109860 0x7f485819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f4855400700 1 -- 172.21.15.71:0/22113765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48581045e0 msgr2=0x7f485819ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f4855400700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48581045e0 0x7f485819ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f4855400700 1 -- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4858109860 msgr2=0x7f485819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f4855400700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4858109860 0x7f485819f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f4855400700 1 -- 172.21.15.71:0/22113765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485819fd60 con 0x7f4858108f10 2024-05-27T09:47:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f4855400700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4858108f10 0x7f485819b430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9c0 tx=0x7f484400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f484ea00700 1 -- 172.21.15.71:0/22113765 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484400cb70 con 0x7f4858108f10 2024-05-27T09:47:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f484ea00700 1 -- 172.21.15.71:0/22113765 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48440044d0 con 0x7f4858108f10 2024-05-27T09:47:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.189+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48581a0050 con 0x7f4858108f10 2024-05-27T09:47:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.190+0000 7f484ea00700 1 -- 172.21.15.71:0/22113765 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844003dd0 con 0x7f4858108f10 2024-05-27T09:47:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.190+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48581a7970 con 0x7f4858108f10 2024-05-27T09:47:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.191+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48580512b0 con 0x7f4858108f10 2024-05-27T09:47:57.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.194+0000 7f484ea00700 1 -- 172.21.15.71:0/22113765 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f4844003f70 con 0x7f4858108f10 2024-05-27T09:47:57.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.195+0000 7f484ea00700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f483c0b2b90 0x7f483c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:47:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.196+0000 7f484ea00700 1 -- 172.21.15.71:0/22113765 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f48440e2b00 con 0x7f4858108f10 2024-05-27T09:47:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.196+0000 7f4855e00700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f483c0b2b90 0x7f483c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:47:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.197+0000 7f4855e00700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f483c0b2b90 0x7f483c0b50a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f484800b790 tx=0x7f484800b280 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:47:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.197+0000 7f484ea00700 1 -- 172.21.15.71:0/22113765 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f48440aa2f0 con 0x7f4858108f10 2024-05-27T09:47:57.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.475+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f485819c1f0 con 0x7f4858108f10 2024-05-27T09:47:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.476+0000 7f484ea00700 1 -- 172.21.15.71:0/22113765 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7f48440b22e0 con 0x7f4858108f10 2024-05-27T09:47:57.477 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:47:57.477 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:47:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f483c0b2b90 msgr2=0x7f483c0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f483c0b2b90 0x7f483c0b50a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f484800b790 tx=0x7f484800b280 comp rx=0 tx=0).stop 2024-05-27T09:47:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4858108f10 msgr2=0x7f485819b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:47:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4858108f10 0x7f485819b430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9c0 tx=0x7f484400ecd0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 shutdown_connections 2024-05-27T09:47:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f483c0b2b90 0x7f483c0b50a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4858109860 0x7f485819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48581045e0 0x7f485819ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 --2- 172.21.15.71:0/22113765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4858108f10 0x7f485819b430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:47:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 >> 172.21.15.71:0/22113765 conn(0x7f4858100030 msgr2=0x7f48581086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:47:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 shutdown_connections 2024-05-27T09:47:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:47:57.479+0000 7f485d000700 1 -- 172.21.15.71:0/22113765 wait complete. 2024-05-27T09:47:57.482 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:47:57.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:57 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/22113765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:57.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:57 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/22113765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:58.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:57 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/22113765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:47:58.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:47:58.778 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:47:58.927 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:47:58 smithi071 ceph-mon[31451]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 653 B/s wr, 13 op/s 2024-05-27T09:47:58.928 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:47:58 smithi072 ceph-mon[35951]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 653 B/s wr, 13 op/s 2024-05-27T09:47:58.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:47:58 smithi122 ceph-mon[36436]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 653 B/s wr, 13 op/s 2024-05-27T09:48:00.926 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:00 smithi071 ceph-mon[31451]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-27T09:48:00.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:00 smithi122 ceph-mon[36436]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-27T09:48:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:00 smithi072 ceph-mon[35951]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-27T09:48:01.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 -- 172.21.15.71:0/2582457435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 msgr2=0x7f88b4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:01.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 --2- 172.21.15.71:0/2582457435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 0x7f88b4106a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88a40099c0 tx=0x7f88a4009cd0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 -- 172.21.15.71:0/2582457435 shutdown_connections 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 --2- 172.21.15.71:0/2582457435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 0x7f88b41131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 --2- 172.21.15.71:0/2582457435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 0x7f88b4106a40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 --2- 172.21.15.71:0/2582457435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b410af10 0x7f88b410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 -- 172.21.15.71:0/2582457435 >> 172.21.15.71:0/2582457435 conn(0x7f88b4102020 msgr2=0x7f88b4104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 -- 172.21.15.71:0/2582457435 shutdown_connections 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.163+0000 7f88b3e00700 1 -- 172.21.15.71:0/2582457435 wait complete. 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.164+0000 7f88b3e00700 1 Processor -- start 2024-05-27T09:48:01.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3e00700 1 -- start start 2024-05-27T09:48:01.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 0x7f88b419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:01.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b410af10 0x7f88b419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:01.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 0x7f88b41a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:01.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f88b41164e0 con 0x7f88b410b860 2024-05-27T09:48:01.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4116360 con 0x7f88b410af10 2024-05-27T09:48:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4116660 con 0x7f88b4106630 2024-05-27T09:48:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 0x7f88b41a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b2000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b410af10 0x7f88b419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 0x7f88b41a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54120/0 (socket says 172.21.15.71:54120) 2024-05-27T09:48:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b3400700 1 -- 172.21.15.71:0/3638915648 learned_addr learned my addr 172.21.15.71:0/3638915648 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.165+0000 7f88b2a00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 0x7f88b419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88b3400700 1 -- 172.21.15.71:0/3638915648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 msgr2=0x7f88b419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88b3400700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 0x7f88b419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88b3400700 1 -- 172.21.15.71:0/3638915648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b410af10 msgr2=0x7f88b419d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88b3400700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b410af10 0x7f88b419d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88b3400700 1 -- 172.21.15.71:0/3638915648 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b41a1ce0 con 0x7f88b410b860 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88b2a00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 0x7f88b419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88b3400700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 0x7f88b41a1640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00ef30 tx=0x7f88ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.166+0000 7f88ab400700 1 -- 172.21.15.71:0/3638915648 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0092e0 con 0x7f88b410b860 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.167+0000 7f88ab400700 1 -- 172.21.15.71:0/3638915648 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88ac004bb0 con 0x7f88b410b860 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.167+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b41a1f70 con 0x7f88b410b860 2024-05-27T09:48:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.167+0000 7f88ab400700 1 -- 172.21.15.71:0/3638915648 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac004020 con 0x7f88b410b860 2024-05-27T09:48:01.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.167+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b41a2460 con 0x7f88b410b860 2024-05-27T09:48:01.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.168+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b40512b0 con 0x7f88b410b860 2024-05-27T09:48:01.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.170+0000 7f88ab400700 1 -- 172.21.15.71:0/3638915648 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f88ac01b030 con 0x7f88b410b860 2024-05-27T09:48:01.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.172+0000 7f88ab400700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f88980b2b10 0x7f88980b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:01.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.172+0000 7f88ab400700 1 -- 172.21.15.71:0/3638915648 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f88ac0e2d20 con 0x7f88b410b860 2024-05-27T09:48:01.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.172+0000 7f88b2a00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f88980b2b10 0x7f88980b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:01.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.173+0000 7f88b2a00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f88980b2b10 0x7f88980b5020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88a4000c00 tx=0x7f88a401a040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:01.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.174+0000 7f88ab400700 1 -- 172.21.15.71:0/3638915648 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88ac022020 con 0x7f88b410b860 2024-05-27T09:48:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.411+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88b402e5e0 con 0x7f88b410b860 2024-05-27T09:48:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.415+0000 7f88ab400700 1 -- 172.21.15.71:0/3638915648 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22980 (secure 0 0 0) 0x7f88ac010040 con 0x7f88b410b860 2024-05-27T09:48:01.417 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":84,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:47:45.456731+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6801/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6800/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/1381797399":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/4081778329":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/193022273":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/4261728686":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:48:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f88980b2b10 msgr2=0x7f88980b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f88980b2b10 0x7f88980b5020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88a4000c00 tx=0x7f88a401a040 comp rx=0 tx=0).stop 2024-05-27T09:48:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 msgr2=0x7f88b41a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 0x7f88b41a1640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00ef30 tx=0x7f88ac00c3a0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 shutdown_connections 2024-05-27T09:48:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f88980b2b10 0x7f88980b5020 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88b410b860 0x7f88b41a1640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88b4106630 0x7f88b419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 --2- 172.21.15.71:0/3638915648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b410af10 0x7f88b419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 >> 172.21.15.71:0/3638915648 conn(0x7f88b4102020 msgr2=0x7f88b410a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 shutdown_connections 2024-05-27T09:48:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:01.419+0000 7f88b3e00700 1 -- 172.21.15.71:0/3638915648 wait complete. 2024-05-27T09:48:01.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:01 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3638915648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:48:01.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:01 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3638915648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:48:02.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:01 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3638915648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:48:02.384 DEBUG:tasks.fwd_scrub:Yielding 2024-05-27T09:48:02.384 INFO:teuthology.run_tasks:Running task exec... 2024-05-27T09:48:02.393 INFO:teuthology.task.exec:Executing custom commands... 2024-05-27T09:48:02.393 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:48:02.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-05-27T09:48:02.394 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-27T09:48:02.394 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-27T09:48:02.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.663+0000 7f8f12600640 1 -- 172.21.15.71:0/1147539912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 msgr2=0x7f8f0c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.663+0000 7f8f12600640 1 --2- 172.21.15.71:0/1147539912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 0x7f8f0c10eeb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009900 tx=0x7f8ef402a410 comp rx=0 tx=0).stop 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.663+0000 7f8f12600640 1 -- 172.21.15.71:0/1147539912 shutdown_connections 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.663+0000 7f8f12600640 1 --2- 172.21.15.71:0/1147539912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f0c10f540 0x7f8f0c116ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.664+0000 7f8f12600640 1 --2- 172.21.15.71:0/1147539912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 0x7f8f0c10eeb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.664+0000 7f8f12600640 1 --2- 172.21.15.71:0/1147539912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 0x7f8f0c10a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.664+0000 7f8f12600640 1 -- 172.21.15.71:0/1147539912 >> 172.21.15.71:0/1147539912 conn(0x7f8f0c077190 msgr2=0x7f8f0c0775d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.664+0000 7f8f12600640 1 -- 172.21.15.71:0/1147539912 shutdown_connections 2024-05-27T09:48:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.664+0000 7f8f12600640 1 -- 172.21.15.71:0/1147539912 wait complete. 2024-05-27T09:48:02.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.665+0000 7f8f12600640 1 Processor -- start 2024-05-27T09:48:02.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.665+0000 7f8f12600640 1 -- start start 2024-05-27T09:48:02.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f12600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 0x7f8f0c1a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:02.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f12600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 0x7f8f0c1a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:02.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f12600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f0c10f540 0x7f8f0c1a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:02.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f12600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c11a490 con 0x7f8f0c10f540 2024-05-27T09:48:02.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f12600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c11a310 con 0x7f8f0c10ea80 2024-05-27T09:48:02.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f12600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c11a610 con 0x7f8f0c10a500 2024-05-27T09:48:02.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f0b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 0x7f8f0c1a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:02.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 0x7f8f0c1a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:02.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f0be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f0c10f540 0x7f8f0c1a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:02.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f0b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 0x7f8f0c1a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40008/0 (socket says 172.21.15.71:40008) 2024-05-27T09:48:02.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.666+0000 7f8f0b400640 1 -- 172.21.15.71:0/344442350 learned_addr learned my addr 172.21.15.71:0/344442350 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:02.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f0b400640 1 -- 172.21.15.71:0/344442350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 msgr2=0x7f8f0c1a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:02.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f0b400640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 0x7f8f0c1a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f0b400640 1 -- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f0c10f540 msgr2=0x7f8f0c1a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:02.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f0b400640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f0c10f540 0x7f8f0c1a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f0b400640 1 -- 172.21.15.71:0/344442350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c1a5d30 con 0x7f8f0c10a500 2024-05-27T09:48:02.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f03e00640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 0x7f8f0c1a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:02.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f0b400640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 0x7f8f0c1a0ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00e9f0 tx=0x7f8efc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:02.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f08c00640 1 -- 172.21.15.71:0/344442350 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00cd80 con 0x7f8f0c10a500 2024-05-27T09:48:02.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.667+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c1a6020 con 0x7f8f0c10a500 2024-05-27T09:48:02.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.668+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c1ad9a0 con 0x7f8f0c10a500 2024-05-27T09:48:02.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.668+0000 7f8f08c00640 1 -- 172.21.15.71:0/344442350 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8efc0054d0 con 0x7f8f0c10a500 2024-05-27T09:48:02.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.668+0000 7f8f08c00640 1 -- 172.21.15.71:0/344442350 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc010430 con 0x7f8f0c10a500 2024-05-27T09:48:02.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.669+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee8005290 con 0x7f8f0c10a500 2024-05-27T09:48:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.671+0000 7f8f08c00640 1 -- 172.21.15.71:0/344442350 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f8efc0105d0 con 0x7f8f0c10a500 2024-05-27T09:48:02.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.673+0000 7f8f08c00640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8ef00b2af0 0x7f8ef00b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:02.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.673+0000 7f8f08c00640 1 -- 172.21.15.71:0/344442350 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8efc0e2ac0 con 0x7f8f0c10a500 2024-05-27T09:48:02.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.673+0000 7f8f03e00640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8ef00b2af0 0x7f8ef00b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:02.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.674+0000 7f8f03e00640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8ef00b2af0 0x7f8ef00b5000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4031440 tx=0x7f8ef4005a20 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.677+0000 7f8f08c00640 1 -- 172.21.15.71:0/344442350 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8efc0aa280 con 0x7f8f0c10a500 2024-05-27T09:48:02.837 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.909+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f8ee8005580 con 0x7f8f0c10a500 2024-05-27T09:48:02.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.917+0000 7f8f08c00640 1 -- 172.21.15.71:0/344442350 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7f8efc0a9b80 con 0x7f8f0c10a500 2024-05-27T09:48:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8ef00b2af0 msgr2=0x7f8ef00b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8ef00b2af0 0x7f8ef00b5000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4031440 tx=0x7f8ef4005a20 comp rx=0 tx=0).stop 2024-05-27T09:48:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 msgr2=0x7f8f0c1a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 0x7f8f0c1a0ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00e9f0 tx=0x7f8efc00edf0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 shutdown_connections 2024-05-27T09:48:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8ef00b2af0 0x7f8ef00b5000 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f0c10f540 0x7f8f0c1a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f0c10ea80 0x7f8f0c1a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 --2- 172.21.15.71:0/344442350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0c10a500 0x7f8f0c1a0ed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 >> 172.21.15.71:0/344442350 conn(0x7f8f0c077190 msgr2=0x7f8f0c07a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 shutdown_connections 2024-05-27T09:48:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:02.920+0000 7f8f12600640 1 -- 172.21.15.71:0/344442350 wait complete. 2024-05-27T09:48:02.945 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:02 smithi071 ceph-mon[31451]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-27T09:48:02.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-05-27T09:48:02.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:02 smithi122 ceph-mon[36436]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-27T09:48:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:02 smithi072 ceph-mon[35951]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-27T09:48:03.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 -- 172.21.15.71:0/4022943163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 msgr2=0x7f18cc10fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 --2- 172.21.15.71:0/4022943163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 0x7f18cc10fde0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009900 tx=0x7f18b802a480 comp rx=0 tx=0).stop 2024-05-27T09:48:03.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 -- 172.21.15.71:0/4022943163 shutdown_connections 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 --2- 172.21.15.71:0/4022943163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc110320 0x7f18cc112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 --2- 172.21.15.71:0/4022943163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 0x7f18cc10fde0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 --2- 172.21.15.71:0/4022943163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18cc075420 0x7f18cc075830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 -- 172.21.15.71:0/4022943163 >> 172.21.15.71:0/4022943163 conn(0x7f18cc079100 msgr2=0x7f18cc079540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 -- 172.21.15.71:0/4022943163 shutdown_connections 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.212+0000 7f18cbe00640 1 -- 172.21.15.71:0/4022943163 wait complete. 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 Processor -- start 2024-05-27T09:48:03.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 -- start start 2024-05-27T09:48:03.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc075420 0x7f18cc1a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 0x7f18cc1a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18cc110320 0x7f18cc19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc115e90 con 0x7f18cc10d9c0 2024-05-27T09:48:03.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc115d10 con 0x7f18cc075420 2024-05-27T09:48:03.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.214+0000 7f18cbe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc116010 con 0x7f18cc110320 2024-05-27T09:48:03.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc075420 0x7f18cc1a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18ca000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 0x7f18cc1a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc075420 0x7f18cc1a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52926/0 (socket says 172.21.15.71:52926) 2024-05-27T09:48:03.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 -- 172.21.15.71:0/1682891052 learned_addr learned my addr 172.21.15.71:0/1682891052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:03.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18cb400640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18cc110320 0x7f18cc19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 -- 172.21.15.71:0/1682891052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18cc110320 msgr2=0x7f18cc19c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18cc110320 0x7f18cc19c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 -- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 msgr2=0x7f18cc1a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 0x7f18cc1a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 -- 172.21.15.71:0/1682891052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc19ce80 con 0x7f18cc075420 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.215+0000 7f18caa00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc075420 0x7f18cc1a25d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e9f0 tx=0x7f18bc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.216+0000 7f18c3400640 1 -- 172.21.15.71:0/1682891052 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00cd80 con 0x7f18cc075420 2024-05-27T09:48:03.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.216+0000 7f18c3400640 1 -- 172.21.15.71:0/1682891052 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18bc0054d0 con 0x7f18cc075420 2024-05-27T09:48:03.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.216+0000 7f18c3400640 1 -- 172.21.15.71:0/1682891052 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc010690 con 0x7f18cc075420 2024-05-27T09:48:03.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.216+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc19d110 con 0x7f18cc075420 2024-05-27T09:48:03.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.216+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc1a9370 con 0x7f18cc075420 2024-05-27T09:48:03.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.217+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc076740 con 0x7f18cc075420 2024-05-27T09:48:03.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.220+0000 7f18c3400640 1 -- 172.21.15.71:0/1682891052 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f18bc004e30 con 0x7f18cc075420 2024-05-27T09:48:03.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.222+0000 7f18c3400640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18b00b2af0 0x7f18b00b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.222+0000 7f18c3400640 1 -- 172.21.15.71:0/1682891052 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f18bc0e2e70 con 0x7f18cc075420 2024-05-27T09:48:03.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.222+0000 7f18ca000640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18b00b2af0 0x7f18b00b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.223+0000 7f18ca000640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18b00b2af0 0x7f18b00b5000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b8031400 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:03.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.223+0000 7f18c3400640 1 -- 172.21.15.71:0/1682891052 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f18bc054df0 con 0x7f18cc075420 2024-05-27T09:48:03.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.443+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f18cc1a9540 con 0x7f18cc075420 2024-05-27T09:48:03.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.454+0000 7f18c3400640 1 -- 172.21.15.71:0/1682891052 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7f18bc0aa5d0 con 0x7f18cc075420 2024-05-27T09:48:03.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18b00b2af0 msgr2=0x7f18b00b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18b00b2af0 0x7f18b00b5000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b8031400 comp rx=0 tx=0).stop 2024-05-27T09:48:03.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc075420 msgr2=0x7f18cc1a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc075420 0x7f18cc1a25d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e9f0 tx=0x7f18bc00edf0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 shutdown_connections 2024-05-27T09:48:03.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18b00b2af0 0x7f18b00b5000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18cc110320 0x7f18cc19c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18cc10d9c0 0x7f18cc1a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 --2- 172.21.15.71:0/1682891052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc075420 0x7f18cc1a25d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 >> 172.21.15.71:0/1682891052 conn(0x7f18cc079100 msgr2=0x7f18cc1022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:03.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 shutdown_connections 2024-05-27T09:48:03.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.457+0000 7f18cbe00640 1 -- 172.21.15.71:0/1682891052 wait complete. 2024-05-27T09:48:03.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-05-27T09:48:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 -- 172.21.15.71:0/3078405878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 msgr2=0x7f3238102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 --2- 172.21.15.71:0/3078405878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 0x7f3238102750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f322c009900 tx=0x7f322c02a3f0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 -- 172.21.15.71:0/3078405878 shutdown_connections 2024-05-27T09:48:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 --2- 172.21.15.71:0/3078405878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238103300 0x7f323810f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 --2- 172.21.15.71:0/3078405878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238109050 0x7f3238102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 --2- 172.21.15.71:0/3078405878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 0x7f3238102750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 -- 172.21.15.71:0/3078405878 >> 172.21.15.71:0/3078405878 conn(0x7f32380781a0 msgr2=0x7f3238078600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 -- 172.21.15.71:0/3078405878 shutdown_connections 2024-05-27T09:48:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.740+0000 7f323fe00640 1 -- 172.21.15.71:0/3078405878 wait complete. 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.741+0000 7f323fe00640 1 Processor -- start 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.741+0000 7f323fe00640 1 -- start start 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238103300 0x7f32381123e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 0x7f3238112920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238109050 0x7f3238112e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f323806be00 con 0x7f3238103300 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323fe00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f323806bc80 con 0x7f3238109050 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323fe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f323806bf80 con 0x7f3238108bb0 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238103300 0x7f32381123e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238103300 0x7f32381123e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54180/0 (socket says 172.21.15.71:54180) 2024-05-27T09:48:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 -- 172.21.15.71:0/533502751 learned_addr learned my addr 172.21.15.71:0/533502751 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323ca00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 0x7f3238112920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323de00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238109050 0x7f3238112e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 -- 172.21.15.71:0/533502751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 msgr2=0x7f3238112920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 0x7f3238112920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 -- 172.21.15.71:0/533502751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238109050 msgr2=0x7f3238112e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238109050 0x7f3238112e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323d400640 1 -- 172.21.15.71:0/533502751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32381a8c00 con 0x7f3238103300 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.742+0000 7f323ca00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 0x7f3238112920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.743+0000 7f323d400640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238103300 0x7f32381123e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f322c032fd0 tx=0x7f322c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:03.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.743+0000 7f3236000640 1 -- 172.21.15.71:0/533502751 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c03f030 con 0x7f3238103300 2024-05-27T09:48:03.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.743+0000 7f3236000640 1 -- 172.21.15.71:0/533502751 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f322c004490 con 0x7f3238103300 2024-05-27T09:48:03.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.743+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32381a8e90 con 0x7f3238103300 2024-05-27T09:48:03.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.743+0000 7f3236000640 1 -- 172.21.15.71:0/533502751 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c035070 con 0x7f3238103300 2024-05-27T09:48:03.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.743+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32381a92f0 con 0x7f3238103300 2024-05-27T09:48:03.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.745+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3238050860 con 0x7f3238103300 2024-05-27T09:48:03.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.747+0000 7f3236000640 1 -- 172.21.15.71:0/533502751 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f322c042030 con 0x7f3238103300 2024-05-27T09:48:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.748+0000 7f3236000640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f32200b2a70 0x7f32200b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.749+0000 7f3236000640 1 -- 172.21.15.71:0/533502751 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f322c1027e0 con 0x7f3238103300 2024-05-27T09:48:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.749+0000 7f323ca00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f32200b2a70 0x7f32200b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:03.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.750+0000 7f323ca00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f32200b2a70 0x7f32200b4f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32381018d0 tx=0x7f3224005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.753+0000 7f3236000640 1 -- 172.21.15.71:0/533502751 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f322c0c99c0 con 0x7f3238103300 2024-05-27T09:48:03.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.966+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f32381a9600 con 0x7f3238103300 2024-05-27T09:48:03.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.971+0000 7f3236000640 1 -- 172.21.15.71:0/533502751 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7f322c0d2090 con 0x7f3238103300 2024-05-27T09:48:03.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f32200b2a70 msgr2=0x7f32200b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f32200b2a70 0x7f32200b4f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32381018d0 tx=0x7f3224005f90 comp rx=0 tx=0).stop 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238103300 msgr2=0x7f32381123e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238103300 0x7f32381123e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f322c032fd0 tx=0x7f322c031a20 comp rx=0 tx=0).stop 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 shutdown_connections 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f32200b2a70 0x7f32200b4f80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238109050 0x7f3238112e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3238108bb0 0x7f3238112920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 --2- 172.21.15.71:0/533502751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3238103300 0x7f32381123e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.974+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 >> 172.21.15.71:0/533502751 conn(0x7f32380781a0 msgr2=0x7f3238100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.975+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 shutdown_connections 2024-05-27T09:48:03.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:03.975+0000 7f323fe00640 1 -- 172.21.15.71:0/533502751 wait complete. 2024-05-27T09:48:04.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:04.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:04.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:04.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: pgmap v12: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 597 B/s wr, 14 op/s 2024-05-27T09:48:04.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:03 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:04.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' 2024-05-27T09:48:04.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:04.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:04.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:04.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:04.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' 2024-05-27T09:48:04.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:04.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:04.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:04.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: pgmap v12: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 597 B/s wr, 14 op/s 2024-05-27T09:48:04.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:03 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 -- 172.21.15.71:0/2739058184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 msgr2=0x7fa90c105220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 --2- 172.21.15.71:0/2739058184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c105220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa900009900 tx=0x7fa90002a510 comp rx=0 tx=0).stop 2024-05-27T09:48:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 -- 172.21.15.71:0/2739058184 shutdown_connections 2024-05-27T09:48:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 --2- 172.21.15.71:0/2739058184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa90c10e220 0x7fa90c110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 --2- 172.21.15.71:0/2739058184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa90c10b870 0x7fa90c10dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 --2- 172.21.15.71:0/2739058184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c105220 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 -- 172.21.15.71:0/2739058184 >> 172.21.15.71:0/2739058184 conn(0x7fa90c0fe380 msgr2=0x7fa90c1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.262+0000 7fa913c00640 1 -- 172.21.15.71:0/2739058184 shutdown_connections 2024-05-27T09:48:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.263+0000 7fa913c00640 1 -- 172.21.15.71:0/2739058184 wait complete. 2024-05-27T09:48:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 Processor -- start 2024-05-27T09:48:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 -- start start 2024-05-27T09:48:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c1026d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa90c10b870 0x7fa90c102c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa90c10e220 0x7fa90c103150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c113e80 con 0x7fa90c10e220 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c113d00 con 0x7fa90c104e10 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.264+0000 7fa913c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c114000 con 0x7fa90c10b870 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c1026d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c1026d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50600/0 (socket says 172.21.15.71:50600) 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 -- 172.21.15.71:0/688491983 learned_addr learned my addr 172.21.15.71:0/688491983 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911c00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa90c10e220 0x7fa90c103150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa90be00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa90c10b870 0x7fa90c102c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 -- 172.21.15.71:0/688491983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa90c10b870 msgr2=0x7fa90c102c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa90c10b870 0x7fa90c102c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 -- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa90c10e220 msgr2=0x7fa90c103150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa90c10e220 0x7fa90c103150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa911200640 1 -- 172.21.15.71:0/688491983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c1a8be0 con 0x7fa90c104e10 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.265+0000 7fa90be00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa90c10b870 0x7fa90c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.266+0000 7fa911200640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c1026d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa900005940 tx=0x7fa9000040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.266+0000 7fa909600640 1 -- 172.21.15.71:0/688491983 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90003f030 con 0x7fa90c104e10 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.266+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90c1a8e70 con 0x7fa90c104e10 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.266+0000 7fa909600640 1 -- 172.21.15.71:0/688491983 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9000044c0 con 0x7fa90c104e10 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.266+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c1a92e0 con 0x7fa90c104e10 2024-05-27T09:48:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.266+0000 7fa909600640 1 -- 172.21.15.71:0/688491983 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900049060 con 0x7fa90c104e10 2024-05-27T09:48:04.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.267+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90c050860 con 0x7fa90c104e10 2024-05-27T09:48:04.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.270+0000 7fa909600640 1 -- 172.21.15.71:0/688491983 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fa900042030 con 0x7fa90c104e10 2024-05-27T09:48:04.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.271+0000 7fa909600640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8f40b2a70 0x7fa8f40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.271+0000 7fa909600640 1 -- 172.21.15.71:0/688491983 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa900103100 con 0x7fa90c104e10 2024-05-27T09:48:04.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.272+0000 7fa90be00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8f40b2a70 0x7fa8f40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.272+0000 7fa90be00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8f40b2a70 0x7fa8f40b4f80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80095f0 tx=0x7fa8f8005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:04.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.274+0000 7fa909600640 1 -- 172.21.15.71:0/688491983 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa9000ca2e0 con 0x7fa90c104e10 2024-05-27T09:48:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' 2024-05-27T09:48:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' 2024-05-27T09:48:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: pgmap v12: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 597 B/s wr, 14 op/s 2024-05-27T09:48:04.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:03 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:04.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.525+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa90c10ee10 con 0x7fa8f40b2a70 2024-05-27T09:48:04.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.614+0000 7fa909600640 1 -- 172.21.15.71:0/688491983 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa90c10ee10 con 0x7fa8f40b2a70 2024-05-27T09:48:04.615 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path / 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.616+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8f40b2a70 msgr2=0x7fa8f40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.616+0000 7fa913c00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8f40b2a70 0x7fa8f40b4f80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80095f0 tx=0x7fa8f8005f90 comp rx=0 tx=0).stop 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 msgr2=0x7fa90c1026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c1026d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa900005940 tx=0x7fa9000040c0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 shutdown_connections 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8f40b2a70 0x7fa8f40b4f80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa90c10e220 0x7fa90c103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa90c10b870 0x7fa90c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 --2- 172.21.15.71:0/688491983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c104e10 0x7fa90c1026d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 >> 172.21.15.71:0/688491983 conn(0x7fa90c0fe380 msgr2=0x7fa90c10e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 shutdown_connections 2024-05-27T09:48:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.617+0000 7fa913c00640 1 -- 172.21.15.71:0/688491983 wait complete. 2024-05-27T09:48:04.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.898+0000 7f7535000640 1 -- 172.21.15.71:0/240023054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f753010c180 msgr2=0x7f7530105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.898+0000 7f7535000640 1 --2- 172.21.15.71:0/240023054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f753010c180 0x7f7530105dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7518009900 tx=0x7f751802a410 comp rx=0 tx=0).stop 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.898+0000 7f7535000640 1 -- 172.21.15.71:0/240023054 shutdown_connections 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.898+0000 7f7535000640 1 --2- 172.21.15.71:0/240023054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7530106430 0x7f7530112800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.898+0000 7f7535000640 1 --2- 172.21.15.71:0/240023054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f753010c180 0x7f7530105dc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.898+0000 7f7535000640 1 --2- 172.21.15.71:0/240023054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 0x7f7530105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.898+0000 7f7535000640 1 -- 172.21.15.71:0/240023054 >> 172.21.15.71:0/240023054 conn(0x7f7530101380 msgr2=0x7f75301037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.899+0000 7f7535000640 1 -- 172.21.15.71:0/240023054 shutdown_connections 2024-05-27T09:48:04.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.899+0000 7f7535000640 1 -- 172.21.15.71:0/240023054 wait complete. 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 Processor -- start 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 -- start start 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7530106430 0x7f75301a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 0x7f75301a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f753010c180 0x7f753019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7530115ed0 con 0x7f7530106430 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7530115d50 con 0x7f753010bce0 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f7535000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7530116050 con 0x7f753010c180 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f752f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7530106430 0x7f75301a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f752ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 0x7f75301a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f752ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 0x7f75301a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50620/0 (socket says 172.21.15.71:50620) 2024-05-27T09:48:04.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f752ea00640 1 -- 172.21.15.71:0/1064835431 learned_addr learned my addr 172.21.15.71:0/1064835431 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:04.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.900+0000 7f752fe00640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f753010c180 0x7f753019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f752ea00640 1 -- 172.21.15.71:0/1064835431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f753010c180 msgr2=0x7f753019c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f752ea00640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f753010c180 0x7f753019c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f752ea00640 1 -- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7530106430 msgr2=0x7f75301a2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:04.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f752ea00640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7530106430 0x7f75301a2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:04.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f752ea00640 1 -- 172.21.15.71:0/1064835431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753019cec0 con 0x7f753010bce0 2024-05-27T09:48:04.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f752f400640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7530106430 0x7f75301a2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:04.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f752ea00640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 0x7f75301a2b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f751802a930 tx=0x7f7518031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:04.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.901+0000 7f7527e00640 1 -- 172.21.15.71:0/1064835431 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751803f030 con 0x7f753010bce0 2024-05-27T09:48:04.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.902+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753019d0f0 con 0x7f753010bce0 2024-05-27T09:48:04.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.902+0000 7f7527e00640 1 -- 172.21.15.71:0/1064835431 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7518004490 con 0x7f753010bce0 2024-05-27T09:48:04.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.902+0000 7f7527e00640 1 -- 172.21.15.71:0/1064835431 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518035070 con 0x7f753010bce0 2024-05-27T09:48:04.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.902+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753019d5e0 con 0x7f753010bce0 2024-05-27T09:48:04.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.903+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7530106fc0 con 0x7f753010bce0 2024-05-27T09:48:04.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.905+0000 7f7527e00640 1 -- 172.21.15.71:0/1064835431 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f7518042030 con 0x7f753010bce0 2024-05-27T09:48:04.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.906+0000 7f7527e00640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f75140b2a70 0x7f75140b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:04.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.907+0000 7f7527e00640 1 -- 172.21.15.71:0/1064835431 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f7518102ef0 con 0x7f753010bce0 2024-05-27T09:48:04.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.907+0000 7f752f400640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f75140b2a70 0x7f75140b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:04.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.907+0000 7f752f400640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f75140b2a70 0x7f75140b4f80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75301069c0 tx=0x7f7520005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:04.909+0000 7f7527e00640 1 -- 172.21.15.71:0/1064835431 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f75180ca0d0 con 0x7f753010bce0 2024-05-27T09:48:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.142+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f7530101f00 con 0x7f75140b2a70 2024-05-27T09:48:05.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.198+0000 7fdedca00700 1 -- 172.21.15.71:0/1447467103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 msgr2=0x7fded81038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.198+0000 7fdedca00700 1 --2- 172.21.15.71:0/1447467103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded81038c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009920 tx=0x7fdec8009c30 comp rx=0 tx=0).stop 2024-05-27T09:48:05.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.199+0000 7fdedca00700 1 -- 172.21.15.71:0/1447467103 shutdown_connections 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.199+0000 7fdedca00700 1 --2- 172.21.15.71:0/1447467103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded8108730 0x7fded8110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.199+0000 7fdedca00700 1 --2- 172.21.15.71:0/1447467103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded81038c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.199+0000 7fdedca00700 1 --2- 172.21.15.71:0/1447467103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded8107de0 0x7fded81081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.199+0000 7fdedca00700 1 -- 172.21.15.71:0/1447467103 >> 172.21.15.71:0/1447467103 conn(0x7fded80fedb0 msgr2=0x7fded81011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.199+0000 7fdedca00700 1 -- 172.21.15.71:0/1447467103 shutdown_connections 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.199+0000 7fdedca00700 1 -- 172.21.15.71:0/1447467103 wait complete. 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.200+0000 7fdedca00700 1 Processor -- start 2024-05-27T09:48:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.200+0000 7fdedca00700 1 -- start start 2024-05-27T09:48:05.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fdedca00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fdedca00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded8107de0 0x7fded819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fdedca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded8108730 0x7fded819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fdedca00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fded81133b0 con 0x7fded81034b0 2024-05-27T09:48:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fdedca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fded8113230 con 0x7fded8108730 2024-05-27T09:48:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fdedca00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fded8113530 con 0x7fded8107de0 2024-05-27T09:48:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fded5e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fded5e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded819aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50046/0 (socket says 172.21.15.71:50046) 2024-05-27T09:48:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fded5e00700 1 -- 172.21.15.71:0/2995624829 learned_addr learned my addr 172.21.15.71:0/2995624829 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.201+0000 7fded6800700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded8108730 0x7fded819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded5400700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded8107de0 0x7fded819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded5e00700 1 -- 172.21.15.71:0/2995624829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded8107de0 msgr2=0x7fded819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded5e00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded8107de0 0x7fded819b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded5e00700 1 -- 172.21.15.71:0/2995624829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded8108730 msgr2=0x7fded819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded5e00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded8108730 0x7fded819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded5e00700 1 -- 172.21.15.71:0/2995624829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded819fd70 con 0x7fded81034b0 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded6800700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded8108730 0x7fded819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.202+0000 7fded5e00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded819aef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009230 tx=0x7fdec800f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.203+0000 7fdecea00700 1 -- 172.21.15.71:0/2995624829 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8027070 con 0x7fded81034b0 2024-05-27T09:48:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.203+0000 7fdecea00700 1 -- 172.21.15.71:0/2995624829 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec80054f0 con 0x7fded81034b0 2024-05-27T09:48:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.203+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded81a0000 con 0x7fded81034b0 2024-05-27T09:48:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.203+0000 7fdecea00700 1 -- 172.21.15.71:0/2995624829 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8004930 con 0x7fded81034b0 2024-05-27T09:48:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.203+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded81a04e0 con 0x7fded81034b0 2024-05-27T09:48:05.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.208+0000 7fdecea00700 1 -- 172.21.15.71:0/2995624829 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fdec802a070 con 0x7fded81034b0 2024-05-27T09:48:05.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:04 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/533502751' entity='client.admin' 2024-05-27T09:48:05.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:04 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:05.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:04 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:05.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:04 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:05.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:04 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:05.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:04 smithi071 ceph-mon[31451]: from='client.25196 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 Processor -- start 2024-05-27T09:48:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 -- start start 2024-05-27T09:48:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69ed37ec0 0x55f69eec0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69eec11c0 0x55f69eebad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eebb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f69ede4ec0 con 0x55f69eebb240 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f69edd4a60 con 0x55f69ed37ec0 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.209+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f69edd8aa0 con 0x55f69eec11c0 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fdecea00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdebc0b2b90 0x7fdebc0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69eec11c0 0x55f69eebad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69eec11c0 0x55f69eebad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54010/0 (socket says 172.21.15.71:54010) 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 -- 172.21.15.71:0/1799212837 learned_addr learned my addr 172.21.15.71:0/1799212837 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fdecea00700 1 -- 172.21.15.71:0/2995624829 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fdec80e3090 con 0x7fded81034b0 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded6800700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdebc0b2b90 0x7fdebc0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5400700 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eebb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded6800700 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69ed37ec0 0x55f69eec0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 -- 172.21.15.71:0/1799212837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69ed37ec0 msgr2=0x55f69eec0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69ed37ec0 0x55f69eec0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 -- 172.21.15.71:0/1799212837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 msgr2=0x55f69eebb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eebb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5e00700 1 -- 172.21.15.71:0/1799212837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69ed9d4a0 con 0x55f69eec11c0 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.210+0000 7fded5400700 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eebb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:48:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.211+0000 7fded5e00700 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69eec11c0 0x55f69eebad00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdec8021000 tx=0x7fdec8077d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7afb3d081d7a39 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.211+0000 7fdec3400700 1 -- 172.21.15.71:0/1799212837 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec80aa880 con 0x55f69eec11c0 2024-05-27T09:48:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.211+0000 7fdec3400700 1 -- 172.21.15.71:0/1799212837 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec80aa180 con 0x55f69eec11c0 2024-05-27T09:48:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.211+0000 7fdec3400700 1 -- 172.21.15.71:0/1799212837 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec80a26a0 con 0x55f69eec11c0 2024-05-27T09:48:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1799212837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69eec11c0 msgr2=0x55f69eebad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fded6800700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdebc0b2b90 0x7fdebc0b50a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55f69eebbfc0 tx=0x7fded00099e0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69eec11c0 0x55f69eebad00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdec8021000 tx=0x7fdec8077d50 comp rx=0 tx=0).stop 2024-05-27T09:48:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1799212837 shutdown_connections 2024-05-27T09:48:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eebb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69ed37ec0 0x55f69eec0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1799212837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69eec11c0 0x55f69eebad00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.212+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1799212837 >> 172.21.15.71:0/1799212837 conn(0x55f69ed98040 msgr2=0x55f69eeb1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.213+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1799212837 shutdown_connections 2024-05-27T09:48:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.213+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1799212837 wait complete. 2024-05-27T09:48:05.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.213+0000 7fdeeb5aeb80 1 -- start start 2024-05-27T09:48:05.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.214+0000 7fdeeb5aeb80 1 Processor -- start 2024-05-27T09:48:05.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.214+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eec4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.214+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eec4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eec54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f69ecdb020 con 0x55f69eec11c0 2024-05-27T09:48:05.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f69ed757e0 con 0x55f69eebb240 2024-05-27T09:48:05.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f69eec7a50 con 0x55f69ed37ec0 2024-05-27T09:48:05.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fdeeb5aeb80 10 client.0 _ll_register_callbacks cb 0x55f69ed7ecf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:05.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fded6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eec54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fded6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eec54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50064/0 (socket says 172.21.15.71:50064) 2024-05-27T09:48:05.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fded6800700 1 -- 172.21.15.71:0/1857987543 learned_addr learned my addr 172.21.15.71:0/1857987543 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:05.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fded5400700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eec4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.215+0000 7fded5e00700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eec4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded5e00700 1 -- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 msgr2=0x55f69eec4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded5e00700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eec4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded5e00700 1 -- 172.21.15.71:0/1857987543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 msgr2=0x55f69eec54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded5e00700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eec54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded5e00700 1 -- 172.21.15.71:0/1857987543 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f69ed24950 con 0x55f69ed37ec0 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded6800700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eec54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded5400700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eec4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:48:05.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fded5e00700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eec4a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdec80058b0 tx=0x7fdec8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45faaf7b824582e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.216+0000 7fdeb7e00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeb7e00700 1 -- 172.21.15.71:0/1857987543 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec80b2f50 con 0x55f69ed37ec0 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdec80aa180 con 0x55f69ed37ec0 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeb7e00700 1 -- 172.21.15.71:0/1857987543 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fdec80ae150 con 0x55f69ed37ec0 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeb7e00700 1 -- 172.21.15.71:0/1857987543 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdec80aa3e0 con 0x55f69ed37ec0 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeeb5aeb80 10 client.25225 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f69eda50e0 con 0x55f69ed37ec0 2024-05-27T09:48:05.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeb7e00700 1 -- 172.21.15.71:0/1857987543 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec80aa180 con 0x55f69ed37ec0 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeb7e00700 1 -- 172.21.15.71:0/1857987543 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fdec80e0910 con 0x55f69ed37ec0 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeeb5aeb80 10 client.25225 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeeb5aeb80 10 client.25225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.217+0000 7fdeeb5aeb80 20 client.25225 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.218+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69eeb6290 0x55f69eeb66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.218+0000 7fdeeb5aeb80 4 client.25225 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.218+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f69ede6e10 con 0x55f69eeb6290 2024-05-27T09:48:05.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.218+0000 7fded5400700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69eeb6290 0x55f69eeb66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.219+0000 7fded5400700 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69eeb6290 0x55f69eeb66a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8156dc7855ef72e6 server_cookie=163e94da74432f21 in_seq=0 out_seq=0 2024-05-27T09:48:05.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.219+0000 7fdeb7e00700 10 client.25225 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeb7e00700 1 -- 172.21.15.71:0/1857987543 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f69ede6e10 con 0x55f69eeb6290 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeb7e00700 10 client.25225 handle_command_reply: tid=0 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 client.25225 shutdown 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 msgr2=0x55f69eec4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eec4a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdec80058b0 tx=0x7fdec8009260 comp rx=0 tx=0).stop 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 shutdown_connections 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69eeb6290 0x55f69eeb66a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eec54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eec4a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/1857987543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eec4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 >> 172.21.15.71:0/1857987543 conn(0x55f69ed98040 msgr2=0x55f69eeb1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.220+0000 7fdeb7e00700 0 client.25225 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:05.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.221+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 shutdown_connections 2024-05-27T09:48:05.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.221+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/1857987543 wait complete. 2024-05-27T09:48:05.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.221+0000 7fdeeb5aeb80 20 client.25225 trim_cache size 0 max 16384 2024-05-27T09:48:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:04 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/533502751' entity='client.admin' 2024-05-27T09:48:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:04 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:04 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:04 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:04 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:04 smithi122 ceph-mon[36436]: from='client.25196 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:05.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.238+0000 7f7527e00640 1 -- 172.21.15.71:0/1064835431 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f7530101f00 con 0x7f75140b2a70 2024-05-27T09:48:05.239 INFO:teuthology.orchestra.run.smithi071.stdout:Retention added to path / 2024-05-27T09:48:05.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f75140b2a70 msgr2=0x7f75140b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f75140b2a70 0x7f75140b4f80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75301069c0 tx=0x7f7520005f90 comp rx=0 tx=0).stop 2024-05-27T09:48:05.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 msgr2=0x7f75301a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 0x7f75301a2b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f751802a930 tx=0x7f7518031a20 comp rx=0 tx=0).stop 2024-05-27T09:48:05.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 shutdown_connections 2024-05-27T09:48:05.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f75140b2a70 0x7f75140b4f80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f753010c180 0x7f753019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f753010bce0 0x7f75301a2b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 --2- 172.21.15.71:0/1064835431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7530106430 0x7f75301a2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 >> 172.21.15.71:0/1064835431 conn(0x7f7530101380 msgr2=0x7f75301017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 shutdown_connections 2024-05-27T09:48:05.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.241+0000 7f7535000640 1 -- 172.21.15.71:0/1064835431 wait complete. 2024-05-27T09:48:05.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 Processor -- start 2024-05-27T09:48:05.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 -- start start 2024-05-27T09:48:05.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eed06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eec6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eec11c0 0x55f69eee1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800fdd0 con 0x55f69eebb240 2024-05-27T09:48:05.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800d660 con 0x55f69eec11c0 2024-05-27T09:48:05.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.247+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800b4b0 con 0x55f69ed37ec0 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eec6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded6800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eec11c0 0x55f69eee1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eec6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50080/0 (socket says 172.21.15.71:50080) 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded6800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eec11c0 0x55f69eee1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50678/0 (socket says 172.21.15.71:50678) 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eed06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 -- 172.21.15.71:0/3235871163 learned_addr learned my addr 172.21.15.71:0/3235871163 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 -- 172.21.15.71:0/3235871163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 msgr2=0x55f69eed06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eed06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 -- 172.21.15.71:0/3235871163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eec11c0 msgr2=0x55f69eee1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eec11c0 0x55f69eee1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5400700 1 -- 172.21.15.71:0/3235871163 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69eec7310 con 0x55f69eebb240 2024-05-27T09:48:05.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded5e00700 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eed06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:05.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.248+0000 7fded6800700 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eec11c0 0x55f69eee1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:05.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.249+0000 7fded5400700 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eec6dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fded8107db0 tx=0x7fdec4004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd458dadeda0f1e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.249+0000 7fdec2a00700 1 -- 172.21.15.71:0/3235871163 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4022070 con 0x55f69eebb240 2024-05-27T09:48:05.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.249+0000 7fdec2a00700 1 -- 172.21.15.71:0/3235871163 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec401d430 con 0x55f69eebb240 2024-05-27T09:48:05.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.249+0000 7fdec2a00700 1 -- 172.21.15.71:0/3235871163 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4010670 con 0x55f69eebb240 2024-05-27T09:48:05.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.250+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3235871163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 msgr2=0x55f69eec6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.250+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eec6dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fded8107db0 tx=0x7fdec4004320 comp rx=0 tx=0).stop 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.250+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3235871163 shutdown_connections 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.250+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eec11c0 0x55f69eee1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.250+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eed06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.250+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3235871163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eebb240 0x55f69eec6dd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.250+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3235871163 >> 172.21.15.71:0/3235871163 conn(0x55f69ed98040 msgr2=0x55f69eec39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.251+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3235871163 shutdown_connections 2024-05-27T09:48:05.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.251+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3235871163 wait complete. 2024-05-27T09:48:05.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.251+0000 7fdeeb5aeb80 1 -- start start 2024-05-27T09:48:05.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.251+0000 7fdeeb5aeb80 1 Processor -- start 2024-05-27T09:48:05.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eede400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eede940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fdeeb5aeb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eedee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800bb20 con 0x55f69eec11c0 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800cf90 con 0x55f69eebb240 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fdeeb5aeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800c1f0 con 0x55f69ed37ec0 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fdeeb5aeb80 10 client.0 _ll_register_callbacks cb 0x55f69ed7ecf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fded6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eedee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fded6800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eedee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50094/0 (socket says 172.21.15.71:50094) 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fded6800700 1 -- 172.21.15.71:0/3078237244 learned_addr learned my addr 172.21.15.71:0/3078237244 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fded5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eede940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.252+0000 7fded5e00700 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eede400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fded6800700 1 -- 172.21.15.71:0/3078237244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 msgr2=0x55f69eede400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fded6800700 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eede400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fded6800700 1 -- 172.21.15.71:0/3078237244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 msgr2=0x55f69eede940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fded6800700 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eede940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fded6800700 1 -- 172.21.15.71:0/3078237244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f69ef42530 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fded5e00700 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eede400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fded6800700 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eedee80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fded0019700 tx=0x7fded0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e12dd6418d74a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.253+0000 7fdeb7e00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.254+0000 7fdeb7e00700 1 -- 172.21.15.71:0/3078237244 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0019e20 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.254+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdec401d430 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.254+0000 7fdeb7e00700 1 -- 172.21.15.71:0/3078237244 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fded0027620 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.254+0000 7fdeb7e00700 1 -- 172.21.15.71:0/3078237244 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fded0036050 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.254+0000 7fdeeb5aeb80 10 client.15108 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.254+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f69ef43820 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.254+0000 7fdeb7e00700 1 -- 172.21.15.71:0/3078237244 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec401d430 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fdeb7e00700 1 -- 172.21.15.71:0/3078237244 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fded001a9a0 con 0x55f69eec11c0 2024-05-27T09:48:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fdeeb5aeb80 10 client.15108 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fdeeb5aeb80 10 client.15108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fdeeb5aeb80 20 client.15108 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69ef43fb0 0x55f69ef463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fdeeb5aeb80 4 client.15108 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f69ede05f0 con 0x55f69ef43fb0 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.255+0000 7fded5e00700 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69ef43fb0 0x55f69ef463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.256+0000 7fded5e00700 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69ef43fb0 0x55f69ef463d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914e28567f3e4d18 server_cookie=6b2cc9f6e650d3 in_seq=0 out_seq=0 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.256+0000 7fdeb7e00700 10 client.15108 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeb7e00700 1 -- 172.21.15.71:0/3078237244 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f69ede05f0 con 0x55f69ef43fb0 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeb7e00700 10 client.15108 handle_command_reply: tid=0 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 client.15108 shutdown 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 msgr2=0x55f69eedee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eedee80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fded0019700 tx=0x7fded0004b40 comp rx=0 tx=0).stop 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 shutdown_connections 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f69ef43fb0 0x55f69ef463d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f69eec11c0 0x55f69eedee80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f69ed37ec0 0x55f69eede400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 --2- 172.21.15.71:0/3078237244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f69eebb240 0x55f69eede940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeb7e00700 0 client.15108 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 >> 172.21.15.71:0/3078237244 conn(0x55f69ed98040 msgr2=0x55f69eebe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.257+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 shutdown_connections 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.258+0000 7fdeeb5aeb80 1 -- 172.21.15.71:0/3078237244 wait complete. 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.258+0000 7fdeeb5aeb80 20 client.15108 trim_cache size 0 max 16384 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "return_code": 0, 2024-05-27T09:48:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_tag": "7fc70291-7c43-46f2-92ef-fac9e425157c", 2024-05-27T09:48:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": "asynchronous" 2024-05-27T09:48:05.263 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:48:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.258+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdebc0b2b90 msgr2=0x7fdebc0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.258+0000 7fdedca00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdebc0b2b90 0x7fdebc0b50a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55f69eebbfc0 tx=0x7fded00099e0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.258+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 msgr2=0x7fded819aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.258+0000 7fdedca00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded819aef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009230 tx=0x7fdec800f930 comp rx=0 tx=0).stop 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 shutdown_connections 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdebc0b2b90 0x7fdebc0b50a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded8108730 0x7fded819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded81034b0 0x7fded819aef0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 --2- 172.21.15.71:0/2995624829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded8107de0 0x7fded819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 >> 172.21.15.71:0/2995624829 conn(0x7fded80fedb0 msgr2=0x7fded806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 shutdown_connections 2024-05-27T09:48:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.259+0000 7fdedca00700 1 -- 172.21.15.71:0/2995624829 wait complete. 2024-05-27T09:48:05.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-27T09:48:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:04 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/533502751' entity='client.admin' 2024-05-27T09:48:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:04 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:48:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:04 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:48:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:04 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:48:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:04 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:48:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:04 smithi072 ceph-mon[35951]: from='client.25196 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 -- 172.21.15.71:0/2982280148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 msgr2=0x7f80b4103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 --2- 172.21.15.71:0/2982280148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 0x7f80b4103d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009900 tx=0x7f80a002a410 comp rx=0 tx=0).stop 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 -- 172.21.15.71:0/2982280148 shutdown_connections 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 --2- 172.21.15.71:0/2982280148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 0x7f80b41107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 --2- 172.21.15.71:0/2982280148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 0x7f80b4103d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 --2- 172.21.15.71:0/2982280148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80b4109cb0 0x7f80b4103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 -- 172.21.15.71:0/2982280148 >> 172.21.15.71:0/2982280148 conn(0x7f80b40ff480 msgr2=0x7f80b41018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 -- 172.21.15.71:0/2982280148 shutdown_connections 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.525+0000 7f80bc600640 1 -- 172.21.15.71:0/2982280148 wait complete. 2024-05-27T09:48:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 Processor -- start 2024-05-27T09:48:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 -- start start 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 0x7f80b4074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80b4109cb0 0x7f80b4075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 0x7f80b4075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4113ed0 con 0x7f80b4104400 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4113d50 con 0x7f80b4109cb0 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.527+0000 7f80bc600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4114050 con 0x7f80b410a150 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 0x7f80b4074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 0x7f80b4074fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50112/0 (socket says 172.21.15.71:50112) 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 -- 172.21.15.71:0/3501222883 learned_addr learned my addr 172.21.15.71:0/3501222883 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9200640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80b4109cb0 0x7f80b4075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80ba600640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 0x7f80b4075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 -- 172.21.15.71:0/3501222883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 msgr2=0x7f80b4075a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 0x7f80b4075a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 -- 172.21.15.71:0/3501222883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80b4109cb0 msgr2=0x7f80b4075500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80b4109cb0 0x7f80b4075500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.528+0000 7f80b9c00640 1 -- 172.21.15.71:0/3501222883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b41a8c30 con 0x7f80b4104400 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.529+0000 7f80b9c00640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 0x7f80b4074fc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9c0 tx=0x7f80a800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.529+0000 7f80b2000640 1 -- 172.21.15.71:0/3501222883 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a800cd80 con 0x7f80b4104400 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.529+0000 7f80b2000640 1 -- 172.21.15.71:0/3501222883 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a80054d0 con 0x7f80b4104400 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.529+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b41a8f20 con 0x7f80b4104400 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.529+0000 7f80b2000640 1 -- 172.21.15.71:0/3501222883 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8010430 con 0x7f80b4104400 2024-05-27T09:48:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.529+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b41a9380 con 0x7f80b4104400 2024-05-27T09:48:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.530+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b406a230 con 0x7f80b4104400 2024-05-27T09:48:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.533+0000 7f80b2000640 1 -- 172.21.15.71:0/3501222883 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f80a8004fb0 con 0x7f80b4104400 2024-05-27T09:48:05.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.535+0000 7f80b2000640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f809c0b2a70 0x7f809c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:05.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.536+0000 7f80b2000640 1 -- 172.21.15.71:0/3501222883 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f80a80e2e30 con 0x7f80b4104400 2024-05-27T09:48:05.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.536+0000 7f80b9200640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f809c0b2a70 0x7f809c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:05.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.536+0000 7f80b9200640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f809c0b2a70 0x7f809c0b4f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80a002aa00 tx=0x7f80a0005a20 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.539+0000 7f80b2000640 1 -- 172.21.15.71:0/3501222883 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f80a8054df0 con 0x7f80b4104400 2024-05-27T09:48:05.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.769+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f80b40fffa0 con 0x7f809c0b2a70 2024-05-27T09:48:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.780+0000 7f80b2000640 1 -- 172.21.15.71:0/3501222883 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f80b40fffa0 con 0x7f809c0b2a70 2024-05-27T09:48:05.781 INFO:teuthology.orchestra.run.smithi071.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-27T00:00:00", "created": "2024-05-27T09:48:04", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-05-27T09:48:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f809c0b2a70 msgr2=0x7f809c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f809c0b2a70 0x7f809c0b4f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80a002aa00 tx=0x7f80a0005a20 comp rx=0 tx=0).stop 2024-05-27T09:48:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 msgr2=0x7f80b4074fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 0x7f80b4074fc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9c0 tx=0x7f80a800ee80 comp rx=0 tx=0).stop 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 shutdown_connections 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f809c0b2a70 0x7f809c0b4f80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b410a150 0x7f80b4075a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80b4109cb0 0x7f80b4075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 --2- 172.21.15.71:0/3501222883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80b4104400 0x7f80b4074fc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.782+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 >> 172.21.15.71:0/3501222883 conn(0x7f80b40ff480 msgr2=0x7f80b40ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.783+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 shutdown_connections 2024-05-27T09:48:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:05.783+0000 7f80bc600640 1 -- 172.21.15.71:0/3501222883 wait complete. 2024-05-27T09:48:05.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-27T09:48:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 -- 172.21.15.71:0/1395181369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 msgr2=0x7feb9010f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 --2- 172.21.15.71:0/1395181369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 0x7feb9010f700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feb88009c10 tx=0x7feb8802a6e0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 -- 172.21.15.71:0/1395181369 shutdown_connections 2024-05-27T09:48:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 --2- 172.21.15.71:0/1395181369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 0x7feb9010f700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 --2- 172.21.15.71:0/1395181369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90103230 0x7feb90103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 --2- 172.21.15.71:0/1395181369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb90108a20 0x7feb90102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 -- 172.21.15.71:0/1395181369 >> 172.21.15.71:0/1395181369 conn(0x7feb900fd950 msgr2=0x7feb900ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 -- 172.21.15.71:0/1395181369 shutdown_connections 2024-05-27T09:48:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.063+0000 7feb8f200640 1 -- 172.21.15.71:0/1395181369 wait complete. 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.064+0000 7feb8f200640 1 Processor -- start 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.064+0000 7feb8f200640 1 -- start start 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8f200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb90103230 0x7feb9010c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8f200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90108a20 0x7feb9010c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 0x7feb901a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feb901021b0 con 0x7feb9010d2e0 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8f200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feb90102030 con 0x7feb90108a20 2024-05-27T09:48:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8f200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feb90102330 con 0x7feb90103230 2024-05-27T09:48:06.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90108a20 0x7feb9010c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 0x7feb901a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90108a20 0x7feb9010c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50720/0 (socket says 172.21.15.71:50720) 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8d400640 1 -- 172.21.15.71:0/1190812514 learned_addr learned my addr 172.21.15.71:0/1190812514 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.065+0000 7feb8de00640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb90103230 0x7feb9010c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb8d400640 1 -- 172.21.15.71:0/1190812514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb90103230 msgr2=0x7feb9010c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb8d400640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb90103230 0x7feb9010c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb8d400640 1 -- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 msgr2=0x7feb901a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb8d400640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 0x7feb901a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb8d400640 1 -- 172.21.15.71:0/1190812514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb901a16d0 con 0x7feb90108a20 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb8d400640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90108a20 0x7feb9010c870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e9f0 tx=0x7feb7c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb86a00640 1 -- 172.21.15.71:0/1190812514 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00ccc0 con 0x7feb90108a20 2024-05-27T09:48:06.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.066+0000 7feb86a00640 1 -- 172.21.15.71:0/1190812514 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7c0108e0 con 0x7feb90108a20 2024-05-27T09:48:06.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.067+0000 7feb86a00640 1 -- 172.21.15.71:0/1190812514 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c018750 con 0x7feb90108a20 2024-05-27T09:48:06.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.067+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb901a19c0 con 0x7feb90108a20 2024-05-27T09:48:06.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.067+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb901a1ec0 con 0x7feb90108a20 2024-05-27T09:48:06.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.068+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb90103d00 con 0x7feb90108a20 2024-05-27T09:48:06.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.071+0000 7feb86a00640 1 -- 172.21.15.71:0/1190812514 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7feb7c010430 con 0x7feb90108a20 2024-05-27T09:48:06.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.072+0000 7feb86a00640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7feb740b2a70 0x7feb740b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:06.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.072+0000 7feb86a00640 1 -- 172.21.15.71:0/1190812514 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7feb7c0e3140 con 0x7feb90108a20 2024-05-27T09:48:06.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.073+0000 7feb8de00640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7feb740b2a70 0x7feb740b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:06.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.074+0000 7feb8de00640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7feb740b2a70 0x7feb740b4f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb9019d910 tx=0x7feb80009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:06.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.074+0000 7feb86a00640 1 -- 172.21.15.71:0/1190812514 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feb7c0aa8a0 con 0x7feb90108a20 2024-05-27T09:48:06.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-27T09:48:06.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:05 smithi071 ceph-mon[31451]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:06.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:05 smithi071 ceph-mon[31451]: scrub queued for path: / 2024-05-27T09:48:06.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:05 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:48:06.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:05 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:48:06.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:05 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:48:06.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:05 smithi071 ceph-mon[31451]: pgmap v13: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:05 smithi072 ceph-mon[35951]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:05 smithi072 ceph-mon[35951]: scrub queued for path: / 2024-05-27T09:48:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:05 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:48:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:05 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:48:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:05 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:48:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:05 smithi072 ceph-mon[35951]: pgmap v13: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:06.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.314+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7feb901125c0 con 0x7feb740b2a70 2024-05-27T09:48:06.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.324+0000 7feb86a00640 1 -- 172.21.15.71:0/1190812514 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7feb901125c0 con 0x7feb740b2a70 2024-05-27T09:48:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/ 1m 6m3h 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7feb740b2a70 msgr2=0x7feb740b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7feb740b2a70 0x7feb740b4f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb9019d910 tx=0x7feb80009260 comp rx=0 tx=0).stop 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90108a20 msgr2=0x7feb9010c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90108a20 0x7feb9010c870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e9f0 tx=0x7feb7c00edf0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 shutdown_connections 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7feb740b2a70 0x7feb740b4f80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb9010d2e0 0x7feb901a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb90108a20 0x7feb9010c870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 --2- 172.21.15.71:0/1190812514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb90103230 0x7feb9010c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 >> 172.21.15.71:0/1190812514 conn(0x7feb900fd950 msgr2=0x7feb90100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:06.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 shutdown_connections 2024-05-27T09:48:06.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:06.327+0000 7feb8f200640 1 -- 172.21.15.71:0/1190812514 wait complete. 2024-05-27T09:48:06.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-05-27T09:48:06.415 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-27T09:48:06.425 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-27T09:48:06.444 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:48:06.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-27T09:48:06.448 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-27T09:48:06.460 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-27T09:48:06.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-27T09:48:06.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:05 smithi122 ceph-mon[36436]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:05 smithi122 ceph-mon[36436]: scrub queued for path: / 2024-05-27T09:48:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:05 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:48:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:05 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:48:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:05 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:48:06.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:05 smithi122 ceph-mon[36436]: pgmap v13: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:06.529 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:07.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:06 smithi071 ceph-mon[31451]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:07.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:06 smithi071 ceph-mon[31451]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:07.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:06 smithi072 ceph-mon[35951]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:07.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:06 smithi072 ceph-mon[35951]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:07.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:06 smithi122 ceph-mon[36436]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:07.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:06 smithi122 ceph-mon[36436]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:48:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:08.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:07 smithi071 ceph-mon[31451]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:08.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:07 smithi072 ceph-mon[35951]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:08.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:07 smithi122 ceph-mon[36436]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:09.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 -- 172.21.15.71:0/3415391903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c107de0 msgr2=0x7f545c1081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 --2- 172.21.15.71:0/3415391903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c107de0 0x7f545c1081f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54480099c0 tx=0x7f5448009cd0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 -- 172.21.15.71:0/3415391903 shutdown_connections 2024-05-27T09:48:09.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 --2- 172.21.15.71:0/3415391903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f545c108730 0x7f545c110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 --2- 172.21.15.71:0/3415391903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c1034b0 0x7f545c1038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 --2- 172.21.15.71:0/3415391903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c107de0 0x7f545c1081f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 -- 172.21.15.71:0/3415391903 >> 172.21.15.71:0/3415391903 conn(0x7f545c0fedb0 msgr2=0x7f545c1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:09.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 -- 172.21.15.71:0/3415391903 shutdown_connections 2024-05-27T09:48:09.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.669+0000 7f5463000700 1 -- 172.21.15.71:0/3415391903 wait complete. 2024-05-27T09:48:09.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.670+0000 7f5463000700 1 Processor -- start 2024-05-27T09:48:09.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.670+0000 7f5463000700 1 -- start start 2024-05-27T09:48:09.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f5463000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c1034b0 0x7f545c110a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f5463000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c107de0 0x7f545c110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f5463000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f545c108730 0x7f545c1114f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f5463000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f545c114500 con 0x7f545c1034b0 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f5463000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f545c114380 con 0x7f545c108730 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f5463000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f545c114680 con 0x7f545c107de0 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f545b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c107de0 0x7f545c110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f545be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c1034b0 0x7f545c110a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f545b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c107de0 0x7f545c110fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54106/0 (socket says 172.21.15.71:54106) 2024-05-27T09:48:09.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.671+0000 7f545b400700 1 -- 172.21.15.71:0/1621330274 learned_addr learned my addr 172.21.15.71:0/1621330274 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:09.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.672+0000 7f5461000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f545c108730 0x7f545c1114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.672+0000 7f545b400700 1 -- 172.21.15.71:0/1621330274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f545c108730 msgr2=0x7f545c1114f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.672+0000 7f545b400700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f545c108730 0x7f545c1114f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.672+0000 7f545b400700 1 -- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c1034b0 msgr2=0x7f545c110a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.672+0000 7f545b400700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c1034b0 0x7f545c110a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.672+0000 7f545b400700 1 -- 172.21.15.71:0/1621330274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c1a91f0 con 0x7f545c107de0 2024-05-27T09:48:09.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.672+0000 7f545b400700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c107de0 0x7f545c110fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f544800b580 tx=0x7f5448004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:09.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.673+0000 7f5458c00700 1 -- 172.21.15.71:0/1621330274 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5448009e60 con 0x7f545c107de0 2024-05-27T09:48:09.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.673+0000 7f5458c00700 1 -- 172.21.15.71:0/1621330274 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5448003c70 con 0x7f545c107de0 2024-05-27T09:48:09.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.673+0000 7f5458c00700 1 -- 172.21.15.71:0/1621330274 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480049c0 con 0x7f545c107de0 2024-05-27T09:48:09.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.673+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c1a9480 con 0x7f545c107de0 2024-05-27T09:48:09.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.673+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c1a9820 con 0x7f545c107de0 2024-05-27T09:48:09.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.678+0000 7f5458c00700 1 -- 172.21.15.71:0/1621330274 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f54480037c0 con 0x7f545c107de0 2024-05-27T09:48:09.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.679+0000 7f5471c05b80 1 Processor -- start 2024-05-27T09:48:09.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.679+0000 7f5471c05b80 1 -- start start 2024-05-27T09:48:09.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa57a5e40 0x557aa592a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5924870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa5924db0 0x557aa59251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f5471c05b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557aa5852e40 con 0x557aa5924db0 2024-05-27T09:48:09.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f5471c05b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557aa58429e0 con 0x557aa592ad30 2024-05-27T09:48:09.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f5471c05b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557aa5846a20 con 0x557aa57a5e40 2024-05-27T09:48:09.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f545be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5924870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f545b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa5924db0 0x557aa59251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f545be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5924870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50746/0 (socket says 172.21.15.71:50746) 2024-05-27T09:48:09.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f545be00700 1 -- 172.21.15.71:0/264179157 learned_addr learned my addr 172.21.15.71:0/264179157 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:09.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.680+0000 7f5461000700 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa57a5e40 0x557aa592a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f5458c00700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54400b2b90 0x7f54400b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f5461000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54400b2b90 0x7f54400b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f5458c00700 1 -- 172.21.15.71:0/1621330274 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f54480e3900 con 0x7f545c107de0 2024-05-27T09:48:09.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f545b400700 1 -- 172.21.15.71:0/264179157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa57a5e40 msgr2=0x557aa592a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f545b400700 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa57a5e40 0x557aa592a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f545b400700 1 -- 172.21.15.71:0/264179157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 msgr2=0x557aa5924870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f545b400700 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5924870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f545b400700 1 -- 172.21.15.71:0/264179157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa580b420 con 0x557aa5924db0 2024-05-27T09:48:09.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.681+0000 7f545be00700 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5924870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:09.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.682+0000 7f545b400700 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa5924db0 0x557aa59251c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54480e0ea0 tx=0x7f5448000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eace5c867903555e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:09.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.682+0000 7f5451600700 1 -- 172.21.15.71:0/264179157 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480aa340 con 0x557aa5924db0 2024-05-27T09:48:09.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.682+0000 7f5451600700 1 -- 172.21.15.71:0/264179157 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54480b3100 con 0x557aa5924db0 2024-05-27T09:48:09.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.682+0000 7f5451600700 1 -- 172.21.15.71:0/264179157 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480a6180 con 0x557aa5924db0 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.683+0000 7f5471c05b80 1 -- 172.21.15.71:0/264179157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa5924db0 msgr2=0x557aa59251c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.683+0000 7f5461000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54400b2b90 0x7f54400b50a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x557aa5925b30 tx=0x7f5454004b40 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.683+0000 7f5471c05b80 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa5924db0 0x557aa59251c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54480e0ea0 tx=0x7f5448000bc0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 -- 172.21.15.71:0/264179157 shutdown_connections 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa5924db0 0x557aa59251c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa57a5e40 0x557aa592a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 --2- 172.21.15.71:0/264179157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5924870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 -- 172.21.15.71:0/264179157 >> 172.21.15.71:0/264179157 conn(0x557aa5805fc0 msgr2=0x557aa591f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 -- 172.21.15.71:0/264179157 shutdown_connections 2024-05-27T09:48:09.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 -- 172.21.15.71:0/264179157 wait complete. 2024-05-27T09:48:09.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.684+0000 7f5471c05b80 1 -- start start 2024-05-27T09:48:09.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.685+0000 7f5471c05b80 1 Processor -- start 2024-05-27T09:48:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa592e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa5924db0 0x557aa592eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa592ad30 0x557aa592f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5471c05b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557aa5748fa0 con 0x557aa57a5e40 2024-05-27T09:48:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5471c05b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557aa57e3760 con 0x557aa5924db0 2024-05-27T09:48:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5471c05b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557aa59315c0 con 0x557aa592ad30 2024-05-27T09:48:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5471c05b80 10 client.0 _ll_register_callbacks cb 0x557aa57ecc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f545be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa592e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f545be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa592e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50162/0 (socket says 172.21.15.71:50162) 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f545be00700 1 -- 172.21.15.71:0/995837051 learned_addr learned my addr 172.21.15.71:0/995837051 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f5461000700 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa592ad30 0x557aa592f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.686+0000 7f545b400700 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa5924db0 0x557aa592eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f545be00700 1 -- 172.21.15.71:0/995837051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa592ad30 msgr2=0x557aa592f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f545be00700 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa592ad30 0x557aa592f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f545be00700 1 -- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa5924db0 msgr2=0x557aa592eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f545be00700 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa5924db0 0x557aa592eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f545be00700 1 -- 172.21.15.71:0/995837051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa57928d0 con 0x557aa57a5e40 2024-05-27T09:48:09.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f545be00700 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa592e620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f544c012a10 tx=0x7f544c012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639070a0b1645e44 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:09.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f5446000700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f5446000700 1 -- 172.21.15.71:0/995837051 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c004050 con 0x557aa57a5e40 2024-05-27T09:48:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f5446000700 1 -- 172.21.15.71:0/995837051 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f544c0041f0 con 0x557aa57a5e40 2024-05-27T09:48:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.687+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557aa5854d90 con 0x557aa57a5e40 2024-05-27T09:48:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5446000700 1 -- 172.21.15.71:0/995837051 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f544c0043f0 con 0x557aa57a5e40 2024-05-27T09:48:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 10 client.15132 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557aa5813060 con 0x557aa57a5e40 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5446000700 1 -- 172.21.15.71:0/995837051 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557aa5854d90 con 0x557aa57a5e40 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5446000700 1 -- 172.21.15.71:0/995837051 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f544c0039f0 con 0x557aa57a5e40 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 10 client.15132 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 10 client.15132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 20 client.15132 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa593e470 0x557aa59408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 4 client.15132 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.688+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557aa584e570 con 0x557aa593e470 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.689+0000 7f545b400700 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa593e470 0x557aa59408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.689+0000 7f545b400700 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa593e470 0x557aa59408b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ab93c9d039246a2 server_cookie=e543dffc013fab4 in_seq=0 out_seq=0 2024-05-27T09:48:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.689+0000 7f5446000700 10 client.15132 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.690+0000 7f5446000700 1 -- 172.21.15.71:0/995837051 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x557aa584e570 con 0x557aa593e470 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.690+0000 7f5446000700 10 client.15132 handle_command_reply: tid=0 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.690+0000 7f5471c05b80 1 client.15132 shutdown 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.690+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 msgr2=0x557aa592e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.690+0000 7f5471c05b80 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa592e620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f544c012a10 tx=0x7f544c012d20 comp rx=0 tx=0).stop 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 shutdown_connections 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa593e470 0x557aa59408b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa592ad30 0x557aa592f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa592e620 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 --2- 172.21.15.71:0/995837051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa5924db0 0x557aa592eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 >> 172.21.15.71:0/995837051 conn(0x557aa5805fc0 msgr2=0x557aa591f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5446000700 0 client.15132 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 shutdown_connections 2024-05-27T09:48:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 1 -- 172.21.15.71:0/995837051 wait complete. 2024-05-27T09:48:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.691+0000 7f5471c05b80 20 client.15132 trim_cache size 0 max 16384 2024-05-27T09:48:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 Processor -- start 2024-05-27T09:48:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 -- start start 2024-05-27T09:48:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa57a5e40 0x557aa5924870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa592d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa592ad30 0x557aa5939580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1b3850 con 0x557aa592ad30 2024-05-27T09:48:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1b10e0 con 0x557aa57a5e40 2024-05-27T09:48:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.714+0000 7f5471c05b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1aef50 con 0x557aa5924db0 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa592d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa57a5e40 0x557aa5924870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f5461000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa592ad30 0x557aa5939580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa592d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54120/0 (socket says 172.21.15.71:54120) 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 -- 172.21.15.71:0/421190755 learned_addr learned my addr 172.21.15.71:0/421190755 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 -- 172.21.15.71:0/421190755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa57a5e40 msgr2=0x557aa5924870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 --2- 172.21.15.71:0/421190755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa57a5e40 0x557aa5924870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 -- 172.21.15.71:0/421190755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa592ad30 msgr2=0x557aa5939580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 --2- 172.21.15.71:0/421190755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa592ad30 0x557aa5939580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 -- 172.21.15.71:0/421190755 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa5921350 con 0x557aa5924db0 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.715+0000 7f545b400700 1 --2- 172.21.15.71:0/421190755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa592d450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54480aa6f0 tx=0x7f54480e3b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39fbd8c9a2bcc72b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.716+0000 7f5450c00700 1 -- 172.21.15.71:0/421190755 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480aa160 con 0x557aa5924db0 2024-05-27T09:48:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.716+0000 7f5450c00700 1 -- 172.21.15.71:0/421190755 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5448003ab0 con 0x557aa5924db0 2024-05-27T09:48:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.716+0000 7f5450c00700 1 -- 172.21.15.71:0/421190755 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480aeda0 con 0x557aa5924db0 2024-05-27T09:48:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 -- 172.21.15.71:0/421190755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 msgr2=0x557aa592d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 --2- 172.21.15.71:0/421190755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa592d450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54480aa6f0 tx=0x7f54480e3b80 comp rx=0 tx=0).stop 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 -- 172.21.15.71:0/421190755 shutdown_connections 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 --2- 172.21.15.71:0/421190755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa592ad30 0x557aa5939580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 --2- 172.21.15.71:0/421190755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa57a5e40 0x557aa5924870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 --2- 172.21.15.71:0/421190755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa592d450 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 -- 172.21.15.71:0/421190755 >> 172.21.15.71:0/421190755 conn(0x557aa5805fc0 msgr2=0x557aa5928b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 -- 172.21.15.71:0/421190755 shutdown_connections 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 -- 172.21.15.71:0/421190755 wait complete. 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.717+0000 7f5471c05b80 1 -- start start 2024-05-27T09:48:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 1 Processor -- start 2024-05-27T09:48:09.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa5933430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa5933970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5933eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1af5a0 con 0x557aa57a5e40 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1b0a10 con 0x557aa592ad30 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1afc70 con 0x557aa5924db0 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.718+0000 7f5471c05b80 10 client.0 _ll_register_callbacks cb 0x557aa57ecc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa5933430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa5933430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50174/0 (socket says 172.21.15.71:50174) 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa5933970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545be00700 1 -- 172.21.15.71:0/2870963169 learned_addr learned my addr 172.21.15.71:0/2870963169 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f5461000700 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5933eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545b400700 1 -- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 msgr2=0x557aa5933eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545b400700 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5933eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545b400700 1 -- 172.21.15.71:0/2870963169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 msgr2=0x557aa5933430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545b400700 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa5933430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545b400700 1 -- 172.21.15.71:0/2870963169 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa592f410 con 0x557aa5924db0 2024-05-27T09:48:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f545b400700 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa5933970 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x557aa592b3a0 tx=0x7f54480aa580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d26eed5b97f444 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.719+0000 7f5446000700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:48:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5446000700 1 -- 172.21.15.71:0/2870963169 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480b12f0 con 0x557aa5924db0 2024-05-27T09:48:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5446000700 1 -- 172.21.15.71:0/2870963169 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f54480aac50 con 0x557aa5924db0 2024-05-27T09:48:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557aa56c5250 con 0x557aa5924db0 2024-05-27T09:48:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5446000700 1 -- 172.21.15.71:0/2870963169 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f54480b37c0 con 0x557aa5924db0 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5471c05b80 10 client.25261 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557aa59a9080 con 0x557aa5924db0 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5446000700 1 -- 172.21.15.71:0/2870963169 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557aa56c5250 con 0x557aa5924db0 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.720+0000 7f5446000700 1 -- 172.21.15.71:0/2870963169 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f544c009ce0 con 0x557aa5924db0 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.721+0000 7f5471c05b80 10 client.25261 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.721+0000 7f5471c05b80 10 client.25261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.721+0000 7f5471c05b80 20 client.25261 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.721+0000 7f5471c05b80 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa59a92c0 0x557aa59ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.721+0000 7f5471c05b80 4 client.25261 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.721+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557aa5816b90 con 0x557aa59a92c0 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.721+0000 7f545be00700 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa59a92c0 0x557aa59ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f545be00700 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa59a92c0 0x557aa59ab6e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d69c4bee062319 server_cookie=dbe44c436308080e in_seq=0 out_seq=0 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5446000700 10 client.25261 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5446000700 1 -- 172.21.15.71:0/2870963169 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557aa5816b90 con 0x557aa59a92c0 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5446000700 10 client.25261 handle_command_reply: tid=0 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 client.25261 shutdown 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 msgr2=0x557aa5933970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa5933970 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x557aa592b3a0 tx=0x7f54480aa580 comp rx=0 tx=0).stop 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 shutdown_connections 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557aa59a92c0 0x557aa59ab6e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557aa592ad30 0x557aa5933eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557aa57a5e40 0x557aa5933430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5446000700 0 client.25261 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 --2- 172.21.15.71:0/2870963169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557aa5924db0 0x557aa5933970 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 >> 172.21.15.71:0/2870963169 conn(0x557aa5805fc0 msgr2=0x557aa5928b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 shutdown_connections 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 1 -- 172.21.15.71:0/2870963169 wait complete. 2024-05-27T09:48:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.722+0000 7f5471c05b80 20 client.25261 trim_cache size 0 max 16384 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: "scrubs": { 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: "7fc70291-7c43-46f2-92ef-fac9e425157c": { 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: "tag": "7fc70291-7c43-46f2-92ef-fac9e425157c", 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: "options": "recursive,force" 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:48:09.725 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:48:09.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54400b2b90 msgr2=0x7f54400b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54400b2b90 0x7f54400b50a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x557aa5925b30 tx=0x7f5454004b40 comp rx=0 tx=0).stop 2024-05-27T09:48:09.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c107de0 msgr2=0x7f545c110fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:09.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c107de0 0x7f545c110fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f544800b580 tx=0x7f5448004270 comp rx=0 tx=0).stop 2024-05-27T09:48:09.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 shutdown_connections 2024-05-27T09:48:09.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54400b2b90 0x7f54400b50a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f545c108730 0x7f545c1114f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f545c1034b0 0x7f545c110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 --2- 172.21.15.71:0/1621330274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f545c107de0 0x7f545c110fb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:09.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.723+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 >> 172.21.15.71:0/1621330274 conn(0x7f545c0fedb0 msgr2=0x7f545c101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:09.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.724+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 shutdown_connections 2024-05-27T09:48:09.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:09.724+0000 7f5463000700 1 -- 172.21.15.71:0/1621330274 wait complete. 2024-05-27T09:48:10.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:10 smithi071 ceph-mon[31451]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:10.893 INFO:tasks.cephfs.filesystem:scrub status for tag:7fc70291-7c43-46f2-92ef-fac9e425157c - {'path': '/', 'tag': '7fc70291-7c43-46f2-92ef-fac9e425157c', 'options': 'recursive,force'} 2024-05-27T09:48:10.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:10 smithi122 ceph-mon[36436]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:10.999+0000 7ff456800700 1 -- 172.21.15.71:0/1556154452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 msgr2=0x7ff4501106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:10.999+0000 7ff456800700 1 --2- 172.21.15.71:0/1556154452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 0x7ff4501106b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009990 tx=0x7ff43c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.000+0000 7ff456800700 1 -- 172.21.15.71:0/1556154452 shutdown_connections 2024-05-27T09:48:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.000+0000 7ff456800700 1 --2- 172.21.15.71:0/1556154452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450110bf0 0x7ff450113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.000+0000 7ff456800700 1 --2- 172.21.15.71:0/1556154452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff450076be0 0x7ff450076ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.000+0000 7ff456800700 1 --2- 172.21.15.71:0/1556154452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 0x7ff4501106b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.000+0000 7ff456800700 1 -- 172.21.15.71:0/1556154452 >> 172.21.15.71:0/1556154452 conn(0x7ff4500ffe90 msgr2=0x7ff4501022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.000+0000 7ff456800700 1 -- 172.21.15.71:0/1556154452 shutdown_connections 2024-05-27T09:48:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.000+0000 7ff456800700 1 -- 172.21.15.71:0/1556154452 wait complete. 2024-05-27T09:48:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.001+0000 7ff456800700 1 Processor -- start 2024-05-27T09:48:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.001+0000 7ff456800700 1 -- start start 2024-05-27T09:48:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff456800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450076be0 0x7ff45019d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff456800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 0x7ff45019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff456800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff450110bf0 0x7ff4501a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff456800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4501166a0 con 0x7ff450077530 2024-05-27T09:48:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff456800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff450116520 con 0x7ff450110bf0 2024-05-27T09:48:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff456800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff450116820 con 0x7ff450076be0 2024-05-27T09:48:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff44ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 0x7ff45019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff44f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450076be0 0x7ff45019d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff44f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450076be0 0x7ff45019d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54140/0 (socket says 172.21.15.71:54140) 2024-05-27T09:48:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff44f400700 1 -- 172.21.15.71:0/3310136510 learned_addr learned my addr 172.21.15.71:0/3310136510 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.002+0000 7ff44fe00700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff450110bf0 0x7ff4501a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff44f400700 1 -- 172.21.15.71:0/3310136510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff450110bf0 msgr2=0x7ff4501a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff44f400700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff450110bf0 0x7ff4501a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff44f400700 1 -- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 msgr2=0x7ff45019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff44f400700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 0x7ff45019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff44f400700 1 -- 172.21.15.71:0/3310136510 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4501a1f60 con 0x7ff450076be0 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff44ea00700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 0x7ff45019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff44f400700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450076be0 0x7ff45019d090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff44000d980 tx=0x7ff44000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff447e00700 1 -- 172.21.15.71:0/3310136510 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440016070 con 0x7ff450076be0 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4501a2250 con 0x7ff450076be0 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff447e00700 1 -- 172.21.15.71:0/3310136510 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff440004830 con 0x7ff450076be0 2024-05-27T09:48:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff447e00700 1 -- 172.21.15.71:0/3310136510 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440005540 con 0x7ff450076be0 2024-05-27T09:48:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.003+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4501a9b70 con 0x7ff450076be0 2024-05-27T09:48:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.005+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4500512b0 con 0x7ff450076be0 2024-05-27T09:48:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.007+0000 7ff447e00700 1 -- 172.21.15.71:0/3310136510 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7ff440004220 con 0x7ff450076be0 2024-05-27T09:48:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.009+0000 7ff447e00700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff4340b2b10 0x7ff4340b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.009+0000 7ff447e00700 1 -- 172.21.15.71:0/3310136510 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff4400e2bc0 con 0x7ff450076be0 2024-05-27T09:48:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.009+0000 7ff44ea00700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff4340b2b10 0x7ff4340b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.010+0000 7ff44ea00700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff4340b2b10 0x7ff4340b5020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff4501033c0 tx=0x7ff43c00b260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.011+0000 7ff447e00700 1 -- 172.21.15.71:0/3310136510 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff44001f020 con 0x7ff450076be0 2024-05-27T09:48:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:10 smithi072 ceph-mon[35951]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.238+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff45019e3f0 con 0x7ff4340b2b10 2024-05-27T09:48:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.265+0000 7ff447e00700 1 -- 172.21.15.71:0/3310136510 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257761 (secure 0 0 0) 0x7ff43c066f00 con 0x7ff4340b2b10 2024-05-27T09:48:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff4340b2b10 msgr2=0x7ff4340b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff4340b2b10 0x7ff4340b5020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff4501033c0 tx=0x7ff43c00b260 comp rx=0 tx=0).stop 2024-05-27T09:48:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450076be0 msgr2=0x7ff45019d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450076be0 0x7ff45019d090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff44000d980 tx=0x7ff44000dc90 comp rx=0 tx=0).stop 2024-05-27T09:48:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 shutdown_connections 2024-05-27T09:48:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff4340b2b10 0x7ff4340b5020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff450110bf0 0x7ff4501a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff450076be0 0x7ff45019d090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 --2- 172.21.15.71:0/3310136510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff450077530 0x7ff45019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 >> 172.21.15.71:0/3310136510 conn(0x7ff4500ffe90 msgr2=0x7ff450100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 shutdown_connections 2024-05-27T09:48:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:11.272+0000 7ff456800700 1 -- 172.21.15.71:0/3310136510 wait complete. 2024-05-27T09:48:11.274 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:48:12.095 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-05-27T09:48:09.506280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1393688,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1937,"num_read_kb":1368,"num_write":566,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":918,"ondisk_log_size":918,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397752,"kb_used_data":15000,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544072,"statfs":{"total":1151940427776,"available":1151533129728,"internally_reserved":0,"allocated":15360000,"data_stored":9563436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":391492925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":197770,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":128,"num_write_kb":917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005184"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567434+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:47:45.567434+0000","last_peered":"2024-05-27T09:47:45.567434+0000","last_clean":"2024-05-27T09:47:45.567434+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:47:45.567434+0000","last_undegraded":"2024-05-27T09:47:45.567434+0000","last_fullsized":"2024-05-27T09:47:45.567434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568072+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:47:45.568072+0000","last_peered":"2024-05-27T09:47:45.568072+0000","last_clean":"2024-05-27T09:47:45.568072+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:47:45.568072+0000","last_undegraded":"2024-05-27T09:47:45.568072+0000","last_fullsized":"2024-05-27T09:47:45.568072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568371+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:47:45.568371+0000","last_peered":"2024-05-27T09:47:45.568371+0000","last_clean":"2024-05-27T09:47:45.568371+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:47:45.568371+0000","last_undegraded":"2024-05-27T09:47:45.568371+0000","last_fullsized":"2024-05-27T09:47:45.568371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611732+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:47:45.611732+0000","last_peered":"2024-05-27T09:47:45.611732+0000","last_clean":"2024-05-27T09:47:45.611732+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:47:45.611732+0000","last_undegraded":"2024-05-27T09:47:45.611732+0000","last_fullsized":"2024-05-27T09:47:45.611732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568665+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:47:45.568665+0000","last_peered":"2024-05-27T09:47:45.568665+0000","last_clean":"2024-05-27T09:47:45.568665+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:47:45.568665+0000","last_undegraded":"2024-05-27T09:47:45.568665+0000","last_fullsized":"2024-05-27T09:47:45.568665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568108+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:47:45.568108+0000","last_peered":"2024-05-27T09:47:45.568108+0000","last_clean":"2024-05-27T09:47:45.568108+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:47:45.568108+0000","last_undegraded":"2024-05-27T09:47:45.568108+0000","last_fullsized":"2024-05-27T09:47:45.568108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.481164+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:47:45.481164+0000","last_peered":"2024-05-27T09:47:45.481164+0000","last_clean":"2024-05-27T09:47:45.481164+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:47:45.481164+0000","last_undegraded":"2024-05-27T09:47:45.481164+0000","last_fullsized":"2024-05-27T09:47:45.481164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568259+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:47:45.568259+0000","last_peered":"2024-05-27T09:47:45.568259+0000","last_clean":"2024-05-27T09:47:45.568259+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:47:45.568259+0000","last_undegraded":"2024-05-27T09:47:45.568259+0000","last_fullsized":"2024-05-27T09:47:45.568259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569551+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:47:45.569551+0000","last_peered":"2024-05-27T09:47:45.569551+0000","last_clean":"2024-05-27T09:47:45.569551+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:47:45.569551+0000","last_undegraded":"2024-05-27T09:47:45.569551+0000","last_fullsized":"2024-05-27T09:47:45.569551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568159+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:47:45.568159+0000","last_peered":"2024-05-27T09:47:45.568159+0000","last_clean":"2024-05-27T09:47:45.568159+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:47:45.568159+0000","last_undegraded":"2024-05-27T09:47:45.568159+0000","last_fullsized":"2024-05-27T09:47:45.568159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471674+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:47:45.471674+0000","last_peered":"2024-05-27T09:47:45.471674+0000","last_clean":"2024-05-27T09:47:45.471674+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:47:45.471674+0000","last_undegraded":"2024-05-27T09:47:45.471674+0000","last_fullsized":"2024-05-27T09:47:45.471674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567201+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:47:45.567201+0000","last_peered":"2024-05-27T09:47:45.567201+0000","last_clean":"2024-05-27T09:47:45.567201+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:47:45.567201+0000","last_undegraded":"2024-05-27T09:47:45.567201+0000","last_fullsized":"2024-05-27T09:47:45.567201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566981+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:47:45.566981+0000","last_peered":"2024-05-27T09:47:45.566981+0000","last_clean":"2024-05-27T09:47:45.566981+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:47:45.566981+0000","last_undegraded":"2024-05-27T09:47:45.566981+0000","last_fullsized":"2024-05-27T09:47:45.566981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567513+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:47:45.567513+0000","last_peered":"2024-05-27T09:47:45.567513+0000","last_clean":"2024-05-27T09:47:45.567513+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:47:45.567513+0000","last_undegraded":"2024-05-27T09:47:45.567513+0000","last_fullsized":"2024-05-27T09:47:45.567513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568602+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:47:45.568602+0000","last_peered":"2024-05-27T09:47:45.568602+0000","last_clean":"2024-05-27T09:47:45.568602+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:47:45.568602+0000","last_undegraded":"2024-05-27T09:47:45.568602+0000","last_fullsized":"2024-05-27T09:47:45.568602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567617+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:47:45.567617+0000","last_peered":"2024-05-27T09:47:45.567617+0000","last_clean":"2024-05-27T09:47:45.567617+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:47:45.567617+0000","last_undegraded":"2024-05-27T09:47:45.567617+0000","last_fullsized":"2024-05-27T09:47:45.567617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:51.519668+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:47:51.519668+0000","last_peered":"2024-05-27T09:47:51.519668+0000","last_clean":"2024-05-27T09:47:51.519668+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:47:51.519668+0000","last_undegraded":"2024-05-27T09:47:51.519668+0000","last_fullsized":"2024-05-27T09:47:51.519668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485814+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:47:45.485814+0000","last_peered":"2024-05-27T09:47:45.485814+0000","last_clean":"2024-05-27T09:47:45.485814+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:47:45.485814+0000","last_undegraded":"2024-05-27T09:47:45.485814+0000","last_fullsized":"2024-05-27T09:47:45.485814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486083+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:47:45.486083+0000","last_peered":"2024-05-27T09:47:45.486083+0000","last_clean":"2024-05-27T09:47:45.486083+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:47:45.486083+0000","last_undegraded":"2024-05-27T09:47:45.486083+0000","last_fullsized":"2024-05-27T09:47:45.486083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568379+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:47:45.568379+0000","last_peered":"2024-05-27T09:47:45.568379+0000","last_clean":"2024-05-27T09:47:45.568379+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:47:45.568379+0000","last_undegraded":"2024-05-27T09:47:45.568379+0000","last_fullsized":"2024-05-27T09:47:45.568379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612112+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:47:45.612112+0000","last_peered":"2024-05-27T09:47:45.612112+0000","last_clean":"2024-05-27T09:47:45.612112+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:47:45.612112+0000","last_undegraded":"2024-05-27T09:47:45.612112+0000","last_fullsized":"2024-05-27T09:47:45.612112+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567678+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:47:45.567678+0000","last_peered":"2024-05-27T09:47:45.567678+0000","last_clean":"2024-05-27T09:47:45.567678+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:47:45.567678+0000","last_undegraded":"2024-05-27T09:47:45.567678+0000","last_fullsized":"2024-05-27T09:47:45.567678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611921+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:47:45.611921+0000","last_peered":"2024-05-27T09:47:45.611921+0000","last_clean":"2024-05-27T09:47:45.611921+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:47:45.611921+0000","last_undegraded":"2024-05-27T09:47:45.611921+0000","last_fullsized":"2024-05-27T09:47:45.611921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471350+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:47:45.471350+0000","last_peered":"2024-05-27T09:47:45.471350+0000","last_clean":"2024-05-27T09:47:45.471350+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:47:45.471350+0000","last_undegraded":"2024-05-27T09:47:45.471350+0000","last_fullsized":"2024-05-27T09:47:45.471350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":274,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:04.710621+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:48:04.710621+0000","last_peered":"2024-05-27T09:48:04.710621+0000","last_clean":"2024-05-27T09:48:04.710621+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:48:04.710621+0000","last_undegraded":"2024-05-27T09:48:04.710621+0000","last_fullsized":"2024-05-27T09:48:04.710621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611693+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:47:45.611693+0000","last_peered":"2024-05-27T09:47:45.611693+0000","last_clean":"2024-05-27T09:47:45.611693+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:47:45.611693+0000","last_undegraded":"2024-05-27T09:47:45.611693+0000","last_fullsized":"2024-05-27T09:47:45.611693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569225+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:47:45.569225+0000","last_peered":"2024-05-27T09:47:45.569225+0000","last_clean":"2024-05-27T09:47:45.569225+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:47:45.569225+0000","last_undegraded":"2024-05-27T09:47:45.569225+0000","last_fullsized":"2024-05-27T09:47:45.569225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471089+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:47:45.471089+0000","last_peered":"2024-05-27T09:47:45.471089+0000","last_clean":"2024-05-27T09:47:45.471089+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:47:45.471089+0000","last_undegraded":"2024-05-27T09:47:45.471089+0000","last_fullsized":"2024-05-27T09:47:45.471089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472110+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:47:45.472110+0000","last_peered":"2024-05-27T09:47:45.472110+0000","last_clean":"2024-05-27T09:47:45.472110+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:47:45.472110+0000","last_undegraded":"2024-05-27T09:47:45.472110+0000","last_fullsized":"2024-05-27T09:47:45.472110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.479557+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:47:45.479557+0000","last_peered":"2024-05-27T09:47:45.479557+0000","last_clean":"2024-05-27T09:47:45.479557+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:47:45.479557+0000","last_undegraded":"2024-05-27T09:47:45.479557+0000","last_fullsized":"2024-05-27T09:47:45.479557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470992+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:47:45.470992+0000","last_peered":"2024-05-27T09:47:45.470992+0000","last_clean":"2024-05-27T09:47:45.470992+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:47:45.470992+0000","last_undegraded":"2024-05-27T09:47:45.470992+0000","last_fullsized":"2024-05-27T09:47:45.470992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567594+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:47:45.567594+0000","last_peered":"2024-05-27T09:47:45.567594+0000","last_clean":"2024-05-27T09:47:45.567594+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:47:45.567594+0000","last_undegraded":"2024-05-27T09:47:45.567594+0000","last_fullsized":"2024-05-27T09:47:45.567594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:04.710148+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:48:04.710148+0000","last_peered":"2024-05-27T09:48:04.710148+0000","last_clean":"2024-05-27T09:48:04.710148+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:48:04.710148+0000","last_undegraded":"2024-05-27T09:48:04.710148+0000","last_fullsized":"2024-05-27T09:48:04.710148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568053+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:47:45.568053+0000","last_peered":"2024-05-27T09:47:45.568053+0000","last_clean":"2024-05-27T09:47:45.568053+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:47:45.568053+0000","last_undegraded":"2024-05-27T09:47:45.568053+0000","last_fullsized":"2024-05-27T09:47:45.568053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569720+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:47:45.569720+0000","last_peered":"2024-05-27T09:47:45.569720+0000","last_clean":"2024-05-27T09:47:45.569720+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:47:45.569720+0000","last_undegraded":"2024-05-27T09:47:45.569720+0000","last_fullsized":"2024-05-27T09:47:45.569720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568263+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:47:45.568263+0000","last_peered":"2024-05-27T09:47:45.568263+0000","last_clean":"2024-05-27T09:47:45.568263+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:47:45.568263+0000","last_undegraded":"2024-05-27T09:47:45.568263+0000","last_fullsized":"2024-05-27T09:47:45.568263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471453+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:47:45.471453+0000","last_peered":"2024-05-27T09:47:45.471453+0000","last_clean":"2024-05-27T09:47:45.471453+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:47:45.471453+0000","last_undegraded":"2024-05-27T09:47:45.471453+0000","last_fullsized":"2024-05-27T09:47:45.471453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567808+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:47:45.567808+0000","last_peered":"2024-05-27T09:47:45.567808+0000","last_clean":"2024-05-27T09:47:45.567808+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:47:45.567808+0000","last_undegraded":"2024-05-27T09:47:45.567808+0000","last_fullsized":"2024-05-27T09:47:45.567808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'42","reported_seq":557,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:05.862503+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:48:05.862503+0000","last_peered":"2024-05-27T09:48:05.862503+0000","last_clean":"2024-05-27T09:48:05.862503+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:48:05.862503+0000","last_undegraded":"2024-05-27T09:48:05.862503+0000","last_fullsized":"2024-05-27T09:48:05.862503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75541,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":318,"num_write":43,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611862+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:47:45.611862+0000","last_peered":"2024-05-27T09:47:45.611862+0000","last_clean":"2024-05-27T09:47:45.611862+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:47:45.611862+0000","last_undegraded":"2024-05-27T09:47:45.611862+0000","last_fullsized":"2024-05-27T09:47:45.611862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567350+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:47:45.567350+0000","last_peered":"2024-05-27T09:47:45.567350+0000","last_clean":"2024-05-27T09:47:45.567350+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:47:45.567350+0000","last_undegraded":"2024-05-27T09:47:45.567350+0000","last_fullsized":"2024-05-27T09:47:45.567350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471788+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:47:45.471788+0000","last_peered":"2024-05-27T09:47:45.471788+0000","last_clean":"2024-05-27T09:47:45.471788+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:47:45.471788+0000","last_undegraded":"2024-05-27T09:47:45.471788+0000","last_fullsized":"2024-05-27T09:47:45.471788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470915+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:47:45.470915+0000","last_peered":"2024-05-27T09:47:45.470915+0000","last_clean":"2024-05-27T09:47:45.470915+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:47:45.470915+0000","last_undegraded":"2024-05-27T09:47:45.470915+0000","last_fullsized":"2024-05-27T09:47:45.470915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569506+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:47:45.569506+0000","last_peered":"2024-05-27T09:47:45.569506+0000","last_clean":"2024-05-27T09:47:45.569506+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:47:45.569506+0000","last_undegraded":"2024-05-27T09:47:45.569506+0000","last_fullsized":"2024-05-27T09:47:45.569506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":277,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:04.812738+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:48:04.812738+0000","last_peered":"2024-05-27T09:48:04.812738+0000","last_clean":"2024-05-27T09:48:04.812738+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:48:04.812738+0000","last_undegraded":"2024-05-27T09:48:04.812738+0000","last_fullsized":"2024-05-27T09:48:04.812738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":7,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566845+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:47:45.566845+0000","last_peered":"2024-05-27T09:47:45.566845+0000","last_clean":"2024-05-27T09:47:45.566845+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:47:45.566845+0000","last_undegraded":"2024-05-27T09:47:45.566845+0000","last_fullsized":"2024-05-27T09:47:45.566845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470885+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:47:45.470885+0000","last_peered":"2024-05-27T09:47:45.470885+0000","last_clean":"2024-05-27T09:47:45.470885+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:47:45.470885+0000","last_undegraded":"2024-05-27T09:47:45.470885+0000","last_fullsized":"2024-05-27T09:47:45.470885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612202+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:47:45.612202+0000","last_peered":"2024-05-27T09:47:45.612202+0000","last_clean":"2024-05-27T09:47:45.612202+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:47:45.612202+0000","last_undegraded":"2024-05-27T09:47:45.612202+0000","last_fullsized":"2024-05-27T09:47:45.612202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567195+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:47:45.567195+0000","last_peered":"2024-05-27T09:47:45.567195+0000","last_clean":"2024-05-27T09:47:45.567195+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:47:45.567195+0000","last_undegraded":"2024-05-27T09:47:45.567195+0000","last_fullsized":"2024-05-27T09:47:45.567195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568365+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:47:45.568365+0000","last_peered":"2024-05-27T09:47:45.568365+0000","last_clean":"2024-05-27T09:47:45.568365+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:47:45.568365+0000","last_undegraded":"2024-05-27T09:47:45.568365+0000","last_fullsized":"2024-05-27T09:47:45.568365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568972+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:47:45.568972+0000","last_peered":"2024-05-27T09:47:45.568972+0000","last_clean":"2024-05-27T09:47:45.568972+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:47:45.568972+0000","last_undegraded":"2024-05-27T09:47:45.568972+0000","last_fullsized":"2024-05-27T09:47:45.568972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569085+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:47:45.569085+0000","last_peered":"2024-05-27T09:47:45.569085+0000","last_clean":"2024-05-27T09:47:45.569085+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:47:45.569085+0000","last_undegraded":"2024-05-27T09:47:45.569085+0000","last_fullsized":"2024-05-27T09:47:45.569085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568901+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:47:45.568901+0000","last_peered":"2024-05-27T09:47:45.568901+0000","last_clean":"2024-05-27T09:47:45.568901+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:47:45.568901+0000","last_undegraded":"2024-05-27T09:47:45.568901+0000","last_fullsized":"2024-05-27T09:47:45.568901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471385+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:47:45.471385+0000","last_peered":"2024-05-27T09:47:45.471385+0000","last_clean":"2024-05-27T09:47:45.471385+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:47:45.471385+0000","last_undegraded":"2024-05-27T09:47:45.471385+0000","last_fullsized":"2024-05-27T09:47:45.471385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":271,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:04.812061+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:48:04.812061+0000","last_peered":"2024-05-27T09:48:04.812061+0000","last_clean":"2024-05-27T09:48:04.812061+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:48:04.812061+0000","last_undegraded":"2024-05-27T09:48:04.812061+0000","last_fullsized":"2024-05-27T09:48:04.812061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567538+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:47:45.567538+0000","last_peered":"2024-05-27T09:47:45.567538+0000","last_clean":"2024-05-27T09:47:45.567538+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:47:45.567538+0000","last_undegraded":"2024-05-27T09:47:45.567538+0000","last_fullsized":"2024-05-27T09:47:45.567538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567813+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:47:45.567813+0000","last_peered":"2024-05-27T09:47:45.567813+0000","last_clean":"2024-05-27T09:47:45.567813+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:47:45.567813+0000","last_undegraded":"2024-05-27T09:47:45.567813+0000","last_fullsized":"2024-05-27T09:47:45.567813+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"84'99","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:47.624529+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:47:47.624529+0000","last_peered":"2024-05-27T09:47:47.624529+0000","last_clean":"2024-05-27T09:47:47.624529+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:47:47.624529+0000","last_undegraded":"2024-05-27T09:47:47.624529+0000","last_fullsized":"2024-05-27T09:47:47.624529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472229+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:47:45.472229+0000","last_peered":"2024-05-27T09:47:45.472229+0000","last_clean":"2024-05-27T09:47:45.472229+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:47:45.472229+0000","last_undegraded":"2024-05-27T09:47:45.472229+0000","last_fullsized":"2024-05-27T09:47:45.472229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568413+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:47:45.568413+0000","last_peered":"2024-05-27T09:47:45.568413+0000","last_clean":"2024-05-27T09:47:45.568413+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:47:45.568413+0000","last_undegraded":"2024-05-27T09:47:45.568413+0000","last_fullsized":"2024-05-27T09:47:45.568413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612093+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:47:45.612093+0000","last_peered":"2024-05-27T09:47:45.612093+0000","last_clean":"2024-05-27T09:47:45.612093+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:47:45.612093+0000","last_undegraded":"2024-05-27T09:47:45.612093+0000","last_fullsized":"2024-05-27T09:47:45.612093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472487+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:47:45.472487+0000","last_peered":"2024-05-27T09:47:45.472487+0000","last_clean":"2024-05-27T09:47:45.472487+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:47:45.472487+0000","last_undegraded":"2024-05-27T09:47:45.472487+0000","last_fullsized":"2024-05-27T09:47:45.472487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'102","reported_seq":224,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:06.322981+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:48:06.322981+0000","last_peered":"2024-05-27T09:48:06.322981+0000","last_clean":"2024-05-27T09:48:06.322981+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:48:06.322981+0000","last_undegraded":"2024-05-27T09:48:06.322981+0000","last_fullsized":"2024-05-27T09:48:06.322981+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486293+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:47:45.486293+0000","last_peered":"2024-05-27T09:47:45.486293+0000","last_clean":"2024-05-27T09:47:45.486293+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:47:45.486293+0000","last_undegraded":"2024-05-27T09:47:45.486293+0000","last_fullsized":"2024-05-27T09:47:45.486293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568134+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:47:45.568134+0000","last_peered":"2024-05-27T09:47:45.568134+0000","last_clean":"2024-05-27T09:47:45.568134+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:47:45.568134+0000","last_undegraded":"2024-05-27T09:47:45.568134+0000","last_fullsized":"2024-05-27T09:47:45.568134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567527+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:47:45.567527+0000","last_peered":"2024-05-27T09:47:45.567527+0000","last_clean":"2024-05-27T09:47:45.567527+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:47:45.567527+0000","last_undegraded":"2024-05-27T09:47:45.567527+0000","last_fullsized":"2024-05-27T09:47:45.567527+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611649+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:47:45.611649+0000","last_peered":"2024-05-27T09:47:45.611649+0000","last_clean":"2024-05-27T09:47:45.611649+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:47:45.611649+0000","last_undegraded":"2024-05-27T09:47:45.611649+0000","last_fullsized":"2024-05-27T09:47:45.611649+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483699+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:47:45.483699+0000","last_peered":"2024-05-27T09:47:45.483699+0000","last_clean":"2024-05-27T09:47:45.483699+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:47:45.483699+0000","last_undegraded":"2024-05-27T09:47:45.483699+0000","last_fullsized":"2024-05-27T09:47:45.483699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566902+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:47:45.566902+0000","last_peered":"2024-05-27T09:47:45.566902+0000","last_clean":"2024-05-27T09:47:45.566902+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:47:45.566902+0000","last_undegraded":"2024-05-27T09:47:45.566902+0000","last_fullsized":"2024-05-27T09:47:45.566902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566936+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:47:45.566936+0000","last_peered":"2024-05-27T09:47:45.566936+0000","last_clean":"2024-05-27T09:47:45.566936+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:47:45.566936+0000","last_undegraded":"2024-05-27T09:47:45.566936+0000","last_fullsized":"2024-05-27T09:47:45.566936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485069+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:47:45.485069+0000","last_peered":"2024-05-27T09:47:45.485069+0000","last_clean":"2024-05-27T09:47:45.485069+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:47:45.485069+0000","last_undegraded":"2024-05-27T09:47:45.485069+0000","last_fullsized":"2024-05-27T09:47:45.485069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611750+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:47:45.611750+0000","last_peered":"2024-05-27T09:47:45.611750+0000","last_clean":"2024-05-27T09:47:45.611750+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:47:45.611750+0000","last_undegraded":"2024-05-27T09:47:45.611750+0000","last_fullsized":"2024-05-27T09:47:45.611750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569176+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:47:45.569176+0000","last_peered":"2024-05-27T09:47:45.569176+0000","last_clean":"2024-05-27T09:47:45.569176+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:47:45.569176+0000","last_undegraded":"2024-05-27T09:47:45.569176+0000","last_fullsized":"2024-05-27T09:47:45.569176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567397+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:47:45.567397+0000","last_peered":"2024-05-27T09:47:45.567397+0000","last_clean":"2024-05-27T09:47:45.567397+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:47:45.567397+0000","last_undegraded":"2024-05-27T09:47:45.567397+0000","last_fullsized":"2024-05-27T09:47:45.567397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569739+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:47:45.569739+0000","last_peered":"2024-05-27T09:47:45.569739+0000","last_clean":"2024-05-27T09:47:45.569739+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:47:45.569739+0000","last_undegraded":"2024-05-27T09:47:45.569739+0000","last_fullsized":"2024-05-27T09:47:45.569739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'65","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:05.777220+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:48:05.777220+0000","last_peered":"2024-05-27T09:48:05.777220+0000","last_clean":"2024-05-27T09:48:05.777220+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:48:05.777220+0000","last_undegraded":"2024-05-27T09:48:05.777220+0000","last_fullsized":"2024-05-27T09:48:05.777220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569485+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:47:45.569485+0000","last_peered":"2024-05-27T09:47:45.569485+0000","last_clean":"2024-05-27T09:47:45.569485+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:47:45.569485+0000","last_undegraded":"2024-05-27T09:47:45.569485+0000","last_fullsized":"2024-05-27T09:47:45.569485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471807+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:47:45.471807+0000","last_peered":"2024-05-27T09:47:45.471807+0000","last_clean":"2024-05-27T09:47:45.471807+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:47:45.471807+0000","last_undegraded":"2024-05-27T09:47:45.471807+0000","last_fullsized":"2024-05-27T09:47:45.471807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569836+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:47:45.569836+0000","last_peered":"2024-05-27T09:47:45.569836+0000","last_clean":"2024-05-27T09:47:45.569836+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:47:45.569836+0000","last_undegraded":"2024-05-27T09:47:45.569836+0000","last_fullsized":"2024-05-27T09:47:45.569836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567131+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:47:45.567131+0000","last_peered":"2024-05-27T09:47:45.567131+0000","last_clean":"2024-05-27T09:47:45.567131+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:47:45.567131+0000","last_undegraded":"2024-05-27T09:47:45.567131+0000","last_fullsized":"2024-05-27T09:47:45.567131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567636+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:47:45.567636+0000","last_peered":"2024-05-27T09:47:45.567636+0000","last_clean":"2024-05-27T09:47:45.567636+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:47:45.567636+0000","last_undegraded":"2024-05-27T09:47:45.567636+0000","last_fullsized":"2024-05-27T09:47:45.567636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566975+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:47:45.566975+0000","last_peered":"2024-05-27T09:47:45.566975+0000","last_clean":"2024-05-27T09:47:45.566975+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:47:45.566975+0000","last_undegraded":"2024-05-27T09:47:45.566975+0000","last_fullsized":"2024-05-27T09:47:45.566975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567496+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:47:45.567496+0000","last_peered":"2024-05-27T09:47:45.567496+0000","last_clean":"2024-05-27T09:47:45.567496+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:47:45.567496+0000","last_undegraded":"2024-05-27T09:47:45.567496+0000","last_fullsized":"2024-05-27T09:47:45.567496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472340+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:47:45.472340+0000","last_peered":"2024-05-27T09:47:45.472340+0000","last_clean":"2024-05-27T09:47:45.472340+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:47:45.472340+0000","last_undegraded":"2024-05-27T09:47:45.472340+0000","last_fullsized":"2024-05-27T09:47:45.472340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567070+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:47:45.567070+0000","last_peered":"2024-05-27T09:47:45.567070+0000","last_clean":"2024-05-27T09:47:45.567070+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:47:45.567070+0000","last_undegraded":"2024-05-27T09:47:45.567070+0000","last_fullsized":"2024-05-27T09:47:45.567070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567527+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:47:45.567527+0000","last_peered":"2024-05-27T09:47:45.567527+0000","last_clean":"2024-05-27T09:47:45.567527+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:47:45.567527+0000","last_undegraded":"2024-05-27T09:47:45.567527+0000","last_fullsized":"2024-05-27T09:47:45.567527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486199+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:47:45.486199+0000","last_peered":"2024-05-27T09:47:45.486199+0000","last_clean":"2024-05-27T09:47:45.486199+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:47:45.486199+0000","last_undegraded":"2024-05-27T09:47:45.486199+0000","last_fullsized":"2024-05-27T09:47:45.486199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471079+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:47:45.471079+0000","last_peered":"2024-05-27T09:47:45.471079+0000","last_clean":"2024-05-27T09:47:45.471079+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:47:45.471079+0000","last_undegraded":"2024-05-27T09:47:45.471079+0000","last_fullsized":"2024-05-27T09:47:45.471079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483079+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:47:45.483079+0000","last_peered":"2024-05-27T09:47:45.483079+0000","last_clean":"2024-05-27T09:47:45.483079+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:47:45.483079+0000","last_undegraded":"2024-05-27T09:47:45.483079+0000","last_fullsized":"2024-05-27T09:47:45.483079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471895+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:47:45.471895+0000","last_peered":"2024-05-27T09:47:45.471895+0000","last_clean":"2024-05-27T09:47:45.471895+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:47:45.471895+0000","last_undegraded":"2024-05-27T09:47:45.471895+0000","last_fullsized":"2024-05-27T09:47:45.471895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566971+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:47:45.566971+0000","last_peered":"2024-05-27T09:47:45.566971+0000","last_clean":"2024-05-27T09:47:45.566971+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:47:45.566971+0000","last_undegraded":"2024-05-27T09:47:45.566971+0000","last_fullsized":"2024-05-27T09:47:45.566971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":803086,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1793,"num_read_kb":1120,"num_write":429,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":2409258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":317,"ondisk_log_size":317,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612677,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":921600,"data_stored":449225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808905,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37368,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707784,"statfs":{"total":95995035648,"available":95956770816,"internally_reserved":0,"allocated":1957888,"data_stored":1446072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005134,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1323008,"data_stored":842565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201366,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708532,"statfs":{"total":95995035648,"available":95957536768,"internally_reserved":0,"allocated":1314816,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397596,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1523712,"data_stored":1043295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593823,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":448738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":524072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":450009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":526204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149809,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1658880,"data_stored":1170497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953580,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":450880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790055,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37280,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707872,"statfs":{"total":95995035648,"available":95956860928,"internally_reserved":0,"allocated":1867776,"data_stored":1369506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":75541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":77673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":393842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":407056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:48:12.100 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-27T09:48:12.585 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:12.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:12 smithi071 ceph-mon[31451]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:12.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:12 smithi071 ceph-mon[31451]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:12 smithi122 ceph-mon[36436]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:12.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:12 smithi122 ceph-mon[36436]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:13.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:12 smithi072 ceph-mon[35951]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:13.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:12 smithi072 ceph-mon[35951]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:14.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 -- 172.21.15.71:0/4253502968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 msgr2=0x7fdc44114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:14.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 --2- 172.21.15.71:0/4253502968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 0x7fdc44114e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009990 tx=0x7fdc2c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:48:14.932 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:14 smithi071 ceph-mon[31451]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:14.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 -- 172.21.15.71:0/4253502968 shutdown_connections 2024-05-27T09:48:14.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 --2- 172.21.15.71:0/4253502968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44115360 0x7fdc44117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:14.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 --2- 172.21.15.71:0/4253502968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44075b50 0x7fdc44075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:14.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 --2- 172.21.15.71:0/4253502968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 0x7fdc44114e20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:14.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 -- 172.21.15.71:0/4253502968 >> 172.21.15.71:0/4253502968 conn(0x7fdc44100030 msgr2=0x7fdc44102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:14.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 -- 172.21.15.71:0/4253502968 shutdown_connections 2024-05-27T09:48:14.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.931+0000 7fdc49400700 1 -- 172.21.15.71:0/4253502968 wait complete. 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.933+0000 7fdc49400700 1 Processor -- start 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.933+0000 7fdc49400700 1 -- start start 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc49400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44075b50 0x7fdc441a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc49400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 0x7fdc441a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc49400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44115360 0x7fdc441a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc49400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4411aab0 con 0x7fdc44115360 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc49400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4411a930 con 0x7fdc44075b50 2024-05-27T09:48:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc49400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4411ac30 con 0x7fdc440764a0 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc42800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44075b50 0x7fdc441a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc42800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44075b50 0x7fdc441a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49084/0 (socket says 172.21.15.71:49084) 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc43200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44115360 0x7fdc441a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc42800700 1 -- 172.21.15.71:0/556392133 learned_addr learned my addr 172.21.15.71:0/556392133 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.934+0000 7fdc39e00700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 0x7fdc441a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc42800700 1 -- 172.21.15.71:0/556392133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 msgr2=0x7fdc441a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc42800700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 0x7fdc441a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:14.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc42800700 1 -- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44115360 msgr2=0x7fdc441a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:14.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc42800700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44115360 0x7fdc441a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:14.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc42800700 1 -- 172.21.15.71:0/556392133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc441a6350 con 0x7fdc44075b50 2024-05-27T09:48:14.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc42800700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44075b50 0x7fdc441a1480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400c370 tx=0x7fdc3400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:14.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc3be00700 1 -- 172.21.15.71:0/556392133 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc340092e0 con 0x7fdc44075b50 2024-05-27T09:48:14.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc3be00700 1 -- 172.21.15.71:0/556392133 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc3400cbe0 con 0x7fdc44075b50 2024-05-27T09:48:14.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc441a65e0 con 0x7fdc44075b50 2024-05-27T09:48:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.935+0000 7fdc3be00700 1 -- 172.21.15.71:0/556392133 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc340046b0 con 0x7fdc44075b50 2024-05-27T09:48:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.936+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc441adf60 con 0x7fdc44075b50 2024-05-27T09:48:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.937+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc44077290 con 0x7fdc44075b50 2024-05-27T09:48:14.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.939+0000 7fdc3be00700 1 -- 172.21.15.71:0/556392133 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fdc3401a020 con 0x7fdc44075b50 2024-05-27T09:48:14.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.941+0000 7fdc3be00700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdc280b2b10 0x7fdc280b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:14.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.941+0000 7fdc3be00700 1 -- 172.21.15.71:0/556392133 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fdc340e2230 con 0x7fdc44075b50 2024-05-27T09:48:14.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.941+0000 7fdc39e00700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdc280b2b10 0x7fdc280b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:14.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.942+0000 7fdc39e00700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdc280b2b10 0x7fdc280b5020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc441034e0 tx=0x7fdc2c005fd0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:14.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:14.945+0000 7fdc3be00700 1 -- 172.21.15.71:0/556392133 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdc34010040 con 0x7fdc44075b50 2024-05-27T09:48:14.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:14 smithi122 ceph-mon[36436]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:15.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:14 smithi072 ceph-mon[35951]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:15.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.173+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc441a27e0 con 0x7fdc280b2b10 2024-05-27T09:48:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.182+0000 7fdc3be00700 1 -- 172.21.15.71:0/556392133 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257761 (secure 0 0 0) 0x7fdc2c066f00 con 0x7fdc280b2b10 2024-05-27T09:48:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdc280b2b10 msgr2=0x7fdc280b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdc280b2b10 0x7fdc280b5020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc441034e0 tx=0x7fdc2c005fd0 comp rx=0 tx=0).stop 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44075b50 msgr2=0x7fdc441a1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44075b50 0x7fdc441a1480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400c370 tx=0x7fdc3400c680 comp rx=0 tx=0).stop 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 shutdown_connections 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdc280b2b10 0x7fdc280b5020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44115360 0x7fdc441a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc44075b50 0x7fdc441a1480 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 --2- 172.21.15.71:0/556392133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc440764a0 0x7fdc441a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.190+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 >> 172.21.15.71:0/556392133 conn(0x7fdc44100030 msgr2=0x7fdc441006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.191+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 shutdown_connections 2024-05-27T09:48:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:15.191+0000 7fdc49400700 1 -- 172.21.15.71:0/556392133 wait complete. 2024-05-27T09:48:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:48:16.148 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-27T09:48:13.507896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1393688,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1967,"num_read_kb":1383,"num_write":566,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":918,"ondisk_log_size":918,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397752,"kb_used_data":15000,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544072,"statfs":{"total":1151940427776,"available":1151533129728,"internally_reserved":0,"allocated":15360000,"data_stored":9563436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":391492925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":197770,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":279,"num_write":128,"num_write_kb":917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004798"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567434+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:47:45.567434+0000","last_peered":"2024-05-27T09:47:45.567434+0000","last_clean":"2024-05-27T09:47:45.567434+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:47:45.567434+0000","last_undegraded":"2024-05-27T09:47:45.567434+0000","last_fullsized":"2024-05-27T09:47:45.567434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568072+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:47:45.568072+0000","last_peered":"2024-05-27T09:47:45.568072+0000","last_clean":"2024-05-27T09:47:45.568072+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:47:45.568072+0000","last_undegraded":"2024-05-27T09:47:45.568072+0000","last_fullsized":"2024-05-27T09:47:45.568072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568371+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:47:45.568371+0000","last_peered":"2024-05-27T09:47:45.568371+0000","last_clean":"2024-05-27T09:47:45.568371+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:47:45.568371+0000","last_undegraded":"2024-05-27T09:47:45.568371+0000","last_fullsized":"2024-05-27T09:47:45.568371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611732+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:47:45.611732+0000","last_peered":"2024-05-27T09:47:45.611732+0000","last_clean":"2024-05-27T09:47:45.611732+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:47:45.611732+0000","last_undegraded":"2024-05-27T09:47:45.611732+0000","last_fullsized":"2024-05-27T09:47:45.611732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568665+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:47:45.568665+0000","last_peered":"2024-05-27T09:47:45.568665+0000","last_clean":"2024-05-27T09:47:45.568665+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:47:45.568665+0000","last_undegraded":"2024-05-27T09:47:45.568665+0000","last_fullsized":"2024-05-27T09:47:45.568665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568108+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:47:45.568108+0000","last_peered":"2024-05-27T09:47:45.568108+0000","last_clean":"2024-05-27T09:47:45.568108+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:47:45.568108+0000","last_undegraded":"2024-05-27T09:47:45.568108+0000","last_fullsized":"2024-05-27T09:47:45.568108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.481164+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:47:45.481164+0000","last_peered":"2024-05-27T09:47:45.481164+0000","last_clean":"2024-05-27T09:47:45.481164+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:47:45.481164+0000","last_undegraded":"2024-05-27T09:47:45.481164+0000","last_fullsized":"2024-05-27T09:47:45.481164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568259+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:47:45.568259+0000","last_peered":"2024-05-27T09:47:45.568259+0000","last_clean":"2024-05-27T09:47:45.568259+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:47:45.568259+0000","last_undegraded":"2024-05-27T09:47:45.568259+0000","last_fullsized":"2024-05-27T09:47:45.568259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569551+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:47:45.569551+0000","last_peered":"2024-05-27T09:47:45.569551+0000","last_clean":"2024-05-27T09:47:45.569551+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:47:45.569551+0000","last_undegraded":"2024-05-27T09:47:45.569551+0000","last_fullsized":"2024-05-27T09:47:45.569551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568159+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:47:45.568159+0000","last_peered":"2024-05-27T09:47:45.568159+0000","last_clean":"2024-05-27T09:47:45.568159+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:47:45.568159+0000","last_undegraded":"2024-05-27T09:47:45.568159+0000","last_fullsized":"2024-05-27T09:47:45.568159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471674+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:47:45.471674+0000","last_peered":"2024-05-27T09:47:45.471674+0000","last_clean":"2024-05-27T09:47:45.471674+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:47:45.471674+0000","last_undegraded":"2024-05-27T09:47:45.471674+0000","last_fullsized":"2024-05-27T09:47:45.471674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567201+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:47:45.567201+0000","last_peered":"2024-05-27T09:47:45.567201+0000","last_clean":"2024-05-27T09:47:45.567201+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:47:45.567201+0000","last_undegraded":"2024-05-27T09:47:45.567201+0000","last_fullsized":"2024-05-27T09:47:45.567201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566981+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:47:45.566981+0000","last_peered":"2024-05-27T09:47:45.566981+0000","last_clean":"2024-05-27T09:47:45.566981+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:47:45.566981+0000","last_undegraded":"2024-05-27T09:47:45.566981+0000","last_fullsized":"2024-05-27T09:47:45.566981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567513+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:47:45.567513+0000","last_peered":"2024-05-27T09:47:45.567513+0000","last_clean":"2024-05-27T09:47:45.567513+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:47:45.567513+0000","last_undegraded":"2024-05-27T09:47:45.567513+0000","last_fullsized":"2024-05-27T09:47:45.567513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568602+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:47:45.568602+0000","last_peered":"2024-05-27T09:47:45.568602+0000","last_clean":"2024-05-27T09:47:45.568602+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:47:45.568602+0000","last_undegraded":"2024-05-27T09:47:45.568602+0000","last_fullsized":"2024-05-27T09:47:45.568602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567617+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:47:45.567617+0000","last_peered":"2024-05-27T09:47:45.567617+0000","last_clean":"2024-05-27T09:47:45.567617+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:47:45.567617+0000","last_undegraded":"2024-05-27T09:47:45.567617+0000","last_fullsized":"2024-05-27T09:47:45.567617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:51.519668+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:47:51.519668+0000","last_peered":"2024-05-27T09:47:51.519668+0000","last_clean":"2024-05-27T09:47:51.519668+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:47:51.519668+0000","last_undegraded":"2024-05-27T09:47:51.519668+0000","last_fullsized":"2024-05-27T09:47:51.519668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485814+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:47:45.485814+0000","last_peered":"2024-05-27T09:47:45.485814+0000","last_clean":"2024-05-27T09:47:45.485814+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:47:45.485814+0000","last_undegraded":"2024-05-27T09:47:45.485814+0000","last_fullsized":"2024-05-27T09:47:45.485814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486083+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:47:45.486083+0000","last_peered":"2024-05-27T09:47:45.486083+0000","last_clean":"2024-05-27T09:47:45.486083+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:47:45.486083+0000","last_undegraded":"2024-05-27T09:47:45.486083+0000","last_fullsized":"2024-05-27T09:47:45.486083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568379+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:47:45.568379+0000","last_peered":"2024-05-27T09:47:45.568379+0000","last_clean":"2024-05-27T09:47:45.568379+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:47:45.568379+0000","last_undegraded":"2024-05-27T09:47:45.568379+0000","last_fullsized":"2024-05-27T09:47:45.568379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612112+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:47:45.612112+0000","last_peered":"2024-05-27T09:47:45.612112+0000","last_clean":"2024-05-27T09:47:45.612112+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:47:45.612112+0000","last_undegraded":"2024-05-27T09:47:45.612112+0000","last_fullsized":"2024-05-27T09:47:45.612112+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567678+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:47:45.567678+0000","last_peered":"2024-05-27T09:47:45.567678+0000","last_clean":"2024-05-27T09:47:45.567678+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:47:45.567678+0000","last_undegraded":"2024-05-27T09:47:45.567678+0000","last_fullsized":"2024-05-27T09:47:45.567678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611921+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:47:45.611921+0000","last_peered":"2024-05-27T09:47:45.611921+0000","last_clean":"2024-05-27T09:47:45.611921+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:47:45.611921+0000","last_undegraded":"2024-05-27T09:47:45.611921+0000","last_fullsized":"2024-05-27T09:47:45.611921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471350+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:47:45.471350+0000","last_peered":"2024-05-27T09:47:45.471350+0000","last_clean":"2024-05-27T09:47:45.471350+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:47:45.471350+0000","last_undegraded":"2024-05-27T09:47:45.471350+0000","last_fullsized":"2024-05-27T09:47:45.471350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":279,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:09.719814+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:48:09.719814+0000","last_peered":"2024-05-27T09:48:09.719814+0000","last_clean":"2024-05-27T09:48:09.719814+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:48:09.719814+0000","last_undegraded":"2024-05-27T09:48:09.719814+0000","last_fullsized":"2024-05-27T09:48:09.719814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611693+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:47:45.611693+0000","last_peered":"2024-05-27T09:47:45.611693+0000","last_clean":"2024-05-27T09:47:45.611693+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:47:45.611693+0000","last_undegraded":"2024-05-27T09:47:45.611693+0000","last_fullsized":"2024-05-27T09:47:45.611693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569225+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:47:45.569225+0000","last_peered":"2024-05-27T09:47:45.569225+0000","last_clean":"2024-05-27T09:47:45.569225+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:47:45.569225+0000","last_undegraded":"2024-05-27T09:47:45.569225+0000","last_fullsized":"2024-05-27T09:47:45.569225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471089+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:47:45.471089+0000","last_peered":"2024-05-27T09:47:45.471089+0000","last_clean":"2024-05-27T09:47:45.471089+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:47:45.471089+0000","last_undegraded":"2024-05-27T09:47:45.471089+0000","last_fullsized":"2024-05-27T09:47:45.471089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472110+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:47:45.472110+0000","last_peered":"2024-05-27T09:47:45.472110+0000","last_clean":"2024-05-27T09:47:45.472110+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:47:45.472110+0000","last_undegraded":"2024-05-27T09:47:45.472110+0000","last_fullsized":"2024-05-27T09:47:45.472110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.479557+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:47:45.479557+0000","last_peered":"2024-05-27T09:47:45.479557+0000","last_clean":"2024-05-27T09:47:45.479557+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:47:45.479557+0000","last_undegraded":"2024-05-27T09:47:45.479557+0000","last_fullsized":"2024-05-27T09:47:45.479557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470992+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:47:45.470992+0000","last_peered":"2024-05-27T09:47:45.470992+0000","last_clean":"2024-05-27T09:47:45.470992+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:47:45.470992+0000","last_undegraded":"2024-05-27T09:47:45.470992+0000","last_fullsized":"2024-05-27T09:47:45.470992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567594+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:47:45.567594+0000","last_peered":"2024-05-27T09:47:45.567594+0000","last_clean":"2024-05-27T09:47:45.567594+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:47:45.567594+0000","last_undegraded":"2024-05-27T09:47:45.567594+0000","last_fullsized":"2024-05-27T09:47:45.567594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:09.719247+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:48:09.719247+0000","last_peered":"2024-05-27T09:48:09.719247+0000","last_clean":"2024-05-27T09:48:09.719247+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:48:09.719247+0000","last_undegraded":"2024-05-27T09:48:09.719247+0000","last_fullsized":"2024-05-27T09:48:09.719247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568053+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:47:45.568053+0000","last_peered":"2024-05-27T09:47:45.568053+0000","last_clean":"2024-05-27T09:47:45.568053+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:47:45.568053+0000","last_undegraded":"2024-05-27T09:47:45.568053+0000","last_fullsized":"2024-05-27T09:47:45.568053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569720+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:47:45.569720+0000","last_peered":"2024-05-27T09:47:45.569720+0000","last_clean":"2024-05-27T09:47:45.569720+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:47:45.569720+0000","last_undegraded":"2024-05-27T09:47:45.569720+0000","last_fullsized":"2024-05-27T09:47:45.569720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568263+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:47:45.568263+0000","last_peered":"2024-05-27T09:47:45.568263+0000","last_clean":"2024-05-27T09:47:45.568263+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:47:45.568263+0000","last_undegraded":"2024-05-27T09:47:45.568263+0000","last_fullsized":"2024-05-27T09:47:45.568263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471453+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:47:45.471453+0000","last_peered":"2024-05-27T09:47:45.471453+0000","last_clean":"2024-05-27T09:47:45.471453+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:47:45.471453+0000","last_undegraded":"2024-05-27T09:47:45.471453+0000","last_fullsized":"2024-05-27T09:47:45.471453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567808+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:47:45.567808+0000","last_peered":"2024-05-27T09:47:45.567808+0000","last_clean":"2024-05-27T09:47:45.567808+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:47:45.567808+0000","last_undegraded":"2024-05-27T09:47:45.567808+0000","last_fullsized":"2024-05-27T09:47:45.567808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'42","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:10.873947+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:48:10.873947+0000","last_peered":"2024-05-27T09:48:10.873947+0000","last_clean":"2024-05-27T09:48:10.873947+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:48:10.873947+0000","last_undegraded":"2024-05-27T09:48:10.873947+0000","last_fullsized":"2024-05-27T09:48:10.873947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75541,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":496,"num_read_kb":323,"num_write":43,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611862+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:47:45.611862+0000","last_peered":"2024-05-27T09:47:45.611862+0000","last_clean":"2024-05-27T09:47:45.611862+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:47:45.611862+0000","last_undegraded":"2024-05-27T09:47:45.611862+0000","last_fullsized":"2024-05-27T09:47:45.611862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567350+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:47:45.567350+0000","last_peered":"2024-05-27T09:47:45.567350+0000","last_clean":"2024-05-27T09:47:45.567350+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:47:45.567350+0000","last_undegraded":"2024-05-27T09:47:45.567350+0000","last_fullsized":"2024-05-27T09:47:45.567350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471788+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:47:45.471788+0000","last_peered":"2024-05-27T09:47:45.471788+0000","last_clean":"2024-05-27T09:47:45.471788+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:47:45.471788+0000","last_undegraded":"2024-05-27T09:47:45.471788+0000","last_fullsized":"2024-05-27T09:47:45.471788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470915+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:47:45.470915+0000","last_peered":"2024-05-27T09:47:45.470915+0000","last_clean":"2024-05-27T09:47:45.470915+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:47:45.470915+0000","last_undegraded":"2024-05-27T09:47:45.470915+0000","last_fullsized":"2024-05-27T09:47:45.470915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569506+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:47:45.569506+0000","last_peered":"2024-05-27T09:47:45.569506+0000","last_clean":"2024-05-27T09:47:45.569506+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:47:45.569506+0000","last_undegraded":"2024-05-27T09:47:45.569506+0000","last_fullsized":"2024-05-27T09:47:45.569506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":282,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:09.823865+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:48:09.823865+0000","last_peered":"2024-05-27T09:48:09.823865+0000","last_clean":"2024-05-27T09:48:09.823865+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:48:09.823865+0000","last_undegraded":"2024-05-27T09:48:09.823865+0000","last_fullsized":"2024-05-27T09:48:09.823865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":7,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566845+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:47:45.566845+0000","last_peered":"2024-05-27T09:47:45.566845+0000","last_clean":"2024-05-27T09:47:45.566845+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:47:45.566845+0000","last_undegraded":"2024-05-27T09:47:45.566845+0000","last_fullsized":"2024-05-27T09:47:45.566845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470885+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:47:45.470885+0000","last_peered":"2024-05-27T09:47:45.470885+0000","last_clean":"2024-05-27T09:47:45.470885+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:47:45.470885+0000","last_undegraded":"2024-05-27T09:47:45.470885+0000","last_fullsized":"2024-05-27T09:47:45.470885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612202+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:47:45.612202+0000","last_peered":"2024-05-27T09:47:45.612202+0000","last_clean":"2024-05-27T09:47:45.612202+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:47:45.612202+0000","last_undegraded":"2024-05-27T09:47:45.612202+0000","last_fullsized":"2024-05-27T09:47:45.612202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567195+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:47:45.567195+0000","last_peered":"2024-05-27T09:47:45.567195+0000","last_clean":"2024-05-27T09:47:45.567195+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:47:45.567195+0000","last_undegraded":"2024-05-27T09:47:45.567195+0000","last_fullsized":"2024-05-27T09:47:45.567195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568365+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:47:45.568365+0000","last_peered":"2024-05-27T09:47:45.568365+0000","last_clean":"2024-05-27T09:47:45.568365+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:47:45.568365+0000","last_undegraded":"2024-05-27T09:47:45.568365+0000","last_fullsized":"2024-05-27T09:47:45.568365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568972+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:47:45.568972+0000","last_peered":"2024-05-27T09:47:45.568972+0000","last_clean":"2024-05-27T09:47:45.568972+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:47:45.568972+0000","last_undegraded":"2024-05-27T09:47:45.568972+0000","last_fullsized":"2024-05-27T09:47:45.568972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569085+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:47:45.569085+0000","last_peered":"2024-05-27T09:47:45.569085+0000","last_clean":"2024-05-27T09:47:45.569085+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:47:45.569085+0000","last_undegraded":"2024-05-27T09:47:45.569085+0000","last_fullsized":"2024-05-27T09:47:45.569085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568901+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:47:45.568901+0000","last_peered":"2024-05-27T09:47:45.568901+0000","last_clean":"2024-05-27T09:47:45.568901+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:47:45.568901+0000","last_undegraded":"2024-05-27T09:47:45.568901+0000","last_fullsized":"2024-05-27T09:47:45.568901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471385+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:47:45.471385+0000","last_peered":"2024-05-27T09:47:45.471385+0000","last_clean":"2024-05-27T09:47:45.471385+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:47:45.471385+0000","last_undegraded":"2024-05-27T09:47:45.471385+0000","last_fullsized":"2024-05-27T09:47:45.471385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":276,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:09.823086+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:48:09.823086+0000","last_peered":"2024-05-27T09:48:09.823086+0000","last_clean":"2024-05-27T09:48:09.823086+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:48:09.823086+0000","last_undegraded":"2024-05-27T09:48:09.823086+0000","last_fullsized":"2024-05-27T09:48:09.823086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567538+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:47:45.567538+0000","last_peered":"2024-05-27T09:47:45.567538+0000","last_clean":"2024-05-27T09:47:45.567538+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:47:45.567538+0000","last_undegraded":"2024-05-27T09:47:45.567538+0000","last_fullsized":"2024-05-27T09:47:45.567538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567813+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:47:45.567813+0000","last_peered":"2024-05-27T09:47:45.567813+0000","last_clean":"2024-05-27T09:47:45.567813+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:47:45.567813+0000","last_undegraded":"2024-05-27T09:47:45.567813+0000","last_fullsized":"2024-05-27T09:47:45.567813+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"84'99","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:47.624529+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:47:47.624529+0000","last_peered":"2024-05-27T09:47:47.624529+0000","last_clean":"2024-05-27T09:47:47.624529+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:47:47.624529+0000","last_undegraded":"2024-05-27T09:47:47.624529+0000","last_fullsized":"2024-05-27T09:47:47.624529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472229+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:47:45.472229+0000","last_peered":"2024-05-27T09:47:45.472229+0000","last_clean":"2024-05-27T09:47:45.472229+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:47:45.472229+0000","last_undegraded":"2024-05-27T09:47:45.472229+0000","last_fullsized":"2024-05-27T09:47:45.472229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568413+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:47:45.568413+0000","last_peered":"2024-05-27T09:47:45.568413+0000","last_clean":"2024-05-27T09:47:45.568413+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:47:45.568413+0000","last_undegraded":"2024-05-27T09:47:45.568413+0000","last_fullsized":"2024-05-27T09:47:45.568413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612093+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:47:45.612093+0000","last_peered":"2024-05-27T09:47:45.612093+0000","last_clean":"2024-05-27T09:47:45.612093+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:47:45.612093+0000","last_undegraded":"2024-05-27T09:47:45.612093+0000","last_fullsized":"2024-05-27T09:47:45.612093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472487+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:47:45.472487+0000","last_peered":"2024-05-27T09:47:45.472487+0000","last_clean":"2024-05-27T09:47:45.472487+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:47:45.472487+0000","last_undegraded":"2024-05-27T09:47:45.472487+0000","last_fullsized":"2024-05-27T09:47:45.472487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'102","reported_seq":224,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:06.322981+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:48:06.322981+0000","last_peered":"2024-05-27T09:48:06.322981+0000","last_clean":"2024-05-27T09:48:06.322981+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:48:06.322981+0000","last_undegraded":"2024-05-27T09:48:06.322981+0000","last_fullsized":"2024-05-27T09:48:06.322981+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486325+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:47:45.486325+0000","last_peered":"2024-05-27T09:47:45.486325+0000","last_clean":"2024-05-27T09:47:45.486325+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:47:45.486325+0000","last_undegraded":"2024-05-27T09:47:45.486325+0000","last_fullsized":"2024-05-27T09:47:45.486325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568134+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:47:45.568134+0000","last_peered":"2024-05-27T09:47:45.568134+0000","last_clean":"2024-05-27T09:47:45.568134+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:47:45.568134+0000","last_undegraded":"2024-05-27T09:47:45.568134+0000","last_fullsized":"2024-05-27T09:47:45.568134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567527+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:47:45.567527+0000","last_peered":"2024-05-27T09:47:45.567527+0000","last_clean":"2024-05-27T09:47:45.567527+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:47:45.567527+0000","last_undegraded":"2024-05-27T09:47:45.567527+0000","last_fullsized":"2024-05-27T09:47:45.567527+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611711+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:47:45.611711+0000","last_peered":"2024-05-27T09:47:45.611711+0000","last_clean":"2024-05-27T09:47:45.611711+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:47:45.611711+0000","last_undegraded":"2024-05-27T09:47:45.611711+0000","last_fullsized":"2024-05-27T09:47:45.611711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483699+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:47:45.483699+0000","last_peered":"2024-05-27T09:47:45.483699+0000","last_clean":"2024-05-27T09:47:45.483699+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:47:45.483699+0000","last_undegraded":"2024-05-27T09:47:45.483699+0000","last_fullsized":"2024-05-27T09:47:45.483699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566963+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:47:45.566963+0000","last_peered":"2024-05-27T09:47:45.566963+0000","last_clean":"2024-05-27T09:47:45.566963+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:47:45.566963+0000","last_undegraded":"2024-05-27T09:47:45.566963+0000","last_fullsized":"2024-05-27T09:47:45.566963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566936+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:47:45.566936+0000","last_peered":"2024-05-27T09:47:45.566936+0000","last_clean":"2024-05-27T09:47:45.566936+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:47:45.566936+0000","last_undegraded":"2024-05-27T09:47:45.566936+0000","last_fullsized":"2024-05-27T09:47:45.566936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485069+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:47:45.485069+0000","last_peered":"2024-05-27T09:47:45.485069+0000","last_clean":"2024-05-27T09:47:45.485069+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:47:45.485069+0000","last_undegraded":"2024-05-27T09:47:45.485069+0000","last_fullsized":"2024-05-27T09:47:45.485069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611810+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:47:45.611810+0000","last_peered":"2024-05-27T09:47:45.611810+0000","last_clean":"2024-05-27T09:47:45.611810+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:47:45.611810+0000","last_undegraded":"2024-05-27T09:47:45.611810+0000","last_fullsized":"2024-05-27T09:47:45.611810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569246+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:47:45.569246+0000","last_peered":"2024-05-27T09:47:45.569246+0000","last_clean":"2024-05-27T09:47:45.569246+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:47:45.569246+0000","last_undegraded":"2024-05-27T09:47:45.569246+0000","last_fullsized":"2024-05-27T09:47:45.569246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567397+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:47:45.567397+0000","last_peered":"2024-05-27T09:47:45.567397+0000","last_clean":"2024-05-27T09:47:45.567397+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:47:45.567397+0000","last_undegraded":"2024-05-27T09:47:45.567397+0000","last_fullsized":"2024-05-27T09:47:45.567397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569739+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:47:45.569739+0000","last_peered":"2024-05-27T09:47:45.569739+0000","last_clean":"2024-05-27T09:47:45.569739+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:47:45.569739+0000","last_undegraded":"2024-05-27T09:47:45.569739+0000","last_fullsized":"2024-05-27T09:47:45.569739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'65","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:05.777220+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:48:05.777220+0000","last_peered":"2024-05-27T09:48:05.777220+0000","last_clean":"2024-05-27T09:48:05.777220+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:48:05.777220+0000","last_undegraded":"2024-05-27T09:48:05.777220+0000","last_fullsized":"2024-05-27T09:48:05.777220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569485+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:47:45.569485+0000","last_peered":"2024-05-27T09:47:45.569485+0000","last_clean":"2024-05-27T09:47:45.569485+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:47:45.569485+0000","last_undegraded":"2024-05-27T09:47:45.569485+0000","last_fullsized":"2024-05-27T09:47:45.569485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471807+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:47:45.471807+0000","last_peered":"2024-05-27T09:47:45.471807+0000","last_clean":"2024-05-27T09:47:45.471807+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:47:45.471807+0000","last_undegraded":"2024-05-27T09:47:45.471807+0000","last_fullsized":"2024-05-27T09:47:45.471807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569836+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:47:45.569836+0000","last_peered":"2024-05-27T09:47:45.569836+0000","last_clean":"2024-05-27T09:47:45.569836+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:47:45.569836+0000","last_undegraded":"2024-05-27T09:47:45.569836+0000","last_fullsized":"2024-05-27T09:47:45.569836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567131+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:47:45.567131+0000","last_peered":"2024-05-27T09:47:45.567131+0000","last_clean":"2024-05-27T09:47:45.567131+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:47:45.567131+0000","last_undegraded":"2024-05-27T09:47:45.567131+0000","last_fullsized":"2024-05-27T09:47:45.567131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567636+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:47:45.567636+0000","last_peered":"2024-05-27T09:47:45.567636+0000","last_clean":"2024-05-27T09:47:45.567636+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:47:45.567636+0000","last_undegraded":"2024-05-27T09:47:45.567636+0000","last_fullsized":"2024-05-27T09:47:45.567636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566975+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:47:45.566975+0000","last_peered":"2024-05-27T09:47:45.566975+0000","last_clean":"2024-05-27T09:47:45.566975+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:47:45.566975+0000","last_undegraded":"2024-05-27T09:47:45.566975+0000","last_fullsized":"2024-05-27T09:47:45.566975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567496+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:47:45.567496+0000","last_peered":"2024-05-27T09:47:45.567496+0000","last_clean":"2024-05-27T09:47:45.567496+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:47:45.567496+0000","last_undegraded":"2024-05-27T09:47:45.567496+0000","last_fullsized":"2024-05-27T09:47:45.567496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472378+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:47:45.472378+0000","last_peered":"2024-05-27T09:47:45.472378+0000","last_clean":"2024-05-27T09:47:45.472378+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:47:45.472378+0000","last_undegraded":"2024-05-27T09:47:45.472378+0000","last_fullsized":"2024-05-27T09:47:45.472378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567123+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:47:45.567123+0000","last_peered":"2024-05-27T09:47:45.567123+0000","last_clean":"2024-05-27T09:47:45.567123+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:47:45.567123+0000","last_undegraded":"2024-05-27T09:47:45.567123+0000","last_fullsized":"2024-05-27T09:47:45.567123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567587+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:47:45.567587+0000","last_peered":"2024-05-27T09:47:45.567587+0000","last_clean":"2024-05-27T09:47:45.567587+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:47:45.567587+0000","last_undegraded":"2024-05-27T09:47:45.567587+0000","last_fullsized":"2024-05-27T09:47:45.567587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486230+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:47:45.486230+0000","last_peered":"2024-05-27T09:47:45.486230+0000","last_clean":"2024-05-27T09:47:45.486230+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:47:45.486230+0000","last_undegraded":"2024-05-27T09:47:45.486230+0000","last_fullsized":"2024-05-27T09:47:45.486230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471079+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:47:45.471079+0000","last_peered":"2024-05-27T09:47:45.471079+0000","last_clean":"2024-05-27T09:47:45.471079+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:47:45.471079+0000","last_undegraded":"2024-05-27T09:47:45.471079+0000","last_fullsized":"2024-05-27T09:47:45.471079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483079+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:47:45.483079+0000","last_peered":"2024-05-27T09:47:45.483079+0000","last_clean":"2024-05-27T09:47:45.483079+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:47:45.483079+0000","last_undegraded":"2024-05-27T09:47:45.483079+0000","last_fullsized":"2024-05-27T09:47:45.483079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471895+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:47:45.471895+0000","last_peered":"2024-05-27T09:47:45.471895+0000","last_clean":"2024-05-27T09:47:45.471895+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:47:45.471895+0000","last_undegraded":"2024-05-27T09:47:45.471895+0000","last_fullsized":"2024-05-27T09:47:45.471895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566971+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:47:45.566971+0000","last_peered":"2024-05-27T09:47:45.566971+0000","last_clean":"2024-05-27T09:47:45.566971+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:47:45.566971+0000","last_undegraded":"2024-05-27T09:47:45.566971+0000","last_fullsized":"2024-05-27T09:47:45.566971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":803086,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1823,"num_read_kb":1135,"num_write":429,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":2409258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":317,"ondisk_log_size":317,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":921600,"data_stored":449225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37368,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707784,"statfs":{"total":95995035648,"available":95956770816,"internally_reserved":0,"allocated":1957888,"data_stored":1446072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005135,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1323008,"data_stored":842565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201367,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708532,"statfs":{"total":95995035648,"available":95957536768,"internally_reserved":0,"allocated":1314816,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397597,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1523712,"data_stored":1043295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593824,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":448738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":524072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":450009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":526204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149810,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1658880,"data_stored":1170497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953581,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":450880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37280,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707872,"statfs":{"total":95995035648,"available":95956860928,"internally_reserved":0,"allocated":1867776,"data_stored":1369506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":75541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":77673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":393842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":407056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:48:16.152 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-27T09:48:16.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-27T09:48:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:16.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:16 smithi071 ceph-mon[31451]: from='client.25259 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:16.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:16 smithi071 ceph-mon[31451]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:16 smithi122 ceph-mon[36436]: from='client.25259 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:16 smithi122 ceph-mon[36436]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:17.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:16 smithi072 ceph-mon[35951]: from='client.25259 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:17.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:16 smithi072 ceph-mon[35951]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-05-27T09:48:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 -- 172.21.15.71:0/97469208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc105e20 msgr2=0x7ff2fc10e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 --2- 172.21.15.71:0/97469208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc105e20 0x7ff2fc10e370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80098f0 tx=0x7ff2e8009c00 comp rx=0 tx=0).stop 2024-05-27T09:48:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 -- 172.21.15.71:0/97469208 shutdown_connections 2024-05-27T09:48:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 --2- 172.21.15.71:0/97469208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2fc10e900 0x7ff2fc110de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 --2- 172.21.15.71:0/97469208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2fc1054d0 0x7ff2fc1058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 --2- 172.21.15.71:0/97469208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc105e20 0x7ff2fc10e370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 -- 172.21.15.71:0/97469208 >> 172.21.15.71:0/97469208 conn(0x7ff2fc0fedb0 msgr2=0x7ff2fc1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 -- 172.21.15.71:0/97469208 shutdown_connections 2024-05-27T09:48:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.831+0000 7ff303400700 1 -- 172.21.15.71:0/97469208 wait complete. 2024-05-27T09:48:18.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.833+0000 7ff303400700 1 Processor -- start 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.833+0000 7ff303400700 1 -- start start 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.833+0000 7ff303400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc1054d0 0x7ff2fc19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.833+0000 7ff303400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2fc105e20 0x7ff2fc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.833+0000 7ff303400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2fc10e900 0x7ff2fc1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.833+0000 7ff303400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc114480 con 0x7ff2fc10e900 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff303400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc114300 con 0x7ff2fc105e20 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff303400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc114600 con 0x7ff2fc1054d0 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff300a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc1054d0 0x7ff2fc19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff2fbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2fc105e20 0x7ff2fc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff301400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2fc10e900 0x7ff2fc1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:18.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff300a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc1054d0 0x7ff2fc19d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:45016/0 (socket says 172.21.15.71:45016) 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff300a00700 1 -- 172.21.15.71:0/1056702671 learned_addr learned my addr 172.21.15.71:0/1056702671 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff2fbe00700 1 -- 172.21.15.71:0/1056702671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc1054d0 msgr2=0x7ff2fc19d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff2fbe00700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc1054d0 0x7ff2fc19d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff2fbe00700 1 -- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2fc10e900 msgr2=0x7ff2fc1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff2fbe00700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2fc10e900 0x7ff2fc1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.834+0000 7ff2fbe00700 1 -- 172.21.15.71:0/1056702671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc1a1f50 con 0x7ff2fc105e20 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.835+0000 7ff300a00700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc1054d0 0x7ff2fc19d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.835+0000 7ff301400700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2fc10e900 0x7ff2fc1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.835+0000 7ff2fbe00700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2fc105e20 0x7ff2fc19d670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c010 tx=0x7ff2e800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:18.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:18 smithi071 ceph-mon[31451]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:18.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:18 smithi071 ceph-mon[31451]: scrub summary: idle 2024-05-27T09:48:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.835+0000 7ff2f9600700 1 -- 172.21.15.71:0/1056702671 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80050c0 con 0x7ff2fc105e20 2024-05-27T09:48:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.836+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc1a21e0 con 0x7ff2fc105e20 2024-05-27T09:48:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.836+0000 7ff2f9600700 1 -- 172.21.15.71:0/1056702671 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2e800b560 con 0x7ff2fc105e20 2024-05-27T09:48:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.836+0000 7ff2f9600700 1 -- 172.21.15.71:0/1056702671 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8003a00 con 0x7ff2fc105e20 2024-05-27T09:48:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.836+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc1a9b60 con 0x7ff2fc105e20 2024-05-27T09:48:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.837+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc0512b0 con 0x7ff2fc105e20 2024-05-27T09:48:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.841+0000 7ff2f9600700 1 -- 172.21.15.71:0/1056702671 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7ff2e800b710 con 0x7ff2fc105e20 2024-05-27T09:48:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.842+0000 7ff2f9600700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff2e40b2b10 0x7ff2e40b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.843+0000 7ff2f9600700 1 -- 172.21.15.71:0/1056702671 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff2e80e3690 con 0x7ff2fc105e20 2024-05-27T09:48:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.843+0000 7ff300a00700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff2e40b2b10 0x7ff2e40b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.844+0000 7ff300a00700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff2e40b2b10 0x7ff2e40b5020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0011550 tx=0x7ff2f0009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:18.848+0000 7ff2f9600700 1 -- 172.21.15.71:0/1056702671 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff2e8013030 con 0x7ff2fc105e20 2024-05-27T09:48:18.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:18 smithi122 ceph-mon[36436]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:18.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:18 smithi122 ceph-mon[36436]: scrub summary: idle 2024-05-27T09:48:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:18 smithi072 ceph-mon[35951]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-05-27T09:48:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:18 smithi072 ceph-mon[35951]: scrub summary: idle 2024-05-27T09:48:19.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.073+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2fc0ff9d0 con 0x7ff2e40b2b10 2024-05-27T09:48:19.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.095+0000 7ff2f9600700 1 -- 172.21.15.71:0/1056702671 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257761 (secure 0 0 0) 0x7ff2fc0ff9d0 con 0x7ff2e40b2b10 2024-05-27T09:48:19.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:19.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.102+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff2e40b2b10 msgr2=0x7ff2e40b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.102+0000 7ff303400700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff2e40b2b10 0x7ff2e40b5020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0011550 tx=0x7ff2f0009260 comp rx=0 tx=0).stop 2024-05-27T09:48:19.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.102+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2fc105e20 msgr2=0x7ff2fc19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.102+0000 7ff303400700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2fc105e20 0x7ff2fc19d670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c010 tx=0x7ff2e800fa00 comp rx=0 tx=0).stop 2024-05-27T09:48:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 shutdown_connections 2024-05-27T09:48:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff2e40b2b10 0x7ff2e40b5020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2fc10e900 0x7ff2fc1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2fc1054d0 0x7ff2fc19d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 --2- 172.21.15.71:0/1056702671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2fc105e20 0x7ff2fc19d670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 >> 172.21.15.71:0/1056702671 conn(0x7ff2fc0fedb0 msgr2=0x7ff2fc0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 shutdown_connections 2024-05-27T09:48:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:19.103+0000 7ff303400700 1 -- 172.21.15.71:0/1056702671 wait complete. 2024-05-27T09:48:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-05-27T09:48:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 -- 172.21.15.71:0/3018905486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c104420 msgr2=0x7fc66c1107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 --2- 172.21.15.71:0/3018905486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c104420 0x7fc66c1107f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc664009860 tx=0x7fc66402a340 comp rx=0 tx=0).stop 2024-05-27T09:48:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 -- 172.21.15.71:0/3018905486 shutdown_connections 2024-05-27T09:48:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 --2- 172.21.15.71:0/3018905486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c104420 0x7fc66c1107f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 --2- 172.21.15.71:0/3018905486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c10a170 0x7fc66c103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 --2- 172.21.15.71:0/3018905486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc66c109cd0 0x7fc66c103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 -- 172.21.15.71:0/3018905486 >> 172.21.15.71:0/3018905486 conn(0x7fc66c079440 msgr2=0x7fc66c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 -- 172.21.15.71:0/3018905486 shutdown_connections 2024-05-27T09:48:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.769+0000 7fc673a00640 1 -- 172.21.15.71:0/3018905486 wait complete. 2024-05-27T09:48:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.771+0000 7fc673a00640 1 Processor -- start 2024-05-27T09:48:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.771+0000 7fc673a00640 1 -- start start 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.771+0000 7fc673a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc66c104420 0x7fc66c1a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc673a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c109cd0 0x7fc66c1a2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc673a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c10a170 0x7fc66c19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc673a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c113ec0 con 0x7fc66c104420 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc673a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c113d40 con 0x7fc66c10a170 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc673a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c114040 con 0x7fc66c109cd0 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc671000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc66c104420 0x7fc66c1a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc66be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c109cd0 0x7fc66c1a2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc66be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c109cd0 0x7fc66c1a2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:45034/0 (socket says 172.21.15.71:45034) 2024-05-27T09:48:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc66be00640 1 -- 172.21.15.71:0/2547689554 learned_addr learned my addr 172.21.15.71:0/2547689554 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc671a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c10a170 0x7fc66c19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc66be00640 1 -- 172.21.15.71:0/2547689554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c10a170 msgr2=0x7fc66c19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc66be00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c10a170 0x7fc66c19c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc66be00640 1 -- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc66c104420 msgr2=0x7fc66c1a2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.772+0000 7fc66be00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc66c104420 0x7fc66c1a2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.773+0000 7fc66be00640 1 -- 172.21.15.71:0/2547689554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c19d040 con 0x7fc66c109cd0 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.773+0000 7fc66be00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c109cd0 0x7fc66c1a2cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc65400e980 tx=0x7fc65400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.773+0000 7fc669600640 1 -- 172.21.15.71:0/2547689554 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65400cd80 con 0x7fc66c109cd0 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.773+0000 7fc669600640 1 -- 172.21.15.71:0/2547689554 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6540108e0 con 0x7fc66c109cd0 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.773+0000 7fc669600640 1 -- 172.21.15.71:0/2547689554 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654018940 con 0x7fc66c109cd0 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.773+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c19d330 con 0x7fc66c109cd0 2024-05-27T09:48:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.773+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c1a9610 con 0x7fc66c109cd0 2024-05-27T09:48:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.777+0000 7fc669600640 1 -- 172.21.15.71:0/2547689554 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fc65401f020 con 0x7fc66c109cd0 2024-05-27T09:48:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 Processor -- start 2024-05-27T09:48:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 -- start start 2024-05-27T09:48:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc669600640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc6500b2af0 0x7fc6500b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc669600640 1 -- 172.21.15.71:0/2547689554 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fc6540e2920 con 0x7fc66c109cd0 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201372b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133602f0 0x56201372bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133684d0 0x56201372c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56201369cb90 con 0x5620133891b0 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56201368c730 con 0x5620133684d0 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.779+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562013690770 con 0x5620133602f0 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc671a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc6500b2af0 0x7fc6500b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133602f0 0x56201372bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133602f0 0x56201372bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:45048/0 (socket says 172.21.15.71:45048) 2024-05-27T09:48:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc671000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201372b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 -- 172.21.15.71:0/2236157034 learned_addr learned my addr 172.21.15.71:0/2236157034 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 -- 172.21.15.71:0/2236157034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133684d0 msgr2=0x56201372c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 --2- 172.21.15.71:0/2236157034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133684d0 0x56201372c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 -- 172.21.15.71:0/2236157034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 msgr2=0x56201372b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 --2- 172.21.15.71:0/2236157034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201372b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.780+0000 7fc66be00640 1 -- 172.21.15.71:0/2236157034 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620136258b0 con 0x5620133602f0 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.781+0000 7fc671a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc6500b2af0 0x7fc6500b5000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6640303f0 tx=0x7fc664030c40 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.781+0000 7fc66be00640 1 --2- 172.21.15.71:0/2236157034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133602f0 0x56201372bda0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc6540a5a00 tx=0x7fc6540a9490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=870b5dd1da4da91f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.781+0000 7fc662000640 1 -- 172.21.15.71:0/2236157034 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540a9980 con 0x5620133602f0 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.781+0000 7fc662000640 1 -- 172.21.15.71:0/2236157034 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6540add30 con 0x5620133602f0 2024-05-27T09:48:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.781+0000 7fc662000640 1 -- 172.21.15.71:0/2236157034 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540b2350 con 0x5620133602f0 2024-05-27T09:48:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.782+0000 7fc67ab6f740 1 -- 172.21.15.71:0/2236157034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133602f0 msgr2=0x56201372bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.782+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/2236157034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133602f0 0x56201372bda0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc6540a5a00 tx=0x7fc6540a9490 comp rx=0 tx=0).stop 2024-05-27T09:48:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.783+0000 7fc67ab6f740 1 -- 172.21.15.71:0/2236157034 shutdown_connections 2024-05-27T09:48:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.783+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/2236157034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133684d0 0x56201372c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.783+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/2236157034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133602f0 0x56201372bda0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.783+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/2236157034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201372b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.783+0000 7fc67ab6f740 1 -- 172.21.15.71:0/2236157034 >> 172.21.15.71:0/2236157034 conn(0x56201337d300 msgr2=0x562013728010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.783+0000 7fc67ab6f740 1 -- 172.21.15.71:0/2236157034 shutdown_connections 2024-05-27T09:48:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.783+0000 7fc67ab6f740 1 -- 172.21.15.71:0/2236157034 wait complete. 2024-05-27T09:48:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.784+0000 7fc67ab6f740 1 -- start start 2024-05-27T09:48:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.784+0000 7fc67ab6f740 1 Processor -- start 2024-05-27T09:48:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133602f0 0x562013735ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137361e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133891b0 0x562013741c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562013372790 con 0x5620133602f0 2024-05-27T09:48:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562013634bc0 con 0x5620133891b0 2024-05-27T09:48:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562013738930 con 0x5620133684d0 2024-05-27T09:48:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc67ab6f740 10 client.0 _ll_register_callbacks cb 0x562013612400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc671000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133602f0 0x562013735ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc66be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.785+0000 7fc66be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137361e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:45062/0 (socket says 172.21.15.71:45062) 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc66be00640 1 -- 172.21.15.71:0/3480272010 learned_addr learned my addr 172.21.15.71:0/3480272010 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc671a00640 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133891b0 0x562013741c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc66be00640 1 -- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133891b0 msgr2=0x562013741c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc66be00640 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133891b0 0x562013741c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc66be00640 1 -- 172.21.15.71:0/3480272010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133602f0 msgr2=0x562013735ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc66be00640 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133602f0 0x562013735ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc66be00640 1 -- 172.21.15.71:0/3480272010 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620133a1210 con 0x5620133684d0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc66be00640 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137361e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56201372d410 tx=0x7fc654010f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58684904ebcd64 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc65aa00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.786+0000 7fc65aa00640 1 -- 172.21.15.71:0/3480272010 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540c2070 con 0x5620133684d0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.787+0000 7fc65aa00640 1 -- 172.21.15.71:0/3480272010 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fc6540b2560 con 0x5620133684d0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.787+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6540add30 con 0x5620133684d0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.787+0000 7fc65aa00640 1 -- 172.21.15.71:0/3480272010 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc654089050 con 0x5620133684d0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.787+0000 7fc67ab6f740 10 client.25291 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.787+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56201346d620 con 0x5620133684d0 2024-05-27T09:48:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.787+0000 7fc65aa00640 1 -- 172.21.15.71:0/3480272010 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6540add30 con 0x5620133684d0 2024-05-27T09:48:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.787+0000 7fc65aa00640 1 -- 172.21.15.71:0/3480272010 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fc6540a8be0 con 0x5620133684d0 2024-05-27T09:48:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.788+0000 7fc67ab6f740 10 client.25291 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.788+0000 7fc67ab6f740 10 client.25291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.788+0000 7fc67ab6f740 20 client.25291 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.788+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562013347d80 0x562013747ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.788+0000 7fc67ab6f740 4 client.25291 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.788+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56201369eae0 con 0x562013347d80 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.788+0000 7fc671000640 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562013347d80 0x562013747ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.789+0000 7fc671000640 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562013347d80 0x562013747ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea8bc2e151233ac2 server_cookie=a5bfa1fb794b3c68 in_seq=0 out_seq=0 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.789+0000 7fc65aa00640 10 client.25291 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.789+0000 7fc65aa00640 1 -- 172.21.15.71:0/3480272010 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56201369eae0 con 0x562013347d80 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc65aa00640 10 client.25291 handle_command_reply: tid=0 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 client.25291 shutdown 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 msgr2=0x5620137361e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137361e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56201372d410 tx=0x7fc654010f30 comp rx=0 tx=0).stop 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 shutdown_connections 2024-05-27T09:48:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133891b0 0x562013741c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137361e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562013347d80 0x562013747ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3480272010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133602f0 0x562013735ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc65aa00640 0 client.25291 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 >> 172.21.15.71:0/3480272010 conn(0x56201337d300 msgr2=0x56201372b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 shutdown_connections 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.790+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3480272010 wait complete. 2024-05-27T09:48:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.791+0000 7fc67ab6f740 20 client.25291 trim_cache size 0 max 16384 2024-05-27T09:48:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.822+0000 7fc67ab6f740 1 Processor -- start 2024-05-27T09:48:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.822+0000 7fc67ab6f740 1 -- start start 2024-05-27T09:48:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.822+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x56201372fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.822+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x562013741bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.822+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x562013732cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b4630 con 0x5620133891b0 2024-05-27T09:48:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b1f00 con 0x5620133602f0 2024-05-27T09:48:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1afd50 con 0x5620133684d0 2024-05-27T09:48:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc671000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x56201372fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc671000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x56201372fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49140/0 (socket says 172.21.15.71:49140) 2024-05-27T09:48:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc671000640 1 -- 172.21.15.71:0/1473864365 learned_addr learned my addr 172.21.15.71:0/1473864365 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc671a00640 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x562013732cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc66be00640 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x562013741bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc66be00640 1 -- 172.21.15.71:0/1473864365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 msgr2=0x56201372fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.823+0000 7fc66be00640 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x56201372fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc66be00640 1 -- 172.21.15.71:0/1473864365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 msgr2=0x562013732cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc66be00640 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x562013732cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc66be00640 1 -- 172.21.15.71:0/1473864365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562013729160 con 0x5620133684d0 2024-05-27T09:48:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc671000640 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x56201372fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc66be00640 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x562013741bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc6540a8fe0 tx=0x7fc6540a9490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fd54186d42f7584 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc661600640 1 -- 172.21.15.71:0/1473864365 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540c2070 con 0x5620133684d0 2024-05-27T09:48:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc661600640 1 -- 172.21.15.71:0/1473864365 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6540dfe00 con 0x5620133684d0 2024-05-27T09:48:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.824+0000 7fc661600640 1 -- 172.21.15.71:0/1473864365 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540a5c10 con 0x5620133684d0 2024-05-27T09:48:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 -- 172.21.15.71:0/1473864365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 msgr2=0x562013741bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x562013741bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc6540a8fe0 tx=0x7fc6540a9490 comp rx=0 tx=0).stop 2024-05-27T09:48:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 -- 172.21.15.71:0/1473864365 shutdown_connections 2024-05-27T09:48:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x562013732cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x562013741bd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/1473864365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x56201372fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 -- 172.21.15.71:0/1473864365 >> 172.21.15.71:0/1473864365 conn(0x56201337d300 msgr2=0x56201372f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 -- 172.21.15.71:0/1473864365 shutdown_connections 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.825+0000 7fc67ab6f740 1 -- 172.21.15.71:0/1473864365 wait complete. 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.826+0000 7fc67ab6f740 1 -- start start 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.826+0000 7fc67ab6f740 1 Processor -- start 2024-05-27T09:48:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x5620137a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137a7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc67ab6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201374a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b03c0 con 0x5620133891b0 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b1830 con 0x5620133602f0 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc67ab6f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b0a90 con 0x5620133684d0 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc67ab6f740 10 client.0 _ll_register_callbacks cb 0x7fc65c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc671000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x5620137a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc66be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc671000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x5620137a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49156/0 (socket says 172.21.15.71:49156) 2024-05-27T09:48:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc671a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201374a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc671000640 1 -- 172.21.15.71:0/3933223323 learned_addr learned my addr 172.21.15.71:0/3933223323 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc671000640 1 -- 172.21.15.71:0/3933223323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 msgr2=0x5620137a7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.827+0000 7fc671000640 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137a7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc671000640 1 -- 172.21.15.71:0/3933223323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 msgr2=0x56201374a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc671000640 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201374a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc671000640 1 -- 172.21.15.71:0/3933223323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201374a6c0 con 0x5620133602f0 2024-05-27T09:48:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc66be00640 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc671000640 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x5620137a71e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc65c005fd0 tx=0x7fc65c010c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7b56b4c5060c23 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc65aa00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:48:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc65aa00640 1 -- 172.21.15.71:0/3933223323 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c01db20 con 0x5620133602f0 2024-05-27T09:48:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6540dfe00 con 0x5620133602f0 2024-05-27T09:48:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc65aa00640 1 -- 172.21.15.71:0/3933223323 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fc65c01dcc0 con 0x5620133602f0 2024-05-27T09:48:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.828+0000 7fc65aa00640 1 -- 172.21.15.71:0/3933223323 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc65c027420 con 0x5620133602f0 2024-05-27T09:48:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 10 client.25280 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5620137af980 con 0x5620133602f0 2024-05-27T09:48:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc65aa00640 1 -- 172.21.15.71:0/3933223323 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6540dfe00 con 0x5620133602f0 2024-05-27T09:48:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc65aa00640 1 -- 172.21.15.71:0/3933223323 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fc65c01c5a0 con 0x5620133602f0 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 10 client.25280 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 10 client.25280 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 20 client.25280 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56201331d1c0 0x5620137b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 4 client.25280 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.829+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620136982c0 con 0x56201331d1c0 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.830+0000 7fc66be00640 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56201331d1c0 0x5620137b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.830+0000 7fc66be00640 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56201331d1c0 0x5620137b21a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa95aba3e61b45a server_cookie=db2a0cd95ebe74ab in_seq=0 out_seq=0 2024-05-27T09:48:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.830+0000 7fc65aa00640 10 client.25280 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc65aa00640 1 -- 172.21.15.71:0/3933223323 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5620136982c0 con 0x56201331d1c0 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc65aa00640 10 client.25280 handle_command_reply: tid=0 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 client.25280 shutdown 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 msgr2=0x5620137a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x5620137a71e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc65c005fd0 tx=0x7fc65c010c30 comp rx=0 tx=0).stop 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 shutdown_connections 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56201331d1c0 0x5620137b21a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620133891b0 0x56201374a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc65aa00640 0 client.25280 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620133684d0 0x5620137a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 --2- 172.21.15.71:0/3933223323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5620133602f0 0x5620137a71e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 >> 172.21.15.71:0/3933223323 conn(0x56201337d300 msgr2=0x562013737060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 shutdown_connections 2024-05-27T09:48:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.842+0000 7fc67ab6f740 1 -- 172.21.15.71:0/3933223323 wait complete. 2024-05-27T09:48:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.843+0000 7fc67ab6f740 20 client.25280 trim_cache size 0 max 16384 2024-05-27T09:48:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:48:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:48:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.843+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc6500b2af0 msgr2=0x7fc6500b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc6500b2af0 0x7fc6500b5000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6640303f0 tx=0x7fc664030c40 comp rx=0 tx=0).stop 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c109cd0 msgr2=0x7fc66c1a2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c109cd0 0x7fc66c1a2cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc65400e980 tx=0x7fc65400ee40 comp rx=0 tx=0).stop 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 shutdown_connections 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc6500b2af0 0x7fc6500b5000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c10a170 0x7fc66c19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc66c109cd0 0x7fc66c1a2cd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 --2- 172.21.15.71:0/2547689554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc66c104420 0x7fc66c1a2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 >> 172.21.15.71:0/2547689554 conn(0x7fc66c079440 msgr2=0x7fc66c075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 shutdown_connections 2024-05-27T09:48:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:19.844+0000 7fc673a00640 1 -- 172.21.15.71:0/2547689554 wait complete. 2024-05-27T09:48:20.033 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-27T09:48:17.510371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1393688,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1997,"num_read_kb":1398,"num_write":566,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":918,"ondisk_log_size":918,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397752,"kb_used_data":15000,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544072,"statfs":{"total":1151940427776,"available":1151533129728,"internally_reserved":0,"allocated":15360000,"data_stored":9563436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":391492925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":197770,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":279,"num_write":128,"num_write_kb":917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006023"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567434+0000","last_change":"2024-05-27T09:43:48.834061+0000","last_active":"2024-05-27T09:47:45.567434+0000","last_peered":"2024-05-27T09:47:45.567434+0000","last_clean":"2024-05-27T09:47:45.567434+0000","last_became_active":"2024-05-27T09:43:48.833668+0000","last_became_peered":"2024-05-27T09:43:48.833668+0000","last_unstale":"2024-05-27T09:47:45.567434+0000","last_undegraded":"2024-05-27T09:47:45.567434+0000","last_fullsized":"2024-05-27T09:47:45.567434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:25.966200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568072+0000","last_change":"2024-05-27T09:43:48.829649+0000","last_active":"2024-05-27T09:47:45.568072+0000","last_peered":"2024-05-27T09:47:45.568072+0000","last_clean":"2024-05-27T09:47:45.568072+0000","last_became_active":"2024-05-27T09:43:48.829194+0000","last_became_peered":"2024-05-27T09:43:48.829194+0000","last_unstale":"2024-05-27T09:47:45.568072+0000","last_undegraded":"2024-05-27T09:47:45.568072+0000","last_fullsized":"2024-05-27T09:47:45.568072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:44.927997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.827269+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.826866+0000","last_became_peered":"2024-05-27T09:43:48.826866+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:34:55.876917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568371+0000","last_change":"2024-05-27T09:43:48.819571+0000","last_active":"2024-05-27T09:47:45.568371+0000","last_peered":"2024-05-27T09:47:45.568371+0000","last_clean":"2024-05-27T09:47:45.568371+0000","last_became_active":"2024-05-27T09:43:48.819188+0000","last_became_peered":"2024-05-27T09:43:48.819188+0000","last_unstale":"2024-05-27T09:47:45.568371+0000","last_undegraded":"2024-05-27T09:47:45.568371+0000","last_fullsized":"2024-05-27T09:47:45.568371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:09.466979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611732+0000","last_change":"2024-05-27T09:43:48.831480+0000","last_active":"2024-05-27T09:47:45.611732+0000","last_peered":"2024-05-27T09:47:45.611732+0000","last_clean":"2024-05-27T09:47:45.611732+0000","last_became_active":"2024-05-27T09:43:48.830666+0000","last_became_peered":"2024-05-27T09:43:48.830666+0000","last_unstale":"2024-05-27T09:47:45.611732+0000","last_undegraded":"2024-05-27T09:47:45.611732+0000","last_fullsized":"2024-05-27T09:47:45.611732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:15:49.615216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568665+0000","last_change":"2024-05-27T09:43:48.826805+0000","last_active":"2024-05-27T09:47:45.568665+0000","last_peered":"2024-05-27T09:47:45.568665+0000","last_clean":"2024-05-27T09:47:45.568665+0000","last_became_active":"2024-05-27T09:43:48.826395+0000","last_became_peered":"2024-05-27T09:43:48.826395+0000","last_unstale":"2024-05-27T09:47:45.568665+0000","last_undegraded":"2024-05-27T09:47:45.568665+0000","last_fullsized":"2024-05-27T09:47:45.568665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:13.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568108+0000","last_change":"2024-05-27T09:44:24.377966+0000","last_active":"2024-05-27T09:47:45.568108+0000","last_peered":"2024-05-27T09:47:45.568108+0000","last_clean":"2024-05-27T09:47:45.568108+0000","last_became_active":"2024-05-27T09:44:24.377496+0000","last_became_peered":"2024-05-27T09:44:24.377496+0000","last_unstale":"2024-05-27T09:47:45.568108+0000","last_undegraded":"2024-05-27T09:47:45.568108+0000","last_fullsized":"2024-05-27T09:47:45.568108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:25:49.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.481164+0000","last_change":"2024-05-27T09:43:48.836000+0000","last_active":"2024-05-27T09:47:45.481164+0000","last_peered":"2024-05-27T09:47:45.481164+0000","last_clean":"2024-05-27T09:47:45.481164+0000","last_became_active":"2024-05-27T09:43:48.835620+0000","last_became_peered":"2024-05-27T09:43:48.835620+0000","last_unstale":"2024-05-27T09:47:45.481164+0000","last_undegraded":"2024-05-27T09:47:45.481164+0000","last_fullsized":"2024-05-27T09:47:45.481164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:44.356548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568259+0000","last_change":"2024-05-27T09:43:48.826439+0000","last_active":"2024-05-27T09:47:45.568259+0000","last_peered":"2024-05-27T09:47:45.568259+0000","last_clean":"2024-05-27T09:47:45.568259+0000","last_became_active":"2024-05-27T09:43:48.826024+0000","last_became_peered":"2024-05-27T09:43:48.826024+0000","last_unstale":"2024-05-27T09:47:45.568259+0000","last_undegraded":"2024-05-27T09:47:45.568259+0000","last_fullsized":"2024-05-27T09:47:45.568259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:18.993207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:48.821499+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:48.820585+0000","last_became_peered":"2024-05-27T09:43:48.820585+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:22:13.243031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569551+0000","last_change":"2024-05-27T09:43:48.823013+0000","last_active":"2024-05-27T09:47:45.569551+0000","last_peered":"2024-05-27T09:47:45.569551+0000","last_clean":"2024-05-27T09:47:45.569551+0000","last_became_active":"2024-05-27T09:43:48.822628+0000","last_became_peered":"2024-05-27T09:43:48.822628+0000","last_unstale":"2024-05-27T09:47:45.569551+0000","last_undegraded":"2024-05-27T09:47:45.569551+0000","last_fullsized":"2024-05-27T09:47:45.569551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:06:33.152796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568159+0000","last_change":"2024-05-27T09:43:48.819670+0000","last_active":"2024-05-27T09:47:45.568159+0000","last_peered":"2024-05-27T09:47:45.568159+0000","last_clean":"2024-05-27T09:47:45.568159+0000","last_became_active":"2024-05-27T09:43:48.819292+0000","last_became_peered":"2024-05-27T09:43:48.819292+0000","last_unstale":"2024-05-27T09:47:45.568159+0000","last_undegraded":"2024-05-27T09:47:45.568159+0000","last_fullsized":"2024-05-27T09:47:45.568159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:54.312462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471674+0000","last_change":"2024-05-27T09:43:48.815864+0000","last_active":"2024-05-27T09:47:45.471674+0000","last_peered":"2024-05-27T09:47:45.471674+0000","last_clean":"2024-05-27T09:47:45.471674+0000","last_became_active":"2024-05-27T09:43:48.813868+0000","last_became_peered":"2024-05-27T09:43:48.813868+0000","last_unstale":"2024-05-27T09:47:45.471674+0000","last_undegraded":"2024-05-27T09:47:45.471674+0000","last_fullsized":"2024-05-27T09:47:45.471674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:03:14.028806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567201+0000","last_change":"2024-05-27T09:43:48.843713+0000","last_active":"2024-05-27T09:47:45.567201+0000","last_peered":"2024-05-27T09:47:45.567201+0000","last_clean":"2024-05-27T09:47:45.567201+0000","last_became_active":"2024-05-27T09:43:48.842572+0000","last_became_peered":"2024-05-27T09:43:48.842572+0000","last_unstale":"2024-05-27T09:47:45.567201+0000","last_undegraded":"2024-05-27T09:47:45.567201+0000","last_fullsized":"2024-05-27T09:47:45.567201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:02:22.762471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566981+0000","last_change":"2024-05-27T09:43:48.843081+0000","last_active":"2024-05-27T09:47:45.566981+0000","last_peered":"2024-05-27T09:47:45.566981+0000","last_clean":"2024-05-27T09:47:45.566981+0000","last_became_active":"2024-05-27T09:43:48.840246+0000","last_became_peered":"2024-05-27T09:43:48.840246+0000","last_unstale":"2024-05-27T09:47:45.566981+0000","last_undegraded":"2024-05-27T09:47:45.566981+0000","last_fullsized":"2024-05-27T09:47:45.566981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:45:07.884360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:43:48.834815+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:43:48.834401+0000","last_became_peered":"2024-05-27T09:43:48.834401+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:33.447035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567513+0000","last_change":"2024-05-27T09:43:48.844820+0000","last_active":"2024-05-27T09:47:45.567513+0000","last_peered":"2024-05-27T09:47:45.567513+0000","last_clean":"2024-05-27T09:47:45.567513+0000","last_became_active":"2024-05-27T09:43:48.844456+0000","last_became_peered":"2024-05-27T09:43:48.844456+0000","last_unstale":"2024-05-27T09:47:45.567513+0000","last_undegraded":"2024-05-27T09:47:45.567513+0000","last_fullsized":"2024-05-27T09:47:45.567513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:40.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568602+0000","last_change":"2024-05-27T09:43:48.828822+0000","last_active":"2024-05-27T09:47:45.568602+0000","last_peered":"2024-05-27T09:47:45.568602+0000","last_clean":"2024-05-27T09:47:45.568602+0000","last_became_active":"2024-05-27T09:43:48.827449+0000","last_became_peered":"2024-05-27T09:43:48.827449+0000","last_unstale":"2024-05-27T09:47:45.568602+0000","last_undegraded":"2024-05-27T09:47:45.568602+0000","last_fullsized":"2024-05-27T09:47:45.568602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:18:41.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567617+0000","last_change":"2024-05-27T09:43:48.833598+0000","last_active":"2024-05-27T09:47:45.567617+0000","last_peered":"2024-05-27T09:47:45.567617+0000","last_clean":"2024-05-27T09:47:45.567617+0000","last_became_active":"2024-05-27T09:43:48.833179+0000","last_became_peered":"2024-05-27T09:43:48.833179+0000","last_unstale":"2024-05-27T09:47:45.567617+0000","last_undegraded":"2024-05-27T09:47:45.567617+0000","last_fullsized":"2024-05-27T09:47:45.567617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:58.744582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:51.519668+0000","last_change":"2024-05-27T09:43:43.745561+0000","last_active":"2024-05-27T09:47:51.519668+0000","last_peered":"2024-05-27T09:47:51.519668+0000","last_clean":"2024-05-27T09:47:51.519668+0000","last_became_active":"2024-05-27T09:43:43.744552+0000","last_became_peered":"2024-05-27T09:43:43.744552+0000","last_unstale":"2024-05-27T09:47:51.519668+0000","last_undegraded":"2024-05-27T09:47:51.519668+0000","last_fullsized":"2024-05-27T09:47:51.519668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:28:50.682647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485814+0000","last_change":"2024-05-27T09:43:48.837208+0000","last_active":"2024-05-27T09:47:45.485814+0000","last_peered":"2024-05-27T09:47:45.485814+0000","last_clean":"2024-05-27T09:47:45.485814+0000","last_became_active":"2024-05-27T09:43:48.836881+0000","last_became_peered":"2024-05-27T09:43:48.836881+0000","last_unstale":"2024-05-27T09:47:45.485814+0000","last_undegraded":"2024-05-27T09:47:45.485814+0000","last_fullsized":"2024-05-27T09:47:45.485814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:44.471297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486083+0000","last_change":"2024-05-27T09:43:43.921604+0000","last_active":"2024-05-27T09:47:45.486083+0000","last_peered":"2024-05-27T09:47:45.486083+0000","last_clean":"2024-05-27T09:47:45.486083+0000","last_became_active":"2024-05-27T09:43:43.921172+0000","last_became_peered":"2024-05-27T09:43:43.921172+0000","last_unstale":"2024-05-27T09:47:45.486083+0000","last_undegraded":"2024-05-27T09:47:45.486083+0000","last_fullsized":"2024-05-27T09:47:45.486083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:50:20.828572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568379+0000","last_change":"2024-05-27T09:43:48.842300+0000","last_active":"2024-05-27T09:47:45.568379+0000","last_peered":"2024-05-27T09:47:45.568379+0000","last_clean":"2024-05-27T09:47:45.568379+0000","last_became_active":"2024-05-27T09:43:48.838180+0000","last_became_peered":"2024-05-27T09:43:48.838180+0000","last_unstale":"2024-05-27T09:47:45.568379+0000","last_undegraded":"2024-05-27T09:47:45.568379+0000","last_fullsized":"2024-05-27T09:47:45.568379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:48:33.960214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612112+0000","last_change":"2024-05-27T09:43:43.746677+0000","last_active":"2024-05-27T09:47:45.612112+0000","last_peered":"2024-05-27T09:47:45.612112+0000","last_clean":"2024-05-27T09:47:45.612112+0000","last_became_active":"2024-05-27T09:43:43.746271+0000","last_became_peered":"2024-05-27T09:43:43.746271+0000","last_unstale":"2024-05-27T09:47:45.612112+0000","last_undegraded":"2024-05-27T09:47:45.612112+0000","last_fullsized":"2024-05-27T09:47:45.612112+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:16:02.496479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567678+0000","last_change":"2024-05-27T09:43:48.824248+0000","last_active":"2024-05-27T09:47:45.567678+0000","last_peered":"2024-05-27T09:47:45.567678+0000","last_clean":"2024-05-27T09:47:45.567678+0000","last_became_active":"2024-05-27T09:43:48.823837+0000","last_became_peered":"2024-05-27T09:43:48.823837+0000","last_unstale":"2024-05-27T09:47:45.567678+0000","last_undegraded":"2024-05-27T09:47:45.567678+0000","last_fullsized":"2024-05-27T09:47:45.567678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:13.759781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611921+0000","last_change":"2024-05-27T09:43:43.744526+0000","last_active":"2024-05-27T09:47:45.611921+0000","last_peered":"2024-05-27T09:47:45.611921+0000","last_clean":"2024-05-27T09:47:45.611921+0000","last_became_active":"2024-05-27T09:43:43.744147+0000","last_became_peered":"2024-05-27T09:43:43.744147+0000","last_unstale":"2024-05-27T09:47:45.611921+0000","last_undegraded":"2024-05-27T09:47:45.611921+0000","last_fullsized":"2024-05-27T09:47:45.611921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:53.975831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471350+0000","last_change":"2024-05-27T09:43:48.823878+0000","last_active":"2024-05-27T09:47:45.471350+0000","last_peered":"2024-05-27T09:47:45.471350+0000","last_clean":"2024-05-27T09:47:45.471350+0000","last_became_active":"2024-05-27T09:43:48.823502+0000","last_became_peered":"2024-05-27T09:43:48.823502+0000","last_unstale":"2024-05-27T09:47:45.471350+0000","last_undegraded":"2024-05-27T09:47:45.471350+0000","last_fullsized":"2024-05-27T09:47:45.471350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:43:03.572463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":284,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:14.728713+0000","last_change":"2024-05-27T09:43:43.747253+0000","last_active":"2024-05-27T09:48:14.728713+0000","last_peered":"2024-05-27T09:48:14.728713+0000","last_clean":"2024-05-27T09:48:14.728713+0000","last_became_active":"2024-05-27T09:43:43.746826+0000","last_became_peered":"2024-05-27T09:43:43.746826+0000","last_unstale":"2024-05-27T09:48:14.728713+0000","last_undegraded":"2024-05-27T09:48:14.728713+0000","last_fullsized":"2024-05-27T09:48:14.728713+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:39:25.106865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611693+0000","last_change":"2024-05-27T09:43:48.832148+0000","last_active":"2024-05-27T09:47:45.611693+0000","last_peered":"2024-05-27T09:47:45.611693+0000","last_clean":"2024-05-27T09:47:45.611693+0000","last_became_active":"2024-05-27T09:43:48.831715+0000","last_became_peered":"2024-05-27T09:43:48.831715+0000","last_unstale":"2024-05-27T09:47:45.611693+0000","last_undegraded":"2024-05-27T09:47:45.611693+0000","last_fullsized":"2024-05-27T09:47:45.611693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:28:35.351905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569225+0000","last_change":"2024-05-27T09:43:43.752234+0000","last_active":"2024-05-27T09:47:45.569225+0000","last_peered":"2024-05-27T09:47:45.569225+0000","last_clean":"2024-05-27T09:47:45.569225+0000","last_became_active":"2024-05-27T09:43:43.751850+0000","last_became_peered":"2024-05-27T09:43:43.751850+0000","last_unstale":"2024-05-27T09:47:45.569225+0000","last_undegraded":"2024-05-27T09:47:45.569225+0000","last_fullsized":"2024-05-27T09:47:45.569225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:47:55.121545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471089+0000","last_change":"2024-05-27T09:43:48.830941+0000","last_active":"2024-05-27T09:47:45.471089+0000","last_peered":"2024-05-27T09:47:45.471089+0000","last_clean":"2024-05-27T09:47:45.471089+0000","last_became_active":"2024-05-27T09:43:48.830536+0000","last_became_peered":"2024-05-27T09:43:48.830536+0000","last_unstale":"2024-05-27T09:47:45.471089+0000","last_undegraded":"2024-05-27T09:47:45.471089+0000","last_fullsized":"2024-05-27T09:47:45.471089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:30:06.654867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472110+0000","last_change":"2024-05-27T09:43:43.752196+0000","last_active":"2024-05-27T09:47:45.472110+0000","last_peered":"2024-05-27T09:47:45.472110+0000","last_clean":"2024-05-27T09:47:45.472110+0000","last_became_active":"2024-05-27T09:43:43.749029+0000","last_became_peered":"2024-05-27T09:43:43.749029+0000","last_unstale":"2024-05-27T09:47:45.472110+0000","last_undegraded":"2024-05-27T09:47:45.472110+0000","last_fullsized":"2024-05-27T09:47:45.472110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:49.856694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.479557+0000","last_change":"2024-05-27T09:43:48.835018+0000","last_active":"2024-05-27T09:47:45.479557+0000","last_peered":"2024-05-27T09:47:45.479557+0000","last_clean":"2024-05-27T09:47:45.479557+0000","last_became_active":"2024-05-27T09:43:48.834545+0000","last_became_peered":"2024-05-27T09:43:48.834545+0000","last_unstale":"2024-05-27T09:47:45.479557+0000","last_undegraded":"2024-05-27T09:47:45.479557+0000","last_fullsized":"2024-05-27T09:47:45.479557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:58:33.359732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470992+0000","last_change":"2024-05-27T09:43:43.744309+0000","last_active":"2024-05-27T09:47:45.470992+0000","last_peered":"2024-05-27T09:47:45.470992+0000","last_clean":"2024-05-27T09:47:45.470992+0000","last_became_active":"2024-05-27T09:43:43.743918+0000","last_became_peered":"2024-05-27T09:43:43.743918+0000","last_unstale":"2024-05-27T09:47:45.470992+0000","last_undegraded":"2024-05-27T09:47:45.470992+0000","last_fullsized":"2024-05-27T09:47:45.470992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:54.737893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567594+0000","last_change":"2024-05-27T09:43:48.842212+0000","last_active":"2024-05-27T09:47:45.567594+0000","last_peered":"2024-05-27T09:47:45.567594+0000","last_clean":"2024-05-27T09:47:45.567594+0000","last_became_active":"2024-05-27T09:43:48.840678+0000","last_became_peered":"2024-05-27T09:43:48.840678+0000","last_unstale":"2024-05-27T09:47:45.567594+0000","last_undegraded":"2024-05-27T09:47:45.567594+0000","last_fullsized":"2024-05-27T09:47:45.567594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:34:24.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":278,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:14.728102+0000","last_change":"2024-05-27T09:43:43.745848+0000","last_active":"2024-05-27T09:48:14.728102+0000","last_peered":"2024-05-27T09:48:14.728102+0000","last_clean":"2024-05-27T09:48:14.728102+0000","last_became_active":"2024-05-27T09:43:43.745444+0000","last_became_peered":"2024-05-27T09:43:43.745444+0000","last_unstale":"2024-05-27T09:48:14.728102+0000","last_undegraded":"2024-05-27T09:48:14.728102+0000","last_fullsized":"2024-05-27T09:48:14.728102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:27:03.621796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":245,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568053+0000","last_change":"2024-05-27T09:43:48.828126+0000","last_active":"2024-05-27T09:47:45.568053+0000","last_peered":"2024-05-27T09:47:45.568053+0000","last_clean":"2024-05-27T09:47:45.568053+0000","last_became_active":"2024-05-27T09:43:48.827672+0000","last_became_peered":"2024-05-27T09:43:48.827672+0000","last_unstale":"2024-05-27T09:47:45.568053+0000","last_undegraded":"2024-05-27T09:47:45.568053+0000","last_fullsized":"2024-05-27T09:47:45.568053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:52:21.113795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569720+0000","last_change":"2024-05-27T09:43:43.746764+0000","last_active":"2024-05-27T09:47:45.569720+0000","last_peered":"2024-05-27T09:47:45.569720+0000","last_clean":"2024-05-27T09:47:45.569720+0000","last_became_active":"2024-05-27T09:43:43.746202+0000","last_became_peered":"2024-05-27T09:43:43.746202+0000","last_unstale":"2024-05-27T09:47:45.569720+0000","last_undegraded":"2024-05-27T09:47:45.569720+0000","last_fullsized":"2024-05-27T09:47:45.569720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:43:27.368364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568263+0000","last_change":"2024-05-27T09:44:24.515777+0000","last_active":"2024-05-27T09:47:45.568263+0000","last_peered":"2024-05-27T09:47:45.568263+0000","last_clean":"2024-05-27T09:47:45.568263+0000","last_became_active":"2024-05-27T09:44:24.515302+0000","last_became_peered":"2024-05-27T09:44:24.515302+0000","last_unstale":"2024-05-27T09:47:45.568263+0000","last_undegraded":"2024-05-27T09:47:45.568263+0000","last_fullsized":"2024-05-27T09:47:45.568263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:13.186778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471453+0000","last_change":"2024-05-27T09:43:43.924458+0000","last_active":"2024-05-27T09:47:45.471453+0000","last_peered":"2024-05-27T09:47:45.471453+0000","last_clean":"2024-05-27T09:47:45.471453+0000","last_became_active":"2024-05-27T09:43:43.924046+0000","last_became_peered":"2024-05-27T09:43:43.924046+0000","last_unstale":"2024-05-27T09:47:45.471453+0000","last_undegraded":"2024-05-27T09:47:45.471453+0000","last_fullsized":"2024-05-27T09:47:45.471453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:07.790457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567808+0000","last_change":"2024-05-27T09:43:48.820655+0000","last_active":"2024-05-27T09:47:45.567808+0000","last_peered":"2024-05-27T09:47:45.567808+0000","last_clean":"2024-05-27T09:47:45.567808+0000","last_became_active":"2024-05-27T09:43:48.818637+0000","last_became_peered":"2024-05-27T09:43:48.818637+0000","last_unstale":"2024-05-27T09:47:45.567808+0000","last_undegraded":"2024-05-27T09:47:45.567808+0000","last_fullsized":"2024-05-27T09:47:45.567808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:34.221064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'42","reported_seq":577,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:15.885431+0000","last_change":"2024-05-27T09:43:43.746732+0000","last_active":"2024-05-27T09:48:15.885431+0000","last_peered":"2024-05-27T09:48:15.885431+0000","last_clean":"2024-05-27T09:48:15.885431+0000","last_became_active":"2024-05-27T09:43:43.746264+0000","last_became_peered":"2024-05-27T09:43:43.746264+0000","last_unstale":"2024-05-27T09:48:15.885431+0000","last_undegraded":"2024-05-27T09:48:15.885431+0000","last_fullsized":"2024-05-27T09:48:15.885431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:54:43.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75541,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":328,"num_write":43,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611862+0000","last_change":"2024-05-27T09:43:48.817011+0000","last_active":"2024-05-27T09:47:45.611862+0000","last_peered":"2024-05-27T09:47:45.611862+0000","last_clean":"2024-05-27T09:47:45.611862+0000","last_became_active":"2024-05-27T09:43:48.816587+0000","last_became_peered":"2024-05-27T09:43:48.816587+0000","last_unstale":"2024-05-27T09:47:45.611862+0000","last_undegraded":"2024-05-27T09:47:45.611862+0000","last_fullsized":"2024-05-27T09:47:45.611862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:39:03.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567350+0000","last_change":"2024-05-27T09:43:43.748891+0000","last_active":"2024-05-27T09:47:45.567350+0000","last_peered":"2024-05-27T09:47:45.567350+0000","last_clean":"2024-05-27T09:47:45.567350+0000","last_became_active":"2024-05-27T09:43:43.748502+0000","last_became_peered":"2024-05-27T09:43:43.748502+0000","last_unstale":"2024-05-27T09:47:45.567350+0000","last_undegraded":"2024-05-27T09:47:45.567350+0000","last_fullsized":"2024-05-27T09:47:45.567350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:21:39.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471788+0000","last_change":"2024-05-27T09:43:48.831184+0000","last_active":"2024-05-27T09:47:45.471788+0000","last_peered":"2024-05-27T09:47:45.471788+0000","last_clean":"2024-05-27T09:47:45.471788+0000","last_became_active":"2024-05-27T09:43:48.830717+0000","last_became_peered":"2024-05-27T09:43:48.830717+0000","last_unstale":"2024-05-27T09:47:45.471788+0000","last_undegraded":"2024-05-27T09:47:45.471788+0000","last_fullsized":"2024-05-27T09:47:45.471788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:19:45.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470915+0000","last_change":"2024-05-27T09:43:43.748249+0000","last_active":"2024-05-27T09:47:45.470915+0000","last_peered":"2024-05-27T09:47:45.470915+0000","last_clean":"2024-05-27T09:47:45.470915+0000","last_became_active":"2024-05-27T09:43:43.747860+0000","last_became_peered":"2024-05-27T09:43:43.747860+0000","last_unstale":"2024-05-27T09:47:45.470915+0000","last_undegraded":"2024-05-27T09:47:45.470915+0000","last_fullsized":"2024-05-27T09:47:45.470915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:14.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569506+0000","last_change":"2024-05-27T09:43:48.836164+0000","last_active":"2024-05-27T09:47:45.569506+0000","last_peered":"2024-05-27T09:47:45.569506+0000","last_clean":"2024-05-27T09:47:45.569506+0000","last_became_active":"2024-05-27T09:43:48.835757+0000","last_became_peered":"2024-05-27T09:43:48.835757+0000","last_unstale":"2024-05-27T09:47:45.569506+0000","last_undegraded":"2024-05-27T09:47:45.569506+0000","last_fullsized":"2024-05-27T09:47:45.569506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:55:34.936424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":287,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:14.835984+0000","last_change":"2024-05-27T09:43:43.745069+0000","last_active":"2024-05-27T09:48:14.835984+0000","last_peered":"2024-05-27T09:48:14.835984+0000","last_clean":"2024-05-27T09:48:14.835984+0000","last_became_active":"2024-05-27T09:43:43.744017+0000","last_became_peered":"2024-05-27T09:43:43.744017+0000","last_unstale":"2024-05-27T09:48:14.835984+0000","last_undegraded":"2024-05-27T09:48:14.835984+0000","last_fullsized":"2024-05-27T09:48:14.835984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:43:35.756312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":251,"num_read_kb":7,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567266+0000","last_change":"2024-05-27T09:44:24.378006+0000","last_active":"2024-05-27T09:47:45.567266+0000","last_peered":"2024-05-27T09:47:45.567266+0000","last_clean":"2024-05-27T09:47:45.567266+0000","last_became_active":"2024-05-27T09:44:24.377521+0000","last_became_peered":"2024-05-27T09:44:24.377521+0000","last_unstale":"2024-05-27T09:47:45.567266+0000","last_undegraded":"2024-05-27T09:47:45.567266+0000","last_fullsized":"2024-05-27T09:47:45.567266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:45:55.715870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566845+0000","last_change":"2024-05-27T09:44:24.388286+0000","last_active":"2024-05-27T09:47:45.566845+0000","last_peered":"2024-05-27T09:47:45.566845+0000","last_clean":"2024-05-27T09:47:45.566845+0000","last_became_active":"2024-05-27T09:44:24.373435+0000","last_became_peered":"2024-05-27T09:44:24.373435+0000","last_unstale":"2024-05-27T09:47:45.566845+0000","last_undegraded":"2024-05-27T09:47:45.566845+0000","last_fullsized":"2024-05-27T09:47:45.566845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:14.673200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.470885+0000","last_change":"2024-05-27T09:43:48.822664+0000","last_active":"2024-05-27T09:47:45.470885+0000","last_peered":"2024-05-27T09:47:45.470885+0000","last_clean":"2024-05-27T09:47:45.470885+0000","last_became_active":"2024-05-27T09:43:48.822151+0000","last_became_peered":"2024-05-27T09:43:48.822151+0000","last_unstale":"2024-05-27T09:47:45.470885+0000","last_undegraded":"2024-05-27T09:47:45.470885+0000","last_fullsized":"2024-05-27T09:47:45.470885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:26:13.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:46.306120+0000","last_change":"2024-05-27T09:43:43.743494+0000","last_active":"2024-05-27T09:47:46.306120+0000","last_peered":"2024-05-27T09:47:46.306120+0000","last_clean":"2024-05-27T09:47:46.306120+0000","last_became_active":"2024-05-27T09:43:43.743114+0000","last_became_peered":"2024-05-27T09:43:43.743114+0000","last_unstale":"2024-05-27T09:47:46.306120+0000","last_undegraded":"2024-05-27T09:47:46.306120+0000","last_fullsized":"2024-05-27T09:47:46.306120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:34:18.559661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567195+0000","last_change":"2024-05-27T09:43:48.824869+0000","last_active":"2024-05-27T09:47:45.567195+0000","last_peered":"2024-05-27T09:47:45.567195+0000","last_clean":"2024-05-27T09:47:45.567195+0000","last_became_active":"2024-05-27T09:43:48.824488+0000","last_became_peered":"2024-05-27T09:43:48.824488+0000","last_unstale":"2024-05-27T09:47:45.567195+0000","last_undegraded":"2024-05-27T09:47:45.567195+0000","last_fullsized":"2024-05-27T09:47:45.567195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:13.736876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568365+0000","last_change":"2024-05-27T09:43:43.921742+0000","last_active":"2024-05-27T09:47:45.568365+0000","last_peered":"2024-05-27T09:47:45.568365+0000","last_clean":"2024-05-27T09:47:45.568365+0000","last_became_active":"2024-05-27T09:43:43.919833+0000","last_became_peered":"2024-05-27T09:43:43.919833+0000","last_unstale":"2024-05-27T09:47:45.568365+0000","last_undegraded":"2024-05-27T09:47:45.568365+0000","last_fullsized":"2024-05-27T09:47:45.568365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:09:52.732435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568972+0000","last_change":"2024-05-27T09:43:48.838281+0000","last_active":"2024-05-27T09:47:45.568972+0000","last_peered":"2024-05-27T09:47:45.568972+0000","last_clean":"2024-05-27T09:47:45.568972+0000","last_became_active":"2024-05-27T09:43:48.837888+0000","last_became_peered":"2024-05-27T09:43:48.837888+0000","last_unstale":"2024-05-27T09:47:45.568972+0000","last_undegraded":"2024-05-27T09:47:45.568972+0000","last_fullsized":"2024-05-27T09:47:45.568972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:57:47.912869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569085+0000","last_change":"2024-05-27T09:43:43.749037+0000","last_active":"2024-05-27T09:47:45.569085+0000","last_peered":"2024-05-27T09:47:45.569085+0000","last_clean":"2024-05-27T09:47:45.569085+0000","last_became_active":"2024-05-27T09:43:43.748450+0000","last_became_peered":"2024-05-27T09:43:43.748450+0000","last_unstale":"2024-05-27T09:47:45.569085+0000","last_undegraded":"2024-05-27T09:47:45.569085+0000","last_fullsized":"2024-05-27T09:47:45.569085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:45.626825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568901+0000","last_change":"2024-05-27T09:44:24.377606+0000","last_active":"2024-05-27T09:47:45.568901+0000","last_peered":"2024-05-27T09:47:45.568901+0000","last_clean":"2024-05-27T09:47:45.568901+0000","last_became_active":"2024-05-27T09:44:24.377066+0000","last_became_peered":"2024-05-27T09:44:24.377066+0000","last_unstale":"2024-05-27T09:47:45.568901+0000","last_undegraded":"2024-05-27T09:47:45.568901+0000","last_fullsized":"2024-05-27T09:47:45.568901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:35.400645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471385+0000","last_change":"2024-05-27T09:43:48.820666+0000","last_active":"2024-05-27T09:47:45.471385+0000","last_peered":"2024-05-27T09:47:45.471385+0000","last_clean":"2024-05-27T09:47:45.471385+0000","last_became_active":"2024-05-27T09:43:48.820085+0000","last_became_peered":"2024-05-27T09:43:48.820085+0000","last_unstale":"2024-05-27T09:47:45.471385+0000","last_undegraded":"2024-05-27T09:47:45.471385+0000","last_fullsized":"2024-05-27T09:47:45.471385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:46:02.057871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":281,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:14.835204+0000","last_change":"2024-05-27T09:43:43.927774+0000","last_active":"2024-05-27T09:48:14.835204+0000","last_peered":"2024-05-27T09:48:14.835204+0000","last_clean":"2024-05-27T09:48:14.835204+0000","last_became_active":"2024-05-27T09:43:43.924138+0000","last_became_peered":"2024-05-27T09:43:43.924138+0000","last_unstale":"2024-05-27T09:48:14.835204+0000","last_undegraded":"2024-05-27T09:48:14.835204+0000","last_fullsized":"2024-05-27T09:48:14.835204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:22.232528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":245,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567538+0000","last_change":"2024-05-27T09:44:24.516278+0000","last_active":"2024-05-27T09:47:45.567538+0000","last_peered":"2024-05-27T09:47:45.567538+0000","last_clean":"2024-05-27T09:47:45.567538+0000","last_became_active":"2024-05-27T09:44:24.515739+0000","last_became_peered":"2024-05-27T09:44:24.515739+0000","last_unstale":"2024-05-27T09:47:45.567538+0000","last_undegraded":"2024-05-27T09:47:45.567538+0000","last_fullsized":"2024-05-27T09:47:45.567538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:55:59.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567813+0000","last_change":"2024-05-27T09:43:43.754114+0000","last_active":"2024-05-27T09:47:45.567813+0000","last_peered":"2024-05-27T09:47:45.567813+0000","last_clean":"2024-05-27T09:47:45.567813+0000","last_became_active":"2024-05-27T09:43:43.753725+0000","last_became_peered":"2024-05-27T09:43:43.753725+0000","last_unstale":"2024-05-27T09:47:45.567813+0000","last_undegraded":"2024-05-27T09:47:45.567813+0000","last_fullsized":"2024-05-27T09:47:45.567813+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:52:55.510054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"84'99","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:47.624529+0000","last_change":"2024-05-27T09:42:09.328319+0000","last_active":"2024-05-27T09:47:47.624529+0000","last_peered":"2024-05-27T09:47:47.624529+0000","last_clean":"2024-05-27T09:47:47.624529+0000","last_became_active":"2024-05-27T09:42:09.322585+0000","last_became_peered":"2024-05-27T09:42:09.322585+0000","last_unstale":"2024-05-27T09:47:47.624529+0000","last_undegraded":"2024-05-27T09:47:47.624529+0000","last_fullsized":"2024-05-27T09:47:47.624529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:38:13.633363+0000","last_clean_scrub_stamp":"2024-05-27T09:38:13.633363+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:05:26.766389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472229+0000","last_change":"2024-05-27T09:43:48.823872+0000","last_active":"2024-05-27T09:47:45.472229+0000","last_peered":"2024-05-27T09:47:45.472229+0000","last_clean":"2024-05-27T09:47:45.472229+0000","last_became_active":"2024-05-27T09:43:48.823452+0000","last_became_peered":"2024-05-27T09:43:48.823452+0000","last_unstale":"2024-05-27T09:47:45.472229+0000","last_undegraded":"2024-05-27T09:47:45.472229+0000","last_fullsized":"2024-05-27T09:47:45.472229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:10:03.460977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568413+0000","last_change":"2024-05-27T09:43:43.744787+0000","last_active":"2024-05-27T09:47:45.568413+0000","last_peered":"2024-05-27T09:47:45.568413+0000","last_clean":"2024-05-27T09:47:45.568413+0000","last_became_active":"2024-05-27T09:43:43.744387+0000","last_became_peered":"2024-05-27T09:43:43.744387+0000","last_unstale":"2024-05-27T09:47:45.568413+0000","last_undegraded":"2024-05-27T09:47:45.568413+0000","last_fullsized":"2024-05-27T09:47:45.568413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:34.374111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.612093+0000","last_change":"2024-05-27T09:43:43.924371+0000","last_active":"2024-05-27T09:47:45.612093+0000","last_peered":"2024-05-27T09:47:45.612093+0000","last_clean":"2024-05-27T09:47:45.612093+0000","last_became_active":"2024-05-27T09:43:43.923902+0000","last_became_peered":"2024-05-27T09:43:43.923902+0000","last_unstale":"2024-05-27T09:47:45.612093+0000","last_undegraded":"2024-05-27T09:47:45.612093+0000","last_fullsized":"2024-05-27T09:47:45.612093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:14.643601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472487+0000","last_change":"2024-05-27T09:43:48.829634+0000","last_active":"2024-05-27T09:47:45.472487+0000","last_peered":"2024-05-27T09:47:45.472487+0000","last_clean":"2024-05-27T09:47:45.472487+0000","last_became_active":"2024-05-27T09:43:48.827987+0000","last_became_peered":"2024-05-27T09:43:48.827987+0000","last_unstale":"2024-05-27T09:47:45.472487+0000","last_undegraded":"2024-05-27T09:47:45.472487+0000","last_fullsized":"2024-05-27T09:47:45.472487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:47:19.256998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'102","reported_seq":224,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:06.322981+0000","last_change":"2024-05-27T09:43:43.754190+0000","last_active":"2024-05-27T09:48:06.322981+0000","last_peered":"2024-05-27T09:48:06.322981+0000","last_clean":"2024-05-27T09:48:06.322981+0000","last_became_active":"2024-05-27T09:43:43.753682+0000","last_became_peered":"2024-05-27T09:43:43.753682+0000","last_unstale":"2024-05-27T09:48:06.322981+0000","last_undegraded":"2024-05-27T09:48:06.322981+0000","last_fullsized":"2024-05-27T09:48:06.322981+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:44:27.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486325+0000","last_change":"2024-05-27T09:43:48.840359+0000","last_active":"2024-05-27T09:47:45.486325+0000","last_peered":"2024-05-27T09:47:45.486325+0000","last_clean":"2024-05-27T09:47:45.486325+0000","last_became_active":"2024-05-27T09:43:48.838094+0000","last_became_peered":"2024-05-27T09:43:48.838094+0000","last_unstale":"2024-05-27T09:47:45.486325+0000","last_undegraded":"2024-05-27T09:47:45.486325+0000","last_fullsized":"2024-05-27T09:47:45.486325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:58.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569159+0000","last_change":"2024-05-27T09:43:43.782654+0000","last_active":"2024-05-27T09:47:45.569159+0000","last_peered":"2024-05-27T09:47:45.569159+0000","last_clean":"2024-05-27T09:47:45.569159+0000","last_became_active":"2024-05-27T09:43:43.782356+0000","last_became_peered":"2024-05-27T09:43:43.782356+0000","last_unstale":"2024-05-27T09:47:45.569159+0000","last_undegraded":"2024-05-27T09:47:45.569159+0000","last_fullsized":"2024-05-27T09:47:45.569159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:45:23.187166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.568134+0000","last_change":"2024-05-27T09:44:24.378797+0000","last_active":"2024-05-27T09:47:45.568134+0000","last_peered":"2024-05-27T09:47:45.568134+0000","last_clean":"2024-05-27T09:47:45.568134+0000","last_became_active":"2024-05-27T09:44:24.377380+0000","last_became_peered":"2024-05-27T09:44:24.377380+0000","last_unstale":"2024-05-27T09:47:45.568134+0000","last_undegraded":"2024-05-27T09:47:45.568134+0000","last_fullsized":"2024-05-27T09:47:45.568134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:24.511817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567527+0000","last_change":"2024-05-27T09:43:43.917452+0000","last_active":"2024-05-27T09:47:45.567527+0000","last_peered":"2024-05-27T09:47:45.567527+0000","last_clean":"2024-05-27T09:47:45.567527+0000","last_became_active":"2024-05-27T09:43:43.917076+0000","last_became_peered":"2024-05-27T09:43:43.917076+0000","last_unstale":"2024-05-27T09:47:45.567527+0000","last_undegraded":"2024-05-27T09:47:45.567527+0000","last_fullsized":"2024-05-27T09:47:45.567527+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:57:31.440556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611711+0000","last_change":"2024-05-27T09:43:48.815657+0000","last_active":"2024-05-27T09:47:45.611711+0000","last_peered":"2024-05-27T09:47:45.611711+0000","last_clean":"2024-05-27T09:47:45.611711+0000","last_became_active":"2024-05-27T09:43:48.815271+0000","last_became_peered":"2024-05-27T09:43:48.815271+0000","last_unstale":"2024-05-27T09:47:45.611711+0000","last_undegraded":"2024-05-27T09:47:45.611711+0000","last_fullsized":"2024-05-27T09:47:45.611711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:18:18.657989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483699+0000","last_change":"2024-05-27T09:43:43.754867+0000","last_active":"2024-05-27T09:47:45.483699+0000","last_peered":"2024-05-27T09:47:45.483699+0000","last_clean":"2024-05-27T09:47:45.483699+0000","last_became_active":"2024-05-27T09:43:43.754348+0000","last_became_peered":"2024-05-27T09:43:43.754348+0000","last_unstale":"2024-05-27T09:47:45.483699+0000","last_undegraded":"2024-05-27T09:47:45.483699+0000","last_fullsized":"2024-05-27T09:47:45.483699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:46:29.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566963+0000","last_change":"2024-05-27T09:43:48.829742+0000","last_active":"2024-05-27T09:47:45.566963+0000","last_peered":"2024-05-27T09:47:45.566963+0000","last_clean":"2024-05-27T09:47:45.566963+0000","last_became_active":"2024-05-27T09:43:48.828851+0000","last_became_peered":"2024-05-27T09:43:48.828851+0000","last_unstale":"2024-05-27T09:47:45.566963+0000","last_undegraded":"2024-05-27T09:47:45.566963+0000","last_fullsized":"2024-05-27T09:47:45.566963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:38:46.133753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566936+0000","last_change":"2024-05-27T09:44:24.376271+0000","last_active":"2024-05-27T09:47:45.566936+0000","last_peered":"2024-05-27T09:47:45.566936+0000","last_clean":"2024-05-27T09:47:45.566936+0000","last_became_active":"2024-05-27T09:44:24.372762+0000","last_became_peered":"2024-05-27T09:44:24.372762+0000","last_unstale":"2024-05-27T09:47:45.566936+0000","last_undegraded":"2024-05-27T09:47:45.566936+0000","last_fullsized":"2024-05-27T09:47:45.566936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:28:47.604075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.485069+0000","last_change":"2024-05-27T09:43:48.842547+0000","last_active":"2024-05-27T09:47:45.485069+0000","last_peered":"2024-05-27T09:47:45.485069+0000","last_clean":"2024-05-27T09:47:45.485069+0000","last_became_active":"2024-05-27T09:43:48.842210+0000","last_became_peered":"2024-05-27T09:43:48.842210+0000","last_unstale":"2024-05-27T09:47:45.485069+0000","last_undegraded":"2024-05-27T09:47:45.485069+0000","last_fullsized":"2024-05-27T09:47:45.485069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:40:16.634573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.611810+0000","last_change":"2024-05-27T09:43:43.748006+0000","last_active":"2024-05-27T09:47:45.611810+0000","last_peered":"2024-05-27T09:47:45.611810+0000","last_clean":"2024-05-27T09:47:45.611810+0000","last_became_active":"2024-05-27T09:43:43.747628+0000","last_became_peered":"2024-05-27T09:43:43.747628+0000","last_unstale":"2024-05-27T09:47:45.611810+0000","last_undegraded":"2024-05-27T09:47:45.611810+0000","last_fullsized":"2024-05-27T09:47:45.611810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569246+0000","last_change":"2024-05-27T09:43:48.833172+0000","last_active":"2024-05-27T09:47:45.569246+0000","last_peered":"2024-05-27T09:47:45.569246+0000","last_clean":"2024-05-27T09:47:45.569246+0000","last_became_active":"2024-05-27T09:43:48.832742+0000","last_became_peered":"2024-05-27T09:43:48.832742+0000","last_unstale":"2024-05-27T09:47:45.569246+0000","last_undegraded":"2024-05-27T09:47:45.569246+0000","last_fullsized":"2024-05-27T09:47:45.569246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:04:23.732228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567458+0000","last_change":"2024-05-27T09:43:43.924400+0000","last_active":"2024-05-27T09:47:45.567458+0000","last_peered":"2024-05-27T09:47:45.567458+0000","last_clean":"2024-05-27T09:47:45.567458+0000","last_became_active":"2024-05-27T09:43:43.923998+0000","last_became_peered":"2024-05-27T09:43:43.923998+0000","last_unstale":"2024-05-27T09:47:45.567458+0000","last_undegraded":"2024-05-27T09:47:45.567458+0000","last_fullsized":"2024-05-27T09:47:45.567458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:37.389861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569739+0000","last_change":"2024-05-27T09:43:48.818521+0000","last_active":"2024-05-27T09:47:45.569739+0000","last_peered":"2024-05-27T09:47:45.569739+0000","last_clean":"2024-05-27T09:47:45.569739+0000","last_became_active":"2024-05-27T09:43:48.818171+0000","last_became_peered":"2024-05-27T09:43:48.818171+0000","last_unstale":"2024-05-27T09:47:45.569739+0000","last_undegraded":"2024-05-27T09:47:45.569739+0000","last_fullsized":"2024-05-27T09:47:45.569739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:27.290354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'65","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:48:06.322361+0000","last_change":"2024-05-27T09:43:43.748150+0000","last_active":"2024-05-27T09:48:06.322361+0000","last_peered":"2024-05-27T09:48:06.322361+0000","last_clean":"2024-05-27T09:48:06.322361+0000","last_became_active":"2024-05-27T09:43:43.747582+0000","last_became_peered":"2024-05-27T09:43:43.747582+0000","last_unstale":"2024-05-27T09:48:06.322361+0000","last_undegraded":"2024-05-27T09:48:06.322361+0000","last_fullsized":"2024-05-27T09:48:06.322361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:24:29.433457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569485+0000","last_change":"2024-05-27T09:43:48.830285+0000","last_active":"2024-05-27T09:47:45.569485+0000","last_peered":"2024-05-27T09:47:45.569485+0000","last_clean":"2024-05-27T09:47:45.569485+0000","last_became_active":"2024-05-27T09:43:48.829905+0000","last_became_peered":"2024-05-27T09:43:48.829905+0000","last_unstale":"2024-05-27T09:47:45.569485+0000","last_undegraded":"2024-05-27T09:47:45.569485+0000","last_fullsized":"2024-05-27T09:47:45.569485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:14.156418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471807+0000","last_change":"2024-05-27T09:43:43.749113+0000","last_active":"2024-05-27T09:47:45.471807+0000","last_peered":"2024-05-27T09:47:45.471807+0000","last_clean":"2024-05-27T09:47:45.471807+0000","last_became_active":"2024-05-27T09:43:43.748577+0000","last_became_peered":"2024-05-27T09:43:43.748577+0000","last_unstale":"2024-05-27T09:47:45.471807+0000","last_undegraded":"2024-05-27T09:47:45.471807+0000","last_fullsized":"2024-05-27T09:47:45.471807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:42.714653+0000","last_clean_scrub_stamp":"2024-05-27T09:43:42.714653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:59.979775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.569836+0000","last_change":"2024-05-27T09:43:48.821244+0000","last_active":"2024-05-27T09:47:45.569836+0000","last_peered":"2024-05-27T09:47:45.569836+0000","last_clean":"2024-05-27T09:47:45.569836+0000","last_became_active":"2024-05-27T09:43:48.820768+0000","last_became_peered":"2024-05-27T09:43:48.820768+0000","last_unstale":"2024-05-27T09:47:45.569836+0000","last_undegraded":"2024-05-27T09:47:45.569836+0000","last_fullsized":"2024-05-27T09:47:45.569836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:40:05.423037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567131+0000","last_change":"2024-05-27T09:43:48.824094+0000","last_active":"2024-05-27T09:47:45.567131+0000","last_peered":"2024-05-27T09:47:45.567131+0000","last_clean":"2024-05-27T09:47:45.567131+0000","last_became_active":"2024-05-27T09:43:48.820075+0000","last_became_peered":"2024-05-27T09:43:48.820075+0000","last_unstale":"2024-05-27T09:47:45.567131+0000","last_undegraded":"2024-05-27T09:47:45.567131+0000","last_fullsized":"2024-05-27T09:47:45.567131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:22:49.557785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567636+0000","last_change":"2024-05-27T09:43:48.822599+0000","last_active":"2024-05-27T09:47:45.567636+0000","last_peered":"2024-05-27T09:47:45.567636+0000","last_clean":"2024-05-27T09:47:45.567636+0000","last_became_active":"2024-05-27T09:43:48.822126+0000","last_became_peered":"2024-05-27T09:43:48.822126+0000","last_unstale":"2024-05-27T09:47:45.567636+0000","last_undegraded":"2024-05-27T09:47:45.567636+0000","last_fullsized":"2024-05-27T09:47:45.567636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:38:34.615392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566975+0000","last_change":"2024-05-27T09:43:48.844813+0000","last_active":"2024-05-27T09:47:45.566975+0000","last_peered":"2024-05-27T09:47:45.566975+0000","last_clean":"2024-05-27T09:47:45.566975+0000","last_became_active":"2024-05-27T09:43:48.844430+0000","last_became_peered":"2024-05-27T09:43:48.844430+0000","last_unstale":"2024-05-27T09:47:45.566975+0000","last_undegraded":"2024-05-27T09:47:45.566975+0000","last_fullsized":"2024-05-27T09:47:45.566975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:26:33.858666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567496+0000","last_change":"2024-05-27T09:43:48.844847+0000","last_active":"2024-05-27T09:47:45.567496+0000","last_peered":"2024-05-27T09:47:45.567496+0000","last_clean":"2024-05-27T09:47:45.567496+0000","last_became_active":"2024-05-27T09:43:48.842788+0000","last_became_peered":"2024-05-27T09:43:48.842788+0000","last_unstale":"2024-05-27T09:47:45.567496+0000","last_undegraded":"2024-05-27T09:47:45.567496+0000","last_fullsized":"2024-05-27T09:47:45.567496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:54:29.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.472378+0000","last_change":"2024-05-27T09:43:48.838035+0000","last_active":"2024-05-27T09:47:45.472378+0000","last_peered":"2024-05-27T09:47:45.472378+0000","last_clean":"2024-05-27T09:47:45.472378+0000","last_became_active":"2024-05-27T09:43:48.837236+0000","last_became_peered":"2024-05-27T09:43:48.837236+0000","last_unstale":"2024-05-27T09:47:45.472378+0000","last_undegraded":"2024-05-27T09:47:45.472378+0000","last_fullsized":"2024-05-27T09:47:45.472378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:32.966997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567123+0000","last_change":"2024-05-27T09:43:48.823692+0000","last_active":"2024-05-27T09:47:45.567123+0000","last_peered":"2024-05-27T09:47:45.567123+0000","last_clean":"2024-05-27T09:47:45.567123+0000","last_became_active":"2024-05-27T09:43:48.821079+0000","last_became_peered":"2024-05-27T09:43:48.821079+0000","last_unstale":"2024-05-27T09:47:45.567123+0000","last_undegraded":"2024-05-27T09:47:45.567123+0000","last_fullsized":"2024-05-27T09:47:45.567123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:15:20.324867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567587+0000","last_change":"2024-05-27T09:43:48.823316+0000","last_active":"2024-05-27T09:47:45.567587+0000","last_peered":"2024-05-27T09:47:45.567587+0000","last_clean":"2024-05-27T09:47:45.567587+0000","last_became_active":"2024-05-27T09:43:48.822912+0000","last_became_peered":"2024-05-27T09:43:48.822912+0000","last_unstale":"2024-05-27T09:47:45.567587+0000","last_undegraded":"2024-05-27T09:47:45.567587+0000","last_fullsized":"2024-05-27T09:47:45.567587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:14.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.486230+0000","last_change":"2024-05-27T09:43:48.842479+0000","last_active":"2024-05-27T09:47:45.486230+0000","last_peered":"2024-05-27T09:47:45.486230+0000","last_clean":"2024-05-27T09:47:45.486230+0000","last_became_active":"2024-05-27T09:43:48.842085+0000","last_became_peered":"2024-05-27T09:43:48.842085+0000","last_unstale":"2024-05-27T09:47:45.486230+0000","last_undegraded":"2024-05-27T09:47:45.486230+0000","last_fullsized":"2024-05-27T09:47:45.486230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:54.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471152+0000","last_change":"2024-05-27T09:43:48.831619+0000","last_active":"2024-05-27T09:47:45.471152+0000","last_peered":"2024-05-27T09:47:45.471152+0000","last_clean":"2024-05-27T09:47:45.471152+0000","last_became_active":"2024-05-27T09:43:48.831250+0000","last_became_peered":"2024-05-27T09:43:48.831250+0000","last_unstale":"2024-05-27T09:47:45.471152+0000","last_undegraded":"2024-05-27T09:47:45.471152+0000","last_fullsized":"2024-05-27T09:47:45.471152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:17:32.051265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.483079+0000","last_change":"2024-05-27T09:43:48.827651+0000","last_active":"2024-05-27T09:47:45.483079+0000","last_peered":"2024-05-27T09:47:45.483079+0000","last_clean":"2024-05-27T09:47:45.483079+0000","last_became_active":"2024-05-27T09:43:48.827312+0000","last_became_peered":"2024-05-27T09:43:48.827312+0000","last_unstale":"2024-05-27T09:47:45.483079+0000","last_undegraded":"2024-05-27T09:47:45.483079+0000","last_fullsized":"2024-05-27T09:47:45.483079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:37:30.036677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.567783+0000","last_change":"2024-05-27T09:43:48.831138+0000","last_active":"2024-05-27T09:47:45.567783+0000","last_peered":"2024-05-27T09:47:45.567783+0000","last_clean":"2024-05-27T09:47:45.567783+0000","last_became_active":"2024-05-27T09:43:48.830725+0000","last_became_peered":"2024-05-27T09:43:48.830725+0000","last_unstale":"2024-05-27T09:47:45.567783+0000","last_undegraded":"2024-05-27T09:47:45.567783+0000","last_fullsized":"2024-05-27T09:47:45.567783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:19:43.973276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.471895+0000","last_change":"2024-05-27T09:43:48.842390+0000","last_active":"2024-05-27T09:47:45.471895+0000","last_peered":"2024-05-27T09:47:45.471895+0000","last_clean":"2024-05-27T09:47:45.471895+0000","last_became_active":"2024-05-27T09:43:48.841724+0000","last_became_peered":"2024-05-27T09:43:48.841724+0000","last_unstale":"2024-05-27T09:47:45.471895+0000","last_undegraded":"2024-05-27T09:47:45.471895+0000","last_fullsized":"2024-05-27T09:47:45.471895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:52.463767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-27T09:47:45.566971+0000","last_change":"2024-05-27T09:43:48.825606+0000","last_active":"2024-05-27T09:47:45.566971+0000","last_peered":"2024-05-27T09:47:45.566971+0000","last_clean":"2024-05-27T09:47:45.566971+0000","last_became_active":"2024-05-27T09:43:48.824909+0000","last_became_peered":"2024-05-27T09:43:48.824909+0000","last_unstale":"2024-05-27T09:47:45.566971+0000","last_undegraded":"2024-05-27T09:47:45.566971+0000","last_fullsized":"2024-05-27T09:47:45.566971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T09:43:47.762059+0000","last_clean_scrub_stamp":"2024-05-27T09:43:47.762059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:43.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":803086,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1853,"num_read_kb":1150,"num_write":429,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":2409258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":317,"ondisk_log_size":317,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612679,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":921600,"data_stored":449225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808907,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37368,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707784,"statfs":{"total":95995035648,"available":95956770816,"internally_reserved":0,"allocated":1957888,"data_stored":1446072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005136,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1323008,"data_stored":842565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201368,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708532,"statfs":{"total":95995035648,"available":95957536768,"internally_reserved":0,"allocated":1314816,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397598,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1523712,"data_stored":1043295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593825,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":448738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":524072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738501,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":450009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411450,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":526204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149811,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1658880,"data_stored":1170497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953582,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":450880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790057,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37280,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707872,"statfs":{"total":95995035648,"available":95956860928,"internally_reserved":0,"allocated":1867776,"data_stored":1369506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":75541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":77673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":393842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":407056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T09:48:20.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:48:20.487 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:20.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:20 smithi071 ceph-mon[31451]: from='client.25265 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:20.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:20 smithi071 ceph-mon[31451]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:20 smithi122 ceph-mon[36436]: from='client.25265 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:20.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:20 smithi122 ceph-mon[36436]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:20 smithi072 ceph-mon[35951]: from='client.25265 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-27T09:48:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:20 smithi072 ceph-mon[35951]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:22.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 -- 172.21.15.71:0/1223316783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c109860 msgr2=0x7fd32c1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:22.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 --2- 172.21.15.71:0/1223316783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c109860 0x7fd32c1111c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd3240099c0 tx=0x7fd324009cd0 comp rx=0 tx=0).stop 2024-05-27T09:48:22.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 -- 172.21.15.71:0/1223316783 shutdown_connections 2024-05-27T09:48:22.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 --2- 172.21.15.71:0/1223316783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c109860 0x7fd32c1111c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:22.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 --2- 172.21.15.71:0/1223316783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd32c1045e0 0x7fd32c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:22.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 --2- 172.21.15.71:0/1223316783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd32c108f10 0x7fd32c109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:22.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 -- 172.21.15.71:0/1223316783 >> 172.21.15.71:0/1223316783 conn(0x7fd32c100030 msgr2=0x7fd32c102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:22.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 -- 172.21.15.71:0/1223316783 shutdown_connections 2024-05-27T09:48:22.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.835+0000 7fd333200700 1 -- 172.21.15.71:0/1223316783 wait complete. 2024-05-27T09:48:22.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.836+0000 7fd333200700 1 Processor -- start 2024-05-27T09:48:22.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.836+0000 7fd333200700 1 -- start start 2024-05-27T09:48:22.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd333200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c1045e0 0x7fd32c19cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:22.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd333200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd32c108f10 0x7fd32c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:22.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd333200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd32c109860 0x7fd32c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:22.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd333200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c114490 con 0x7fd32c1045e0 2024-05-27T09:48:22.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd333200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c114310 con 0x7fd32c108f10 2024-05-27T09:48:22.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd333200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c114610 con 0x7fd32c109860 2024-05-27T09:48:22.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd32be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c1045e0 0x7fd32c19cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:22.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd32be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c1045e0 0x7fd32c19cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55200/0 (socket says 172.21.15.71:55200) 2024-05-27T09:48:22.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd32be00700 1 -- 172.21.15.71:0/830715481 learned_addr learned my addr 172.21.15.71:0/830715481 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:22.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd331200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd32c109860 0x7fd32c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:22.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd323400700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd32c108f10 0x7fd32c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd331200700 1 -- 172.21.15.71:0/830715481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd32c108f10 msgr2=0x7fd32c19d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd331200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd32c108f10 0x7fd32c19d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd331200700 1 -- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c1045e0 msgr2=0x7fd32c19cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd331200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c1045e0 0x7fd32c19cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.837+0000 7fd331200700 1 -- 172.21.15.71:0/830715481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c1a1eb0 con 0x7fd32c109860 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.838+0000 7fd331200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd32c109860 0x7fd32c1a1810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3240059d0 tx=0x7fd324005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.838+0000 7fd329600700 1 -- 172.21.15.71:0/830715481 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324026070 con 0x7fd32c109860 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.838+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c1a2140 con 0x7fd32c109860 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.838+0000 7fd329600700 1 -- 172.21.15.71:0/830715481 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd324005680 con 0x7fd32c109860 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.838+0000 7fd329600700 1 -- 172.21.15.71:0/830715481 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32400f9a0 con 0x7fd32c109860 2024-05-27T09:48:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.838+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c1a9ac0 con 0x7fd32c109860 2024-05-27T09:48:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.840+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c105a90 con 0x7fd32c109860 2024-05-27T09:48:22.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.842+0000 7fd329600700 1 -- 172.21.15.71:0/830715481 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fd324029070 con 0x7fd32c109860 2024-05-27T09:48:22.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.843+0000 7fd329600700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3100b2b90 0x7fd3100b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:22.843 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:22 smithi071 ceph-mon[31451]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:48:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.844+0000 7fd329600700 1 -- 172.21.15.71:0/830715481 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fd3240e2ff0 con 0x7fd32c109860 2024-05-27T09:48:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.844+0000 7fd32be00700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3100b2b90 0x7fd3100b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.845+0000 7fd32be00700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3100b2b90 0x7fd3100b50a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009c10 tx=0x7fd31c00b040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:22.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:22.848+0000 7fd329600700 1 -- 172.21.15.71:0/830715481 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd324013070 con 0x7fd32c109860 2024-05-27T09:48:22.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:22 smithi122 ceph-mon[36436]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:48:23.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:22 smithi072 ceph-mon[35951]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:48:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.131+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd32c1a9c90 con 0x7fd32c109860 2024-05-27T09:48:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.132+0000 7fd329600700 1 -- 172.21.15.71:0/830715481 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7fd3240aa820 con 0x7fd32c109860 2024-05-27T09:48:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:23.133 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:48:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3100b2b90 msgr2=0x7fd3100b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3100b2b90 0x7fd3100b50a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009c10 tx=0x7fd31c00b040 comp rx=0 tx=0).stop 2024-05-27T09:48:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd32c109860 msgr2=0x7fd32c1a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd32c109860 0x7fd32c1a1810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3240059d0 tx=0x7fd324005280 comp rx=0 tx=0).stop 2024-05-27T09:48:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 shutdown_connections 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3100b2b90 0x7fd3100b50a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd32c109860 0x7fd32c1a1810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c1045e0 0x7fd32c19cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 --2- 172.21.15.71:0/830715481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd32c108f10 0x7fd32c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 >> 172.21.15.71:0/830715481 conn(0x7fd32c100030 msgr2=0x7fd32c110e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 shutdown_connections 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:23.136+0000 7fd333200700 1 -- 172.21.15.71:0/830715481 wait complete. 2024-05-27T09:48:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:48:23.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:23 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/830715481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:23.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:23 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/830715481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:24.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:23 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/830715481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:24.036 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:48:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:24.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:24 smithi071 ceph-mon[31451]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-27T09:48:24.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:24 smithi122 ceph-mon[36436]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-27T09:48:25.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:24 smithi072 ceph-mon[35951]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-27T09:48:26.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 -- 172.21.15.71:0/1035899361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 msgr2=0x7f709c1131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 --2- 172.21.15.71:0/1035899361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 0x7f709c1131f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f709400b0d0 tx=0x7f709400b3e0 comp rx=0 tx=0).stop 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 -- 172.21.15.71:0/1035899361 shutdown_connections 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 --2- 172.21.15.71:0/1035899361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 0x7f709c1131f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 --2- 172.21.15.71:0/1035899361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f709c106610 0x7f709c106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 --2- 172.21.15.71:0/1035899361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 0x7f709c10b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 -- 172.21.15.71:0/1035899361 >> 172.21.15.71:0/1035899361 conn(0x7f709c102020 msgr2=0x7f709c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 -- 172.21.15.71:0/1035899361 shutdown_connections 2024-05-27T09:48:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.758+0000 7f70a2000700 1 -- 172.21.15.71:0/1035899361 wait complete. 2024-05-27T09:48:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.759+0000 7f70a2000700 1 Processor -- start 2024-05-27T09:48:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.759+0000 7f70a2000700 1 -- start start 2024-05-27T09:48:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a2000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f709c106610 0x7f709c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a2000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 0x7f709c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a2000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 0x7f709c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a2000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f709c116510 con 0x7f709c10b890 2024-05-27T09:48:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a2000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f709c116390 con 0x7f709c10af40 2024-05-27T09:48:26.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a2000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f709c116690 con 0x7f709c106610 2024-05-27T09:48:26.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f709be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 0x7f709c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:26.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a1600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 0x7f709c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:26.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f70a0c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f709c106610 0x7f709c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:26.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f709be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 0x7f709c19d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58724/0 (socket says 172.21.15.71:58724) 2024-05-27T09:48:26.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.760+0000 7f709be00700 1 -- 172.21.15.71:0/1925008871 learned_addr learned my addr 172.21.15.71:0/1925008871 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f709be00700 1 -- 172.21.15.71:0/1925008871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f709c106610 msgr2=0x7f709c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f709be00700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f709c106610 0x7f709c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f709be00700 1 -- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 msgr2=0x7f709c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f709be00700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 0x7f709c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f709be00700 1 -- 172.21.15.71:0/1925008871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c1a1cd0 con 0x7f709c10af40 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f709be00700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 0x7f709c19d3a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f708800e970 tx=0x7f708800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f7099600700 1 -- 172.21.15.71:0/1925008871 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088004a30 con 0x7f709c10af40 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c1a1fc0 con 0x7f709c10af40 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f7099600700 1 -- 172.21.15.71:0/1925008871 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f708800cc90 con 0x7f709c10af40 2024-05-27T09:48:26.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f7099600700 1 -- 172.21.15.71:0/1925008871 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088005610 con 0x7f709c10af40 2024-05-27T09:48:26.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.761+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c1a98e0 con 0x7f709c10af40 2024-05-27T09:48:26.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.762+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f709c0512b0 con 0x7f709c10af40 2024-05-27T09:48:26.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.765+0000 7f7099600700 1 -- 172.21.15.71:0/1925008871 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f708800c7e0 con 0x7f709c10af40 2024-05-27T09:48:26.765 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:26 smithi071 ceph-mon[31451]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:26.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.766+0000 7f7099600700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f70840b2b10 0x7f70840b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:26.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.767+0000 7f7099600700 1 -- 172.21.15.71:0/1925008871 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f70880e2c30 con 0x7f709c10af40 2024-05-27T09:48:26.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.767+0000 7f70a0c00700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f70840b2b10 0x7f70840b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:26.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.768+0000 7f70a0c00700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f70840b2b10 0x7f70840b5020 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7090009c60 tx=0x7f7090009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:26.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:26.769+0000 7f7099600700 1 -- 172.21.15.71:0/1925008871 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7088054df0 con 0x7f709c10af40 2024-05-27T09:48:26.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:26 smithi122 ceph-mon[36436]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:27.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:26 smithi072 ceph-mon[35951]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:27.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.044+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f709c19e160 con 0x7f709c10af40 2024-05-27T09:48:27.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.045+0000 7f7099600700 1 -- 172.21.15.71:0/1925008871 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7f7088091090 con 0x7f709c10af40 2024-05-27T09:48:27.045 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:27.045 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:48:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f70840b2b10 msgr2=0x7f70840b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f70840b2b10 0x7f70840b5020 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7090009c60 tx=0x7f7090009260 comp rx=0 tx=0).stop 2024-05-27T09:48:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 msgr2=0x7f709c19d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 0x7f709c19d3a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f708800e970 tx=0x7f708800ec80 comp rx=0 tx=0).stop 2024-05-27T09:48:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 shutdown_connections 2024-05-27T09:48:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f70840b2b10 0x7f70840b5020 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f709c10b890 0x7f709c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f709c106610 0x7f709c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 --2- 172.21.15.71:0/1925008871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c10af40 0x7f709c19d3a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 >> 172.21.15.71:0/1925008871 conn(0x7f709c102020 msgr2=0x7f709c10a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 shutdown_connections 2024-05-27T09:48:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:27.048+0000 7f70a2000700 1 -- 172.21.15.71:0/1925008871 wait complete. 2024-05-27T09:48:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:48:27.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:27 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1925008871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:27.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:27 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1925008871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:28.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:27 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1925008871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:28.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T09:48:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:28.923 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:28 smithi071 ceph-mon[31451]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-27T09:48:28.927 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:28 smithi072 ceph-mon[35951]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-27T09:48:28.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:28 smithi122 ceph-mon[36436]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-27T09:48:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 -- 172.21.15.71:0/3996754618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4076670 msgr2=0x7f18e4110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 --2- 172.21.15.71:0/3996754618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4076670 0x7f18e4110650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f18d00098f0 tx=0x7f18d0009c00 comp rx=0 tx=0).stop 2024-05-27T09:48:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 -- 172.21.15.71:0/3996754618 shutdown_connections 2024-05-27T09:48:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 --2- 172.21.15.71:0/3996754618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4110b90 0x7f18e4112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 --2- 172.21.15.71:0/3996754618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18e4075d20 0x7f18e4076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 --2- 172.21.15.71:0/3996754618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4076670 0x7f18e4110650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:30.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 -- 172.21.15.71:0/3996754618 >> 172.21.15.71:0/3996754618 conn(0x7f18e4100030 msgr2=0x7f18e4102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:30.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 -- 172.21.15.71:0/3996754618 shutdown_connections 2024-05-27T09:48:30.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.759+0000 7f18e9600700 1 -- 172.21.15.71:0/3996754618 wait complete. 2024-05-27T09:48:30.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.760+0000 7f18e9600700 1 Processor -- start 2024-05-27T09:48:30.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.761+0000 7f18e9600700 1 -- start start 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.761+0000 7f18e9600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4075d20 0x7f18e419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.761+0000 7f18e9600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18e4076670 0x7f18e419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.761+0000 7f18e9600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4110b90 0x7f18e41a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.761+0000 7f18e9600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18e4116690 con 0x7f18e4076670 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.761+0000 7f18e9600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f18e4116510 con 0x7f18e4075d20 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.761+0000 7f18e9600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f18e4116810 con 0x7f18e4110b90 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18e4076670 0x7f18e419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4075d20 0x7f18e419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18e4076670 0x7f18e419d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52004/0 (socket says 172.21.15.71:52004) 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4075d20 0x7f18e419d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58746/0 (socket says 172.21.15.71:58746) 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2000700 1 -- 172.21.15.71:0/1291842370 learned_addr learned my addr 172.21.15.71:0/1291842370 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:30.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e3400700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4110b90 0x7f18e41a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:30.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2a00700 1 -- 172.21.15.71:0/1291842370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4110b90 msgr2=0x7f18e41a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:30.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2a00700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4110b90 0x7f18e41a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2a00700 1 -- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18e4076670 msgr2=0x7f18e419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2a00700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18e4076670 0x7f18e419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.762+0000 7f18e2a00700 1 -- 172.21.15.71:0/1291842370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e41a1f10 con 0x7f18e4075d20 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.763+0000 7f18e2a00700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4075d20 0x7f18e419d040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f18d400e9c0 tx=0x7f18d400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.763+0000 7f18db400700 1 -- 172.21.15.71:0/1291842370 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d400c9c0 con 0x7f18e4075d20 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.763+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e41a2200 con 0x7f18e4075d20 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.763+0000 7f18db400700 1 -- 172.21.15.71:0/1291842370 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18d400cb60 con 0x7f18e4075d20 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.763+0000 7f18db400700 1 -- 172.21.15.71:0/1291842370 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4018420 con 0x7f18e4075d20 2024-05-27T09:48:30.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.763+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e41a9b20 con 0x7f18e4075d20 2024-05-27T09:48:30.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.764+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e40512b0 con 0x7f18e4075d20 2024-05-27T09:48:30.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.767+0000 7f18db400700 1 -- 172.21.15.71:0/1291842370 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f18d4010430 con 0x7f18e4075d20 2024-05-27T09:48:30.767 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:30 smithi071 ceph-mon[31451]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:30.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.768+0000 7f18db400700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18c80b2b10 0x7f18c80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:30.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.768+0000 7f18db400700 1 -- 172.21.15.71:0/1291842370 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f18d40e2ed0 con 0x7f18e4075d20 2024-05-27T09:48:30.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.768+0000 7f18e2000700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18c80b2b10 0x7f18c80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:30.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.769+0000 7f18e2000700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18c80b2b10 0x7f18c80b5020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009680 tx=0x7f18d0019040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:30.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:30.770+0000 7f18db400700 1 -- 172.21.15.71:0/1291842370 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f18d40aa630 con 0x7f18e4075d20 2024-05-27T09:48:30.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:30 smithi122 ceph-mon[36436]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:31.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.008+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18e402e5e0 con 0x7f18e4075d20 2024-05-27T09:48:31.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.010+0000 7f18db400700 1 -- 172.21.15.71:0/1291842370 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22980 (secure 0 0 0) 0x7f18d40a9f30 con 0x7f18e4075d20 2024-05-27T09:48:31.011 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:31.011 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":84,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:47:45.456731+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6801/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6800/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/1381797399":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/4081778329":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/193022273":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/4261728686":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:48:31.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18c80b2b10 msgr2=0x7f18c80b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:31.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18c80b2b10 0x7f18c80b5020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009680 tx=0x7f18d0019040 comp rx=0 tx=0).stop 2024-05-27T09:48:31.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4075d20 msgr2=0x7f18e419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:31.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4075d20 0x7f18e419d040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f18d400e9c0 tx=0x7f18d400ecd0 comp rx=0 tx=0).stop 2024-05-27T09:48:31.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 shutdown_connections 2024-05-27T09:48:31.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18c80b2b10 0x7f18c80b5020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:31.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18e4110b90 0x7f18e41a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:31.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4075d20 0x7f18e419d040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:31.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 --2- 172.21.15.71:0/1291842370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18e4076670 0x7f18e419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:31.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 >> 172.21.15.71:0/1291842370 conn(0x7f18e4100030 msgr2=0x7f18e4100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:31.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 shutdown_connections 2024-05-27T09:48:31.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:31.013+0000 7f18e9600700 1 -- 172.21.15.71:0/1291842370 wait complete. 2024-05-27T09:48:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:30 smithi072 ceph-mon[35951]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:31.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-05-27T09:48:31.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:31 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1291842370' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:48:32.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:31 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1291842370' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:48:32.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:31 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1291842370' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:48:32.230 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:32.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:32 smithi122 ceph-mon[36436]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:33.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:32 smithi071 ceph-mon[31451]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:33.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:32 smithi072 ceph-mon[35951]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-05-27T09:48:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 -- 172.21.15.71:0/1281488466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84114af0 msgr2=0x7f0a84116f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 --2- 172.21.15.71:0/1281488466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84114af0 0x7f0a84116f10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009ca0 tx=0x7f0a7c02a8c0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 -- 172.21.15.71:0/1281488466 shutdown_connections 2024-05-27T09:48:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 --2- 172.21.15.71:0/1281488466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84114af0 0x7f0a84116f10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 --2- 172.21.15.71:0/1281488466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a84112190 0x7f0a841145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 --2- 172.21.15.71:0/1281488466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a84078720 0x7f0a84078b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 -- 172.21.15.71:0/1281488466 >> 172.21.15.71:0/1281488466 conn(0x7f0a840771f0 msgr2=0x7f0a84077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 -- 172.21.15.71:0/1281488466 shutdown_connections 2024-05-27T09:48:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.072+0000 7f0a8b600640 1 -- 172.21.15.71:0/1281488466 wait complete. 2024-05-27T09:48:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.073+0000 7f0a8b600640 1 Processor -- start 2024-05-27T09:48:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.073+0000 7f0a8b600640 1 -- start start 2024-05-27T09:48:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a8b600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a84078720 0x7f0a841a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a8b600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84112190 0x7f0a841a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a8b600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a84114af0 0x7f0a841a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a8b600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8411a4b0 con 0x7f0a84112190 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a8b600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8411a330 con 0x7f0a84114af0 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a8b600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8411a630 con 0x7f0a84078720 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84112190 0x7f0a841a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84112190 0x7f0a841a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52026/0 (socket says 172.21.15.71:52026) 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a88c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a84078720 0x7f0a841a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a83e00640 1 -- 172.21.15.71:0/3570566036 learned_addr learned my addr 172.21.15.71:0/3570566036 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.074+0000 7f0a89600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a84114af0 0x7f0a841a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a83e00640 1 -- 172.21.15.71:0/3570566036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a84078720 msgr2=0x7f0a841a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a83e00640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a84078720 0x7f0a841a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a83e00640 1 -- 172.21.15.71:0/3570566036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a84114af0 msgr2=0x7f0a841a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a83e00640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a84114af0 0x7f0a841a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a83e00640 1 -- 172.21.15.71:0/3570566036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a841a5ca0 con 0x7f0a84112190 2024-05-27T09:48:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a83e00640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84112190 0x7f0a841a13f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000e9c0 tx=0x7f0a7000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a81600640 1 -- 172.21.15.71:0/3570566036 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000cd80 con 0x7f0a84112190 2024-05-27T09:48:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a81600640 1 -- 172.21.15.71:0/3570566036 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a700054d0 con 0x7f0a84112190 2024-05-27T09:48:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a841a5f90 con 0x7f0a84112190 2024-05-27T09:48:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a81600640 1 -- 172.21.15.71:0/3570566036 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70010430 con 0x7f0a84112190 2024-05-27T09:48:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.075+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a841ad910 con 0x7f0a84112190 2024-05-27T09:48:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.080+0000 7f0a925d3740 1 Processor -- start 2024-05-27T09:48:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.080+0000 7f0a925d3740 1 -- start start 2024-05-27T09:48:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087dc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087dd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a925d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c90874db90 con 0x55c9084194d0 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a925d3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c90873d730 con 0x55c90843a1b0 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a925d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c908741770 con 0x55c9084112f0 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a81600640 1 -- 172.21.15.71:0/3570566036 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f0a70004fd0 con 0x7f0a84112190 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a89600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087dc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a89600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087dc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58770/0 (socket says 172.21.15.71:58770) 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a89600640 1 -- 172.21.15.71:0/493237685 learned_addr learned my addr 172.21.15.71:0/493237685 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a88c00640 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a83e00640 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087dd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a89600640 1 -- 172.21.15.71:0/493237685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 msgr2=0x55c9087dcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.081+0000 7f0a89600640 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087dcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.082+0000 7f0a89600640 1 -- 172.21.15.71:0/493237685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 msgr2=0x55c9087dd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.082+0000 7f0a89600640 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087dd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.082+0000 7f0a89600640 1 -- 172.21.15.71:0/493237685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9086d68b0 con 0x55c90843a1b0 2024-05-27T09:48:33.084 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.082+0000 7f0a89600640 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087dc860 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009ca0 tx=0x7f0a7c009430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a46f7e5e15e75708 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:33.084 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.082+0000 7f0a75c00640 1 -- 172.21.15.71:0/493237685 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c031cf0 con 0x55c90843a1b0 2024-05-27T09:48:33.084 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.082+0000 7f0a75c00640 1 -- 172.21.15.71:0/493237685 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a7c036030 con 0x55c90843a1b0 2024-05-27T09:48:33.084 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.082+0000 7f0a75c00640 1 -- 172.21.15.71:0/493237685 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0042a0 con 0x55c90843a1b0 2024-05-27T09:48:33.084 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 -- 172.21.15.71:0/493237685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 msgr2=0x55c9087dc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.084 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087dc860 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009ca0 tx=0x7f0a7c009430 comp rx=0 tx=0).stop 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 -- 172.21.15.71:0/493237685 shutdown_connections 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087dd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 --2- 172.21.15.71:0/493237685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087dc860 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 -- 172.21.15.71:0/493237685 >> 172.21.15.71:0/493237685 conn(0x55c90842e300 msgr2=0x55c9087d9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a81600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0a6c0b2a70 0x7f0a6c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.083+0000 7f0a925d3740 1 -- 172.21.15.71:0/493237685 shutdown_connections 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.084+0000 7f0a81600640 1 -- 172.21.15.71:0/3570566036 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f0a700e2c20 con 0x7f0a84112190 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.084+0000 7f0a925d3740 1 -- 172.21.15.71:0/493237685 wait complete. 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.084+0000 7f0a88c00640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0a6c0b2a70 0x7f0a6c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.084+0000 7f0a925d3740 1 -- start start 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.084+0000 7f0a925d3740 1 Processor -- start 2024-05-27T09:48:33.085 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.084+0000 7f0a88c00640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0a6c0b2a70 0x7f0a6c0b4f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55c9087ddc10 tx=0x7f0a78005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084112f0 0x55c9087e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084194d0 0x55c9087e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a925d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c908423790 con 0x55c9084112f0 2024-05-27T09:48:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a925d3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c9086e5bc0 con 0x55c90843a1b0 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a925d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c9087e97b0 con 0x55c9084194d0 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a925d3740 10 client.0 _ll_register_callbacks cb 0x55c9086c3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a88c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084112f0 0x55c9087e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a88c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084112f0 0x55c9087e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52046/0 (socket says 172.21.15.71:52046) 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a88c00640 1 -- 172.21.15.71:0/3215537573 learned_addr learned my addr 172.21.15.71:0/3215537573 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a89600640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.085+0000 7f0a83e00640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084194d0 0x55c9087e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a88c00640 1 -- 172.21.15.71:0/3215537573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084194d0 msgr2=0x55c9087e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a88c00640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084194d0 0x55c9087e6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a88c00640 1 -- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 msgr2=0x55c9087f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a88c00640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a88c00640 1 -- 172.21.15.71:0/3215537573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c908452210 con 0x55c9084112f0 2024-05-27T09:48:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a89600640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a88c00640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084112f0 0x55c9087e6a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009fd0 tx=0x7f0a78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d3565912494b80 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a6a000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a6a000640 1 -- 172.21.15.71:0/3215537573 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7802e060 con 0x55c9084112f0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a6a000640 1 -- 172.21.15.71:0/3215537573 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f0a78018030 con 0x55c9084112f0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.086+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a7c036030 con 0x55c9084112f0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a6a000640 1 -- 172.21.15.71:0/3215537573 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a7801ed20 con 0x55c9084112f0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a925d3740 10 client.15204 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c90851e620 con 0x55c9084112f0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a6a000640 1 -- 172.21.15.71:0/3215537573 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a7c036030 con 0x55c9084112f0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a6a000640 1 -- 172.21.15.71:0/3215537573 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f0a7801c4a0 con 0x55c9084112f0 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a925d3740 10 client.15204 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a925d3740 10 client.15204 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a925d3740 20 client.15204 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a925d3740 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083f8d80 0x55c9087f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.087+0000 7f0a925d3740 4 client.15204 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.088+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c90874fae0 con 0x55c9083f8d80 2024-05-27T09:48:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.088+0000 7f0a83e00640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083f8d80 0x55c9087f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.089+0000 7f0a6a000640 10 client.15204 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.089+0000 7f0a83e00640 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083f8d80 0x55c9087f8b40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34e3726f2d4edc48 server_cookie=8ff1ee5068e473f7 in_seq=0 out_seq=0 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.089+0000 7f0a6a000640 1 -- 172.21.15.71:0/3215537573 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55c90874fae0 con 0x55c9083f8d80 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.089+0000 7f0a6a000640 10 client.15204 handle_command_reply: tid=0 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 client.15204 shutdown 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084112f0 msgr2=0x55c9087e6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084112f0 0x55c9087e6a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009fd0 tx=0x7f0a78004730 comp rx=0 tx=0).stop 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 shutdown_connections 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c9087f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084194d0 0x55c9087e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083f8d80 0x55c9087f8b40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 --2- 172.21.15.71:0/3215537573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084112f0 0x55c9087e6a50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 >> 172.21.15.71:0/3215537573 conn(0x55c90842e300 msgr2=0x55c9087dc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a6a000640 0 client.15204 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 shutdown_connections 2024-05-27T09:48:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 1 -- 172.21.15.71:0/3215537573 wait complete. 2024-05-27T09:48:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.090+0000 7f0a925d3740 20 client.15204 trim_cache size 0 max 16384 2024-05-27T09:48:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 Processor -- start 2024-05-27T09:48:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 -- start start 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c9084194d0 0x55c9087f2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c90843a1b0 0x55c9087f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b8910 con 0x55c90843a1b0 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b61e0 con 0x55c9084194d0 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a925d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b4030 con 0x55c9084112f0 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a89600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c90843a1b0 0x55c9087f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.107+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c9084194d0 0x55c9087f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c9084194d0 0x55c9087f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58782/0 (socket says 172.21.15.71:58782) 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a89600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c90843a1b0 0x55c9087f2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52062/0 (socket says 172.21.15.71:52062) 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 -- 172.21.15.71:0/1261996519 learned_addr learned my addr 172.21.15.71:0/1261996519 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a88c00640 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 -- 172.21.15.71:0/1261996519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 msgr2=0x55c9087e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087e9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 -- 172.21.15.71:0/1261996519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c90843a1b0 msgr2=0x55c9087f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c90843a1b0 0x55c9087f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 -- 172.21.15.71:0/1261996519 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9087ddc40 con 0x55c9084194d0 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a83e00640 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c9084194d0 0x55c9087f2850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a700057a0 tx=0x7f0a700caf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=495ccaf9b0b1aa78 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a75200640 1 -- 172.21.15.71:0/1261996519 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700046c0 con 0x55c9084194d0 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a75200640 1 -- 172.21.15.71:0/1261996519 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a700a97f0 con 0x55c9084194d0 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.108+0000 7f0a75200640 1 -- 172.21.15.71:0/1261996519 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700052c0 con 0x55c9084194d0 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 -- 172.21.15.71:0/1261996519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c9084194d0 msgr2=0x55c9087f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c9084194d0 0x55c9087f2850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a700057a0 tx=0x7f0a700caf90 comp rx=0 tx=0).stop 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 -- 172.21.15.71:0/1261996519 shutdown_connections 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c90843a1b0 0x55c9087f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c9084194d0 0x55c9087f2850 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 --2- 172.21.15.71:0/1261996519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 -- 172.21.15.71:0/1261996519 >> 172.21.15.71:0/1261996519 conn(0x55c90842e300 msgr2=0x55c9087e6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 -- 172.21.15.71:0/1261996519 shutdown_connections 2024-05-27T09:48:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.109+0000 7f0a925d3740 1 -- 172.21.15.71:0/1261996519 wait complete. 2024-05-27T09:48:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.110+0000 7f0a925d3740 1 -- start start 2024-05-27T09:48:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.110+0000 7f0a925d3740 1 Processor -- start 2024-05-27T09:48:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087ec460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a925d3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c90885f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a925d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b46a0 con 0x55c9084194d0 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a925d3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b5b10 con 0x55c90843a1b0 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a925d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b4d70 con 0x55c9084112f0 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a925d3740 10 client.0 _ll_register_callbacks cb 0x7f0a7801e560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087ec460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52072/0 (socket says 172.21.15.71:52072) 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 -- 172.21.15.71:0/126203579 learned_addr learned my addr 172.21.15.71:0/126203579 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a89600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c90885f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a88c00640 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 -- 172.21.15.71:0/126203579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 msgr2=0x55c9087ebf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087ebf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 -- 172.21.15.71:0/126203579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 msgr2=0x55c90885f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c90885f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.111+0000 7f0a83e00640 1 -- 172.21.15.71:0/126203579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c90885f6e0 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a83e00640 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087ec460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a700e0330 tx=0x7f0a700e0280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94df99c5747b5f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a6a000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a6a000640 1 -- 172.21.15.71:0/126203579 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700a9ce0 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a6a000640 1 -- 172.21.15.71:0/126203579 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f0a700a62d0 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a700a97f0 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a6a000640 1 -- 172.21.15.71:0/126203579 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a700ae090 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a925d3740 10 client.15210 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.112+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c908860900 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a6a000640 1 -- 172.21.15.71:0/126203579 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a700a97f0 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a6a000640 1 -- 172.21.15.71:0/126203579 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f0a700b26b0 con 0x55c9084194d0 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a925d3740 10 client.15210 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a925d3740 10 client.15210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a925d3740 20 client.15210 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a925d3740 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083ce1c0 0x55c908862f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a925d3740 4 client.15210 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:48:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9087492c0 con 0x55c9083ce1c0 2024-05-27T09:48:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.113+0000 7f0a88c00640 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083ce1c0 0x55c908862f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.114+0000 7f0a88c00640 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083ce1c0 0x55c908862f70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c62abd11272f25d server_cookie=9b037632947eae4b in_seq=0 out_seq=0 2024-05-27T09:48:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.114+0000 7f0a6a000640 10 client.15210 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a6a000640 1 -- 172.21.15.71:0/126203579 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c9087492c0 con 0x55c9083ce1c0 2024-05-27T09:48:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a6a000640 10 client.15210 handle_command_reply: tid=0 2024-05-27T09:48:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 client.15210 shutdown 2024-05-27T09:48:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 msgr2=0x55c9087ec460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087ec460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a700e0330 tx=0x7f0a700e0280 comp rx=0 tx=0).stop 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 shutdown_connections 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c90843a1b0 0x55c90885f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c9083ce1c0 0x55c908862f70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c9084194d0 0x55c9087ec460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 --2- 172.21.15.71:0/126203579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c9084112f0 0x55c9087ebf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a6a000640 0 client.15210 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 >> 172.21.15.71:0/126203579 conn(0x55c90842e300 msgr2=0x55c9087e6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 shutdown_connections 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 1 -- 172.21.15.71:0/126203579 wait complete. 2024-05-27T09:48:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.118+0000 7f0a925d3740 20 client.15210 trim_cache size 0 max 16384 2024-05-27T09:48:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:48:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:48:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:48:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0a6c0b2a70 msgr2=0x7f0a6c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0a6c0b2a70 0x7f0a6c0b4f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55c9087ddc10 tx=0x7f0a78005f90 comp rx=0 tx=0).stop 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84112190 msgr2=0x7f0a841a13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84112190 0x7f0a841a13f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000e9c0 tx=0x7f0a7000ee80 comp rx=0 tx=0).stop 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 shutdown_connections 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0a6c0b2a70 0x7f0a6c0b4f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a84114af0 0x7f0a841a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a84112190 0x7f0a841a13f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 --2- 172.21.15.71:0/3570566036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a84078720 0x7f0a841a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 >> 172.21.15.71:0/3570566036 conn(0x7f0a840771f0 msgr2=0x7f0a841125a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 shutdown_connections 2024-05-27T09:48:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:33.119+0000 7f0a8b600640 1 -- 172.21.15.71:0/3570566036 wait complete. 2024-05-27T09:48:34.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:34 smithi122 ceph-mon[36436]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-05-27T09:48:35.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:34 smithi071 ceph-mon[31451]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-05-27T09:48:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:34 smithi072 ceph-mon[35951]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-05-27T09:48:35.566 INFO:teuthology.orchestra.run.smithi071.stdout:{"run_dir":"/var/run/ceph"} 2024-05-27T09:48:35.567 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-27T09:48:35.567 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 2274 2024-05-27T09:48:35.567 DEBUG:tasks.quiescer:Yielding 2024-05-27T09:48:35.568 INFO:teuthology.run_tasks:Running task workunit... 2024-05-27T09:48:35.591 INFO:tasks.workunit:Pulling workunits from ref a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:48:35.592 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-27T09:48:35.592 INFO:tasks.workunit:timeout=3h 2024-05-27T09:48:35.592 INFO:tasks.workunit:cleanup=True 2024-05-27T09:48:35.593 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-27T09:48:35.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-05-27 09:44:30.825236049 +0000 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-05-27 09:44:30.825236049 +0000 2024-05-27T09:48:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-05-27 09:47:43.061920387 +0000 2024-05-27T09:48:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-05-27 09:44:30.825236049 +0000 2024-05-27T09:48:35.642 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-27T09:48:35.642 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-27T09:48:35.771 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a6507388dd5057528934822c0163b0c347ef1d5d 2024-05-27T09:48:35.813 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-27T09:48:36.039 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:36.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:36 smithi122 ceph-mon[36436]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:37.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:36 smithi071 ceph-mon[31451]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:37.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:36 smithi072 ceph-mon[35951]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:48:38.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 -- 172.21.15.71:0/3578444731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0109840 msgr2=0x7f7cc01111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/3578444731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0109840 0x7f7cc01111a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009fc0 tx=0x7f7cb800b330 comp rx=0 tx=0).stop 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 -- 172.21.15.71:0/3578444731 shutdown_connections 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/3578444731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0109840 0x7f7cc01111a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/3578444731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc01045c0 0x7f7cc01049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/3578444731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc0108ef0 0x7f7cc0109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 -- 172.21.15.71:0/3578444731 >> 172.21.15.71:0/3578444731 conn(0x7f7cc00ffe90 msgr2=0x7f7cc01022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 -- 172.21.15.71:0/3578444731 shutdown_connections 2024-05-27T09:48:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.354+0000 7f7cc7c00700 1 -- 172.21.15.71:0/3578444731 wait complete. 2024-05-27T09:48:38.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.355+0000 7f7cc7c00700 1 Processor -- start 2024-05-27T09:48:38.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.356+0000 7f7cc7c00700 1 -- start start 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.356+0000 7f7cc7c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc01045c0 0x7f7cc019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.356+0000 7f7cc7c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc0108ef0 0x7f7cc019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.356+0000 7f7cc7c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc0109840 0x7f7cc019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.356+0000 7f7cc7c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc0114470 con 0x7f7cc01045c0 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.356+0000 7f7cc7c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc01142f0 con 0x7f7cc0108ef0 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.356+0000 7f7cc7c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc01145f0 con 0x7f7cc0109840 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cbfe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc0108ef0 0x7f7cc019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc01045c0 0x7f7cc019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:38.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cbfe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc0108ef0 0x7f7cc019b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45608/0 (socket says 172.21.15.71:45608) 2024-05-27T09:48:38.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cbfe00700 1 -- 172.21.15.71:0/1315796438 learned_addr learned my addr 172.21.15.71:0/1315796438 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:38.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc0109840 0x7f7cc019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:38.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5c00700 1 -- 172.21.15.71:0/1315796438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc0108ef0 msgr2=0x7f7cc019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:38.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc0108ef0 0x7f7cc019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5c00700 1 -- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc01045c0 msgr2=0x7f7cc019ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc01045c0 0x7f7cc019ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5c00700 1 -- 172.21.15.71:0/1315796438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc019fc50 con 0x7f7cc0109840 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.357+0000 7f7cc5200700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc01045c0 0x7f7cc019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.358+0000 7f7cc5c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc0109840 0x7f7cc019f5b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8015000 tx=0x7f7cb800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.358+0000 7f7cbd600700 1 -- 172.21.15.71:0/1315796438 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8021070 con 0x7f7cc0109840 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.358+0000 7f7cbd600700 1 -- 172.21.15.71:0/1315796438 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cb8007ac0 con 0x7f7cc0109840 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.358+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc019fee0 con 0x7f7cc0109840 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.358+0000 7f7cbd600700 1 -- 172.21.15.71:0/1315796438 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8005040 con 0x7f7cc0109840 2024-05-27T09:48:38.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.358+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc0076af0 con 0x7f7cc0109840 2024-05-27T09:48:38.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.359+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc0105a70 con 0x7f7cc0109840 2024-05-27T09:48:38.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.362+0000 7f7cbd600700 1 -- 172.21.15.71:0/1315796438 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f7cb8024070 con 0x7f7cc0109840 2024-05-27T09:48:38.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.363+0000 7f7cbd600700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ca80b2b10 0x7f7ca80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:38.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.363+0000 7f7cbd600700 1 -- 172.21.15.71:0/1315796438 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f7cb800f020 con 0x7f7cc0109840 2024-05-27T09:48:38.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.363+0000 7f7cc5200700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ca80b2b10 0x7f7ca80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:38.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.364+0000 7f7cc5200700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ca80b2b10 0x7f7ca80b5020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009730 tx=0x7f7cb4012040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:38.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.365+0000 7f7cbd600700 1 -- 172.21.15.71:0/1315796438 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7cb802b020 con 0x7f7cc0109840 2024-05-27T09:48:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.645+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cc019c0e0 con 0x7f7cc0109840 2024-05-27T09:48:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.646+0000 7f7cbd600700 1 -- 172.21.15.71:0/1315796438 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7f7cb80ab8d0 con 0x7f7cc0109840 2024-05-27T09:48:38.648 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:38.648 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:48:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.649+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ca80b2b10 msgr2=0x7f7ca80b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.649+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ca80b2b10 0x7f7ca80b5020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009730 tx=0x7f7cb4012040 comp rx=0 tx=0).stop 2024-05-27T09:48:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.649+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc0109840 msgr2=0x7f7cc019f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.649+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc0109840 0x7f7cc019f5b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8015000 tx=0x7f7cb800ccb0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.649+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 shutdown_connections 2024-05-27T09:48:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.650+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ca80b2b10 0x7f7ca80b5020 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.650+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc0109840 0x7f7cc019f5b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.650+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc01045c0 0x7f7cc019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.650+0000 7f7cc7c00700 1 --2- 172.21.15.71:0/1315796438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc0108ef0 0x7f7cc019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.650+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 >> 172.21.15.71:0/1315796438 conn(0x7f7cc00ffe90 msgr2=0x7f7cc0108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.650+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 shutdown_connections 2024-05-27T09:48:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:38.650+0000 7f7cc7c00700 1 -- 172.21.15.71:0/1315796438 wait complete. 2024-05-27T09:48:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:48:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:38 smithi122 ceph-mon[36436]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-27T09:48:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:38 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1315796438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:38 smithi071 ceph-mon[31451]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-27T09:48:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:38 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1315796438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:38 smithi072 ceph-mon[35951]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-27T09:48:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:38 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1315796438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:39.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-27T09:43:51.731640+0000', 'modified': '2024-05-27T09:47:44.135191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24530, 'mds_1': 24518, 'mds_2': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.72:6837/4192538973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 4192538973}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 4192538973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6837/1257572460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 1257572460}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1257572460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'g', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6839/2510446999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 2510446999}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 2510446999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.122:6839/3712813671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 3712813671}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 3712813671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.71:6841/1086406252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6840', 'nonce': 1086406252}, {'type': 'v1', 'addr': '172.21.15.71:6841', 'nonce': 1086406252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24530': {'gid': 24530, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.72:6839/1043512787', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6838', 'nonce': 1043512787}, {'type': 'v1', 'addr': '172.21.15.72:6839', 'nonce': 1043512787}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24530, 'qdb_cluster': [24508, 24518, 24530]} 2024-05-27T09:48:39.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-27T09:48:39.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-05-27T09:48:40.059 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:40.758 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:40 smithi071 ceph-mon[31451]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:40.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-27T09:48:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:40 smithi122 ceph-mon[36436]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:40 smithi072 ceph-mon[35951]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:41.479 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:42 smithi122 ceph-mon[36436]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:43.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:42 smithi071 ceph-mon[31451]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:42 smithi072 ceph-mon[35951]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:43.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 -- 172.21.15.71:0/61187060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63010c5a0 msgr2=0x7ff63010c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 --2- 172.21.15.71:0/61187060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63010c5a0 0x7ff63010c9b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff620009990 tx=0x7ff620009ca0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 -- 172.21.15.71:0/61187060 shutdown_connections 2024-05-27T09:48:43.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 --2- 172.21.15.71:0/61187060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 0x7ff630113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 --2- 172.21.15.71:0/61187060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63010c5a0 0x7ff63010c9b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 --2- 172.21.15.71:0/61187060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff630106560 0x7ff630106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 -- 172.21.15.71:0/61187060 >> 172.21.15.71:0/61187060 conn(0x7ff630102040 msgr2=0x7ff630104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:43.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 -- 172.21.15.71:0/61187060 shutdown_connections 2024-05-27T09:48:43.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.440+0000 7ff637200700 1 -- 172.21.15.71:0/61187060 wait complete. 2024-05-27T09:48:43.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 Processor -- start 2024-05-27T09:48:43.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 -- start start 2024-05-27T09:48:43.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630106560 0x7ff63019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 0x7ff63019d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63010c5a0 0x7ff6301a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff630116720 con 0x7ff630106eb0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301165a0 con 0x7ff630106560 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff637200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301168a0 con 0x7ff63010c5a0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.442+0000 7ff62f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 0x7ff63019d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630106560 0x7ff63019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 0x7ff63019d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53828/0 (socket says 172.21.15.71:53828) 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 -- 172.21.15.71:0/3070604208 learned_addr learned my addr 172.21.15.71:0/3070604208 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff635200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63010c5a0 0x7ff6301a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 -- 172.21.15.71:0/3070604208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63010c5a0 msgr2=0x7ff6301a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63010c5a0 0x7ff6301a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 -- 172.21.15.71:0/3070604208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630106560 msgr2=0x7ff63019d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630106560 0x7ff63019d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 -- 172.21.15.71:0/3070604208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6301a1f20 con 0x7ff630106eb0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.443+0000 7ff62f400700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 0x7ff63019d5f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00e9c0 tx=0x7ff61c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.444+0000 7ff62cc00700 1 -- 172.21.15.71:0/3070604208 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c004a30 con 0x7ff630106eb0 2024-05-27T09:48:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.444+0000 7ff62cc00700 1 -- 172.21.15.71:0/3070604208 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff61c00cc70 con 0x7ff630106eb0 2024-05-27T09:48:43.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.444+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6301a2210 con 0x7ff630106eb0 2024-05-27T09:48:43.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.444+0000 7ff62cc00700 1 -- 172.21.15.71:0/3070604208 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c005500 con 0x7ff630106eb0 2024-05-27T09:48:43.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.444+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6301a9b30 con 0x7ff630106eb0 2024-05-27T09:48:43.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.448+0000 7ff62cc00700 1 -- 172.21.15.71:0/3070604208 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7ff61c004bd0 con 0x7ff630106eb0 2024-05-27T09:48:43.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 Processor -- start 2024-05-27T09:48:43.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 -- start start 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c12005f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c120060170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c11ff8ddf0 con 0x55c120065ce0 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c11ff7d990 con 0x55c12005fd60 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.449+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c11ff819d0 con 0x55c11fee0df0 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c12005f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff635200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c12005f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53830/0 (socket says 172.21.15.71:53830) 2024-05-27T09:48:43.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 -- 172.21.15.71:0/3625691513 learned_addr learned my addr 172.21.15.71:0/3625691513 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:43.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62f400700 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c120060170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 -- 172.21.15.71:0/3625691513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 msgr2=0x55c1200657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 -- 172.21.15.71:0/3625691513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 msgr2=0x55c120060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c120060170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff62fe00700 1 -- 172.21.15.71:0/3625691513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c11ff463d0 con 0x55c120065ce0 2024-05-27T09:48:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.450+0000 7ff635200700 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.451+0000 7ff62cc00700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6140b2b10 0x7ff6140b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.451+0000 7ff62fe00700 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c12005f820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff620015000 tx=0x7ff6200096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef93702f330a4277 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:43.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.451+0000 7ff62cc00700 1 -- 172.21.15.71:0/3070604208 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff61c0e2aa0 con 0x7ff630106eb0 2024-05-27T09:48:43.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.451+0000 7ff635200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6140b2b10 0x7ff6140b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.451+0000 7ff625600700 1 -- 172.21.15.71:0/3625691513 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620027070 con 0x55c120065ce0 2024-05-27T09:48:43.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.451+0000 7ff625600700 1 -- 172.21.15.71:0/3625691513 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff62000bbd0 con 0x55c120065ce0 2024-05-27T09:48:43.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.451+0000 7ff625600700 1 -- 172.21.15.71:0/3625691513 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620003c60 con 0x55c120065ce0 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.452+0000 7ff645d2cb80 1 -- 172.21.15.71:0/3625691513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 msgr2=0x55c12005f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.452+0000 7ff635200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6140b2b10 0x7ff6140b5020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c120060ae0 tx=0x7ff62800b040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.452+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c12005f820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff620015000 tx=0x7ff6200096a0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.452+0000 7ff645d2cb80 1 -- 172.21.15.71:0/3625691513 shutdown_connections 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.452+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c120060170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.452+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.452+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/3625691513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c12005f820 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.453+0000 7ff645d2cb80 1 -- 172.21.15.71:0/3625691513 >> 172.21.15.71:0/3625691513 conn(0x55c11ff40f70 msgr2=0x55c12005a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.453+0000 7ff645d2cb80 1 -- 172.21.15.71:0/3625691513 shutdown_connections 2024-05-27T09:48:43.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.453+0000 7ff645d2cb80 1 -- 172.21.15.71:0/3625691513 wait complete. 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.453+0000 7ff645d2cb80 1 -- start start 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 1 Processor -- start 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c1200699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c120069f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c11fe83f50 con 0x55c120065ce0 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c11ff1e710 con 0x55c12005fd60 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c12006c750 con 0x55c11fee0df0 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.454+0000 7ff645d2cb80 10 client.0 _ll_register_callbacks cb 0x55c11ff27c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff635200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c120069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:51750/0 (socket says 172.21.15.71:51750) 2024-05-27T09:48:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 -- 172.21.15.71:0/1702736868 learned_addr learned my addr 172.21.15.71:0/1702736868 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62f400700 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c1200699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 -- 172.21.15.71:0/1702736868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 msgr2=0x55c1200699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c1200699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 -- 172.21.15.71:0/1702736868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 msgr2=0x55c120069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c120069f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.455+0000 7ff62fe00700 1 -- 172.21.15.71:0/1702736868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c11fecd880 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff62fe00700 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200694a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6200094e0 tx=0x7ff620003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d56c717a31c42f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff61a000700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff61a000700 1 -- 172.21.15.71:0/1702736868 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620027040 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff62000bbd0 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff61a000700 1 -- 172.21.15.71:0/1702736868 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff62000b720 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff61a000700 1 -- 172.21.15.71:0/1702736868 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff6200056e0 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff645d2cb80 10 client.25351 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.456+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c11ff4e010 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff61a000700 1 -- 172.21.15.71:0/1702736868 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff62000bbd0 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff61a000700 1 -- 172.21.15.71:0/1702736868 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7ff62000f700 con 0x55c11fee0df0 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff645d2cb80 10 client.25351 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff645d2cb80 10 client.25351 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-27T09:48:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff645d2cb80 20 client.25351 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c120078350 0x55c12007a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff645d2cb80 4 client.25351 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c11ff8fd40 con 0x55c120078350 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.457+0000 7ff62f400700 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c120078350 0x55c12007a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.458+0000 7ff61a000700 10 client.25351 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.458+0000 7ff62f400700 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c120078350 0x55c12007a4e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e247c9d5250c10d0 server_cookie=6a7e0ff94a9ebe74 in_seq=0 out_seq=0 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff61a000700 1 -- 172.21.15.71:0/1702736868 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55c11ff8fd40 con 0x55c120078350 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff61a000700 10 client.25351 handle_command_reply: tid=0 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 client.25351 shutdown 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 msgr2=0x55c1200694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200694a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6200094e0 tx=0x7ff620003730 comp rx=0 tx=0).stop 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 shutdown_connections 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c120078350 0x55c12007a4e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c120065ce0 0x55c120069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c11fee0df0 0x55c1200694a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff61a000700 0 client.25351 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:43.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/1702736868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c1200699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 >> 172.21.15.71:0/1702736868 conn(0x55c11ff40f70 msgr2=0x55c12005a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:43.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 shutdown_connections 2024-05-27T09:48:43.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.459+0000 7ff645d2cb80 1 -- 172.21.15.71:0/1702736868 wait complete. 2024-05-27T09:48:43.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.460+0000 7ff645d2cb80 20 client.25351 trim_cache size 0 max 16384 2024-05-27T09:48:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.483+0000 7ff645d2cb80 1 Processor -- start 2024-05-27T09:48:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.483+0000 7ff645d2cb80 1 -- start start 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c12005f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c12006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c120065ce0 0x55c120063b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c120078820 con 0x55c11fee0df0 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c120078ef0 con 0x55c12005fd60 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c1200795c0 con 0x55c120065ce0 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c12005f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c12006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff635200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c120065ce0 0x55c120063b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c12006b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45646/0 (socket says 172.21.15.71:45646) 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c12005f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53854/0 (socket says 172.21.15.71:53854) 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 -- 172.21.15.71:0/4156739306 learned_addr learned my addr 172.21.15.71:0/4156739306 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 -- 172.21.15.71:0/4156739306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c120065ce0 msgr2=0x55c120063b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 --2- 172.21.15.71:0/4156739306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c120065ce0 0x55c120063b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 -- 172.21.15.71:0/4156739306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 msgr2=0x55c12005f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 --2- 172.21.15.71:0/4156739306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c12005f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.484+0000 7ff62f400700 1 -- 172.21.15.71:0/4156739306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c120065330 con 0x55c12005fd60 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.485+0000 7ff62f400700 1 --2- 172.21.15.71:0/4156739306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c12006b940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0a9800 tx=0x7ff61c0e4ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca495f7c0541061 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.485+0000 7ff624c00700 1 -- 172.21.15.71:0/4156739306 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0ec040 con 0x55c12005fd60 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.485+0000 7ff624c00700 1 -- 172.21.15.71:0/4156739306 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff61c005720 con 0x55c12005fd60 2024-05-27T09:48:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.485+0000 7ff624c00700 1 -- 172.21.15.71:0/4156739306 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0a9fc0 con 0x55c12005fd60 2024-05-27T09:48:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 -- 172.21.15.71:0/4156739306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 msgr2=0x55c12006b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/4156739306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c12006b940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0a9800 tx=0x7ff61c0e4ef0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 -- 172.21.15.71:0/4156739306 shutdown_connections 2024-05-27T09:48:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/4156739306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c120065ce0 0x55c120063b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/4156739306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c12005f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/4156739306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c12005fd60 0x55c12006b940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 -- 172.21.15.71:0/4156739306 >> 172.21.15.71:0/4156739306 conn(0x55c11ff40f70 msgr2=0x55c120064c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 -- 172.21.15.71:0/4156739306 shutdown_connections 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.486+0000 7ff645d2cb80 1 -- 172.21.15.71:0/4156739306 wait complete. 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.487+0000 7ff645d2cb80 1 -- start start 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.487+0000 7ff645d2cb80 1 Processor -- start 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c120083960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c12005fd60 0x55c120083ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff645d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c120065ce0 0x55c12007e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c12007a360 con 0x55c11fee0df0 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c120079c90 con 0x55c120065ce0 2024-05-27T09:48:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff645d2cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c12007aa30 con 0x55c12005fd60 2024-05-27T09:48:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff645d2cb80 10 client.0 _ll_register_callbacks cb 0x55c11ff27c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c12005fd60 0x55c120083ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c120083960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c12005fd60 0x55c120083ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:51764/0 (socket says 172.21.15.71:51764) 2024-05-27T09:48:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 -- 172.21.15.71:0/2795275450 learned_addr learned my addr 172.21.15.71:0/2795275450 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff635200700 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c120065ce0 0x55c12007e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 -- 172.21.15.71:0/2795275450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c120065ce0 msgr2=0x55c12007e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c120065ce0 0x55c12007e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 -- 172.21.15.71:0/2795275450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 msgr2=0x55c120083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c120083960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.488+0000 7ff62f400700 1 -- 172.21.15.71:0/2795275450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c12006a290 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff62f400700 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c12005fd60 0x55c120083ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0cc010 tx=0x7ff61c0a9f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470ecdfa1dafc7c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff61a000700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff61a000700 1 -- 172.21.15.71:0/2795275450 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0a9270 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff61a000700 1 -- 172.21.15.71:0/2795275450 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff61c0b26e0 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c11ff89520 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff61a000700 1 -- 172.21.15.71:0/2795275450 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff61c0a5290 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff645d2cb80 10 client.25357 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c1200e4b40 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.489+0000 7ff61a000700 1 -- 172.21.15.71:0/2795275450 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c11ff89520 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff61a000700 1 -- 172.21.15.71:0/2795275450 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7ff61c06f2e0 con 0x55c12005fd60 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff645d2cb80 10 client.25357 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff645d2cb80 10 client.25357 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff645d2cb80 20 client.25357 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c1200e6a20 0x55c1200e7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff645d2cb80 4 client.25357 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "status"}) -- 0x55c11fe00200 con 0x55c1200e6a20 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.490+0000 7ff62fe00700 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c1200e6a20 0x55c1200e7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff61a000700 10 client.25357 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff62fe00700 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c1200e6a20 0x55c1200e7e90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a438b9807f674b6 server_cookie=c4d8622f20cdc8fd in_seq=0 out_seq=0 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff61a000700 1 -- 172.21.15.71:0/2795275450 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c11fe00200 con 0x55c1200e6a20 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff61a000700 10 client.25357 handle_command_reply: tid=0 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 client.25357 shutdown 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c12005fd60 msgr2=0x55c120083ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c12005fd60 0x55c120083ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0cc010 tx=0x7ff61c0a9f70 comp rx=0 tx=0).stop 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 shutdown_connections 2024-05-27T09:48:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x55c1200e6a20 0x55c1200e7e90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c120065ce0 0x55c12007e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c11fee0df0 0x55c120083960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff61a000700 0 client.25357 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 --2- 172.21.15.71:0/2795275450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c12005fd60 0x55c120083ea0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 >> 172.21.15.71:0/2795275450 conn(0x55c11ff40f70 msgr2=0x55c120064c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.491+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 shutdown_connections 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.492+0000 7ff645d2cb80 1 -- 172.21.15.71:0/2795275450 wait complete. 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.492+0000 7ff645d2cb80 20 client.25357 trim_cache size 0 max 16384 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:48:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 2, 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24508, 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 275.22287290100002, 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 26, 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 84, 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 83, 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 327.05011999999999 2024-05-27T09:48:43.497 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.492+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6140b2b10 msgr2=0x7ff6140b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.492+0000 7ff637200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6140b2b10 0x7ff6140b5020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c120060ae0 tx=0x7ff62800b040 comp rx=0 tx=0).stop 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 msgr2=0x7ff63019d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 0x7ff63019d5f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00e9c0 tx=0x7ff61c00ecd0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 shutdown_connections 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6140b2b10 0x7ff6140b5020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63010c5a0 0x7ff6301a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630106560 0x7ff63019d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 --2- 172.21.15.71:0/3070604208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff630106eb0 0x7ff63019d5f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 >> 172.21.15.71:0/3070604208 conn(0x7ff630102040 msgr2=0x7ff6301037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 shutdown_connections 2024-05-27T09:48:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:43.493+0000 7ff637200700 1 -- 172.21.15.71:0/3070604208 wait complete. 2024-05-27T09:48:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.216+0000 7f46d9000700 1 -- 172.21.15.71:0/2890261562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 msgr2=0x7f46d4109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.216+0000 7f46d9000700 1 --2- 172.21.15.71:0/2890261562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 0x7f46d4109300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f46c00099c0 tx=0x7f46c0009cd0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.217+0000 7f46d9000700 1 -- 172.21.15.71:0/2890261562 shutdown_connections 2024-05-27T09:48:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.217+0000 7f46d9000700 1 --2- 172.21.15.71:0/2890261562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d4109840 0x7f46d41111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.217+0000 7f46d9000700 1 --2- 172.21.15.71:0/2890261562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d41045c0 0x7f46d41049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.217+0000 7f46d9000700 1 --2- 172.21.15.71:0/2890261562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 0x7f46d4109300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.217+0000 7f46d9000700 1 -- 172.21.15.71:0/2890261562 >> 172.21.15.71:0/2890261562 conn(0x7f46d40ffe90 msgr2=0x7f46d41022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.217+0000 7f46d9000700 1 -- 172.21.15.71:0/2890261562 shutdown_connections 2024-05-27T09:48:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.217+0000 7f46d9000700 1 -- 172.21.15.71:0/2890261562 wait complete. 2024-05-27T09:48:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.218+0000 7f46d9000700 1 Processor -- start 2024-05-27T09:48:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.218+0000 7f46d9000700 1 -- start start 2024-05-27T09:48:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d9000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d41045c0 0x7f46d419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d9000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 0x7f46d419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d9000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d4109840 0x7f46d419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d9000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4114450 con 0x7f46d4109840 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d9000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f46d41142d0 con 0x7f46d41045c0 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d9000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f46d41145d0 con 0x7f46d4108ef0 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d41045c0 0x7f46d419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d41045c0 0x7f46d419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36672/0 (socket says 172.21.15.71:36672) 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d4109840 0x7f46d419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.219+0000 7f46d1e00700 1 -- 172.21.15.71:0/2549104625 learned_addr learned my addr 172.21.15.71:0/2549104625 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.220+0000 7f46d1400700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 0x7f46d419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.220+0000 7f46d1e00700 1 -- 172.21.15.71:0/2549104625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 msgr2=0x7f46d419b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.220+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 0x7f46d419b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.220+0000 7f46d1e00700 1 -- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d4109840 msgr2=0x7f46d419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.220+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d4109840 0x7f46d419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.220+0000 7f46d1e00700 1 -- 172.21.15.71:0/2549104625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d419fd70 con 0x7f46d41045c0 2024-05-27T09:48:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.220+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d41045c0 0x7f46d419aea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46c400e9a0 tx=0x7f46c400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.221+0000 7f46caa00700 1 -- 172.21.15.71:0/2549104625 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c400cbd0 con 0x7f46d41045c0 2024-05-27T09:48:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.221+0000 7f46caa00700 1 -- 172.21.15.71:0/2549104625 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46c400cd70 con 0x7f46d41045c0 2024-05-27T09:48:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.221+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d41a0060 con 0x7f46d41045c0 2024-05-27T09:48:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.221+0000 7f46caa00700 1 -- 172.21.15.71:0/2549104625 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4018680 con 0x7f46d41045c0 2024-05-27T09:48:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.221+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d41a7980 con 0x7f46d41045c0 2024-05-27T09:48:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.225+0000 7f46caa00700 1 -- 172.21.15.71:0/2549104625 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f46c4010430 con 0x7f46d41045c0 2024-05-27T09:48:44.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.225+0000 7f46e7a48b80 1 Processor -- start 2024-05-27T09:48:44.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46e7a48b80 1 -- start start 2024-05-27T09:48:44.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7182330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5639b70b0e40 con 0x5639b70ef9f0 2024-05-27T09:48:44.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5639b70a09e0 con 0x5639b7003e40 2024-05-27T09:48:44.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5639b70a4a20 con 0x5639b7182e70 2024-05-27T09:48:44.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.226+0000 7f46caa00700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f46b80b2b90 0x7f46b80b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7182330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7182330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38590/0 (socket says 172.21.15.71:38590) 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36682/0 (socket says 172.21.15.71:36682) 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 -- 172.21.15.71:0/2386497189 learned_addr learned my addr 172.21.15.71:0/2386497189 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46caa00700 1 -- 172.21.15.71:0/2549104625 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f46c40e2b10 con 0x7f46d41045c0 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d1400700 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f46b80b2b90 0x7f46b80b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 -- 172.21.15.71:0/2386497189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 msgr2=0x5639b718f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 -- 172.21.15.71:0/2386497189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 msgr2=0x5639b7182870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d2800700 1 -- 172.21.15.71:0/2386497189 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639b7069420 con 0x5639b70ef9f0 2024-05-27T09:48:44.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.227+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:44.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.228+0000 7f46d2800700 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7182330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f46cc012c60 tx=0x7f46cc012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198cb254e1ed676e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.228+0000 7f46bf400700 1 -- 172.21.15.71:0/2386497189 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc007500 con 0x5639b70ef9f0 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.228+0000 7f46bf400700 1 -- 172.21.15.71:0/2386497189 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46cc0198e0 con 0x5639b70ef9f0 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.228+0000 7f46bf400700 1 -- 172.21.15.71:0/2386497189 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc021680 con 0x5639b70ef9f0 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.228+0000 7f46d2800700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f46b80b2b90 0x7f46b80b50a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46cc021000 tx=0x7f46cc01f000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2386497189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 msgr2=0x5639b7182330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7182330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f46cc012c60 tx=0x7f46cc012f70 comp rx=0 tx=0).stop 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2386497189 shutdown_connections 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7182330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2386497189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2386497189 >> 172.21.15.71:0/2386497189 conn(0x5639b709d390 msgr2=0x5639b717e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:44.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.229+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2386497189 shutdown_connections 2024-05-27T09:48:44.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.230+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2386497189 wait complete. 2024-05-27T09:48:44.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.230+0000 7f46e7a48b80 1 -- start start 2024-05-27T09:48:44.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 1 Processor -- start 2024-05-27T09:48:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b718c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b718ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5639b6fa6fa0 con 0x5639b70ef9f0 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5639b7041760 con 0x5639b7003e40 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5639b718fb80 con 0x5639b7182e70 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.231+0000 7f46e7a48b80 10 client.0 _ll_register_callbacks cb 0x5639b704ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b718c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b718c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36698/0 (socket says 172.21.15.71:36698) 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 -- 172.21.15.71:0/2314571353 learned_addr learned my addr 172.21.15.71:0/2314571353 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d2800700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1400700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b718ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 -- 172.21.15.71:0/2314571353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 msgr2=0x5639b718d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 -- 172.21.15.71:0/2314571353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 msgr2=0x5639b718ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b718ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1e00700 1 -- 172.21.15.71:0/2314571353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639b6ff08d0 con 0x5639b7003e40 2024-05-27T09:48:44.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.232+0000 7f46d1400700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b718ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b718c780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46c40a9b00 tx=0x7f46c40b2820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17dd0dc303f11d7f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46b3e00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46b3e00700 1 -- 172.21.15.71:0/2314571353 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40a5300 con 0x5639b7003e40 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46b3e00700 1 -- 172.21.15.71:0/2314571353 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f46c40e0390 con 0x5639b7003e40 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46cc0198e0 con 0x5639b7003e40 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46b3e00700 1 -- 172.21.15.71:0/2314571353 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f46c40aa050 con 0x5639b7003e40 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46e7a48b80 10 client.25352 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.234+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5639b7071060 con 0x5639b7003e40 2024-05-27T09:48:44.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46b3e00700 1 -- 172.21.15.71:0/2314571353 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46cc0198e0 con 0x5639b7003e40 2024-05-27T09:48:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46b3e00700 1 -- 172.21.15.71:0/2314571353 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f46c40a54e0 con 0x5639b7003e40 2024-05-27T09:48:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46e7a48b80 10 client.25352 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46e7a48b80 10 client.25352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46e7a48b80 20 client.25352 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b71a0fd0 0x5639b71a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46e7a48b80 4 client.25352 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.235+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639b70b2d90 con 0x5639b71a0fd0 2024-05-27T09:48:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.236+0000 7f46d1400700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b71a0fd0 0x5639b71a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.236+0000 7f46d1400700 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b71a0fd0 0x5639b71a33f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4965853a2ac0fa8 server_cookie=1f725b219bb11fbd in_seq=0 out_seq=0 2024-05-27T09:48:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.236+0000 7f46b3e00700 10 client.25352 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.237+0000 7f46b3e00700 1 -- 172.21.15.71:0/2314571353 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5639b70b2d90 con 0x5639b71a0fd0 2024-05-27T09:48:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.237+0000 7f46b3e00700 10 client.25352 handle_command_reply: tid=0 2024-05-27T09:48:44.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.237+0000 7f46e7a48b80 1 client.25352 shutdown 2024-05-27T09:48:44.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 msgr2=0x5639b718c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b718c780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46c40a9b00 tx=0x7f46c40b2820 comp rx=0 tx=0).stop 2024-05-27T09:48:44.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 shutdown_connections 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b71a0fd0 0x5639b71a33f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b718d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b718c780 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2314571353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b718ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46b3e00700 0 client.25352 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 >> 172.21.15.71:0/2314571353 conn(0x5639b709d390 msgr2=0x5639b71823b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 shutdown_connections 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2314571353 wait complete. 2024-05-27T09:48:44.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.238+0000 7f46e7a48b80 20 client.25352 trim_cache size 0 max 16384 2024-05-27T09:48:44.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.260+0000 7f46e7a48b80 1 Processor -- start 2024-05-27T09:48:44.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46e7a48b80 1 -- start start 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b719d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b71a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4074b10 con 0x5639b70ef9f0 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40723a0 con 0x5639b7003e40 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4070210 con 0x5639b7182e70 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46d1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36700/0 (socket says 172.21.15.71:36700) 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46d1e00700 1 -- 172.21.15.71:0/2992147070 learned_addr learned my addr 172.21.15.71:0/2992147070 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46d1400700 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b719d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.261+0000 7f46d2800700 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b71a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46d1e00700 1 -- 172.21.15.71:0/2992147070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 msgr2=0x5639b71a8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b71a8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46d1e00700 1 -- 172.21.15.71:0/2992147070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 msgr2=0x5639b719d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b719d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46d1e00700 1 -- 172.21.15.71:0/2992147070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639b718d570 con 0x5639b7003e40 2024-05-27T09:48:44.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46d1400700 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b719d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:48:44.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46d1e00700 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c5b0 tx=0x7f46c40c42e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c39dde445467028 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46bea00700 1 -- 172.21.15.71:0/2992147070 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40dfff0 con 0x5639b7003e40 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46bea00700 1 -- 172.21.15.71:0/2992147070 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46c40a9680 con 0x5639b7003e40 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.262+0000 7f46bea00700 1 -- 172.21.15.71:0/2992147070 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40a9030 con 0x5639b7003e40 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2992147070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 msgr2=0x5639b7182830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c5b0 tx=0x7f46c40c42e0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2992147070 shutdown_connections 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7182e70 0x5639b71a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7003e40 0x5639b7182830 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/2992147070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b719d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2992147070 >> 172.21.15.71:0/2992147070 conn(0x5639b709d390 msgr2=0x5639b7182120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:44.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2992147070 shutdown_connections 2024-05-27T09:48:44.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.263+0000 7f46e7a48b80 1 -- 172.21.15.71:0/2992147070 wait complete. 2024-05-27T09:48:44.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.264+0000 7f46e7a48b80 1 -- start start 2024-05-27T09:48:44.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.264+0000 7f46e7a48b80 1 Processor -- start 2024-05-27T09:48:44.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7003e40 0x5639b7199690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7186880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46e7a48b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7182e70 0x5639b7186dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4070860 con 0x5639b70ef9f0 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4071cd0 con 0x5639b7182e70 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46e7a48b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4070f30 con 0x5639b7003e40 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46e7a48b80 10 client.0 _ll_register_callbacks cb 0x5639b704ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46d1400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7186880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46d1400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7186880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38604/0 (socket says 172.21.15.71:38604) 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46d1400700 1 -- 172.21.15.71:0/3945855309 learned_addr learned my addr 172.21.15.71:0/3945855309 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46d2800700 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7182e70 0x5639b7186dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.265+0000 7f46d1e00700 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7003e40 0x5639b7199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46d1400700 1 -- 172.21.15.71:0/3945855309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7003e40 msgr2=0x5639b7199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46d1400700 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7003e40 0x5639b7199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46d1400700 1 -- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7182e70 msgr2=0x5639b7186dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46d1400700 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7182e70 0x5639b7186dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46d1400700 1 -- 172.21.15.71:0/3945855309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639b7187300 con 0x5639b70ef9f0 2024-05-27T09:48:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46d1400700 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7186880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46c0003760 tx=0x7f46c0005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ee74b864aa7fdc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46b3e00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:44.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46b3e00700 1 -- 172.21.15.71:0/3945855309 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c00056a0 con 0x5639b70ef9f0 2024-05-27T09:48:44.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46b3e00700 1 -- 172.21.15.71:0/3945855309 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f46c00037c0 con 0x5639b70ef9f0 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.266+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46c40a9680 con 0x5639b70ef9f0 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46b3e00700 1 -- 172.21.15.71:0/3945855309 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f46c00039c0 con 0x5639b70ef9f0 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46e7a48b80 10 client.15249 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5639b7199090 con 0x5639b70ef9f0 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46b3e00700 1 -- 172.21.15.71:0/3945855309 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46c40a9680 con 0x5639b70ef9f0 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46b3e00700 1 -- 172.21.15.71:0/3945855309 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f46c0027420 con 0x5639b70ef9f0 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46e7a48b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46e7a48b80 10 client.15249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46e7a48b80 20 client.15249 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b720bd90 0x5639b720e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.267+0000 7f46e7a48b80 4 client.15249 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.268+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5639b70ac570 con 0x5639b720bd90 2024-05-27T09:48:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.268+0000 7f46d1e00700 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b720bd90 0x5639b720e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:44.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.268+0000 7f46b3e00700 10 client.15249 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:44.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.268+0000 7f46d1e00700 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b720bd90 0x5639b720e1b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89399902a3f4da86 server_cookie=aa96d2887d577121 in_seq=0 out_seq=0 2024-05-27T09:48:44.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46b3e00700 1 -- 172.21.15.71:0/3945855309 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5639b70ac570 con 0x5639b720bd90 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46b3e00700 10 client.15249 handle_command_reply: tid=0 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 client.15249 shutdown 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 msgr2=0x5639b7186880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7186880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46c0003760 tx=0x7f46c0005330 comp rx=0 tx=0).stop 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 shutdown_connections 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5639b720bd90 0x5639b720e1b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5639b7182e70 0x5639b7186dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5639b7003e40 0x5639b7199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 --2- 172.21.15.71:0/3945855309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5639b70ef9f0 0x5639b7186880 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 >> 172.21.15.71:0/3945855309 conn(0x5639b709d390 msgr2=0x5639b718c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46b3e00700 0 client.15249 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.269+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 shutdown_connections 2024-05-27T09:48:44.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.270+0000 7f46e7a48b80 1 -- 172.21.15.71:0/3945855309 wait complete. 2024-05-27T09:48:44.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.270+0000 7f46e7a48b80 20 client.15249 trim_cache size 0 max 16384 2024-05-27T09:48:44.273 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:48:44.273 INFO:teuthology.orchestra.run.smithi071.stdout: "status": "no active scrubs running", 2024-05-27T09:48:44.273 INFO:teuthology.orchestra.run.smithi071.stdout: "scrubs": {} 2024-05-27T09:48:44.273 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.270+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f46b80b2b90 msgr2=0x7f46b80b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.270+0000 7f46d9000700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f46b80b2b90 0x7f46b80b50a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46cc021000 tx=0x7f46cc01f000 comp rx=0 tx=0).stop 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.270+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d41045c0 msgr2=0x7f46d419aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.270+0000 7f46d9000700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d41045c0 0x7f46d419aea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46c400e9a0 tx=0x7f46c400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 shutdown_connections 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f46b80b2b90 0x7f46b80b50a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d4109840 0x7f46d419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d41045c0 0x7f46d419aea0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 --2- 172.21.15.71:0/2549104625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d4108ef0 0x7f46d419b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 >> 172.21.15.71:0/2549104625 conn(0x7f46d40ffe90 msgr2=0x7f46d410a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 shutdown_connections 2024-05-27T09:48:44.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:44.271+0000 7f46d9000700 1 -- 172.21.15.71:0/2549104625 wait complete. 2024-05-27T09:48:44.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.a status 2024-05-27T09:48:44.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:44 smithi071 ceph-mon[31451]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-27T09:48:44.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:44 smithi122 ceph-mon[36436]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-27T09:48:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:44 smithi072 ceph-mon[35951]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-27T09:48:45.419 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-27T09:48:45.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:48:45.534 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.344+0000 7f81b4000640 1 -- 172.21.15.71:0/1804911788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10b890 msgr2=0x7f81ac10dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.344+0000 7f81b4000640 1 --2- 172.21.15.71:0/1804911788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10b890 0x7f81ac10dcb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8198009900 tx=0x7f819802a480 comp rx=0 tx=0).stop 2024-05-27T09:48:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.345+0000 7f81b4000640 1 -- 172.21.15.71:0/1804911788 shutdown_connections 2024-05-27T09:48:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.345+0000 7f81b4000640 1 --2- 172.21.15.71:0/1804911788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac10e1f0 0x7f81ac1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.345+0000 7f81b4000640 1 --2- 172.21.15.71:0/1804911788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10b890 0x7f81ac10dcb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.345+0000 7f81b4000640 1 --2- 172.21.15.71:0/1804911788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac104e30 0x7f81ac105240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.345+0000 7f81b4000640 1 -- 172.21.15.71:0/1804911788 >> 172.21.15.71:0/1804911788 conn(0x7f81ac0782d0 msgr2=0x7f81ac078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:46.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.345+0000 7f81b4000640 1 -- 172.21.15.71:0/1804911788 shutdown_connections 2024-05-27T09:48:46.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.345+0000 7f81b4000640 1 -- 172.21.15.71:0/1804911788 wait complete. 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.346+0000 7f81b4000640 1 Processor -- start 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.346+0000 7f81b4000640 1 -- start start 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.346+0000 7f81b4000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac104e30 0x7f81ac1a2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.346+0000 7f81b4000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac10b890 0x7f81ac1a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b4000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10e1f0 0x7f81ac19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b4000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac113e50 con 0x7f81ac10e1f0 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b4000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac113cd0 con 0x7f81ac104e30 2024-05-27T09:48:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b4000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac113fd0 con 0x7f81ac10b890 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac104e30 0x7f81ac1a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10e1f0 0x7f81ac19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac104e30 0x7f81ac1a2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36714/0 (socket says 172.21.15.71:36714) 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 -- 172.21.15.71:0/2802263467 learned_addr learned my addr 172.21.15.71:0/2802263467 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b0c00640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac10b890 0x7f81ac1a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 -- 172.21.15.71:0/2802263467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac10b890 msgr2=0x7f81ac1a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac10b890 0x7f81ac1a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 -- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10e1f0 msgr2=0x7f81ac19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10e1f0 0x7f81ac19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.347+0000 7f81b1600640 1 -- 172.21.15.71:0/2802263467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac19cff0 con 0x7f81ac104e30 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.348+0000 7f81b1600640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac104e30 0x7f81ac1a2740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f81a000e9f0 tx=0x7f81a000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.348+0000 7f81aa000640 1 -- 172.21.15.71:0/2802263467 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a000ccc0 con 0x7f81ac104e30 2024-05-27T09:48:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.348+0000 7f81aa000640 1 -- 172.21.15.71:0/2802263467 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a00108e0 con 0x7f81ac104e30 2024-05-27T09:48:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.348+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac19d2e0 con 0x7f81ac104e30 2024-05-27T09:48:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.348+0000 7f81aa000640 1 -- 172.21.15.71:0/2802263467 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0018880 con 0x7f81ac104e30 2024-05-27T09:48:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.348+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac1a95c0 con 0x7f81ac104e30 2024-05-27T09:48:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.351+0000 7f81bb033740 1 Processor -- start 2024-05-27T09:48:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.351+0000 7f81bb033740 1 -- start start 2024-05-27T09:48:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81bb033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9a31b0 0x564bdbd45860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81bb033740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb97a2f0 0x564bdbd45da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81bb033740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81bb033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564bdbcb6b90 con 0x564bdb9a31b0 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81bb033740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564bdbca6730 con 0x564bdb97a2f0 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81bb033740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564bdbcaa770 con 0x564bdb9824d0 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81aa000640 1 -- 172.21.15.71:0/2802263467 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f81a0010430 con 0x7f81ac104e30 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9a31b0 0x564bdbd45860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9a31b0 0x564bdbd45860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38632/0 (socket says 172.21.15.71:38632) 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81b0c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81b2000640 1 -- 172.21.15.71:0/2103593426 learned_addr learned my addr 172.21.15.71:0/2103593426 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.352+0000 7f81b1600640 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb97a2f0 0x564bdbd45da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f81b2000640 1 -- 172.21.15.71:0/2103593426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 msgr2=0x564bdbd462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f81b2000640 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f81b2000640 1 -- 172.21.15.71:0/2103593426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb97a2f0 msgr2=0x564bdbd45da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f81b2000640 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb97a2f0 0x564bdbd45da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f81b2000640 1 -- 172.21.15.71:0/2103593426 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bdbc3f8b0 con 0x564bdb9a31b0 2024-05-27T09:48:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f81b1600640 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb97a2f0 0x564bdbd45da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:48:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f81b2000640 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9a31b0 0x564bdbd45860 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009f60 tx=0x7f81a4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0835d661efc7be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f819e600640 1 -- 172.21.15.71:0/2103593426 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a401e070 con 0x564bdb9a31b0 2024-05-27T09:48:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f819e600640 1 -- 172.21.15.71:0/2103593426 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a4003c30 con 0x564bdb9a31b0 2024-05-27T09:48:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.353+0000 7f819e600640 1 -- 172.21.15.71:0/2103593426 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a400f8a0 con 0x564bdb9a31b0 2024-05-27T09:48:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.354+0000 7f81aa000640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f81940b2af0 0x7f81940b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.354+0000 7f81aa000640 1 -- 172.21.15.71:0/2802263467 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f81a00e2c00 con 0x7f81ac104e30 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.354+0000 7f81b1600640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f81940b2af0 0x7f81940b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.354+0000 7f81bb033740 1 -- 172.21.15.71:0/2103593426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9a31b0 msgr2=0x564bdbd45860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.354+0000 7f81bb033740 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9a31b0 0x564bdbd45860 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009f60 tx=0x7f81a4009f90 comp rx=0 tx=0).stop 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 -- 172.21.15.71:0/2103593426 shutdown_connections 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb97a2f0 0x564bdbd45da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 --2- 172.21.15.71:0/2103593426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9a31b0 0x564bdbd45860 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 -- 172.21.15.71:0/2103593426 >> 172.21.15.71:0/2103593426 conn(0x564bdb997300 msgr2=0x564bdbd42010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 -- 172.21.15.71:0/2103593426 shutdown_connections 2024-05-27T09:48:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 -- 172.21.15.71:0/2103593426 wait complete. 2024-05-27T09:48:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81b1600640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f81940b2af0 0x7f81940b5000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81a00e0260 tx=0x7f81a000ce60 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.355+0000 7f81bb033740 1 -- start start 2024-05-27T09:48:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 1 Processor -- start 2024-05-27T09:48:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb97a2f0 0x564bdbd4f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9824d0 0x564bdbd4ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd5bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564bdb98c790 con 0x564bdb9824d0 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564bdbc4ebc0 con 0x564bdb9a31b0 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564bdbd52990 con 0x564bdb97a2f0 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81bb033740 10 client.0 _ll_register_callbacks cb 0x564bdbc2c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81b0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9824d0 0x564bdbd4ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81b0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9824d0 0x564bdbd4ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38642/0 (socket says 172.21.15.71:38642) 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.356+0000 7f81b0c00640 1 -- 172.21.15.71:0/1855491518 learned_addr learned my addr 172.21.15.71:0/1855491518 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b2000640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb97a2f0 0x564bdbd4f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b2000640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd5bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b0c00640 1 -- 172.21.15.71:0/1855491518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb97a2f0 msgr2=0x564bdbd4f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b0c00640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb97a2f0 0x564bdbd4f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b0c00640 1 -- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 msgr2=0x564bdbd5bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b0c00640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd5bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b0c00640 1 -- 172.21.15.71:0/1855491518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bdb9bb210 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b2000640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb97a2f0 0x564bdbd4f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f81b0c00640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9824d0 0x564bdbd4ff30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8198009900 tx=0x7f8198005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3459ee81270bad49 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.357+0000 7f8192a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f8192a00640 1 -- 172.21.15.71:0/1855491518 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198035040 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f8192a00640 1 -- 172.21.15.71:0/1855491518 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f81980317e0 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a4003c30 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f8192a00640 1 -- 172.21.15.71:0/1855491518 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8198004040 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f81bb033740 10 client.15261 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564bdba87620 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f8192a00640 1 -- 172.21.15.71:0/1855491518 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a4003c30 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f8192a00640 1 -- 172.21.15.71:0/1855491518 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f81980047e0 con 0x564bdb9824d0 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f81bb033740 10 client.15261 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f81bb033740 10 client.15261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f81bb033740 20 client.15261 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.358+0000 7f81bb033740 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb961d80 0x564bdbd61c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.359+0000 7f81bb033740 4 client.15261 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.359+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bdbcb8ae0 con 0x564bdb961d80 2024-05-27T09:48:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.359+0000 7f81b2000640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb961d80 0x564bdbd61c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.359+0000 7f81b2000640 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb961d80 0x564bdbd61c30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=971e777a45f49f77 server_cookie=a2a446fa93d167ee in_seq=0 out_seq=0 2024-05-27T09:48:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.359+0000 7f8192a00640 10 client.15261 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.360+0000 7f8192a00640 1 -- 172.21.15.71:0/1855491518 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x564bdbcb8ae0 con 0x564bdb961d80 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.360+0000 7f8192a00640 10 client.15261 handle_command_reply: tid=0 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.360+0000 7f81bb033740 1 client.15261 shutdown 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.360+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9824d0 msgr2=0x564bdbd4ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9824d0 0x564bdbd4ff30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8198009900 tx=0x7f8198005f10 comp rx=0 tx=0).stop 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 shutdown_connections 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd5bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb961d80 0x564bdbd61c30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb9824d0 0x564bdbd4ff30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 --2- 172.21.15.71:0/1855491518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb97a2f0 0x564bdbd4f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f8192a00640 0 client.15261 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:46.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 >> 172.21.15.71:0/1855491518 conn(0x564bdb997300 msgr2=0x564bdbd45690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:46.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 shutdown_connections 2024-05-27T09:48:46.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 1 -- 172.21.15.71:0/1855491518 wait complete. 2024-05-27T09:48:46.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.361+0000 7f81bb033740 20 client.15261 trim_cache size 0 max 16384 2024-05-27T09:48:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.377+0000 7f81bb033740 1 Processor -- start 2024-05-27T09:48:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81bb033740 1 -- start start 2024-05-27T09:48:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81bb033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd52120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81bb033740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd41330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81bb033740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd4f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81bb033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac1b4580 con 0x564bdb97a2f0 2024-05-27T09:48:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81bb033740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac1b1e50 con 0x564bdb9a31b0 2024-05-27T09:48:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81bb033740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac1afca0 con 0x564bdb9824d0 2024-05-27T09:48:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd52120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd52120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38658/0 (socket says 172.21.15.71:38658) 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81b2000640 1 -- 172.21.15.71:0/3102588870 learned_addr learned my addr 172.21.15.71:0/3102588870 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81b2000640 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd4f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.378+0000 7f81b0c00640 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd41330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f81b2000640 1 -- 172.21.15.71:0/3102588870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 msgr2=0x564bdbd41330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f81b2000640 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd41330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f81b2000640 1 -- 172.21.15.71:0/3102588870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 msgr2=0x564bdbd4f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f81b2000640 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd4f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f81b2000640 1 -- 172.21.15.71:0/3102588870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bdbd49ff0 con 0x564bdb97a2f0 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f81b2000640 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd52120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f81a4004920 tx=0x7f81a4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f799684612b7c658 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f819dc00640 1 -- 172.21.15.71:0/3102588870 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a401e040 con 0x564bdb97a2f0 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f819dc00640 1 -- 172.21.15.71:0/3102588870 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a4004700 con 0x564bdb97a2f0 2024-05-27T09:48:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.379+0000 7f819dc00640 1 -- 172.21.15.71:0/3102588870 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a400fd50 con 0x564bdb97a2f0 2024-05-27T09:48:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 -- 172.21.15.71:0/3102588870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 msgr2=0x564bdbd52120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd52120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f81a4004920 tx=0x7f81a4009f90 comp rx=0 tx=0).stop 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 -- 172.21.15.71:0/3102588870 shutdown_connections 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbd4f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd41330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 --2- 172.21.15.71:0/3102588870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd52120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 -- 172.21.15.71:0/3102588870 >> 172.21.15.71:0/3102588870 conn(0x564bdb997300 msgr2=0x564bdbd4f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 -- 172.21.15.71:0/3102588870 shutdown_connections 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.380+0000 7f81bb033740 1 -- 172.21.15.71:0/3102588870 wait complete. 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 -- start start 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 Processor -- start 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd53240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd53780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbdc2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac1b0310 con 0x564bdb97a2f0 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac1b1780 con 0x564bdb9a31b0 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac1b09e0 con 0x564bdb9824d0 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.381+0000 7f81bb033740 10 client.0 _ll_register_callbacks cb 0x7f8198009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd53240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd53240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38668/0 (socket says 172.21.15.71:38668) 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 -- 172.21.15.71:0/3215517707 learned_addr learned my addr 172.21.15.71:0/3215517707 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b0c00640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd53780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbdc2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 -- 172.21.15.71:0/3215517707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 msgr2=0x564bdbd53780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd53780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 -- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 msgr2=0x564bdbdc2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbdc2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 -- 172.21.15.71:0/3215517707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bdbdc27c0 con 0x564bdb97a2f0 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b0c00640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd53780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f81b2000640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd53240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009d70 tx=0x7f81a400f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca5972a443c4713 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.382+0000 7f8192a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f8192a00640 1 -- 172.21.15.71:0/3215517707 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a401e040 con 0x564bdb97a2f0 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f8192a00640 1 -- 172.21.15.71:0/3215517707 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f81a400f9d0 con 0x564bdb97a2f0 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a4004700 con 0x564bdb97a2f0 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f8192a00640 1 -- 172.21.15.71:0/3215517707 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f81a4004ba0 con 0x564bdb97a2f0 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 10 client.15267 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564bdbdc9ac0 con 0x564bdb97a2f0 2024-05-27T09:48:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f8192a00640 1 -- 172.21.15.71:0/3215517707 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a4004700 con 0x564bdb97a2f0 2024-05-27T09:48:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f8192a00640 1 -- 172.21.15.71:0/3215517707 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f81a4027420 con 0x564bdb97a2f0 2024-05-27T09:48:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 10 client.15267 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 10 client.15267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:46.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 20 client.15267 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:46.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb9371c0 0x564bdbdcbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:46.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 4 client.15267 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:48:46.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.383+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564bdbcb22c0 con 0x564bdb9371c0 2024-05-27T09:48:46.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.384+0000 7f81b0c00640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb9371c0 0x564bdbdcbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:46.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.384+0000 7f81b0c00640 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb9371c0 0x564bdbdcbfa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5df8367b2dd9fef server_cookie=e7c54370f08c118a in_seq=0 out_seq=0 2024-05-27T09:48:46.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.384+0000 7f8192a00640 10 client.15267 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:46.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f8192a00640 1 -- 172.21.15.71:0/3215517707 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564bdbcb22c0 con 0x564bdb9371c0 2024-05-27T09:48:46.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f8192a00640 10 client.15267 handle_command_reply: tid=0 2024-05-27T09:48:46.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 client.15267 shutdown 2024-05-27T09:48:46.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 msgr2=0x564bdbd53240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd53240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009d70 tx=0x7f81a400f930 comp rx=0 tx=0).stop 2024-05-27T09:48:46.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 shutdown_connections 2024-05-27T09:48:46.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bdb9a31b0 0x564bdbdc2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564bdb9824d0 0x564bdbd53780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564bdb9371c0 0x564bdbdcbfa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 --2- 172.21.15.71:0/3215517707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bdb97a2f0 0x564bdbd53240 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f8192a00640 0 client.15267 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 >> 172.21.15.71:0/3215517707 conn(0x564bdb997300 msgr2=0x564bdbd4fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 shutdown_connections 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 1 -- 172.21.15.71:0/3215517707 wait complete. 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.394+0000 7f81bb033740 20 client.15267 trim_cache size 0 max 16384 2024-05-27T09:48:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:48:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:48:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:48:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f81940b2af0 msgr2=0x7f81940b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f81940b2af0 0x7f81940b5000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81a00e0260 tx=0x7f81a000ce60 comp rx=0 tx=0).stop 2024-05-27T09:48:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac104e30 msgr2=0x7f81ac1a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac104e30 0x7f81ac1a2740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f81a000e9f0 tx=0x7f81a000edf0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 shutdown_connections 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f81940b2af0 0x7f81940b5000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81ac10e1f0 0x7f81ac19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac10b890 0x7f81ac1a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 --2- 172.21.15.71:0/2802263467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ac104e30 0x7f81ac1a2740 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 >> 172.21.15.71:0/2802263467 conn(0x7f81ac0782d0 msgr2=0x7f81ac10e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.395+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 shutdown_connections 2024-05-27T09:48:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:46.396+0000 7f81b4000640 1 -- 172.21.15.71:0/2802263467 wait complete. 2024-05-27T09:48:46.930 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:46 smithi071 ceph-mon[31451]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:46.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:46 smithi122 ceph-mon[36436]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:46 smithi072 ceph-mon[35951]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-27T09:48:48.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 -- 172.21.15.71:0/1468049357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94301045e0 msgr2=0x7f94301049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 --2- 172.21.15.71:0/1468049357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94301045e0 0x7f94301049f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9420009920 tx=0x7f9420009c30 comp rx=0 tx=0).stop 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 -- 172.21.15.71:0/1468049357 shutdown_connections 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 --2- 172.21.15.71:0/1468049357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9430109860 0x7f94301111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 --2- 172.21.15.71:0/1468049357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94301045e0 0x7f94301049f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 --2- 172.21.15.71:0/1468049357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9430108f10 0x7f9430109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 -- 172.21.15.71:0/1468049357 >> 172.21.15.71:0/1468049357 conn(0x7f94300fffd0 msgr2=0x7f94301023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 -- 172.21.15.71:0/1468049357 shutdown_connections 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.139+0000 7f9435800700 1 -- 172.21.15.71:0/1468049357 wait complete. 2024-05-27T09:48:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.141+0000 7f9435800700 1 Processor -- start 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.141+0000 7f9435800700 1 -- start start 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.141+0000 7f9435800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94301045e0 0x7f9430075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.141+0000 7f9435800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9430108f10 0x7f9430075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.141+0000 7f9435800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9430109860 0x7f9430076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.141+0000 7f9435800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94301144e0 con 0x7f94301045e0 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f9435800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9430114360 con 0x7f9430109860 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f9435800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9430114660 con 0x7f9430108f10 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94301045e0 0x7f9430075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94301045e0 0x7f9430075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38682/0 (socket says 172.21.15.71:38682) 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 -- 172.21.15.71:0/225397958 learned_addr learned my addr 172.21.15.71:0/225397958 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942e000700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9430108f10 0x7f9430075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 -- 172.21.15.71:0/225397958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9430108f10 msgr2=0x7f9430075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9430108f10 0x7f9430075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 -- 172.21.15.71:0/225397958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9430109860 msgr2=0x7f9430076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9430109860 0x7f9430076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.142+0000 7f942ea00700 1 -- 172.21.15.71:0/225397958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94301a9290 con 0x7f94301045e0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.143+0000 7f942ea00700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94301045e0 0x7f9430075ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9420000c00 tx=0x7f942000fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.143+0000 7f9427400700 1 -- 172.21.15.71:0/225397958 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420027070 con 0x7f94301045e0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.143+0000 7f9427400700 1 -- 172.21.15.71:0/225397958 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94200055f0 con 0x7f94301045e0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.143+0000 7f9427400700 1 -- 172.21.15.71:0/225397958 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420004930 con 0x7f94301045e0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.143+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94301a9520 con 0x7f94301045e0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.143+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94301a9920 con 0x7f94301045e0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.149+0000 7f9427400700 1 -- 172.21.15.71:0/225397958 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f942002a070 con 0x7f94301045e0 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 Processor -- start 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 -- start start 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270972e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x560527097820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f9427400700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f94140b2b10 0x7f94140b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560526fc5df0 con 0x560527097e20 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560526fb5990 con 0x560526f18df0 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.150+0000 7f944424eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560526fb99d0 con 0x5605270049a0 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f9427400700 1 -- 172.21.15.71:0/225397958 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f94200e32d0 con 0x7f94301045e0 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:56202/0 (socket says 172.21.15.71:56202) 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942f400700 1 -- 172.21.15.71:0/2126050782 learned_addr learned my addr 172.21.15.71:0/2126050782 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942f400700 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942e000700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f94140b2b10 0x7f94140b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942ea00700 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x560527097820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942ea00700 1 -- 172.21.15.71:0/2126050782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 msgr2=0x5605270972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942ea00700 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942ea00700 1 -- 172.21.15.71:0/2126050782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 msgr2=0x5605270a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942ea00700 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.151+0000 7f942ea00700 1 -- 172.21.15.71:0/2126050782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560526f7e3d0 con 0x560526f18df0 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.152+0000 7f942ea00700 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x560527097820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f94200e08d0 tx=0x7f94200a6410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbca55cf52935bf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.152+0000 7f942e000700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f94140b2b10 0x7f94140b5020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9430108ad0 tx=0x7f941c009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.152+0000 7f941be00700 1 -- 172.21.15.71:0/2126050782 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94200c4e60 con 0x560526f18df0 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.152+0000 7f941be00700 1 -- 172.21.15.71:0/2126050782 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94200a9f30 con 0x560526f18df0 2024-05-27T09:48:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.152+0000 7f941be00700 1 -- 172.21.15.71:0/2126050782 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94200c7d90 con 0x560526f18df0 2024-05-27T09:48:48.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 -- 172.21.15.71:0/2126050782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 msgr2=0x560527097820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x560527097820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f94200e08d0 tx=0x7f94200a6410 comp rx=0 tx=0).stop 2024-05-27T09:48:48.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 -- 172.21.15.71:0/2126050782 shutdown_connections 2024-05-27T09:48:48.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 --2- 172.21.15.71:0/2126050782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x560527097820 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 -- 172.21.15.71:0/2126050782 >> 172.21.15.71:0/2126050782 conn(0x560526fb2340 msgr2=0x560527093470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 -- 172.21.15.71:0/2126050782 shutdown_connections 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.153+0000 7f944424eb80 1 -- 172.21.15.71:0/2126050782 wait complete. 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.154+0000 7f944424eb80 1 -- start start 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.154+0000 7f944424eb80 1 Processor -- start 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f944424eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560526f18df0 0x5605270a1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f944424eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f944424eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f944424eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560526ebbf50 con 0x560526f18df0 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f944424eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560526f56710 con 0x560527097e20 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f944424eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605270a48f0 con 0x5605270049a0 2024-05-27T09:48:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f944424eb80 10 client.0 _ll_register_callbacks cb 0x560526f5fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f942ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560526f18df0 0x5605270a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f942ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560526f18df0 0x5605270a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38706/0 (socket says 172.21.15.71:38706) 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f942ea00700 1 -- 172.21.15.71:0/1197518142 learned_addr learned my addr 172.21.15.71:0/1197518142 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f942e000700 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.155+0000 7f942f400700 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f942ea00700 1 -- 172.21.15.71:0/1197518142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 msgr2=0x5605270a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f942ea00700 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f942ea00700 1 -- 172.21.15.71:0/1197518142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 msgr2=0x5605270a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f942ea00700 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f942ea00700 1 -- 172.21.15.71:0/1197518142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560526f05880 con 0x560526f18df0 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f942ea00700 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560526f18df0 0x5605270a1650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94200e0930 tx=0x7f94200ae7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167756858fc5abc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f9418c00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f9418c00700 1 -- 172.21.15.71:0/1197518142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94200c4c80 con 0x560526f18df0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f9418c00700 1 -- 172.21.15.71:0/1197518142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f94200aa890 con 0x560526f18df0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94200a9f30 con 0x560526f18df0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f9418c00700 1 -- 172.21.15.71:0/1197518142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f94200aab20 con 0x560526f18df0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f944424eb80 10 client.15279 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.156+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560526f86010 con 0x560526f18df0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f9418c00700 1 -- 172.21.15.71:0/1197518142 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94200a9f30 con 0x560526f18df0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f9418c00700 1 -- 172.21.15.71:0/1197518142 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f94200b2d60 con 0x560526f18df0 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f944424eb80 10 client.15279 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f944424eb80 10 client.15279 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f944424eb80 20 client.15279 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f944424eb80 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5605270b1370 0x5605270b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f944424eb80 4 client.15279 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.157+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560526fc7d40 con 0x5605270b1370 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.158+0000 7f942e000700 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5605270b1370 0x5605270b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.158+0000 7f942e000700 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5605270b1370 0x5605270b27e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe33f40a10e9c16c server_cookie=bfc7b32aa06c20b in_seq=0 out_seq=0 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.158+0000 7f9418c00700 10 client.15279 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f9418c00700 1 -- 172.21.15.71:0/1197518142 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x560526fc7d40 con 0x5605270b1370 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f9418c00700 10 client.15279 handle_command_reply: tid=0 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 client.15279 shutdown 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560526f18df0 msgr2=0x5605270a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560526f18df0 0x5605270a1650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94200e0930 tx=0x7f94200ae7d0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 shutdown_connections 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5605270b1370 0x5605270b27e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560526f18df0 0x5605270a1650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f9418c00700 0 client.15279 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:48:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 --2- 172.21.15.71:0/1197518142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 >> 172.21.15.71:0/1197518142 conn(0x560526fb2340 msgr2=0x5605270972c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 shutdown_connections 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.159+0000 7f944424eb80 1 -- 172.21.15.71:0/1197518142 wait complete. 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.160+0000 7f944424eb80 20 client.15279 trim_cache size 0 max 16384 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.183+0000 7f944424eb80 1 Processor -- start 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.183+0000 7f944424eb80 1 -- start start 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f944424eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560526f18df0 0x5605270a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f944424eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605270049a0 0x56052709ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f944424eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f944424eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5605270b0b20 con 0x5605270049a0 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f944424eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5605270b11f0 con 0x560527097e20 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f944424eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605270b18c0 con 0x560526f18df0 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f942e000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605270049a0 0x56052709ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f942ea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560526f18df0 0x5605270a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f942e000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605270049a0 0x56052709ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38720/0 (socket says 172.21.15.71:38720) 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f942e000700 1 -- 172.21.15.71:0/3577690718 learned_addr learned my addr 172.21.15.71:0/3577690718 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f942ea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560526f18df0 0x5605270a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:56218/0 (socket says 172.21.15.71:56218) 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.184+0000 7f942f400700 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f942f400700 1 -- 172.21.15.71:0/3577690718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560526f18df0 msgr2=0x5605270a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f942f400700 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560526f18df0 0x5605270a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f942f400700 1 -- 172.21.15.71:0/3577690718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605270049a0 msgr2=0x56052709ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f942f400700 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605270049a0 0x56052709ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f942f400700 1 -- 172.21.15.71:0/3577690718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560526f86010 con 0x560527097e20 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f942f400700 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270adb50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x560527099fa0 tx=0x7f94280099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940452527f6266b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f941b400700 1 -- 172.21.15.71:0/3577690718 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428014040 con 0x560527097e20 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f941b400700 1 -- 172.21.15.71:0/3577690718 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9428004db0 con 0x560527097e20 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.185+0000 7f941b400700 1 -- 172.21.15.71:0/3577690718 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942801b480 con 0x560527097e20 2024-05-27T09:48:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 -- 172.21.15.71:0/3577690718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 msgr2=0x5605270adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270adb50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x560527099fa0 tx=0x7f94280099e0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 -- 172.21.15.71:0/3577690718 shutdown_connections 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560527097e20 0x5605270adb50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560526f18df0 0x5605270a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 --2- 172.21.15.71:0/3577690718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605270049a0 0x56052709ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 -- 172.21.15.71:0/3577690718 >> 172.21.15.71:0/3577690718 conn(0x560526fb2340 msgr2=0x5605270976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.186+0000 7f944424eb80 1 -- 172.21.15.71:0/3577690718 shutdown_connections 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.187+0000 7f944424eb80 1 -- 172.21.15.71:0/3577690718 wait complete. 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.187+0000 7f944424eb80 1 -- start start 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.187+0000 7f944424eb80 1 Processor -- start 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f944424eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x5605270bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f944424eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f944424eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270ba630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f944424eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5605270b2660 con 0x560527097e20 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f944424eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5605270b1f90 con 0x560526f18df0 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f944424eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605270b2d30 con 0x5605270049a0 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f944424eb80 10 client.0 _ll_register_callbacks cb 0x560526f5fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f942f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270ba630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f942ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x5605270bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f942f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270ba630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38722/0 (socket says 172.21.15.71:38722) 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f942ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x5605270bc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36814/0 (socket says 172.21.15.71:36814) 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f942f400700 1 -- 172.21.15.71:0/809410692 learned_addr learned my addr 172.21.15.71:0/809410692 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f942e000700 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.188+0000 7f942ea00700 1 -- 172.21.15.71:0/809410692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 msgr2=0x5605270ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f942ea00700 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270ba0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f942ea00700 1 -- 172.21.15.71:0/809410692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 msgr2=0x5605270ba630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:48.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f942ea00700 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270ba630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f942ea00700 1 -- 172.21.15.71:0/809410692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560527094970 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f942ea00700 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x5605270bc2c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f94200a64a0 tx=0x7f942000b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05c95f41b829abf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f9418c00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f9418c00700 1 -- 172.21.15.71:0/809410692 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94200c4c80 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f9418c00700 1 -- 172.21.15.71:0/809410692 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f94200e0bb0 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9428004db0 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f9418c00700 1 -- 172.21.15.71:0/809410692 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f94200a9f30 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f944424eb80 10 client.25391 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.189+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560527094970 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f9418c00700 1 -- 172.21.15.71:0/809410692 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9428004db0 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f9418c00700 1 -- 172.21.15.71:0/809410692 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f94200cb1c0 con 0x560526f18df0 2024-05-27T09:48:48.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f944424eb80 10 client.25391 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f944424eb80 10 client.25391 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f944424eb80 20 client.25391 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f944424eb80 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x56052711f940 0x560527120db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f944424eb80 4 client.25391 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "status"}) -- 0x560526fc1520 con 0x56052711f940 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.190+0000 7f942e000700 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x56052711f940 0x560527120db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.191+0000 7f942e000700 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x56052711f940 0x560527120db0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c89e756d13e816c8 server_cookie=c64e41c2de48e59f in_seq=0 out_seq=0 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.191+0000 7f9418c00700 10 client.25391 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.191+0000 7f9418c00700 1 -- 172.21.15.71:0/809410692 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560526fc1520 con 0x56052711f940 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.191+0000 7f9418c00700 10 client.25391 handle_command_reply: tid=0 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.191+0000 7f944424eb80 1 client.25391 shutdown 2024-05-27T09:48:48.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.191+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 msgr2=0x5605270bc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.191+0000 7f944424eb80 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x5605270bc2c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f94200a64a0 tx=0x7f942000b990 comp rx=0 tx=0).stop 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 shutdown_connections 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x56052711f940 0x560527120db0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560527097e20 0x5605270ba630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560526f18df0 0x5605270bc2c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 --2- 172.21.15.71:0/809410692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605270049a0 0x5605270ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f9418c00700 0 client.25391 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 >> 172.21.15.71:0/809410692 conn(0x560526fb2340 msgr2=0x5605270976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 shutdown_connections 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 1 -- 172.21.15.71:0/809410692 wait complete. 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.192+0000 7f944424eb80 20 client.25391 trim_cache size 0 max 16384 2024-05-27T09:48:48.623 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 1, 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24518, 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 280.93311182000002, 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 26, 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 84, 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 83, 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 322.57466707399999 2024-05-27T09:48:48.624 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f94140b2b10 msgr2=0x7f94140b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f94140b2b10 0x7f94140b5020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9430108ad0 tx=0x7f941c009260 comp rx=0 tx=0).stop 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94301045e0 msgr2=0x7f9430075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94301045e0 0x7f9430075ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9420000c00 tx=0x7f942000fa40 comp rx=0 tx=0).stop 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 shutdown_connections 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f94140b2b10 0x7f94140b5020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9430109860 0x7f9430076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94301045e0 0x7f9430075ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 --2- 172.21.15.71:0/225397958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9430108f10 0x7f9430075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 >> 172.21.15.71:0/225397958 conn(0x7f94300fffd0 msgr2=0x7f9430107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 shutdown_connections 2024-05-27T09:48:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:48.193+0000 7f9435800700 1 -- 172.21.15.71:0/225397958 wait complete. 2024-05-27T09:48:48.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:48 smithi071 ceph-mon[31451]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-05-27T09:48:48.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:48 smithi122 ceph-mon[36436]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-05-27T09:48:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:48 smithi072 ceph-mon[35951]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-05-27T09:48:49.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-05-27T09:48:50.565 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 -- 172.21.15.71:0/647231007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c10c5a0 msgr2=0x7fbe9c10c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 --2- 172.21.15.71:0/647231007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c10c5a0 0x7fbe9c10c9b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009990 tx=0x7fbe8c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 -- 172.21.15.71:0/647231007 shutdown_connections 2024-05-27T09:48:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 --2- 172.21.15.71:0/647231007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe9c106eb0 0x7fbe9c113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 --2- 172.21.15.71:0/647231007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c10c5a0 0x7fbe9c10c9b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 --2- 172.21.15.71:0/647231007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe9c106560 0x7fbe9c106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 -- 172.21.15.71:0/647231007 >> 172.21.15.71:0/647231007 conn(0x7fbe9c102080 msgr2=0x7fbe9c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:50.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 -- 172.21.15.71:0/647231007 shutdown_connections 2024-05-27T09:48:50.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.660+0000 7fbea2200700 1 -- 172.21.15.71:0/647231007 wait complete. 2024-05-27T09:48:50.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.662+0000 7fbea2200700 1 Processor -- start 2024-05-27T09:48:50.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.662+0000 7fbea2200700 1 -- start start 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbea2200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c106560 0x7fbe9c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbea2200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe9c106eb0 0x7fbe9c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbea2200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe9c10c5a0 0x7fbe9c1a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbea2200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c116700 con 0x7fbe9c106560 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbea2200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c116580 con 0x7fbe9c106eb0 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbea2200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c116880 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c106560 0x7fbe9c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c106560 0x7fbe9c19d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38728/0 (socket says 172.21.15.71:38728) 2024-05-27T09:48:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9b400700 1 -- 172.21.15.71:0/795176555 learned_addr learned my addr 172.21.15.71:0/795176555 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:50.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9be00700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe9c10c5a0 0x7fbe9c1a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:50.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9aa00700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe9c106eb0 0x7fbe9c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:50.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9be00700 1 -- 172.21.15.71:0/795176555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe9c106eb0 msgr2=0x7fbe9c19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:50.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9be00700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe9c106eb0 0x7fbe9c19d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9be00700 1 -- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c106560 msgr2=0x7fbe9c19d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9be00700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c106560 0x7fbe9c19d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.663+0000 7fbe9be00700 1 -- 172.21.15.71:0/795176555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c1a1f20 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.664+0000 7fbe9be00700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe9c10c5a0 0x7fbe9c1a1880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400efc0 tx=0x7fbe9400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.664+0000 7fbe93e00700 1 -- 172.21.15.71:0/795176555 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe940092e0 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.664+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c1a21b0 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.664+0000 7fbe93e00700 1 -- 172.21.15.71:0/795176555 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe94004bb0 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.664+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c1a9b30 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.664+0000 7fbe93e00700 1 -- 172.21.15.71:0/795176555 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94004020 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.666+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7c005330 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.668+0000 7fbe93e00700 1 -- 172.21.15.71:0/795176555 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fbe9401b030 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.669+0000 7fbe93e00700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe800b2b10 0x7fbe800b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:50.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.670+0000 7fbe93e00700 1 -- 172.21.15.71:0/795176555 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fbe940e2880 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.670+0000 7fbe9b400700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe800b2b10 0x7fbe800b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:50.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.671+0000 7fbe9b400700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe800b2b10 0x7fbe800b5020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00b2e0 tx=0x7fbe8c005fd0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.672+0000 7fbe93e00700 1 -- 172.21.15.71:0/795176555 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbe94022020 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.927 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:50 smithi071 ceph-mon[31451]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-27T09:48:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.961+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe7c005620 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.962+0000 7fbe93e00700 1 -- 172.21.15.71:0/795176555 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7fbe94010040 con 0x7fbe9c10c5a0 2024-05-27T09:48:50.963 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:48:50.963 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:48:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.964+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe800b2b10 msgr2=0x7fbe800b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.964+0000 7fbea2200700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe800b2b10 0x7fbe800b5020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00b2e0 tx=0x7fbe8c005fd0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.964+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe9c10c5a0 msgr2=0x7fbe9c1a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.964+0000 7fbea2200700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe9c10c5a0 0x7fbe9c1a1880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400efc0 tx=0x7fbe9400c3a0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 shutdown_connections 2024-05-27T09:48:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe800b2b10 0x7fbe800b5020 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe9c10c5a0 0x7fbe9c1a1880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe9c106560 0x7fbe9c19d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 --2- 172.21.15.71:0/795176555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe9c106eb0 0x7fbe9c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 >> 172.21.15.71:0/795176555 conn(0x7fbe9c102080 msgr2=0x7fbe9c1049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 shutdown_connections 2024-05-27T09:48:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:50.965+0000 7fbea2200700 1 -- 172.21.15.71:0/795176555 wait complete. 2024-05-27T09:48:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:48:50.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:50 smithi122 ceph-mon[36436]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-27T09:48:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:50 smithi072 ceph-mon[35951]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-27T09:48:51.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:51 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/795176555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:52.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:51 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/795176555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:52.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:51 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/795176555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:48:52.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-27T09:48:52.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:52 smithi122 ceph-mon[36436]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-27T09:48:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:52 smithi071 ceph-mon[31451]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-27T09:48:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:52 smithi072 ceph-mon[35951]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-27T09:48:53.216 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:53.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 -- 172.21.15.71:0/3900426573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c1027d0 msgr2=0x7fca4c102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 --2- 172.21.15.71:0/3900426573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c1027d0 0x7fca4c102be0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fca34009990 tx=0x7fca34009ca0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 -- 172.21.15.71:0/3900426573 shutdown_connections 2024-05-27T09:48:53.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 --2- 172.21.15.71:0/3900426573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c103120 0x7fca4c111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 --2- 172.21.15.71:0/3900426573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca4c10a3d0 0x7fca4c10a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 --2- 172.21.15.71:0/3900426573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c1027d0 0x7fca4c102be0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 -- 172.21.15.71:0/3900426573 >> 172.21.15.71:0/3900426573 conn(0x7fca4c0fe6e0 msgr2=0x7fca4c100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 -- 172.21.15.71:0/3900426573 shutdown_connections 2024-05-27T09:48:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.633+0000 7fca51600700 1 -- 172.21.15.71:0/3900426573 wait complete. 2024-05-27T09:48:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.634+0000 7fca51600700 1 Processor -- start 2024-05-27T09:48:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.635+0000 7fca51600700 1 -- start start 2024-05-27T09:48:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.635+0000 7fca51600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c1027d0 0x7fca4c19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.635+0000 7fca51600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca4c103120 0x7fca4c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.635+0000 7fca51600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10a3d0 0x7fca4c19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.635+0000 7fca51600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c114450 con 0x7fca4c10a3d0 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.635+0000 7fca51600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c1142d0 con 0x7fca4c103120 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.635+0000 7fca51600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c1145d0 con 0x7fca4c1027d0 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10a3d0 0x7fca4c19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c1027d0 0x7fca4c19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c1027d0 0x7fca4c19ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:56246/0 (socket says 172.21.15.71:56246) 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10a3d0 0x7fca4c19f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38738/0 (socket says 172.21.15.71:38738) 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 -- 172.21.15.71:0/692499970 learned_addr learned my addr 172.21.15.71:0/692499970 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca42000700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca4c103120 0x7fca4c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 -- 172.21.15.71:0/692499970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca4c103120 msgr2=0x7fca4c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca4c103120 0x7fca4c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 -- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10a3d0 msgr2=0x7fca4c19f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10a3d0 0x7fca4c19f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4aa00700 1 -- 172.21.15.71:0/692499970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c19fcf0 con 0x7fca4c1027d0 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca42000700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca4c103120 0x7fca4c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.636+0000 7fca4b400700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10a3d0 0x7fca4c19f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.637+0000 7fca4aa00700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c1027d0 0x7fca4c19ae20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00e9a0 tx=0x7fca3c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.637+0000 7fca43e00700 1 -- 172.21.15.71:0/692499970 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00ca10 con 0x7fca4c1027d0 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.637+0000 7fca43e00700 1 -- 172.21.15.71:0/692499970 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca3c00cbb0 con 0x7fca4c1027d0 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.637+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c19ffe0 con 0x7fca4c1027d0 2024-05-27T09:48:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.637+0000 7fca43e00700 1 -- 172.21.15.71:0/692499970 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c018680 con 0x7fca4c1027d0 2024-05-27T09:48:53.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.637+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4c1a7900 con 0x7fca4c1027d0 2024-05-27T09:48:53.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.641+0000 7fca43e00700 1 -- 172.21.15.71:0/692499970 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fca3c010430 con 0x7fca4c1027d0 2024-05-27T09:48:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.642+0000 7fca6017eb80 1 Processor -- start 2024-05-27T09:48:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.642+0000 7fca6017eb80 1 -- start start 2024-05-27T09:48:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca139749a0 0x55ca13a072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a07820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca13a07e20 0x55ca13a140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca6017eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca13935df0 con 0x55ca13a07e20 2024-05-27T09:48:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca6017eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ca13925990 con 0x55ca13888df0 2024-05-27T09:48:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca6017eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ca139299d0 con 0x55ca139749a0 2024-05-27T09:48:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca4b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca139749a0 0x55ca13a072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca4aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a07820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca4b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca139749a0 0x55ca13a072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:56254/0 (socket says 172.21.15.71:56254) 2024-05-27T09:48:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca4b400700 1 -- 172.21.15.71:0/2284152053 learned_addr learned my addr 172.21.15.71:0/2284152053 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca43e00700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fca300b2b10 0x7fca300b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.643+0000 7fca42000700 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca13a07e20 0x55ca13a140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca43e00700 1 -- 172.21.15.71:0/692499970 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fca3c0e29b0 con 0x7fca4c1027d0 2024-05-27T09:48:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca4b400700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fca300b2b10 0x7fca300b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca4b400700 1 -- 172.21.15.71:0/2284152053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 msgr2=0x55ca13a07820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca4b400700 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a07820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca4b400700 1 -- 172.21.15.71:0/2284152053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca13a07e20 msgr2=0x55ca13a140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca4b400700 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca13a07e20 0x55ca13a140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca4b400700 1 -- 172.21.15.71:0/2284152053 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca138ee3d0 con 0x55ca139749a0 2024-05-27T09:48:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.644+0000 7fca4b400700 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca139749a0 0x55ca13a072e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fca44004560 tx=0x7fca44004870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=411ffb54b0dc2d53 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:53.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.645+0000 7fca4b400700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fca300b2b10 0x7fca300b5020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca4400e7d0 tx=0x7fca4401e000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:53.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.645+0000 7fca3be00700 1 -- 172.21.15.71:0/2284152053 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44007700 con 0x55ca139749a0 2024-05-27T09:48:53.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.645+0000 7fca3be00700 1 -- 172.21.15.71:0/2284152053 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca44007d50 con 0x55ca139749a0 2024-05-27T09:48:53.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.645+0000 7fca3be00700 1 -- 172.21.15.71:0/2284152053 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44022b40 con 0x55ca139749a0 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.646+0000 7fca6017eb80 1 -- 172.21.15.71:0/2284152053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca139749a0 msgr2=0x55ca13a072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.646+0000 7fca6017eb80 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca139749a0 0x55ca13a072e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fca44004560 tx=0x7fca44004870 comp rx=0 tx=0).stop 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.646+0000 7fca6017eb80 1 -- 172.21.15.71:0/2284152053 shutdown_connections 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.646+0000 7fca6017eb80 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca13a07e20 0x55ca13a140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.646+0000 7fca6017eb80 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca139749a0 0x55ca13a072e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.646+0000 7fca6017eb80 1 --2- 172.21.15.71:0/2284152053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a07820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.646+0000 7fca6017eb80 1 -- 172.21.15.71:0/2284152053 >> 172.21.15.71:0/2284152053 conn(0x55ca13922340 msgr2=0x55ca13a03470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.647+0000 7fca6017eb80 1 -- 172.21.15.71:0/2284152053 shutdown_connections 2024-05-27T09:48:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.647+0000 7fca6017eb80 1 -- 172.21.15.71:0/2284152053 wait complete. 2024-05-27T09:48:53.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.647+0000 7fca6017eb80 1 -- start start 2024-05-27T09:48:53.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 1 Processor -- start 2024-05-27T09:48:53.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a116c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a11c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a12140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca1382bf50 con 0x55ca139749a0 2024-05-27T09:48:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ca138c6710 con 0x55ca13888df0 2024-05-27T09:48:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ca13a14ad0 con 0x55ca13a07e20 2024-05-27T09:48:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.648+0000 7fca6017eb80 10 client.0 _ll_register_callbacks cb 0x55ca138cfc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca42000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a11c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36854/0 (socket says 172.21.15.71:36854) 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 -- 172.21.15.71:0/893094821 learned_addr learned my addr 172.21.15.71:0/893094821 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca42000700 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a11c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38760/0 (socket says 172.21.15.71:38760) 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4b400700 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 -- 172.21.15.71:0/893094821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 msgr2=0x55ca13a12140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a12140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 -- 172.21.15.71:0/893094821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 msgr2=0x55ca13a11c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a11c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 -- 172.21.15.71:0/893094821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca13875880 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca4aa00700 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a116c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0e00c0 tx=0x7fca3c0a5200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=934940b68f4c7ae0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca38c00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.649+0000 7fca38c00700 1 -- 172.21.15.71:0/893094821 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0aa170 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca38c00700 1 -- 172.21.15.71:0/893094821 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fca3c0cc0b0 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca44007d50 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca38c00700 1 -- 172.21.15.71:0/893094821 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fca3c0a9a70 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca6017eb80 10 client.25409 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca138f6010 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca38c00700 1 -- 172.21.15.71:0/893094821 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca44007d50 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca38c00700 1 -- 172.21.15.71:0/893094821 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fca3c0a8cd0 con 0x55ca13888df0 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca6017eb80 10 client.25409 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca6017eb80 10 client.25409 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T09:48:53.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.650+0000 7fca6017eb80 20 client.25409 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.651+0000 7fca6017eb80 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a21a10 0x55ca13a22e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.651+0000 7fca6017eb80 4 client.25409 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.651+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca13937d40 con 0x55ca13a21a10 2024-05-27T09:48:53.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.651+0000 7fca42000700 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a21a10 0x55ca13a22e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.651+0000 7fca38c00700 10 client.25409 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.651+0000 7fca42000700 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a21a10 0x55ca13a22e80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd007e1e62b0df60 server_cookie=585fd50a95b955c8 in_seq=0 out_seq=0 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.652+0000 7fca38c00700 1 -- 172.21.15.71:0/893094821 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ca13937d40 con 0x55ca13a21a10 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.652+0000 7fca38c00700 10 client.25409 handle_command_reply: tid=0 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.652+0000 7fca6017eb80 1 client.25409 shutdown 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.652+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 msgr2=0x55ca13a116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.652+0000 7fca6017eb80 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a116c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0e00c0 tx=0x7fca3c0a5200 comp rx=0 tx=0).stop 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.652+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 shutdown_connections 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a21a10 0x55ca13a22e80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a12140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a116c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 1 --2- 172.21.15.71:0/893094821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a11c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca38c00700 0 client.25409 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:53.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 >> 172.21.15.71:0/893094821 conn(0x55ca13922340 msgr2=0x55ca13a07320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:53.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 shutdown_connections 2024-05-27T09:48:53.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 1 -- 172.21.15.71:0/893094821 wait complete. 2024-05-27T09:48:53.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.653+0000 7fca6017eb80 20 client.25409 trim_cache size 0 max 16384 2024-05-27T09:48:53.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.675+0000 7fca6017eb80 1 Processor -- start 2024-05-27T09:48:53.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca6017eb80 1 -- start start 2024-05-27T09:48:53.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a1dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a07800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a2c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca6017eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca13a211c0 con 0x55ca139749a0 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca6017eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ca13a21890 con 0x55ca13888df0 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca6017eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ca13a21f60 con 0x55ca13a07e20 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca42000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a07800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca42000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a07800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38762/0 (socket says 172.21.15.71:38762) 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca42000700 1 -- 172.21.15.71:0/1418975559 learned_addr learned my addr 172.21.15.71:0/1418975559 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.676+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a1dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca4b400700 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a2c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca4aa00700 1 -- 172.21.15.71:0/1418975559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 msgr2=0x55ca13a2c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a2c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca4aa00700 1 -- 172.21.15.71:0/1418975559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 msgr2=0x55ca13a07800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a07800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca4aa00700 1 -- 172.21.15.71:0/1418975559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca13a124b0 con 0x55ca13888df0 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca42000700 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a07800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a1dd70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0a90e0 tx=0x7fca3c0a52f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef4dea560b7bfce server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.677+0000 7fca3b400700 1 -- 172.21.15.71:0/1418975559 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0ade20 con 0x55ca13888df0 2024-05-27T09:48:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca3b400700 1 -- 172.21.15.71:0/1418975559 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca3c0b28d0 con 0x55ca13888df0 2024-05-27T09:48:53.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca3b400700 1 -- 172.21.15.71:0/1418975559 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0cc3d0 con 0x55ca13888df0 2024-05-27T09:48:53.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca6017eb80 1 -- 172.21.15.71:0/1418975559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 msgr2=0x55ca13a1dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a1dd70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0a90e0 tx=0x7fca3c0a52f0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca6017eb80 1 -- 172.21.15.71:0/1418975559 shutdown_connections 2024-05-27T09:48:53.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13a07e20 0x55ca13a2c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13888df0 0x55ca13a1dd70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.678+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1418975559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a07800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.679+0000 7fca6017eb80 1 -- 172.21.15.71:0/1418975559 >> 172.21.15.71:0/1418975559 conn(0x55ca13922340 msgr2=0x55ca13a070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.679+0000 7fca6017eb80 1 -- 172.21.15.71:0/1418975559 shutdown_connections 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.679+0000 7fca6017eb80 1 -- 172.21.15.71:0/1418975559 wait complete. 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.679+0000 7fca6017eb80 1 -- start start 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.679+0000 7fca6017eb80 1 Processor -- start 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13888df0 0x55ca13a0e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a0e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca6017eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13a07e20 0x55ca13a901c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca6017eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca13a22d00 con 0x55ca139749a0 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca6017eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ca13a22630 con 0x55ca13a07e20 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca6017eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ca13a233d0 con 0x55ca13888df0 2024-05-27T09:48:53.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca6017eb80 10 client.0 _ll_register_callbacks cb 0x55ca138cfc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:53.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca42000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a0e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca42000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a0e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38768/0 (socket says 172.21.15.71:38768) 2024-05-27T09:48:53.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca42000700 1 -- 172.21.15.71:0/1957303467 learned_addr learned my addr 172.21.15.71:0/1957303467 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:53.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13888df0 0x55ca13a0e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.680+0000 7fca4b400700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13a07e20 0x55ca13a901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca4aa00700 1 -- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13a07e20 msgr2=0x55ca13a901c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13a07e20 0x55ca13a901c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca4aa00700 1 -- 172.21.15.71:0/1957303467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 msgr2=0x55ca13a0e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a0e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca4aa00700 1 -- 172.21.15.71:0/1957303467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca13a90750 con 0x55ca13888df0 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca42000700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a0e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca4aa00700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13888df0 0x55ca13a0e190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0a90e0 tx=0x7fca3c0a5200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a72f645f94129ac9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca38c00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:48:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca38c00700 1 -- 172.21.15.71:0/1957303467 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0cc2b0 con 0x55ca13888df0 2024-05-27T09:48:53.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca38c00700 1 -- 172.21.15.71:0/1957303467 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fca3c010720 con 0x55ca13888df0 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.681+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca3c0b28d0 con 0x55ca13888df0 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca38c00700 1 -- 172.21.15.71:0/1957303467 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fca3c0dfef0 con 0x55ca13888df0 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 10 client.25435 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca13a90750 con 0x55ca13888df0 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca38c00700 1 -- 172.21.15.71:0/1957303467 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca3c0b28d0 con 0x55ca13888df0 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca38c00700 1 -- 172.21.15.71:0/1957303467 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fca3c0a8740 con 0x55ca13888df0 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 10 client.25435 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 10 client.25435 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 20 client.25435 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a28f90 0x55ca13a2a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 4 client.25435 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.682+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "status"}) -- 0x55ca13931520 con 0x55ca13a28f90 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.683+0000 7fca42000700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a28f90 0x55ca13a2a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.683+0000 7fca42000700 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a28f90 0x55ca13a2a400 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd21ee2708af9b77 server_cookie=4b162db90dd03618 in_seq=0 out_seq=0 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.683+0000 7fca38c00700 10 client.25435 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca38c00700 1 -- 172.21.15.71:0/1957303467 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ca13931520 con 0x55ca13a28f90 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca38c00700 10 client.25435 handle_command_reply: tid=0 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 client.25435 shutdown 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13888df0 msgr2=0x55ca13a0e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13888df0 0x55ca13a0e190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0a90e0 tx=0x7fca3c0a5200 comp rx=0 tx=0).stop 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 shutdown_connections 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ca13a28f90 0x55ca13a2a400 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ca13a07e20 0x55ca13a901c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ca13888df0 0x55ca13a0e190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 --2- 172.21.15.71:0/1957303467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca139749a0 0x55ca13a0e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 >> 172.21.15.71:0/1957303467 conn(0x55ca13922340 msgr2=0x55ca13a07060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca38c00700 0 client.25435 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.684+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 shutdown_connections 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.685+0000 7fca6017eb80 1 -- 172.21.15.71:0/1957303467 wait complete. 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.685+0000 7fca6017eb80 20 client.25435 trim_cache size 0 max 16384 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "13785e2a-1c0c-11ef-bc9b-c7b262605968", 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 24530, 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-05-27T09:48:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-05-27T09:48:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-05-27T09:48:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 301.85237404499998, 2024-05-27T09:48:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 26, 2024-05-27T09:48:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 84, 2024-05-27T09:48:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 83, 2024-05-27T09:48:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 325.45335074500002 2024-05-27T09:48:53.689 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:48:53.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fca300b2b10 msgr2=0x7fca300b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fca300b2b10 0x7fca300b5020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca4400e7d0 tx=0x7fca4401e000 comp rx=0 tx=0).stop 2024-05-27T09:48:53.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c1027d0 msgr2=0x7fca4c19ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:53.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c1027d0 0x7fca4c19ae20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00e9a0 tx=0x7fca3c00ecb0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 shutdown_connections 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fca300b2b10 0x7fca300b5020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10a3d0 0x7fca4c19f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca4c1027d0 0x7fca4c19ae20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 --2- 172.21.15.71:0/692499970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca4c103120 0x7fca4c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 >> 172.21.15.71:0/692499970 conn(0x7fca4c0fe6e0 msgr2=0x7fca4c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 shutdown_connections 2024-05-27T09:48:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:53.689+0000 7fca51600700 1 -- 172.21.15.71:0/692499970 wait complete. 2024-05-27T09:48:54.718 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-27T09:48:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:54 smithi122 ceph-mon[36436]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-27T09:48:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:54 smithi071 ceph-mon[31451]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-27T09:48:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:54 smithi072 ceph-mon[35951]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-27T09:48:56.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 -- 172.21.15.71:0/3091801693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106ec0 msgr2=0x7f91b4113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3091801693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106ec0 0x7f91b4113350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00b0a0 tx=0x7f91ac00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 -- 172.21.15.71:0/3091801693 shutdown_connections 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3091801693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106ec0 0x7f91b4113350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3091801693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b410c5b0 0x7f91b410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3091801693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91b4106570 0x7f91b4106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 -- 172.21.15.71:0/3091801693 >> 172.21.15.71:0/3091801693 conn(0x7f91b4102070 msgr2=0x7f91b41044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 -- 172.21.15.71:0/3091801693 shutdown_connections 2024-05-27T09:48:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.581+0000 7f91b8a00700 1 -- 172.21.15.71:0/3091801693 wait complete. 2024-05-27T09:48:56.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.582+0000 7f91b8a00700 1 Processor -- start 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.582+0000 7f91b8a00700 1 -- start start 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b8a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106570 0x7f91b419d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b8a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91b4106ec0 0x7f91b419d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b8a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b410c5b0 0x7f91b41a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b8a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91b4116730 con 0x7f91b4106570 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b8a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41165b0 con 0x7f91b410c5b0 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b8a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41168b0 con 0x7f91b4106ec0 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106570 0x7f91b419d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91b4106ec0 0x7f91b419d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106570 0x7f91b419d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60914/0 (socket says 172.21.15.71:60914) 2024-05-27T09:48:56.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b1e00700 1 -- 172.21.15.71:0/3307861965 learned_addr learned my addr 172.21.15.71:0/3307861965 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:56.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.583+0000 7f91b2800700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b410c5b0 0x7f91b41a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91b1e00700 1 -- 172.21.15.71:0/3307861965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91b4106ec0 msgr2=0x7f91b419d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91b4106ec0 0x7f91b419d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91b1e00700 1 -- 172.21.15.71:0/3307861965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b410c5b0 msgr2=0x7f91b41a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b410c5b0 0x7f91b41a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91b1e00700 1 -- 172.21.15.71:0/3307861965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b41a1ed0 con 0x7f91b4106570 2024-05-27T09:48:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106570 0x7f91b419d000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f91a400e970 tx=0x7f91a400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91aaa00700 1 -- 172.21.15.71:0/3307861965 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4004a30 con 0x7f91b4106570 2024-05-27T09:48:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91aaa00700 1 -- 172.21.15.71:0/3307861965 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91a400cc90 con 0x7f91b4106570 2024-05-27T09:48:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91aaa00700 1 -- 172.21.15.71:0/3307861965 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4005610 con 0x7f91b4106570 2024-05-27T09:48:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.584+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b41a21c0 con 0x7f91b4106570 2024-05-27T09:48:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.585+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b41a9ae0 con 0x7f91b4106570 2024-05-27T09:48:56.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.589+0000 7f91aaa00700 1 -- 172.21.15.71:0/3307861965 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f91a400c7e0 con 0x7f91b4106570 2024-05-27T09:48:56.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.589+0000 7f91c7522b80 1 Processor -- start 2024-05-27T09:48:56.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91c7522b80 1 -- start start 2024-05-27T09:48:56.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df1302330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df1302870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91c7522b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564df1230e40 con 0x564df126f9f0 2024-05-27T09:48:56.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91c7522b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564df12209e0 con 0x564df1183e40 2024-05-27T09:48:56.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91c7522b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564df1224a20 con 0x564df1302e70 2024-05-27T09:48:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.590+0000 7f91aaa00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f91980b2b90 0x7f91980b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df1302330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91aaa00700 1 -- 172.21.15.71:0/3307861965 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f91a40e29c0 con 0x7f91b4106570 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df1302870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df1302330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60922/0 (socket says 172.21.15.71:60922) 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b2800700 1 -- 172.21.15.71:0/3129433138 learned_addr learned my addr 172.21.15.71:0/3129433138 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b2800700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f91980b2b90 0x7f91980b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b1e00700 1 -- 172.21.15.71:0/3129433138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 msgr2=0x564df130f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3129433138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b1e00700 1 -- 172.21.15.71:0/3129433138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 msgr2=0x564df1302330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3129433138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df1302330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.591+0000 7f91b1e00700 1 -- 172.21.15.71:0/3129433138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df11e9420 con 0x564df1183e40 2024-05-27T09:48:56.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.592+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3129433138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df1302870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f91a40dff60 tx=0x7f91a4004bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb343ff3d9fd19c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:56.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.592+0000 7f91b2800700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f91980b2b90 0x7f91980b50a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x564df1304ff0 tx=0x7f91ac006210 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:56.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.592+0000 7f919f400700 1 -- 172.21.15.71:0/3129433138 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40a9190 con 0x564df1183e40 2024-05-27T09:48:56.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.592+0000 7f919f400700 1 -- 172.21.15.71:0/3129433138 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91a400cad0 con 0x564df1183e40 2024-05-27T09:48:56.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.592+0000 7f919f400700 1 -- 172.21.15.71:0/3129433138 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40a9ee0 con 0x564df1183e40 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 -- 172.21.15.71:0/3129433138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 msgr2=0x564df1302870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3129433138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df1302870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f91a40dff60 tx=0x7f91a4004bd0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 -- 172.21.15.71:0/3129433138 shutdown_connections 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3129433138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3129433138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df1302330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3129433138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df1302870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 -- 172.21.15.71:0/3129433138 >> 172.21.15.71:0/3129433138 conn(0x564df121d390 msgr2=0x564df12fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 -- 172.21.15.71:0/3129433138 shutdown_connections 2024-05-27T09:48:56.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.593+0000 7f91c7522b80 1 -- 172.21.15.71:0/3129433138 wait complete. 2024-05-27T09:48:56.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.594+0000 7f91c7522b80 1 -- start start 2024-05-27T09:48:56.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.594+0000 7f91c7522b80 1 Processor -- start 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df130cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91c7522b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564df1126fa0 con 0x564df126f9f0 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91c7522b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564df11c1760 con 0x564df1183e40 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91c7522b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564df130fb20 con 0x564df1302e70 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91c7522b80 10 client.0 _ll_register_callbacks cb 0x564df11cac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df130cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b2800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36312/0 (socket says 172.21.15.71:36312) 2024-05-27T09:48:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 -- 172.21.15.71:0/3229563283 learned_addr learned my addr 172.21.15.71:0/3229563283 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 -- 172.21.15.71:0/3229563283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 msgr2=0x564df130d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 -- 172.21.15.71:0/3229563283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 msgr2=0x564df130cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df130cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.595+0000 7f91b1e00700 1 -- 172.21.15.71:0/3229563283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df11708d0 con 0x564df1183e40 2024-05-27T09:48:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130c7e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f91a40a9720 tx=0x7f91a40b26a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a213dbc103575fc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f9193e00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:48:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f9193e00700 1 -- 172.21.15.71:0/3229563283 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40c4070 con 0x564df1183e40 2024-05-27T09:48:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f9193e00700 1 -- 172.21.15.71:0/3229563283 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f91a40cc2e0 con 0x564df1183e40 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564df1232d90 con 0x564df1183e40 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f9193e00700 1 -- 172.21.15.71:0/3229563283 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f91a40a9190 con 0x564df1183e40 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f91c7522b80 10 client.25427 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.596+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564df11f1060 con 0x564df1183e40 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f9193e00700 1 -- 172.21.15.71:0/3229563283 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564df1232d90 con 0x564df1183e40 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f9193e00700 1 -- 172.21.15.71:0/3229563283 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f91a40a8c80 con 0x564df1183e40 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f91c7522b80 10 client.25427 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f91c7522b80 10 client.25427 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f91c7522b80 20 client.25427 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df131c970 0x564df131ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f91c7522b80 4 client.25427 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564df122c570 con 0x564df131c970 2024-05-27T09:48:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.597+0000 7f91b1400700 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df131c970 0x564df131ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.598+0000 7f91b1400700 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df131c970 0x564df131ed90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ff80b1c8b64245d server_cookie=54eeee86d124fce in_seq=0 out_seq=0 2024-05-27T09:48:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.598+0000 7f9193e00700 10 client.25427 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f9193e00700 1 -- 172.21.15.71:0/3229563283 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x564df122c570 con 0x564df131c970 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f9193e00700 10 client.25427 handle_command_reply: tid=0 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 client.25427 shutdown 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 msgr2=0x564df130c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130c7e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f91a40a9720 tx=0x7f91a40b26a0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 shutdown_connections 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df131c970 0x564df131ed90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df1302e70 0x564df130d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130c7e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3229563283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df126f9f0 0x564df130cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f9193e00700 0 client.25427 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:56.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.599+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 >> 172.21.15.71:0/3229563283 conn(0x564df121d390 msgr2=0x564df1302450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:56.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.600+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 shutdown_connections 2024-05-27T09:48:56.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.600+0000 7f91c7522b80 1 -- 172.21.15.71:0/3229563283 wait complete. 2024-05-27T09:48:56.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.600+0000 7f91c7522b80 20 client.25427 trim_cache size 0 max 16384 2024-05-27T09:48:56.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.616+0000 7f91c7522b80 1 Processor -- start 2024-05-27T09:48:56.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.616+0000 7f91c7522b80 1 -- start start 2024-05-27T09:48:56.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df1308030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1302e70 0x564df12fe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91c7522b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41b3910 con 0x564df1302e70 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91c7522b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41b11a0 con 0x564df1183e40 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91c7522b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41af010 con 0x564df126f9f0 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91b2800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1302e70 0x564df12fe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36320/0 (socket says 172.21.15.71:36320) 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91b1e00700 1 -- 172.21.15.71:0/3626682707 learned_addr learned my addr 172.21.15.71:0/3626682707 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.617+0000 7f91b1400700 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df1308030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f91b1e00700 1 -- 172.21.15.71:0/3626682707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 msgr2=0x564df1308030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df1308030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f91b1e00700 1 -- 172.21.15.71:0/3626682707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1302e70 msgr2=0x564df12fe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1302e70 0x564df12fe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f91b1e00700 1 -- 172.21.15.71:0/3626682707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df12ff9c0 con 0x564df1183e40 2024-05-27T09:48:56.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f91b1e00700 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130bb00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91a40a9050 tx=0x7f91a400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ec9d71cef6cc916 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f919ea00700 1 -- 172.21.15.71:0/3626682707 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40c4050 con 0x564df1183e40 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f919ea00700 1 -- 172.21.15.71:0/3626682707 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91a40b21c0 con 0x564df1183e40 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.618+0000 7f919ea00700 1 -- 172.21.15.71:0/3626682707 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4086020 con 0x564df1183e40 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 -- 172.21.15.71:0/3626682707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 msgr2=0x564df130bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130bb00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91a40a9050 tx=0x7f91a400cef0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 -- 172.21.15.71:0/3626682707 shutdown_connections 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1302e70 0x564df12fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1183e40 0x564df130bb00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 --2- 172.21.15.71:0/3626682707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df1308030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 -- 172.21.15.71:0/3626682707 >> 172.21.15.71:0/3626682707 conn(0x564df121d390 msgr2=0x564df1317db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 -- 172.21.15.71:0/3626682707 shutdown_connections 2024-05-27T09:48:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.619+0000 7f91c7522b80 1 -- 172.21.15.71:0/3626682707 wait complete. 2024-05-27T09:48:56.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.620+0000 7f91c7522b80 1 -- start start 2024-05-27T09:48:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.620+0000 7f91c7522b80 1 Processor -- start 2024-05-27T09:48:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1183e40 0x564df131d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df131d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91c7522b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1302e70 0x564df137f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91c7522b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41af660 con 0x564df1183e40 2024-05-27T09:48:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91c7522b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41b0ad0 con 0x564df1302e70 2024-05-27T09:48:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91c7522b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41afd30 con 0x564df126f9f0 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91c7522b80 10 client.0 _ll_register_callbacks cb 0x564df11cac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91b1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df131d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91b1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1183e40 0x564df131d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91b2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1302e70 0x564df137f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91b1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df131d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:48264/0 (socket says 172.21.15.71:48264) 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91b1400700 1 -- 172.21.15.71:0/498656724 learned_addr learned my addr 172.21.15.71:0/498656724 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91b2800700 1 -- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 msgr2=0x564df131d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.621+0000 7f91b2800700 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df131d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f91b2800700 1 -- 172.21.15.71:0/498656724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1183e40 msgr2=0x564df131d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f91b2800700 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1183e40 0x564df131d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f91b2800700 1 -- 172.21.15.71:0/498656724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df137f750 con 0x564df1302e70 2024-05-27T09:48:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f91b1400700 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df131d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:56.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f91b2800700 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1302e70 0x564df137f190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009fd0 tx=0x7f91ac0099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1cfb6c190928b9a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:56.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f9193e00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:48:56.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f9193e00700 1 -- 172.21.15.71:0/498656724 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac020450 con 0x564df1302e70 2024-05-27T09:48:56.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f9193e00700 1 -- 172.21.15.71:0/498656724 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f91ac0205f0 con 0x564df1302e70 2024-05-27T09:48:56.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.622+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564df10a3250 con 0x564df1302e70 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f9193e00700 1 -- 172.21.15.71:0/498656724 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f91ac03e050 con 0x564df1302e70 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 10 client.25433 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564df1386a90 con 0x564df1302e70 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f9193e00700 1 -- 172.21.15.71:0/498656724 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564df10a3250 con 0x564df1302e70 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f9193e00700 1 -- 172.21.15.71:0/498656724 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f91ac011070 con 0x564df1302e70 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 10 client.25433 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 10 client.25433 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 20 client.25433 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df13871f0 0x564df1389610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 4 client.25433 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.623+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564df11f4b90 con 0x564df13871f0 2024-05-27T09:48:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.624+0000 7f91b1e00700 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df13871f0 0x564df1389610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.624+0000 7f91b1e00700 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df13871f0 0x564df1389610 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf531f3ff7082da7 server_cookie=f4fee0acbea94673 in_seq=0 out_seq=0 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.624+0000 7f9193e00700 10 client.25433 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.624+0000 7f9193e00700 1 -- 172.21.15.71:0/498656724 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564df11f4b90 con 0x564df13871f0 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.624+0000 7f9193e00700 10 client.25433 handle_command_reply: tid=0 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.624+0000 7f91c7522b80 1 client.25433 shutdown 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1302e70 msgr2=0x564df137f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1302e70 0x564df137f190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009fd0 tx=0x7f91ac0099e0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 shutdown_connections 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x564df13871f0 0x564df1389610 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564df1302e70 0x564df137f190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df1183e40 0x564df131d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 --2- 172.21.15.71:0/498656724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564df126f9f0 0x564df131d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f9193e00700 0 client.25433 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:48:56.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 >> 172.21.15.71:0/498656724 conn(0x564df121d390 msgr2=0x564df130b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:56.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 shutdown_connections 2024-05-27T09:48:56.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 1 -- 172.21.15.71:0/498656724 wait complete. 2024-05-27T09:48:56.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.625+0000 7f91c7522b80 20 client.25433 trim_cache size 0 max 16384 2024-05-27T09:48:56.629 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f91980b2b90 msgr2=0x7f91980b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f91980b2b90 0x7f91980b50a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x564df1304ff0 tx=0x7f91ac006210 comp rx=0 tx=0).stop 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106570 msgr2=0x7f91b419d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106570 0x7f91b419d000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f91a400e970 tx=0x7f91a400ec80 comp rx=0 tx=0).stop 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 shutdown_connections 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f91980b2b90 0x7f91980b50a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b410c5b0 0x7f91b41a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91b4106570 0x7f91b419d000 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 --2- 172.21.15.71:0/3307861965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91b4106ec0 0x7f91b419d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 >> 172.21.15.71:0/3307861965 conn(0x7f91b4102070 msgr2=0x7f91b41046f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 shutdown_connections 2024-05-27T09:48:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:48:56.626+0000 7f91b8a00700 1 -- 172.21.15.71:0/3307861965 wait complete. 2024-05-27T09:48:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:56 smithi122 ceph-mon[36436]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-27T09:48:57.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:56 smithi071 ceph-mon[31451]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-27T09:48:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:56 smithi072 ceph-mon[35951]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-27T09:48:57.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-27T09:48:58.055 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:48:59.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:48:58 smithi071 ceph-mon[31451]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-27T09:48:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:48:58 smithi072 ceph-mon[35951]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-27T09:48:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:48:58 smithi122 ceph-mon[36436]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-27T09:48:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 -- 172.21.15.71:0/580007154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae281021c0 msgr2=0x7fae281025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 --2- 172.21.15.71:0/580007154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae281021c0 0x7fae281025d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae14009900 tx=0x7fae1402a410 comp rx=0 tx=0).stop 2024-05-27T09:48:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 -- 172.21.15.71:0/580007154 shutdown_connections 2024-05-27T09:48:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 --2- 172.21.15.71:0/580007154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae2810e6c0 0x7fae28110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 --2- 172.21.15.71:0/580007154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae281021c0 0x7fae281025d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 --2- 172.21.15.71:0/580007154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae28109d10 0x7fae28101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 -- 172.21.15.71:0/580007154 >> 172.21.15.71:0/580007154 conn(0x7fae280779d0 msgr2=0x7fae28077e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 -- 172.21.15.71:0/580007154 shutdown_connections 2024-05-27T09:48:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.617+0000 7fae30200640 1 -- 172.21.15.71:0/580007154 wait complete. 2024-05-27T09:48:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 Processor -- start 2024-05-27T09:48:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 -- start start 2024-05-27T09:48:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae281021c0 0x7fae281a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae28109d10 0x7fae281a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae2810e6c0 0x7fae2819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae28113e80 con 0x7fae28109d10 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fae28113d00 con 0x7fae2810e6c0 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.619+0000 7fae30200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fae28114000 con 0x7fae281021c0 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae281021c0 0x7fae281a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2e200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae2810e6c0 0x7fae2819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae28109d10 0x7fae281a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae281021c0 0x7fae281a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:48290/0 (socket says 172.21.15.71:48290) 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 -- 172.21.15.71:0/4117888018 learned_addr learned my addr 172.21.15.71:0/4117888018 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 -- 172.21.15.71:0/4117888018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae2810e6c0 msgr2=0x7fae2819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae2810e6c0 0x7fae2819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 -- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae28109d10 msgr2=0x7fae281a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae28109d10 0x7fae281a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 -- 172.21.15.71:0/4117888018 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2819ae10 con 0x7fae281021c0 2024-05-27T09:48:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.620+0000 7fae2d800640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae281021c0 0x7fae281a0560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00e9f0 tx=0x7fae1c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.621+0000 7fae26000640 1 -- 172.21.15.71:0/4117888018 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c00ccc0 con 0x7fae281021c0 2024-05-27T09:48:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.621+0000 7fae26000640 1 -- 172.21.15.71:0/4117888018 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c0035f0 con 0x7fae281021c0 2024-05-27T09:48:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.621+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2819b0a0 con 0x7fae281021c0 2024-05-27T09:48:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.621+0000 7fae26000640 1 -- 172.21.15.71:0/4117888018 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c00ce60 con 0x7fae281021c0 2024-05-27T09:48:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.621+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae281a7300 con 0x7fae281021c0 2024-05-27T09:48:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.625+0000 7fae3737e740 1 Processor -- start 2024-05-27T09:48:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.625+0000 7fae3737e740 1 -- start start 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae3737e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed815710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae3737e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed815c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae3737e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed816190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae3737e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55eaed786b90 con 0x55eaed4731b0 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae3737e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55eaed776730 con 0x55eaed4524d0 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae3737e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eaed77a770 con 0x55eaed44a2f0 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae2e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed815710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae2e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed815710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60972/0 (socket says 172.21.15.71:60972) 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae2e200640 1 -- 172.21.15.71:0/3634184471 learned_addr learned my addr 172.21.15.71:0/3634184471 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae2ce00640 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed816190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.626+0000 7fae26000640 1 -- 172.21.15.71:0/4117888018 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fae1c004000 con 0x7fae281021c0 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.627+0000 7fae2ce00640 1 -- 172.21.15.71:0/3634184471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 msgr2=0x55eaed815c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.627+0000 7fae2ce00640 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed815c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.627+0000 7fae2ce00640 1 -- 172.21.15.71:0/3634184471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 msgr2=0x55eaed815710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.627+0000 7fae2ce00640 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed815710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.627+0000 7fae2ce00640 1 -- 172.21.15.71:0/3634184471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaed70f8b0 con 0x55eaed4524d0 2024-05-27T09:48:59.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.627+0000 7fae2e200640 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed815710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:59.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.627+0000 7fae2ce00640 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed816190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fae14006010 tx=0x7fae14032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f08247a83069293 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:59.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.628+0000 7fae1aa00640 1 -- 172.21.15.71:0/3634184471 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14040070 con 0x55eaed4524d0 2024-05-27T09:48:59.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.628+0000 7fae1aa00640 1 -- 172.21.15.71:0/3634184471 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae14004030 con 0x55eaed4524d0 2024-05-27T09:48:59.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.628+0000 7fae1aa00640 1 -- 172.21.15.71:0/3634184471 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14035040 con 0x55eaed4524d0 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.628+0000 7fae26000640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fae100b2a70 0x7fae100b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae26000640 1 -- 172.21.15.71:0/4117888018 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fae1c0e2c70 con 0x7fae281021c0 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae2e200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fae100b2a70 0x7fae100b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 -- 172.21.15.71:0/3634184471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 msgr2=0x55eaed816190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed816190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fae14006010 tx=0x7fae14032b20 comp rx=0 tx=0).stop 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 -- 172.21.15.71:0/3634184471 shutdown_connections 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed816190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed815c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 --2- 172.21.15.71:0/3634184471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed815710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 -- 172.21.15.71:0/3634184471 >> 172.21.15.71:0/3634184471 conn(0x55eaed467300 msgr2=0x55eaed812010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 -- 172.21.15.71:0/3634184471 shutdown_connections 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae3737e740 1 -- 172.21.15.71:0/3634184471 wait complete. 2024-05-27T09:48:59.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.629+0000 7fae2e200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fae100b2a70 0x7fae100b4f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae20012720 tx=0x7fae20009500 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.630+0000 7fae3737e740 1 -- start start 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.630+0000 7fae3737e740 1 Processor -- start 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae3737e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed44a2f0 0x55eaed823e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae3737e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed8243d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae3737e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed4731b0 0x55eaed830070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae3737e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55eaed45c790 con 0x55eaed44a2f0 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae3737e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55eaed71ebc0 con 0x55eaed4524d0 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae3737e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eaed826d40 con 0x55eaed4731b0 2024-05-27T09:48:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae3737e740 10 client.0 _ll_register_callbacks cb 0x55eaed6fc400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed44a2f0 0x55eaed823e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed44a2f0 0x55eaed823e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60984/0 (socket says 172.21.15.71:60984) 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 -- 172.21.15.71:0/3992870940 learned_addr learned my addr 172.21.15.71:0/3992870940 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2ce00640 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed8243d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2e200640 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed4731b0 0x55eaed830070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 -- 172.21.15.71:0/3992870940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed4731b0 msgr2=0x55eaed830070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed4731b0 0x55eaed830070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 -- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 msgr2=0x55eaed8243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed8243d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.631+0000 7fae2d800640 1 -- 172.21.15.71:0/3992870940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaed48b210 con 0x55eaed44a2f0 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae2d800640 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed44a2f0 0x55eaed823e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0e09f0 tx=0x7fae1c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b255ef5f86b989 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae0f400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:48:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae0f400640 1 -- 172.21.15.71:0/3992870940 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0a9d30 con 0x55eaed44a2f0 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae0f400640 1 -- 172.21.15.71:0/3992870940 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fae1c0e0550 con 0x55eaed44a2f0 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae14004030 con 0x55eaed44a2f0 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae0f400640 1 -- 172.21.15.71:0/3992870940 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fae1c0ae0e0 con 0x55eaed44a2f0 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae3737e740 10 client.15339 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eaed557620 con 0x55eaed44a2f0 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.632+0000 7fae0f400640 1 -- 172.21.15.71:0/3992870940 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae14004030 con 0x55eaed44a2f0 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae0f400640 1 -- 172.21.15.71:0/3992870940 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fae1c0a9120 con 0x55eaed44a2f0 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae3737e740 10 client.15339 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae3737e740 10 client.15339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae3737e740 20 client.15339 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae3737e740 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed431d80 0x55eaed836030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae3737e740 4 client.15339 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:48:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaed788ae0 con 0x55eaed431d80 2024-05-27T09:48:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.633+0000 7fae2ce00640 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed431d80 0x55eaed836030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.634+0000 7fae2ce00640 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed431d80 0x55eaed836030 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a789aed1e629c1 server_cookie=d5efc8e38b1fe832 in_seq=0 out_seq=0 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.634+0000 7fae0f400640 10 client.15339 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae0f400640 1 -- 172.21.15.71:0/3992870940 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55eaed788ae0 con 0x55eaed431d80 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae0f400640 10 client.15339 handle_command_reply: tid=0 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 client.15339 shutdown 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed44a2f0 msgr2=0x55eaed823e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed44a2f0 0x55eaed823e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0e09f0 tx=0x7fae1c003cd0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 shutdown_connections 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed4731b0 0x55eaed830070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed8243d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed431d80 0x55eaed836030 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 --2- 172.21.15.71:0/3992870940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed44a2f0 0x55eaed823e90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 >> 172.21.15.71:0/3992870940 conn(0x55eaed467300 msgr2=0x55eaed817510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae0f400640 0 client.15339 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 shutdown_connections 2024-05-27T09:48:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 1 -- 172.21.15.71:0/3992870940 wait complete. 2024-05-27T09:48:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.635+0000 7fae3737e740 20 client.15339 trim_cache size 0 max 16384 2024-05-27T09:48:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 Processor -- start 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 -- start start 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed81daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed81dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed82fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae281b00b0 con 0x55eaed4731b0 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fae281ad980 con 0x55eaed4524d0 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.652+0000 7fae3737e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fae281ab7d0 con 0x55eaed44a2f0 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed82fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed82fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60994/0 (socket says 172.21.15.71:60994) 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2e200640 1 -- 172.21.15.71:0/170647425 learned_addr learned my addr 172.21.15.71:0/170647425 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2d800640 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed81daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2ce00640 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed81dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2d800640 1 -- 172.21.15.71:0/170647425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 msgr2=0x55eaed81dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2d800640 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed81dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2d800640 1 -- 172.21.15.71:0/170647425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 msgr2=0x55eaed82fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2d800640 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed82fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2d800640 1 -- 172.21.15.71:0/170647425 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaed8223e0 con 0x55eaed44a2f0 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.653+0000 7fae2e200640 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed82fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.654+0000 7fae2d800640 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed81daa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0a56a0 tx=0x7fae1c0039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfaa3045bde93c26 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.654+0000 7fae1a000640 1 -- 172.21.15.71:0/170647425 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0e01b0 con 0x55eaed44a2f0 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.654+0000 7fae1a000640 1 -- 172.21.15.71:0/170647425 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c0c9020 con 0x55eaed44a2f0 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.654+0000 7fae1a000640 1 -- 172.21.15.71:0/170647425 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0b2b90 con 0x55eaed44a2f0 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 -- 172.21.15.71:0/170647425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 msgr2=0x55eaed81daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed81daa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0a56a0 tx=0x7fae1c0039b0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 -- 172.21.15.71:0/170647425 shutdown_connections 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4731b0 0x55eaed82fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4524d0 0x55eaed81dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 --2- 172.21.15.71:0/170647425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed81daa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 -- 172.21.15.71:0/170647425 >> 172.21.15.71:0/170647425 conn(0x55eaed467300 msgr2=0x55eaed816020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 -- 172.21.15.71:0/170647425 shutdown_connections 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 -- 172.21.15.71:0/170647425 wait complete. 2024-05-27T09:48:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.655+0000 7fae3737e740 1 -- start start 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 1 Processor -- start 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed827bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4524d0 0x55eaed828130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4731b0 0x55eaed828670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae281abe40 con 0x55eaed4524d0 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fae281ad2b0 con 0x55eaed4731b0 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fae281ac510 con 0x55eaed44a2f0 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.656+0000 7fae3737e740 10 client.0 _ll_register_callbacks cb 0x7fae1c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4731b0 0x55eaed828670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4524d0 0x55eaed828130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4731b0 0x55eaed828670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36388/0 (socket says 172.21.15.71:36388) 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 -- 172.21.15.71:0/557573768 learned_addr learned my addr 172.21.15.71:0/557573768 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:48:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2d800640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed827bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 -- 172.21.15.71:0/557573768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 msgr2=0x55eaed827bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed827bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 -- 172.21.15.71:0/557573768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4524d0 msgr2=0x55eaed828130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4524d0 0x55eaed828130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 -- 172.21.15.71:0/557573768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaed89d660 con 0x55eaed4731b0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2d800640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed827bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2ce00640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4524d0 0x55eaed828130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae2e200640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4731b0 0x55eaed828670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae20003fd0 tx=0x7fae20004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b804caa5a5ae13 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.657+0000 7fae0f400640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae0f400640 1 -- 172.21.15.71:0/557573768 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2002f060 con 0x55eaed4731b0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae0f400640 1 -- 172.21.15.71:0/557573768 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fae2000f9d0 con 0x55eaed4731b0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1c0c9020 con 0x55eaed4731b0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae0f400640 1 -- 172.21.15.71:0/557573768 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fae2000fbd0 con 0x55eaed4731b0 2024-05-27T09:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 10 client.25451 fetch_fsmap learned FSMap version 26 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eaed89e770 con 0x55eaed4731b0 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae0f400640 1 -- 172.21.15.71:0/557573768 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c0c9020 con 0x55eaed4731b0 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae0f400640 1 -- 172.21.15.71:0/557573768 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fae2001e420 con 0x55eaed4731b0 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 10 client.25451 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 20 client.25451 populate_metadata read hostname 'smithi071' 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed4071c0 0x55eaed8a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 4 client.25451 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.658+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eaed7822c0 con 0x55eaed4071c0 2024-05-27T09:48:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.659+0000 7fae2d800640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed4071c0 0x55eaed8a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:48:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.659+0000 7fae0f400640 10 client.25451 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.659+0000 7fae2d800640 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed4071c0 0x55eaed8a0f60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e52eb23f24c27a2 server_cookie=6317d7775827db49 in_seq=0 out_seq=0 2024-05-27T09:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.663+0000 7fae0f400640 1 -- 172.21.15.71:0/557573768 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55eaed7822c0 con 0x55eaed4071c0 2024-05-27T09:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae0f400640 10 client.25451 handle_command_reply: tid=0 2024-05-27T09:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 client.25451 shutdown 2024-05-27T09:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4731b0 msgr2=0x55eaed828670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4731b0 0x55eaed828670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae20003fd0 tx=0x7fae20004a40 comp rx=0 tx=0).stop 2024-05-27T09:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 shutdown_connections 2024-05-27T09:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55eaed4731b0 0x55eaed828670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55eaed4071c0 0x55eaed8a0f60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eaed4524d0 0x55eaed828130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 --2- 172.21.15.71:0/557573768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eaed44a2f0 0x55eaed827bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae0f400640 0 client.25451 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 >> 172.21.15.71:0/557573768 conn(0x55eaed467300 msgr2=0x55eaed815d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 shutdown_connections 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 1 -- 172.21.15.71:0/557573768 wait complete. 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.664+0000 7fae3737e740 20 client.25451 trim_cache size 0 max 16384 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fae100b2a70 msgr2=0x7fae100b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fae100b2a70 0x7fae100b4f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae20012720 tx=0x7fae20009500 comp rx=0 tx=0).stop 2024-05-27T09:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae281021c0 msgr2=0x7fae281a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae281021c0 0x7fae281a0560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00e9f0 tx=0x7fae1c00edf0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 shutdown_connections 2024-05-27T09:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fae100b2a70 0x7fae100b4f80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae2810e6c0 0x7fae2819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae28109d10 0x7fae281a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 --2- 172.21.15.71:0/4117888018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae281021c0 0x7fae281a0560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 >> 172.21.15.71:0/4117888018 conn(0x7fae280779d0 msgr2=0x7fae28105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 shutdown_connections 2024-05-27T09:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:48:59.665+0000 7fae30200640 1 -- 172.21.15.71:0/4117888018 wait complete. 2024-05-27T09:49:00.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 -- 172.21.15.71:0/2873654993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 msgr2=0x7f9634109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 --2- 172.21.15.71:0/2873654993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 0x7f9634109130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9620009920 tx=0x7f9620009c30 comp rx=0 tx=0).stop 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 -- 172.21.15.71:0/2873654993 shutdown_connections 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 --2- 172.21.15.71:0/2873654993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9634109670 0x7f9634110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 --2- 172.21.15.71:0/2873654993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96341043f0 0x7f9634104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 --2- 172.21.15.71:0/2873654993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 0x7f9634109130 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 -- 172.21.15.71:0/2873654993 >> 172.21.15.71:0/2873654993 conn(0x7f9634079d40 msgr2=0x7f963407a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 -- 172.21.15.71:0/2873654993 shutdown_connections 2024-05-27T09:49:00.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.474+0000 7f963b000700 1 -- 172.21.15.71:0/2873654993 wait complete. 2024-05-27T09:49:00.476 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:49:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:49:00.266+0000 7f2e51400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:49:00.476 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:49:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:49:00.266+0000 7f2e51400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:49:00.477 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:49:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:49:00.266+0000 7f2e51400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:49:00.477 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:49:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:49:00.266+0000 7f2e51400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:49:00.477 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 09:49:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T09:49:00.266+0000 7f2e51400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T09:49:00.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.476+0000 7f963b000700 1 Processor -- start 2024-05-27T09:49:00.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.476+0000 7f963b000700 1 -- start start 2024-05-27T09:49:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f963b000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96341043f0 0x7f963419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f963b000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 0x7f963419d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f963b000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9634109670 0x7f96341a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f963b000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96341142f0 con 0x7f96341043f0 2024-05-27T09:49:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f963b000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9634114170 con 0x7f9634109670 2024-05-27T09:49:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f963b000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9634114470 con 0x7f9634108d20 2024-05-27T09:49:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f9639c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96341043f0 0x7f963419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f9639c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96341043f0 0x7f963419cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32794/0 (socket says 172.21.15.71:32794) 2024-05-27T09:49:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f9639c00700 1 -- 172.21.15.71:0/939642549 learned_addr learned my addr 172.21.15.71:0/939642549 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f9639200700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 0x7f963419d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.477+0000 7f963a600700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9634109670 0x7f96341a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9639c00700 1 -- 172.21.15.71:0/939642549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 msgr2=0x7f963419d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9639c00700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 0x7f963419d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9639c00700 1 -- 172.21.15.71:0/939642549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9634109670 msgr2=0x7f96341a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9639c00700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9634109670 0x7f96341a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9639c00700 1 -- 172.21.15.71:0/939642549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96341a1dd0 con 0x7f96341043f0 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f963a600700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9634109670 0x7f96341a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9639c00700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96341043f0 0x7f963419cf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f962800ef30 tx=0x7f962800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9632000700 1 -- 172.21.15.71:0/939642549 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96280092e0 con 0x7f96341043f0 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.478+0000 7f9632000700 1 -- 172.21.15.71:0/939642549 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9628004bb0 con 0x7f96341043f0 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.479+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96341a2060 con 0x7f96341043f0 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.479+0000 7f9632000700 1 -- 172.21.15.71:0/939642549 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628004020 con 0x7f96341043f0 2024-05-27T09:49:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.479+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96341a2520 con 0x7f96341043f0 2024-05-27T09:49:00.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.482+0000 7f9632000700 1 -- 172.21.15.71:0/939642549 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f962801b030 con 0x7f96341043f0 2024-05-27T09:49:00.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.483+0000 7f964b0bbb80 1 Processor -- start 2024-05-27T09:49:00.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f964b0bbb80 1 -- start start 2024-05-27T09:49:00.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7ddad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7e0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d87b701e40 con 0x55d87b7d3820 2024-05-27T09:49:00.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d87b6f19e0 con 0x55d87b7d3410 2024-05-27T09:49:00.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d87b6f5a20 con 0x55d87b654e40 2024-05-27T09:49:00.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f9632000700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f961c0b2b10 0x7f961c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f9632000700 1 -- 172.21.15.71:0/939642549 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f96280e2470 con 0x7f96341043f0 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.484+0000 7f963a600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f9639c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7ddad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:48356/0 (socket says 172.21.15.71:48356) 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f9639200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 -- 172.21.15.71:0/1701468497 learned_addr learned my addr 172.21.15.71:0/1701468497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f961c0b2b10 0x7f961c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 -- 172.21.15.71:0/1701468497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 msgr2=0x55d87b7ddad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 --2- 172.21.15.71:0/1701468497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7ddad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 -- 172.21.15.71:0/1701468497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 msgr2=0x55d87b7e0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 --2- 172.21.15.71:0/1701468497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7e0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 -- 172.21.15.71:0/1701468497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d87b6ba420 con 0x55d87b654e40 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.485+0000 7f963a600700 1 --2- 172.21.15.71:0/1701468497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d2ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f962c0119c0 tx=0x7f962c011cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90cdd1a92dca75ed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.486+0000 7f9626a00700 1 -- 172.21.15.71:0/1701468497 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c022020 con 0x55d87b654e40 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.486+0000 7f9626a00700 1 -- 172.21.15.71:0/1701468497 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f962c011540 con 0x55d87b654e40 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.486+0000 7f9626a00700 1 -- 172.21.15.71:0/1701468497 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c01d640 con 0x55d87b654e40 2024-05-27T09:49:00.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.486+0000 7f963a600700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f961c0b2b10 0x7f961c0b5020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f962c023000 tx=0x7f962c021000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:00.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1701468497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 msgr2=0x55d87b7d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1701468497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d2ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f962c0119c0 tx=0x7f962c011cd0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1701468497 shutdown_connections 2024-05-27T09:49:00.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1701468497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1701468497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d2ed0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1701468497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7ddad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1701468497 >> 172.21.15.71:0/1701468497 conn(0x55d87b6b4fc0 msgr2=0x55d87b7ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:00.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1701468497 shutdown_connections 2024-05-27T09:49:00.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.487+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1701468497 wait complete. 2024-05-27T09:49:00.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.488+0000 7f964b0bbb80 1 -- start start 2024-05-27T09:49:00.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.488+0000 7f964b0bbb80 1 Processor -- start 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.488+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d87b5f7fa0 con 0x55d87b7d3410 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d87b692760 con 0x55d87b7d3820 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d87b7e0990 con 0x55d87b654e40 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f964b0bbb80 10 client.0 _ll_register_callbacks cb 0x55d87b69bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:00.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7dd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:48358/0 (socket says 172.21.15.71:48358) 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 -- 172.21.15.71:0/696494885 learned_addr learned my addr 172.21.15.71:0/696494885 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639200700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f963a600700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 -- 172.21.15.71:0/696494885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 msgr2=0x55d87b7ddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7ddfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 -- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 msgr2=0x55d87b7dda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7dda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639c00700 1 -- 172.21.15.71:0/696494885 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d87b6418d0 con 0x55d87b654e40 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.489+0000 7f9639200700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f9639c00700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7dd550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96280a67d0 tx=0x7f9628004f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a4eb374c096d696 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f961b400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:00.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f961b400700 1 -- 172.21.15.71:0/696494885 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962806ef60 con 0x55d87b654e40 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f961b400700 1 -- 172.21.15.71:0/696494885 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f96280910d0 con 0x55d87b654e40 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d87b703d90 con 0x55d87b654e40 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f961b400700 1 -- 172.21.15.71:0/696494885 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96280a9560 con 0x55d87b654e40 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f964b0bbb80 10 client.25486 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d87b6c2060 con 0x55d87b654e40 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.490+0000 7f961b400700 1 -- 172.21.15.71:0/696494885 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d87b703d90 con 0x55d87b654e40 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f961b400700 1 -- 172.21.15.71:0/696494885 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f96280e2040 con 0x55d87b654e40 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f964b0bbb80 10 client.25486 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f964b0bbb80 10 client.25486 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f964b0bbb80 20 client.25486 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b7ed8a0 0x55d87b7efd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f964b0bbb80 4 client.25486 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:00.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d87b6fd570 con 0x55d87b7ed8a0 2024-05-27T09:49:00.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.491+0000 7f9639200700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b7ed8a0 0x55d87b7efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.492+0000 7f9639200700 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b7ed8a0 0x55d87b7efd00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33aac70ed33aefa2 server_cookie=d3a38ea6df4a1ada in_seq=0 out_seq=0 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.492+0000 7f961b400700 10 client.25486 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f961b400700 1 -- 172.21.15.71:0/696494885 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d87b6fd570 con 0x55d87b7ed8a0 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f961b400700 10 client.25486 handle_command_reply: tid=0 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 client.25486 shutdown 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 msgr2=0x55d87b7dd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7dd550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96280a67d0 tx=0x7f9628004f90 comp rx=0 tx=0).stop 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 shutdown_connections 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b7ed8a0 0x55d87b7efd00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7dd550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f961b400700 0 client.25486 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:00.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/696494885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 >> 172.21.15.71:0/696494885 conn(0x55d87b6b4fc0 msgr2=0x55d87b7cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:00.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 shutdown_connections 2024-05-27T09:49:00.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.493+0000 7f964b0bbb80 1 -- 172.21.15.71:0/696494885 wait complete. 2024-05-27T09:49:00.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.494+0000 7f964b0bbb80 20 client.25486 trim_cache size 0 max 16384 2024-05-27T09:49:00.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.510+0000 7f964b0bbb80 1 Processor -- start 2024-05-27T09:49:00.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.510+0000 7f964b0bbb80 1 -- start start 2024-05-27T09:49:00.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96341b36c0 con 0x55d87b7d3820 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96341b0f50 con 0x55d87b7d3410 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96341aedc0 con 0x55d87b654e40 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f963a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:48366/0 (socket says 172.21.15.71:48366) 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f963a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7dbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32812/0 (socket says 172.21.15.71:32812) 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 -- 172.21.15.71:0/1023076189 learned_addr learned my addr 172.21.15.71:0/1023076189 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 -- 172.21.15.71:0/1023076189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 msgr2=0x55d87b7e9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 --2- 172.21.15.71:0/1023076189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7e9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 -- 172.21.15.71:0/1023076189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 msgr2=0x55d87b7dbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 --2- 172.21.15.71:0/1023076189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7dbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.511+0000 7f9639c00700 1 -- 172.21.15.71:0/1023076189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d87b7dbac0 con 0x55d87b654e40 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.512+0000 7f9639c00700 1 --2- 172.21.15.71:0/1023076189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d8d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9628009c10 tx=0x7f96280a9b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5690518cdf749c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.512+0000 7f9626000700 1 -- 172.21.15.71:0/1023076189 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962806ef60 con 0x55d87b654e40 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.512+0000 7f9626000700 1 -- 172.21.15.71:0/1023076189 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96280ad910 con 0x55d87b654e40 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.512+0000 7f9626000700 1 -- 172.21.15.71:0/1023076189 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96280a50b0 con 0x55d87b654e40 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1023076189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 msgr2=0x55d87b7d8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1023076189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d8d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9628009c10 tx=0x7f96280a9b50 comp rx=0 tx=0).stop 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1023076189 shutdown_connections 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1023076189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3820 0x55d87b7dbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1023076189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7d8d90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1023076189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3410 0x55d87b7e9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1023076189 >> 172.21.15.71:0/1023076189 conn(0x55d87b6b4fc0 msgr2=0x55d87b7ddd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:00.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1023076189 shutdown_connections 2024-05-27T09:49:00.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.513+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1023076189 wait complete. 2024-05-27T09:49:00.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 -- start start 2024-05-27T09:49:00.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 Processor -- start 2024-05-27T09:49:00.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7e1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7e1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96341af410 con 0x55d87b7d3410 2024-05-27T09:49:00.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96341b0880 con 0x55d87b7d3820 2024-05-27T09:49:00.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96341afae0 con 0x55d87b654e40 2024-05-27T09:49:00.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.514+0000 7f964b0bbb80 10 client.0 _ll_register_callbacks cb 0x55d87b7f01e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7e61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:48380/0 (socket says 172.21.15.71:48380) 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7e1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32824/0 (socket says 172.21.15.71:32824) 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 -- 172.21.15.71:0/1854048246 learned_addr learned my addr 172.21.15.71:0/1854048246 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f963a600700 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7e1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 -- 172.21.15.71:0/1854048246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 msgr2=0x55d87b7e1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7e1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 -- 172.21.15.71:0/1854048246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 msgr2=0x55d87b7e1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7e1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 -- 172.21.15.71:0/1854048246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d87b7e2070 con 0x55d87b654e40 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f9639c00700 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7e61c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96280a67d0 tx=0x7f96280a4fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86a2d89c3fed087 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:00.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.515+0000 7f961b400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f961b400700 1 -- 172.21.15.71:0/1854048246 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96280df950 con 0x55d87b654e40 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f961b400700 1 -- 172.21.15.71:0/1854048246 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f96280910d0 con 0x55d87b654e40 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96280ad910 con 0x55d87b654e40 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f961b400700 1 -- 172.21.15.71:0/1854048246 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96280b2330 con 0x55d87b654e40 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f964b0bbb80 10 client.25492 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d87b858130 con 0x55d87b654e40 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f961b400700 1 -- 172.21.15.71:0/1854048246 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96280ad910 con 0x55d87b654e40 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.516+0000 7f961b400700 1 -- 172.21.15.71:0/1854048246 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f96280a8230 con 0x55d87b654e40 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f964b0bbb80 10 client.25492 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f964b0bbb80 10 client.25492 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f964b0bbb80 20 client.25492 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b858540 0x55d87b85a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f964b0bbb80 4 client.25492 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:49:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d87b574250 con 0x55d87b858540 2024-05-27T09:49:00.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f9639200700 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b858540 0x55d87b85a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f9639200700 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b858540 0x55d87b85a960 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5786f035d9ee71fd server_cookie=e65ddc679eee6ada in_seq=0 out_seq=0 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.517+0000 7f961b400700 10 client.25492 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f961b400700 1 -- 172.21.15.71:0/1854048246 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d87b574250 con 0x55d87b858540 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f961b400700 10 client.25492 handle_command_reply: tid=0 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 client.25492 shutdown 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 msgr2=0x55d87b7e61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7e61c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96280a67d0 tx=0x7f96280a4fc0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 shutdown_connections 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d87b858540 0x55d87b85a960 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d87b7d3820 0x55d87b7e1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d87b654e40 0x55d87b7e61c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 --2- 172.21.15.71:0/1854048246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d87b7d3410 0x55d87b7e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 >> 172.21.15.71:0/1854048246 conn(0x55d87b6b4fc0 msgr2=0x55d87b7ddd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:00.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f961b400700 0 client.25492 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:00.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 shutdown_connections 2024-05-27T09:49:00.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.518+0000 7f964b0bbb80 1 -- 172.21.15.71:0/1854048246 wait complete. 2024-05-27T09:49:00.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f964b0bbb80 20 client.25492 trim_cache size 0 max 16384 2024-05-27T09:49:00.523 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f961c0b2b10 msgr2=0x7f961c0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f961c0b2b10 0x7f961c0b5020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f962c023000 tx=0x7f962c021000 comp rx=0 tx=0).stop 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96341043f0 msgr2=0x7f963419cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96341043f0 0x7f963419cf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f962800ef30 tx=0x7f962800c3a0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 shutdown_connections 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f961c0b2b10 0x7f961c0b5020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9634109670 0x7f96341a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96341043f0 0x7f963419cf00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 --2- 172.21.15.71:0/939642549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9634108d20 0x7f963419d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:00.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 >> 172.21.15.71:0/939642549 conn(0x7f9634079d40 msgr2=0x7f9634110d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:00.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.519+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 shutdown_connections 2024-05-27T09:49:00.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:00.520+0000 7f963b000700 1 -- 172.21.15.71:0/939642549 wait complete. 2024-05-27T09:49:01.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:00 smithi071 ceph-mon[31451]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T09:49:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:00 smithi072 ceph-mon[35951]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T09:49:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:00 smithi122 ceph-mon[36436]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T09:49:01.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-27T09:49:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:03.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:02 smithi071 ceph-mon[31451]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-27T09:49:03.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:02 smithi071 ceph-mon[31451]: mgrmap e25: x(active, since 76s), standbys: y, z 2024-05-27T09:49:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:02 smithi072 ceph-mon[35951]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-27T09:49:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:02 smithi072 ceph-mon[35951]: mgrmap e25: x(active, since 76s), standbys: y, z 2024-05-27T09:49:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:02 smithi122 ceph-mon[36436]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-27T09:49:03.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:02 smithi122 ceph-mon[36436]: mgrmap e25: x(active, since 76s), standbys: y, z 2024-05-27T09:49:04.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 -- 172.21.15.71:0/3205693794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 msgr2=0x7f8980110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 --2- 172.21.15.71:0/3205693794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 0x7f8980110650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89680098f0 tx=0x7f8968009c00 comp rx=0 tx=0).stop 2024-05-27T09:49:04.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 -- 172.21.15.71:0/3205693794 shutdown_connections 2024-05-27T09:49:04.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 --2- 172.21.15.71:0/3205693794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8980110b90 0x7f8980112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 --2- 172.21.15.71:0/3205693794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8980075d20 0x7f8980076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 --2- 172.21.15.71:0/3205693794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 0x7f8980110650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 -- 172.21.15.71:0/3205693794 >> 172.21.15.71:0/3205693794 conn(0x7f8980100030 msgr2=0x7f8980102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:04.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 -- 172.21.15.71:0/3205693794 shutdown_connections 2024-05-27T09:49:04.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.217+0000 7f8984e00700 1 -- 172.21.15.71:0/3205693794 wait complete. 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.218+0000 7f8984e00700 1 Processor -- start 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.218+0000 7f8984e00700 1 -- start start 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f8984e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8980075d20 0x7f898019d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f8984e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 0x7f898019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f8984e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8980110b90 0x7f89801a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f8984e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8980116690 con 0x7f8980110b90 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f8984e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8980116510 con 0x7f8980076670 2024-05-27T09:49:04.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f8984e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8980116810 con 0x7f8980075d20 2024-05-27T09:49:04.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f897e800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8980110b90 0x7f89801a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f8975400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 0x7f898019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f897de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8980075d20 0x7f898019d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f897e800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8980110b90 0x7f89801a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35160/0 (socket says 172.21.15.71:35160) 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.219+0000 7f897e800700 1 -- 172.21.15.71:0/1112257487 learned_addr learned my addr 172.21.15.71:0/1112257487 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f897de00700 1 -- 172.21.15.71:0/1112257487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 msgr2=0x7f898019d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f897de00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 0x7f898019d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f897de00700 1 -- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8980110b90 msgr2=0x7f89801a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f897de00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8980110b90 0x7f89801a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f897de00700 1 -- 172.21.15.71:0/1112257487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89801a1f30 con 0x7f8980075d20 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f8975400700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 0x7f898019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f897de00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8980075d20 0x7f898019d060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8970009fd0 tx=0x7f897000c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f8977400700 1 -- 172.21.15.71:0/1112257487 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897000cd90 con 0x7f8980075d20 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.220+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89801a21c0 con 0x7f8980075d20 2024-05-27T09:49:04.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.221+0000 7f8977400700 1 -- 172.21.15.71:0/1112257487 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8970003a00 con 0x7f8980075d20 2024-05-27T09:49:04.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.221+0000 7f8977400700 1 -- 172.21.15.71:0/1112257487 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970007c20 con 0x7f8980075d20 2024-05-27T09:49:04.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.221+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89801a9b40 con 0x7f8980075d20 2024-05-27T09:49:04.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.226+0000 7f8977400700 1 -- 172.21.15.71:0/1112257487 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f897001a020 con 0x7f8980075d20 2024-05-27T09:49:04.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.227+0000 7f899394db80 1 Processor -- start 2024-05-27T09:49:04.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.227+0000 7f899394db80 1 -- start start 2024-05-27T09:49:04.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.227+0000 7f899394db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c557b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.227+0000 7f899394db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c5575870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f899394db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c5575db0 0x5605c55761c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f899394db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5605c54a3e40 con 0x5605c53f6e40 2024-05-27T09:49:04.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f899394db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5605c54939e0 con 0x5605c557bd30 2024-05-27T09:49:04.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f899394db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605c5497a20 con 0x5605c5575db0 2024-05-27T09:49:04.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f897e800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c557b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f897de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c5575870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f897de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c5575870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60934/0 (socket says 172.21.15.71:60934) 2024-05-27T09:49:04.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f897e800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c557b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35170/0 (socket says 172.21.15.71:35170) 2024-05-27T09:49:04.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f897e800700 1 -- 172.21.15.71:0/695404348 learned_addr learned my addr 172.21.15.71:0/695404348 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:04.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.228+0000 7f8975400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c5575db0 0x5605c55761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8975400700 1 -- 172.21.15.71:0/695404348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 msgr2=0x5605c5575870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8975400700 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c5575870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8975400700 1 -- 172.21.15.71:0/695404348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 msgr2=0x5605c557b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8975400700 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c557b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8975400700 1 -- 172.21.15.71:0/695404348 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c545c420 con 0x5605c5575db0 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f897e800700 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c557b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8977400700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f89640b2c20 0x7f89640b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8975400700 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c5575db0 0x5605c55761c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89680098c0 tx=0x7f8968005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a434ae526f4e7a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:04.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f8977400700 1 -- 172.21.15.71:0/1112257487 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f89700e2250 con 0x7f8980075d20 2024-05-27T09:49:04.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.229+0000 7f896f400700 1 -- 172.21.15.71:0/695404348 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896800f6e0 con 0x5605c5575db0 2024-05-27T09:49:04.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.230+0000 7f896f400700 1 -- 172.21.15.71:0/695404348 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f896800f880 con 0x5605c5575db0 2024-05-27T09:49:04.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.230+0000 7f896f400700 1 -- 172.21.15.71:0/695404348 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896800bae0 con 0x5605c5575db0 2024-05-27T09:49:04.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.230+0000 7f897e800700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f89640b2c20 0x7f89640b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 -- 172.21.15.71:0/695404348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c5575db0 msgr2=0x5605c55761c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c5575db0 0x5605c55761c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89680098c0 tx=0x7f8968005dc0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f897e800700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f89640b2c20 0x7f89640b5130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5605c5576b30 tx=0x7f8978009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 -- 172.21.15.71:0/695404348 shutdown_connections 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c5575db0 0x5605c55761c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c557b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 --2- 172.21.15.71:0/695404348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c5575870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 -- 172.21.15.71:0/695404348 >> 172.21.15.71:0/695404348 conn(0x5605c5456fc0 msgr2=0x5605c55708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 -- 172.21.15.71:0/695404348 shutdown_connections 2024-05-27T09:49:04.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.231+0000 7f899394db80 1 -- 172.21.15.71:0/695404348 wait complete. 2024-05-27T09:49:04.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.232+0000 7f899394db80 1 -- start start 2024-05-27T09:49:04.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.232+0000 7f899394db80 1 Processor -- start 2024-05-27T09:49:04.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f899394db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c53f6e40 0x5605c557f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f899394db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c557fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f899394db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c557ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f899394db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5605c5399fa0 con 0x5605c5575db0 2024-05-27T09:49:04.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f899394db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5605c5434760 con 0x5605c53f6e40 2024-05-27T09:49:04.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f899394db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605c55827a0 con 0x5605c557bd30 2024-05-27T09:49:04.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f899394db80 10 client.0 _ll_register_callbacks cb 0x5605c543dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:04.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f897de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c53f6e40 0x5605c557f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f8975400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c557fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f897de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c53f6e40 0x5605c557f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60944/0 (socket says 172.21.15.71:60944) 2024-05-27T09:49:04.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f897de00700 1 -- 172.21.15.71:0/3587933410 learned_addr learned my addr 172.21.15.71:0/3587933410 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:04.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.233+0000 7f897e800700 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c557ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f897de00700 1 -- 172.21.15.71:0/3587933410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 msgr2=0x5605c557ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f897de00700 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c557ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f897de00700 1 -- 172.21.15.71:0/3587933410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 msgr2=0x5605c557fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f897de00700 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c557fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f897de00700 1 -- 172.21.15.71:0/3587933410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c53e38d0 con 0x5605c53f6e40 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f897e800700 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c557ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f897de00700 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c53f6e40 0x5605c557f510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89700a53e0 tx=0x7f89700e5f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba1f5117538f4366 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f8963e00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f8963e00700 1 -- 172.21.15.71:0/3587933410 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a9130 con 0x5605c53f6e40 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f896800f880 con 0x5605c53f6e40 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.234+0000 7f8963e00700 1 -- 172.21.15.71:0/3587933410 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f89700b1f40 con 0x5605c53f6e40 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f8963e00700 1 -- 172.21.15.71:0/3587933410 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89700a8ad0 con 0x5605c53f6e40 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f899394db80 10 client.25487 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5605c5464060 con 0x5605c53f6e40 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f8963e00700 1 -- 172.21.15.71:0/3587933410 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f896800f880 con 0x5605c53f6e40 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f8963e00700 1 -- 172.21.15.71:0/3587933410 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f89700a85c0 con 0x5605c53f6e40 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f899394db80 10 client.25487 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f899394db80 10 client.25487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f899394db80 20 client.25487 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.235+0000 7f899394db80 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c558f760 0x5605c5591bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.236+0000 7f899394db80 4 client.25487 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.236+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605c54a5d90 con 0x5605c558f760 2024-05-27T09:49:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.236+0000 7f8975400700 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c558f760 0x5605c5591bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.237+0000 7f8963e00700 10 client.25487 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.237+0000 7f8975400700 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c558f760 0x5605c5591bc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f55dfd9a05fb539 server_cookie=b6319a798c659bb2 in_seq=0 out_seq=0 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.237+0000 7f8963e00700 1 -- 172.21.15.71:0/3587933410 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5605c54a5d90 con 0x5605c558f760 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.237+0000 7f8963e00700 10 client.25487 handle_command_reply: tid=0 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 client.25487 shutdown 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c53f6e40 msgr2=0x5605c557f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c53f6e40 0x5605c557f510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89700a53e0 tx=0x7f89700e5f70 comp rx=0 tx=0).stop 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 shutdown_connections 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c558f760 0x5605c5591bc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c557ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c53f6e40 0x5605c557f510 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 --2- 172.21.15.71:0/3587933410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c557fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f8963e00700 0 client.25487 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:04.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 >> 172.21.15.71:0/3587933410 conn(0x5605c5456fc0 msgr2=0x5605c5570580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 shutdown_connections 2024-05-27T09:49:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 1 -- 172.21.15.71:0/3587933410 wait complete. 2024-05-27T09:49:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.238+0000 7f899394db80 20 client.25487 trim_cache size 0 max 16384 2024-05-27T09:49:04.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 Processor -- start 2024-05-27T09:49:04.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 -- start start 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c5575870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c5575db0 0x5605c5579c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c558b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89801b3880 con 0x5605c53f6e40 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f89801b1110 con 0x5605c5575db0 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f899394db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f89801aef60 con 0x5605c557bd30 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.255+0000 7f897de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c5575870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c5575870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35188/0 (socket says 172.21.15.71:35188) 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 -- 172.21.15.71:0/2122008055 learned_addr learned my addr 172.21.15.71:0/2122008055 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:04.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897e800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c558b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f8975400700 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c5575db0 0x5605c5579c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 -- 172.21.15.71:0/2122008055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 msgr2=0x5605c558b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c558b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 -- 172.21.15.71:0/2122008055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c5575db0 msgr2=0x5605c5579c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c5575db0 0x5605c5579c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 -- 172.21.15.71:0/2122008055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c558d180 con 0x5605c53f6e40 2024-05-27T09:49:04.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897e800700 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c558b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:04.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.256+0000 7f897de00700 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c5575870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f89700a9060 tx=0x7f89700076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ee99cd45af12a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:04.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.257+0000 7f896ea00700 1 -- 172.21.15.71:0/2122008055 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a8cb0 con 0x5605c53f6e40 2024-05-27T09:49:04.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.257+0000 7f896ea00700 1 -- 172.21.15.71:0/2122008055 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89700e2070 con 0x5605c53f6e40 2024-05-27T09:49:04.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.257+0000 7f896ea00700 1 -- 172.21.15.71:0/2122008055 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a9360 con 0x5605c53f6e40 2024-05-27T09:49:04.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 -- 172.21.15.71:0/2122008055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 msgr2=0x5605c5575870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c5575870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f89700a9060 tx=0x7f89700076c0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 -- 172.21.15.71:0/2122008055 shutdown_connections 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c557bd30 0x5605c558b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c53f6e40 0x5605c5575870 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 --2- 172.21.15.71:0/2122008055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c5575db0 0x5605c5579c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 -- 172.21.15.71:0/2122008055 >> 172.21.15.71:0/2122008055 conn(0x5605c5456fc0 msgr2=0x5605c557e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 -- 172.21.15.71:0/2122008055 shutdown_connections 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 -- 172.21.15.71:0/2122008055 wait complete. 2024-05-27T09:49:04.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.258+0000 7f899394db80 1 -- start start 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 1 Processor -- start 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c53f6e40 0x5605c5587c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c5588150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c55967d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89801af5d0 con 0x5605c5575db0 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f89801b0a40 con 0x5605c557bd30 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f89801afca0 con 0x5605c53f6e40 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.259+0000 7f899394db80 10 client.0 _ll_register_callbacks cb 0x5605c543dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c53f6e40 0x5605c5587c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c53f6e40 0x5605c5587c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:60828/0 (socket says 172.21.15.71:60828) 2024-05-27T09:49:04.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 -- 172.21.15.71:0/1117241857 learned_addr learned my addr 172.21.15.71:0/1117241857 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f8975400700 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c5588150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897e800700 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c55967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 -- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 msgr2=0x5605c55967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c55967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 -- 172.21.15.71:0/1117241857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 msgr2=0x5605c5588150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c5588150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 -- 172.21.15.71:0/1117241857 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c5580300 con 0x5605c53f6e40 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f897de00700 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c53f6e40 0x5605c5587c10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89700e2220 tx=0x7f8970003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4672c0051596dd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.260+0000 7f8963e00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f8963e00700 1 -- 172.21.15.71:0/1117241857 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89700a8cb0 con 0x5605c53f6e40 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f8963e00700 1 -- 172.21.15.71:0/1117241857 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f89700ca2e0 con 0x5605c53f6e40 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89700e2070 con 0x5605c53f6e40 2024-05-27T09:49:04.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f8963e00700 1 -- 172.21.15.71:0/1117241857 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89700a8e70 con 0x5605c53f6e40 2024-05-27T09:49:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f899394db80 10 client.25510 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:04.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5605c55f9a90 con 0x5605c53f6e40 2024-05-27T09:49:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f8963e00700 1 -- 172.21.15.71:0/1117241857 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89700e2070 con 0x5605c53f6e40 2024-05-27T09:49:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f8963e00700 1 -- 172.21.15.71:0/1117241857 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f89700a4cd0 con 0x5605c53f6e40 2024-05-27T09:49:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f899394db80 10 client.25510 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f899394db80 10 client.25510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f899394db80 20 client.25510 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:04.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.261+0000 7f899394db80 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c55f9e50 0x5605c55fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.262+0000 7f899394db80 4 client.25510 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.262+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605c549f570 con 0x5605c55f9e50 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.262+0000 7f8975400700 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c55f9e50 0x5605c55fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.262+0000 7f8975400700 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c55f9e50 0x5605c55fc270 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b21d496c791268b server_cookie=4d396b30b4742354 in_seq=0 out_seq=0 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.262+0000 7f8963e00700 10 client.25510 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f8963e00700 1 -- 172.21.15.71:0/1117241857 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605c549f570 con 0x5605c55f9e50 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f8963e00700 10 client.25510 handle_command_reply: tid=0 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 client.25510 shutdown 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c53f6e40 msgr2=0x5605c5587c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c53f6e40 0x5605c5587c10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89700e2220 tx=0x7f8970003ed0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 shutdown_connections 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5605c55f9e50 0x5605c55fc270 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5605c557bd30 0x5605c55967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605c53f6e40 0x5605c5587c10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 --2- 172.21.15.71:0/1117241857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605c5575db0 0x5605c5588150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f8963e00700 0 client.25510 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 >> 172.21.15.71:0/1117241857 conn(0x5605c5456fc0 msgr2=0x5605c557f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 shutdown_connections 2024-05-27T09:49:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 1 -- 172.21.15.71:0/1117241857 wait complete. 2024-05-27T09:49:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.263+0000 7f899394db80 20 client.25510 trim_cache size 0 max 16384 2024-05-27T09:49:04.267 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f89640b2c20 msgr2=0x7f89640b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f89640b2c20 0x7f89640b5130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5605c5576b30 tx=0x7f8978009260 comp rx=0 tx=0).stop 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8980075d20 msgr2=0x7f898019d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8980075d20 0x7f898019d060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8970009fd0 tx=0x7f897000c620 comp rx=0 tx=0).stop 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 shutdown_connections 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f89640b2c20 0x7f89640b5130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8980110b90 0x7f89801a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8980075d20 0x7f898019d060 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 --2- 172.21.15.71:0/1112257487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8980076670 0x7f898019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:04.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 >> 172.21.15.71:0/1112257487 conn(0x7f8980100030 msgr2=0x7f8980100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:04.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 shutdown_connections 2024-05-27T09:49:04.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:04.264+0000 7f8984e00700 1 -- 172.21.15.71:0/1112257487 wait complete. 2024-05-27T09:49:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:04 smithi071 ceph-mon[31451]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-05-27T09:49:04.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:04 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:49:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:04 smithi072 ceph-mon[35951]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-05-27T09:49:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:04 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:49:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:04 smithi122 ceph-mon[36436]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-05-27T09:49:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:04 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:49:06.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:05 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:49:06.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:05 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:49:06.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:05 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:49:06.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:05 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:49:06.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:05 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:49:06.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:05 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:49:06.032 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-27T09:49:06.033 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-27T09:49:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:05 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:49:06.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:05 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:49:06.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:05 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:49:06.466 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:06.955 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:06 smithi071 ceph-mon[31451]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:49:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:06 smithi072 ceph-mon[35951]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:49:07.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:06 smithi122 ceph-mon[36436]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:49:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 -- 172.21.15.71:0/2268009535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf01054b0 msgr2=0x7f8bf01058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/2268009535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf01054b0 0x7f8bf01058c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8be40098f0 tx=0x7f8be4009c00 comp rx=0 tx=0).stop 2024-05-27T09:49:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 -- 172.21.15.71:0/2268009535 shutdown_connections 2024-05-27T09:49:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/2268009535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf010e8e0 0x7f8bf0110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/2268009535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf01054b0 0x7f8bf01058c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/2268009535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bf0105e00 0x7f8bf010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 -- 172.21.15.71:0/2268009535 >> 172.21.15.71:0/2268009535 conn(0x7f8bf00fede0 msgr2=0x7f8bf0101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:08.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 -- 172.21.15.71:0/2268009535 shutdown_connections 2024-05-27T09:49:08.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.911+0000 7f8bf7c00700 1 -- 172.21.15.71:0/2268009535 wait complete. 2024-05-27T09:49:08.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:08 smithi071 ceph-mon[31451]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-27T09:49:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.912+0000 7f8bf7c00700 1 Processor -- start 2024-05-27T09:49:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf7c00700 1 -- start start 2024-05-27T09:49:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf7c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf01054b0 0x7f8bf019d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf7c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bf0105e00 0x7f8bf019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf7c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf010e8e0 0x7f8bf01a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf7c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0114430 con 0x7f8bf0105e00 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf7c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01142b0 con 0x7f8bf01054b0 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf7c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01145b0 con 0x7f8bf010e8e0 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf01054b0 0x7f8bf019d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.913+0000 7f8befe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bf0105e00 0x7f8bf019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf01054b0 0x7f8bf019d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60986/0 (socket says 172.21.15.71:60986) 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8bf5200700 1 -- 172.21.15.71:0/1839551632 learned_addr learned my addr 172.21.15.71:0/1839551632 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8bf5c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf010e8e0 0x7f8bf01a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8befe00700 1 -- 172.21.15.71:0/1839551632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf010e8e0 msgr2=0x7f8bf01a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8befe00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf010e8e0 0x7f8bf01a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8befe00700 1 -- 172.21.15.71:0/1839551632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf01054b0 msgr2=0x7f8bf019d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8befe00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf01054b0 0x7f8bf019d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8befe00700 1 -- 172.21.15.71:0/1839551632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01a1f70 con 0x7f8bf0105e00 2024-05-27T09:49:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8bf5200700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf01054b0 0x7f8bf019d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.914+0000 7f8befe00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bf0105e00 0x7f8bf019d640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00eb90 tx=0x7f8bdc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.915+0000 7f8bed600700 1 -- 172.21.15.71:0/1839551632 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00cc90 con 0x7f8bf0105e00 2024-05-27T09:49:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.915+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf01a2260 con 0x7f8bf0105e00 2024-05-27T09:49:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.915+0000 7f8bed600700 1 -- 172.21.15.71:0/1839551632 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bdc00ce30 con 0x7f8bf0105e00 2024-05-27T09:49:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.915+0000 7f8bed600700 1 -- 172.21.15.71:0/1839551632 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc010430 con 0x7f8bf0105e00 2024-05-27T09:49:08.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.915+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a9b80 con 0x7f8bf0105e00 2024-05-27T09:49:08.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.919+0000 7f8bed600700 1 -- 172.21.15.71:0/1839551632 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f8bdc003ef0 con 0x7f8bf0105e00 2024-05-27T09:49:08.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 Processor -- start 2024-05-27T09:49:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 -- start start 2024-05-27T09:49:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074b2bec0 0x55d074cb0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074cb0db0 0x55d074caa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074cab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d074bd8ec0 con 0x55d074b2bec0 2024-05-27T09:49:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d074bc8a60 con 0x55d074caae30 2024-05-27T09:49:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8c06700b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d074bccaa0 con 0x55d074cb0db0 2024-05-27T09:49:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.920+0000 7f8bed600700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8bd80b2ba0 0x7f8bd80b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bed600700 1 -- 172.21.15.71:0/1839551632 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8bdc0e2b90 con 0x7f8bf0105e00 2024-05-27T09:49:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074cb0db0 0x55d074caa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074cb0db0 0x55d074caa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:60850/0 (socket says 172.21.15.71:60850) 2024-05-27T09:49:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 -- 172.21.15.71:0/1762882687 learned_addr learned my addr 172.21.15.71:0/1762882687 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5c00700 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074b2bec0 0x55d074cb0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8befe00700 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074cab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8bd80b2ba0 0x7f8bd80b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 -- 172.21.15.71:0/1762882687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 msgr2=0x55d074cab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074cab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 -- 172.21.15.71:0/1762882687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074b2bec0 msgr2=0x55d074cb0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074b2bec0 0x55d074cb0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 -- 172.21.15.71:0/1762882687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d074b914a0 con 0x55d074cb0db0 2024-05-27T09:49:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.921+0000 7f8bf5200700 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074cb0db0 0x55d074caa8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8be400f510 tx=0x7f8be4005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86ec47b76901f77c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.922+0000 7f8be2000700 1 -- 172.21.15.71:0/1762882687 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400f8a0 con 0x55d074cb0db0 2024-05-27T09:49:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.922+0000 7f8be2000700 1 -- 172.21.15.71:0/1762882687 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be40054f0 con 0x55d074cb0db0 2024-05-27T09:49:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.922+0000 7f8bf5c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8bd80b2ba0 0x7f8bd80b50b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55d074cabbb0 tx=0x7f8be8009130 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.922+0000 7f8be2000700 1 -- 172.21.15.71:0/1762882687 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400bcf0 con 0x55d074cb0db0 2024-05-27T09:49:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 -- 172.21.15.71:0/1762882687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074cb0db0 msgr2=0x55d074caa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074cb0db0 0x55d074caa8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8be400f510 tx=0x7f8be4005dc0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 -- 172.21.15.71:0/1762882687 shutdown_connections 2024-05-27T09:49:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074cab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074b2bec0 0x55d074cb0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 --2- 172.21.15.71:0/1762882687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074cb0db0 0x55d074caa8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 -- 172.21.15.71:0/1762882687 >> 172.21.15.71:0/1762882687 conn(0x55d074b8c040 msgr2=0x55d074ca5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 -- 172.21.15.71:0/1762882687 shutdown_connections 2024-05-27T09:49:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.923+0000 7f8c06700b80 1 -- 172.21.15.71:0/1762882687 wait complete. 2024-05-27T09:49:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.924+0000 7f8c06700b80 1 -- start start 2024-05-27T09:49:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.924+0000 7f8c06700b80 1 Processor -- start 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074b2bec0 0x55d074cb4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074caae30 0x55d074cb4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cb4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8c06700b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d074acf020 con 0x55d074cb0db0 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8c06700b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d074b697e0 con 0x55d074b2bec0 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8c06700b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d074cb7820 con 0x55d074caae30 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8c06700b80 10 client.0 _ll_register_callbacks cb 0x55d074b72cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8bf5c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cb4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074b2bec0 0x55d074cb4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8bf5c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cb4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35234/0 (socket says 172.21.15.71:35234) 2024-05-27T09:49:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074b2bec0 0x55d074cb4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32782/0 (socket says 172.21.15.71:32782) 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8bf5c00700 1 -- 172.21.15.71:0/887863497 learned_addr learned my addr 172.21.15.71:0/887863497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8befe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074caae30 0x55d074cb4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.925+0000 7f8befe00700 1 -- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074b2bec0 msgr2=0x55d074cb4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8befe00700 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074b2bec0 0x55d074cb4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8befe00700 1 -- 172.21.15.71:0/887863497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 msgr2=0x55d074cb4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8befe00700 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cb4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8befe00700 1 -- 172.21.15.71:0/887863497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d074b18950 con 0x55d074caae30 2024-05-27T09:49:08.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8bf5200700 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074b2bec0 0x55d074cb4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:08.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8befe00700 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074caae30 0x55d074cb4ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0e00d0 tx=0x7f8bdc0a94c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2714008d0810fb24 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8bd6a00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8bd6a00700 1 -- 172.21.15.71:0/887863497 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0aa360 con 0x55d074caae30 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be40054f0 con 0x55d074caae30 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8bd6a00700 1 -- 172.21.15.71:0/887863497 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8bdc070090 con 0x55d074caae30 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.926+0000 7f8bd6a00700 1 -- 172.21.15.71:0/887863497 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8bdc06f8f0 con 0x55d074caae30 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 10 client.25522 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d074b990e0 con 0x55d074caae30 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8bd6a00700 1 -- 172.21.15.71:0/887863497 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be40054f0 con 0x55d074caae30 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8bd6a00700 1 -- 172.21.15.71:0/887863497 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f8bdc0a9ec0 con 0x55d074caae30 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 10 client.25522 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 10 client.25522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 20 client.25522 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:08.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074cc46b0 0x55d074cc6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 4 client.25522 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:08.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.927+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d074bdae10 con 0x55d074cc46b0 2024-05-27T09:49:08.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.928+0000 7f8bf5200700 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074cc46b0 0x55d074cc6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.928+0000 7f8bd6a00700 10 client.25522 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:08.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.928+0000 7f8bf5200700 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074cc46b0 0x55d074cc6b60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9a3174f5e39806 server_cookie=15252c93a28eb47a in_seq=0 out_seq=0 2024-05-27T09:49:08.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8bd6a00700 1 -- 172.21.15.71:0/887863497 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d074bdae10 con 0x55d074cc46b0 2024-05-27T09:49:08.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8bd6a00700 10 client.25522 handle_command_reply: tid=0 2024-05-27T09:49:08.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8c06700b80 1 client.25522 shutdown 2024-05-27T09:49:08.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074caae30 msgr2=0x55d074cb4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8c06700b80 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074caae30 0x55d074cb4ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0e00d0 tx=0x7f8bdc0a94c0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 shutdown_connections 2024-05-27T09:49:08.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8c06700b80 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074cc46b0 0x55d074cc6b60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8c06700b80 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cb4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.929+0000 7f8c06700b80 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074b2bec0 0x55d074cb4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.930+0000 7f8c06700b80 1 --2- 172.21.15.71:0/887863497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074caae30 0x55d074cb4ab0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.930+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 >> 172.21.15.71:0/887863497 conn(0x55d074b8c040 msgr2=0x55d074ca5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.930+0000 7f8bd6a00700 0 client.25522 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.930+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 shutdown_connections 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.930+0000 7f8c06700b80 1 -- 172.21.15.71:0/887863497 wait complete. 2024-05-27T09:49:08.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.930+0000 7f8c06700b80 20 client.25522 trim_cache size 0 max 16384 2024-05-27T09:49:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.952+0000 7f8c06700b80 1 Processor -- start 2024-05-27T09:49:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.952+0000 7f8c06700b80 1 -- start start 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074caa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074caecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cc08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8c06700b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01b38a0 con 0x55d074cb0db0 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8c06700b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01b1130 con 0x55d074caae30 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8c06700b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01aef80 con 0x55d074b2bec0 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074caa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cc08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074caa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:60866/0 (socket says 172.21.15.71:60866) 2024-05-27T09:49:08.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 -- 172.21.15.71:0/439553995 learned_addr learned my addr 172.21.15.71:0/439553995 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:08.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8befe00700 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074caecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 -- 172.21.15.71:0/439553995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 msgr2=0x55d074caecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074caecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 -- 172.21.15.71:0/439553995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 msgr2=0x55d074cc08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cc08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.953+0000 7f8bf5200700 1 -- 172.21.15.71:0/439553995 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d074cb6e10 con 0x55d074b2bec0 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.954+0000 7f8bf5200700 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074caa8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8be4006010 tx=0x7f8be4005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67ec6e8e86ec9389 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.954+0000 7f8be1600700 1 -- 172.21.15.71:0/439553995 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4039070 con 0x55d074b2bec0 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.954+0000 7f8be1600700 1 -- 172.21.15.71:0/439553995 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be400f7f0 con 0x55d074b2bec0 2024-05-27T09:49:08.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.954+0000 7f8be1600700 1 -- 172.21.15.71:0/439553995 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4034070 con 0x55d074b2bec0 2024-05-27T09:49:08.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 -- 172.21.15.71:0/439553995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 msgr2=0x55d074caa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074caa8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8be4006010 tx=0x7f8be4005fa0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 -- 172.21.15.71:0/439553995 shutdown_connections 2024-05-27T09:49:08.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074cb0db0 0x55d074cc08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074caa8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 --2- 172.21.15.71:0/439553995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074caae30 0x55d074caecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 -- 172.21.15.71:0/439553995 >> 172.21.15.71:0/439553995 conn(0x55d074b8c040 msgr2=0x55d074cb4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:08.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 -- 172.21.15.71:0/439553995 shutdown_connections 2024-05-27T09:49:08.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.955+0000 7f8c06700b80 1 -- 172.21.15.71:0/439553995 wait complete. 2024-05-27T09:49:08.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.956+0000 7f8c06700b80 1 -- start start 2024-05-27T09:49:08.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.956+0000 7f8c06700b80 1 Processor -- start 2024-05-27T09:49:08.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074cbd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074caae30 0x55d074ccb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8c06700b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074cb0db0 0x55d074ccbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8c06700b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01af5f0 con 0x55d074caae30 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8c06700b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01b0a60 con 0x55d074cb0db0 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8c06700b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01afcc0 con 0x55d074b2bec0 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8c06700b80 10 client.0 _ll_register_callbacks cb 0x55d074b72cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8befe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074caae30 0x55d074ccb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8befe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074caae30 0x55d074ccb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35256/0 (socket says 172.21.15.71:35256) 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8befe00700 1 -- 172.21.15.71:0/3082958694 learned_addr learned my addr 172.21.15.71:0/3082958694 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8bf5200700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074cbd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8bf5c00700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074cb0db0 0x55d074ccbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.957+0000 7f8befe00700 1 -- 172.21.15.71:0/3082958694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 msgr2=0x55d074cbd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8befe00700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074cbd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8befe00700 1 -- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074cb0db0 msgr2=0x55d074ccbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8befe00700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074cb0db0 0x55d074ccbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8befe00700 1 -- 172.21.15.71:0/3082958694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d074ccc4a0 con 0x55d074caae30 2024-05-27T09:49:08.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8bf5200700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074cbd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8bf5c00700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074cb0db0 0x55d074ccbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8befe00700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074caae30 0x55d074ccb9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0a5ce0 tx=0x7f8bdc003940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3babe5eeb65a8498 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8bd6a00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8bd6a00700 1 -- 172.21.15.71:0/3082958694 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a5b20 con 0x55d074caae30 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8bd6a00700 1 -- 172.21.15.71:0/3082958694 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8bdc06fcf0 con 0x55d074caae30 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be400f7f0 con 0x55d074caae30 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.958+0000 7f8bd6a00700 1 -- 172.21.15.71:0/3082958694 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8bdc0aa360 con 0x55d074caae30 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 10 client.15405 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d074d37750 con 0x55d074caae30 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8bd6a00700 1 -- 172.21.15.71:0/3082958694 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be400f7f0 con 0x55d074caae30 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8bd6a00700 1 -- 172.21.15.71:0/3082958694 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f8bdc06f440 con 0x55d074caae30 2024-05-27T09:49:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 10 client.15405 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 20 client.15405 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074d37bb0 0x55d074d39fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 4 client.15405 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-27T09:49:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.959+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d074bd45f0 con 0x55d074d37bb0 2024-05-27T09:49:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.960+0000 7f8bf5200700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074d37bb0 0x55d074d39fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.960+0000 7f8bf5200700 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074d37bb0 0x55d074d39fd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d10524278d0010cf server_cookie=943c7291c81c37cd in_seq=0 out_seq=0 2024-05-27T09:49:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.960+0000 7f8bd6a00700 10 client.15405 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.961+0000 7f8bd6a00700 1 -- 172.21.15.71:0/3082958694 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d074bd45f0 con 0x55d074d37bb0 2024-05-27T09:49:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.961+0000 7f8bd6a00700 10 client.15405 handle_command_reply: tid=0 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.961+0000 7f8c06700b80 1 client.15405 shutdown 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.961+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074caae30 msgr2=0x55d074ccb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.961+0000 7f8c06700b80 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074caae30 0x55d074ccb9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0a5ce0 tx=0x7f8bdc003940 comp rx=0 tx=0).stop 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 shutdown_connections 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d074d37bb0 0x55d074d39fd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d074cb0db0 0x55d074ccbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d074b2bec0 0x55d074cbd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 --2- 172.21.15.71:0/3082958694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d074caae30 0x55d074ccb9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 >> 172.21.15.71:0/3082958694 conn(0x55d074b8c040 msgr2=0x55d074caea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8bd6a00700 0 client.15405 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 shutdown_connections 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 1 -- 172.21.15.71:0/3082958694 wait complete. 2024-05-27T09:49:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.962+0000 7f8c06700b80 20 client.15405 trim_cache size 0 max 16384 2024-05-27T09:49:08.965 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:49:08.965 INFO:teuthology.orchestra.run.smithi071.stdout: "return_code": 0, 2024-05-27T09:49:08.965 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_tag": "156b023d-88bd-44b0-8368-2b876a78d398", 2024-05-27T09:49:08.965 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": "asynchronous" 2024-05-27T09:49:08.965 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8bd80b2ba0 msgr2=0x7f8bd80b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8bd80b2ba0 0x7f8bd80b50b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55d074cabbb0 tx=0x7f8be8009130 comp rx=0 tx=0).stop 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bf0105e00 msgr2=0x7f8bf019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bf0105e00 0x7f8bf019d640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00eb90 tx=0x7f8bdc00eea0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 shutdown_connections 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8bd80b2ba0 0x7f8bd80b50b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bf010e8e0 0x7f8bf01a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bf01054b0 0x7f8bf019d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 --2- 172.21.15.71:0/1839551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bf0105e00 0x7f8bf019d640 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.963+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 >> 172.21.15.71:0/1839551632 conn(0x7f8bf00fede0 msgr2=0x7f8bf0103230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.964+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 shutdown_connections 2024-05-27T09:49:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:08.964+0000 7f8bf7c00700 1 -- 172.21.15.71:0/1839551632 wait complete. 2024-05-27T09:49:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:08 smithi072 ceph-mon[35951]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-27T09:49:09.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:08 smithi122 ceph-mon[36436]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-27T09:49:09.719 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.4 2024-05-27T09:49:09.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:49:09.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-27T09:49:10.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:09 smithi072 ceph-mon[35951]: scrub queued for path: / 2024-05-27T09:49:10.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:09 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:10.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:09 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:49:10.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:09 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:10.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:09 smithi071 ceph-mon[31451]: scrub queued for path: / 2024-05-27T09:49:10.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:09 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:10.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:09 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:49:10.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:09 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:10.131 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:09 smithi122 ceph-mon[36436]: scrub queued for path: / 2024-05-27T09:49:10.131 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:09 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:10.131 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:09 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:49:10.131 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:09 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:10.171 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:11.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:10 smithi071 ceph-mon[31451]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:49:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:10 smithi072 ceph-mon[35951]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:49:11.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:10 smithi122 ceph-mon[36436]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:49:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:11.941 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:11 smithi071 ceph-mon[31451]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-05-27T09:49:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:11 smithi072 ceph-mon[35951]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-05-27T09:49:12.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:11 smithi122 ceph-mon[36436]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-05-27T09:49:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.897+0000 7f9325e00640 1 -- 172.21.15.71:0/2169104564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9320109c60 msgr2=0x7f9320103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.897+0000 7f9325e00640 1 --2- 172.21.15.71:0/2169104564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9320109c60 0x7f9320103800 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9310009ca0 tx=0x7f931002a8c0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.898+0000 7f9325e00640 1 -- 172.21.15.71:0/2169104564 shutdown_connections 2024-05-27T09:49:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.898+0000 7f9325e00640 1 --2- 172.21.15.71:0/2169104564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93201043b0 0x7f9320110780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.898+0000 7f9325e00640 1 --2- 172.21.15.71:0/2169104564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f932010a100 0x7f9320103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.898+0000 7f9325e00640 1 --2- 172.21.15.71:0/2169104564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9320109c60 0x7f9320103800 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.898+0000 7f9325e00640 1 -- 172.21.15.71:0/2169104564 >> 172.21.15.71:0/2169104564 conn(0x7f93200ff320 msgr2=0x7f9320101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.898+0000 7f9325e00640 1 -- 172.21.15.71:0/2169104564 shutdown_connections 2024-05-27T09:49:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.898+0000 7f9325e00640 1 -- 172.21.15.71:0/2169104564 wait complete. 2024-05-27T09:49:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.899+0000 7f9325e00640 1 Processor -- start 2024-05-27T09:49:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.899+0000 7f9325e00640 1 -- start start 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.899+0000 7f9325e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93201043b0 0x7f93201a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f9325e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9320109c60 0x7f93201a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f9325e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f932010a100 0x7f932019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f9325e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9320113e50 con 0x7f93201043b0 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f9325e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9320113cd0 con 0x7f9320109c60 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f9325e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9320113fd0 con 0x7f932010a100 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93201043b0 0x7f93201a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93201043b0 0x7f93201a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35274/0 (socket says 172.21.15.71:35274) 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 -- 172.21.15.71:0/2639041034 learned_addr learned my addr 172.21.15.71:0/2639041034 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931e000640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9320109c60 0x7f93201a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931f400640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f932010a100 0x7f932019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 -- 172.21.15.71:0/2639041034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f932010a100 msgr2=0x7f932019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f932010a100 0x7f932019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 -- 172.21.15.71:0/2639041034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9320109c60 msgr2=0x7f93201a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9320109c60 0x7f93201a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931ea00640 1 -- 172.21.15.71:0/2639041034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932019ade0 con 0x7f93201043b0 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.900+0000 7f931e000640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9320109c60 0x7f93201a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.901+0000 7f931ea00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93201043b0 0x7f93201a0530 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9310033040 tx=0x7f93100316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.901+0000 7f9324a00640 1 -- 172.21.15.71:0/2639041034 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310003b70 con 0x7f93201043b0 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.901+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932019b010 con 0x7f93201043b0 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.901+0000 7f9324a00640 1 -- 172.21.15.71:0/2639041034 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9310003d10 con 0x7f93201043b0 2024-05-27T09:49:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.901+0000 7f9324a00640 1 -- 172.21.15.71:0/2639041034 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931002fa80 con 0x7f93201043b0 2024-05-27T09:49:12.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.901+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93201a72d0 con 0x7f93201043b0 2024-05-27T09:49:12.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.904+0000 7f932cde9740 1 Processor -- start 2024-05-27T09:49:12.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f932cde9740 1 -- start start 2024-05-27T09:49:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f9324a00640 1 -- 172.21.15.71:0/2639041034 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f931002fc20 con 0x7f93201043b0 2024-05-27T09:49:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f932cde9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefa1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f932cde9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefa1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f932cde9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebde4d0 0x5634eefa22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f932cde9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5634eef12b90 con 0x5634eebff1b0 2024-05-27T09:49:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f932cde9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5634eef02730 con 0x5634eebd62f0 2024-05-27T09:49:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f932cde9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5634eef06770 con 0x5634eebde4d0 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f931f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefa1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f931f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefa1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35280/0 (socket says 172.21.15.71:35280) 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f931f400640 1 -- 172.21.15.71:0/2148722720 learned_addr learned my addr 172.21.15.71:0/2148722720 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f931ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefa1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.905+0000 7f931e000640 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebde4d0 0x5634eefa22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f931f400640 1 -- 172.21.15.71:0/2148722720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebde4d0 msgr2=0x5634eefa22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f931f400640 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebde4d0 0x5634eefa22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f931f400640 1 -- 172.21.15.71:0/2148722720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 msgr2=0x5634eefa1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f931f400640 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefa1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f931f400640 1 -- 172.21.15.71:0/2148722720 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634eee9b8b0 con 0x5634eebff1b0 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f931ea00640 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefa1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f931f400640 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefa1860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9318009ca0 tx=0x7f9318011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a29231a5cf495b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.906+0000 7f930be00640 1 -- 172.21.15.71:0/2148722720 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931801e070 con 0x5634eebff1b0 2024-05-27T09:49:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.907+0000 7f930be00640 1 -- 172.21.15.71:0/2148722720 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9318009e50 con 0x5634eebff1b0 2024-05-27T09:49:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.907+0000 7f930be00640 1 -- 172.21.15.71:0/2148722720 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931800ea50 con 0x5634eebff1b0 2024-05-27T09:49:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.907+0000 7f9324a00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f93040b2b00 0x7f93040b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.907+0000 7f9324a00640 1 -- 172.21.15.71:0/2639041034 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9310103ce0 con 0x7f93201043b0 2024-05-27T09:49:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.907+0000 7f931ea00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f93040b2b00 0x7f93040b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.907+0000 7f932cde9740 1 -- 172.21.15.71:0/2148722720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 msgr2=0x5634eefa1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.907+0000 7f932cde9740 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefa1860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9318009ca0 tx=0x7f9318011810 comp rx=0 tx=0).stop 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 -- 172.21.15.71:0/2148722720 shutdown_connections 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebde4d0 0x5634eefa22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefa1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 --2- 172.21.15.71:0/2148722720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefa1860 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 -- 172.21.15.71:0/2148722720 >> 172.21.15.71:0/2148722720 conn(0x5634eebf3300 msgr2=0x5634eef9e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 -- 172.21.15.71:0/2148722720 shutdown_connections 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 -- 172.21.15.71:0/2148722720 wait complete. 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f931ea00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f93040b2b00 0x7f93040b5010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9310101390 tx=0x7f9310107790 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.908+0000 7f932cde9740 1 -- start start 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 1 Processor -- start 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefaba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebde4d0 0x5634eefabf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebff1b0 0x5634eefb7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5634eebe8790 con 0x5634eebde4d0 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5634eeeaabc0 con 0x5634eebd62f0 2024-05-27T09:49:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5634eefae990 con 0x5634eebff1b0 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.909+0000 7f932cde9740 10 client.0 _ll_register_callbacks cb 0x5634eee88400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebde4d0 0x5634eefabf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefaba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebde4d0 0x5634eefabf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35296/0 (socket says 172.21.15.71:35296) 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 -- 172.21.15.71:0/3526549386 learned_addr learned my addr 172.21.15.71:0/3526549386 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931f400640 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebff1b0 0x5634eefb7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 -- 172.21.15.71:0/3526549386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebff1b0 msgr2=0x5634eefb7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebff1b0 0x5634eefb7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 -- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 msgr2=0x5634eefaba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefaba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931e000640 1 -- 172.21.15.71:0/3526549386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634eec17210 con 0x5634eebde4d0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.910+0000 7f931f400640 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefaba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f931e000640 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebde4d0 0x5634eefabf60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f930c012d20 tx=0x7f930c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1908b185af5b3e11 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f9308c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f9308c00640 1 -- 172.21.15.71:0/3526549386 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c0120d0 con 0x5634eebde4d0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9318009e50 con 0x5634eebde4d0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f9308c00640 1 -- 172.21.15.71:0/3526549386 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f930c004030 con 0x5634eebde4d0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f9308c00640 1 -- 172.21.15.71:0/3526549386 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f930c012270 con 0x5634eebde4d0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f932cde9740 10 client.15417 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5634eece3620 con 0x5634eebde4d0 2024-05-27T09:49:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.911+0000 7f9308c00640 1 -- 172.21.15.71:0/3526549386 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9318009e50 con 0x5634eebde4d0 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f9308c00640 1 -- 172.21.15.71:0/3526549386 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f930c01c460 con 0x5634eebde4d0 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f932cde9740 10 client.15417 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f932cde9740 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f932cde9740 20 client.15417 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f932cde9740 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eebbdd80 0x5634eefbdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f932cde9740 4 client.15417 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634eef14ae0 con 0x5634eebbdd80 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.912+0000 7f931f400640 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eebbdd80 0x5634eefbdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.913+0000 7f931f400640 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eebbdd80 0x5634eefbdce0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e25eeb96021b7c3 server_cookie=70323ef0a4bcfe59 in_seq=0 out_seq=0 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.913+0000 7f9308c00640 10 client.15417 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.913+0000 7f9308c00640 1 -- 172.21.15.71:0/3526549386 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5634eef14ae0 con 0x5634eebbdd80 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.913+0000 7f9308c00640 10 client.15417 handle_command_reply: tid=0 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.913+0000 7f932cde9740 1 client.15417 shutdown 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebde4d0 msgr2=0x5634eefabf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebde4d0 0x5634eefabf60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f930c012d20 tx=0x7f930c00f790 comp rx=0 tx=0).stop 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 shutdown_connections 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebff1b0 0x5634eefb7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eebbdd80 0x5634eefbdce0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebde4d0 0x5634eefabf60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 --2- 172.21.15.71:0/3526549386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebd62f0 0x5634eefaba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f9308c00640 0 client.15417 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 >> 172.21.15.71:0/3526549386 conn(0x5634eebf3300 msgr2=0x5634eefa1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 shutdown_connections 2024-05-27T09:49:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 1 -- 172.21.15.71:0/3526549386 wait complete. 2024-05-27T09:49:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.914+0000 7f932cde9740 20 client.15417 trim_cache size 0 max 16384 2024-05-27T09:49:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.931+0000 7f932cde9740 1 Processor -- start 2024-05-27T09:49:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.932+0000 7f932cde9740 1 -- start start 2024-05-27T09:49:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.932+0000 7f932cde9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eef9d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.932+0000 7f932cde9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefb7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.932+0000 7f932cde9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefb7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.932+0000 7f932cde9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93201b2460 con 0x5634eebff1b0 2024-05-27T09:49:12.933 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.932+0000 7f932cde9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93201afd30 con 0x5634eebde4d0 2024-05-27T09:49:12.933 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.932+0000 7f932cde9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f93201adb80 con 0x5634eebd62f0 2024-05-27T09:49:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefb7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eef9d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefb7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32856/0 (socket says 172.21.15.71:32856) 2024-05-27T09:49:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 -- 172.21.15.71:0/2100158992 learned_addr learned my addr 172.21.15.71:0/2100158992 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931f400640 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefb7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 -- 172.21.15.71:0/2100158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 msgr2=0x5634eef9d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eef9d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 -- 172.21.15.71:0/2100158992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 msgr2=0x5634eefb7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefb7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 -- 172.21.15.71:0/2100158992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634eef9e550 con 0x5634eebde4d0 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931f400640 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eef9d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.933+0000 7f931e000640 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefb7a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f930c01ca70 tx=0x7f930c00fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da997814b8d2e5ca server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.934+0000 7f930b400640 1 -- 172.21.15.71:0/2100158992 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c029020 con 0x5634eebde4d0 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.934+0000 7f930b400640 1 -- 172.21.15.71:0/2100158992 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f930c01c460 con 0x5634eebde4d0 2024-05-27T09:49:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.934+0000 7f930b400640 1 -- 172.21.15.71:0/2100158992 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c0035f0 con 0x5634eebde4d0 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 -- 172.21.15.71:0/2100158992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 msgr2=0x5634eefb7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefb7a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f930c01ca70 tx=0x7f930c00fc90 comp rx=0 tx=0).stop 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 -- 172.21.15.71:0/2100158992 shutdown_connections 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634eefb7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefb7a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 --2- 172.21.15.71:0/2100158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eef9d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 -- 172.21.15.71:0/2100158992 >> 172.21.15.71:0/2100158992 conn(0x5634eebf3300 msgr2=0x5634eefa6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 -- 172.21.15.71:0/2100158992 shutdown_connections 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 -- 172.21.15.71:0/2100158992 wait complete. 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.935+0000 7f932cde9740 1 -- start start 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 1 Processor -- start 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eefaf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefaf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634ef0243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93201ae1f0 con 0x5634eebff1b0 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93201af660 con 0x5634eebde4d0 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f93201ae8c0 con 0x5634eebd62f0 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f932cde9740 10 client.0 _ll_register_callbacks cb 0x7f930c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f931f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634ef0243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f931e000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefaf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.936+0000 7f931f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634ef0243b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35302/0 (socket says 172.21.15.71:35302) 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931f400640 1 -- 172.21.15.71:0/3171567871 learned_addr learned my addr 172.21.15.71:0/3171567871 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931f400640 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eefaf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931e000640 1 -- 172.21.15.71:0/3171567871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 msgr2=0x5634eefaf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931e000640 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eefaf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931e000640 1 -- 172.21.15.71:0/3171567871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 msgr2=0x5634ef0243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931e000640 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634ef0243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931e000640 1 -- 172.21.15.71:0/3171567871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ef0248f0 con 0x5634eebde4d0 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931f400640 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634ef0243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f931e000640 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefaf740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f930c012d20 tx=0x7f930c01c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a53f67df37e562 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f9308c00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.937+0000 7f9308c00640 1 -- 172.21.15.71:0/3171567871 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c029030 con 0x5634eebde4d0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.938+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f930c01c460 con 0x5634eebde4d0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.938+0000 7f9308c00640 1 -- 172.21.15.71:0/3171567871 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f930c0052e0 con 0x5634eebde4d0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.938+0000 7f9308c00640 1 -- 172.21.15.71:0/3171567871 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f930c03c050 con 0x5634eebde4d0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.938+0000 7f932cde9740 10 client.25529 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.938+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5634ef025a90 con 0x5634eebde4d0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.938+0000 7f9308c00640 1 -- 172.21.15.71:0/3171567871 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f930c01c460 con 0x5634eebde4d0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.938+0000 7f9308c00640 1 -- 172.21.15.71:0/3171567871 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f930c02e550 con 0x5634eebde4d0 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f932cde9740 10 client.25529 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f932cde9740 10 client.25529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f932cde9740 20 client.25529 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f932cde9740 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eeb931c0 0x5634ef0280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f932cde9740 4 client.25529 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:49:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5634eef0e2c0 con 0x5634eeb931c0 2024-05-27T09:49:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f931f400640 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eeb931c0 0x5634ef0280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f931f400640 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eeb931c0 0x5634ef0280d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc640e1d2827fb76 server_cookie=915e4e84c773221a in_seq=0 out_seq=0 2024-05-27T09:49:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.939+0000 7f9308c00640 10 client.25529 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f9308c00640 1 -- 172.21.15.71:0/3171567871 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5634eef0e2c0 con 0x5634eeb931c0 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f9308c00640 10 client.25529 handle_command_reply: tid=0 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 client.25529 shutdown 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 msgr2=0x5634eefaf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefaf740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f930c012d20 tx=0x7f930c01c750 comp rx=0 tx=0).stop 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 shutdown_connections 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5634eeb931c0 0x5634ef0280d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5634eebff1b0 0x5634ef0243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5634eebde4d0 0x5634eefaf740 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 --2- 172.21.15.71:0/3171567871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634eebd62f0 0x5634eefaf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f9308c00640 0 client.25529 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.948+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 >> 172.21.15.71:0/3171567871 conn(0x5634eebf3300 msgr2=0x5634eef9cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.949+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 shutdown_connections 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.949+0000 7f932cde9740 1 -- 172.21.15.71:0/3171567871 wait complete. 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.949+0000 7f932cde9740 20 client.25529 trim_cache size 0 max 16384 2024-05-27T09:49:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:49:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:49:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:49:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f93040b2b00 msgr2=0x7f93040b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f93040b2b00 0x7f93040b5010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9310101390 tx=0x7f9310107790 comp rx=0 tx=0).stop 2024-05-27T09:49:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93201043b0 msgr2=0x7f93201a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93201043b0 0x7f93201a0530 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9310033040 tx=0x7f93100316f0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 shutdown_connections 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f93040b2b00 0x7f93040b5010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f932010a100 0x7f932019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9320109c60 0x7f93201a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 --2- 172.21.15.71:0/2639041034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93201043b0 0x7f93201a0530 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 >> 172.21.15.71:0/2639041034 conn(0x7f93200ff320 msgr2=0x7f93201011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 shutdown_connections 2024-05-27T09:49:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:12.950+0000 7f9325e00640 1 -- 172.21.15.71:0/2639041034 wait complete. 2024-05-27T09:49:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 -- 172.21.15.71:0/3208530856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 msgr2=0x7f0608075f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 --2- 172.21.15.71:0/3208530856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 0x7f0608075f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009f90 tx=0x7f05f800b330 comp rx=0 tx=0).stop 2024-05-27T09:49:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 -- 172.21.15.71:0/3208530856 shutdown_connections 2024-05-27T09:49:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 --2- 172.21.15.71:0/3208530856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608110bf0 0x7f0608113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 --2- 172.21.15.71:0/3208530856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 0x7f0608075f00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 --2- 172.21.15.71:0/3208530856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0608076440 0x7f06081106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 -- 172.21.15.71:0/3208530856 >> 172.21.15.71:0/3208530856 conn(0x7f0608100030 msgr2=0x7f0608102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 -- 172.21.15.71:0/3208530856 shutdown_connections 2024-05-27T09:49:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.157+0000 7f060e400700 1 -- 172.21.15.71:0/3208530856 wait complete. 2024-05-27T09:49:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.158+0000 7f060e400700 1 Processor -- start 2024-05-27T09:49:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f060e400700 1 -- start start 2024-05-27T09:49:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f060e400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 0x7f060819d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f060e400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608076440 0x7f060819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f060e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0608110bf0 0x7f06081a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f060e400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0608116720 con 0x7f0608076440 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f060e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f06081165a0 con 0x7f0608110bf0 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f060e400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f06081168a0 con 0x7f0608075af0 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f05fea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608076440 0x7f060819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f05fea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608076440 0x7f060819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35322/0 (socket says 172.21.15.71:35322) 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f05fea00700 1 -- 172.21.15.71:0/2048205044 learned_addr learned my addr 172.21.15.71:0/2048205044 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f0607e00700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0608110bf0 0x7f06081a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.159+0000 7f0607400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 0x7f060819d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.160+0000 7f0607e00700 1 -- 172.21.15.71:0/2048205044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 msgr2=0x7f060819d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.160+0000 7f0607e00700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 0x7f060819d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.160+0000 7f0607e00700 1 -- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608076440 msgr2=0x7f060819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.160+0000 7f0607e00700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608076440 0x7f060819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.160+0000 7f0607e00700 1 -- 172.21.15.71:0/2048205044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06081a1fc0 con 0x7f0608110bf0 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.160+0000 7f0607e00700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0608110bf0 0x7f06081a1920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0600005fd0 tx=0x7f060000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.160+0000 7f0604c00700 1 -- 172.21.15.71:0/2048205044 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600004220 con 0x7f0608110bf0 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.161+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06081a22b0 con 0x7f0608110bf0 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.161+0000 7f0604c00700 1 -- 172.21.15.71:0/2048205044 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06000043c0 con 0x7f0608110bf0 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.161+0000 7f0604c00700 1 -- 172.21.15.71:0/2048205044 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600010700 con 0x7f0608110bf0 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.161+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081a9bd0 con 0x7f0608110bf0 2024-05-27T09:49:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.162+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06080512b0 con 0x7f0608110bf0 2024-05-27T09:49:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.164+0000 7f0604c00700 1 -- 172.21.15.71:0/2048205044 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f0600004750 con 0x7f0608110bf0 2024-05-27T09:49:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.166+0000 7f0604c00700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f05ec0b2c20 0x7f05ec0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.166+0000 7f0604c00700 1 -- 172.21.15.71:0/2048205044 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f06000e24a0 con 0x7f0608110bf0 2024-05-27T09:49:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.166+0000 7f0607400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f05ec0b2c20 0x7f05ec0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.167+0000 7f0607400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f05ec0b2c20 0x7f05ec0b5130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05f800b6c0 tx=0x7f05f80096c0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.170+0000 7f0604c00700 1 -- 172.21.15.71:0/2048205044 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f06000a9c70 con 0x7f0608110bf0 2024-05-27T09:49:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.454+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f060819e450 con 0x7f0608110bf0 2024-05-27T09:49:13.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.456+0000 7f0604c00700 1 -- 172.21.15.71:0/2048205044 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7f06000a9570 con 0x7f0608110bf0 2024-05-27T09:49:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:49:13.456 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:49:13.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f05ec0b2c20 msgr2=0x7f05ec0b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:13.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f05ec0b2c20 0x7f05ec0b5130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05f800b6c0 tx=0x7f05f80096c0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0608110bf0 msgr2=0x7f06081a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0608110bf0 0x7f06081a1920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0600005fd0 tx=0x7f060000ec20 comp rx=0 tx=0).stop 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 shutdown_connections 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f05ec0b2c20 0x7f05ec0b5130 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0608110bf0 0x7f06081a1920 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0608075af0 0x7f060819d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 --2- 172.21.15.71:0/2048205044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0608076440 0x7f060819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.459+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 >> 172.21.15.71:0/2048205044 conn(0x7f0608100030 msgr2=0x7f0608100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.460+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 shutdown_connections 2024-05-27T09:49:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:13.460+0000 7f060e400700 1 -- 172.21.15.71:0/2048205044 wait complete. 2024-05-27T09:49:13.461 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:49:13.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:13 smithi122 ceph-mon[36436]: scrub summary: idle 2024-05-27T09:49:13.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:13 smithi071 ceph-mon[31451]: scrub summary: idle 2024-05-27T09:49:13.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:13 smithi072 ceph-mon[35951]: scrub summary: idle 2024-05-27T09:49:14.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 -- 172.21.15.71:0/1259700140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8010e6f0 msgr2=0x7f5b80110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 --2- 172.21.15.71:0/1259700140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8010e6f0 0x7f5b80110bd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009f90 tx=0x7f5b7800b330 comp rx=0 tx=0).stop 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 -- 172.21.15.71:0/1259700140 shutdown_connections 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 --2- 172.21.15.71:0/1259700140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b8010e6f0 0x7f5b80110bd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 --2- 172.21.15.71:0/1259700140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b80105280 0x7f5b80105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 --2- 172.21.15.71:0/1259700140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b80105bd0 0x7f5b8010e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 -- 172.21.15.71:0/1259700140 >> 172.21.15.71:0/1259700140 conn(0x7f5b80078ab0 msgr2=0x7f5b80078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 -- 172.21.15.71:0/1259700140 shutdown_connections 2024-05-27T09:49:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.419+0000 7f5b85800700 1 -- 172.21.15.71:0/1259700140 wait complete. 2024-05-27T09:49:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.420+0000 7f5b85800700 1 Processor -- start 2024-05-27T09:49:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b85800700 1 -- start start 2024-05-27T09:49:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b85800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b80105280 0x7f5b80102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b85800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b80105bd0 0x7f5b801034b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b85800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8010e6f0 0x7f5b801039f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b85800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b80114250 con 0x7f5b80105280 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b85800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801140d0 con 0x7f5b8010e6f0 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b85800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801143d0 con 0x7f5b80105bd0 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b80105280 0x7f5b80102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b80105280 0x7f5b80102f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39394/0 (socket says 172.21.15.71:39394) 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.421+0000 7f5b7fe00700 1 -- 172.21.15.71:0/2954511984 learned_addr learned my addr 172.21.15.71:0/2954511984 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b84e00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8010e6f0 0x7f5b801039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b7f400700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b80105bd0 0x7f5b801034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b7fe00700 1 -- 172.21.15.71:0/2954511984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b80105bd0 msgr2=0x7f5b801034b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b80105bd0 0x7f5b801034b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b7fe00700 1 -- 172.21.15.71:0/2954511984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8010e6f0 msgr2=0x7f5b801039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8010e6f0 0x7f5b801039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b7fe00700 1 -- 172.21.15.71:0/2954511984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b801a8f40 con 0x7f5b80105280 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b84e00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8010e6f0 0x7f5b801039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.422+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b80105280 0x7f5b80102f70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000ec10 tx=0x7f5b7000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.423+0000 7f5b7cc00700 1 -- 172.21.15.71:0/2954511984 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000cc90 con 0x7f5b80105280 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.423+0000 7f5b7cc00700 1 -- 172.21.15.71:0/2954511984 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b7000ce30 con 0x7f5b80105280 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.423+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b801a9230 con 0x7f5b80105280 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.423+0000 7f5b7cc00700 1 -- 172.21.15.71:0/2954511984 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b70010430 con 0x7f5b80105280 2024-05-27T09:49:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.423+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b801a97c0 con 0x7f5b80105280 2024-05-27T09:49:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.427+0000 7f5b7cc00700 1 -- 172.21.15.71:0/2954511984 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f5b70004000 con 0x7f5b80105280 2024-05-27T09:49:14.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.428+0000 7f5b958bab80 1 Processor -- start 2024-05-27T09:49:14.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b958bab80 1 -- start start 2024-05-27T09:49:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f80750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0e00e40 0x556bf0f80c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f8c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b7cc00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b640b2c20 0x7f5b640b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b958bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556bf0eade40 con 0x556bf0e00e40 2024-05-27T09:49:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b958bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556bf0e9d9e0 con 0x556bf0f8a2c0 2024-05-27T09:49:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.429+0000 7f5b958bab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556bf0ea1a20 con 0x556bf0eec9f0 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0e00e40 0x556bf0f80c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b84e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f80750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7cc00700 1 -- 172.21.15.71:0/2954511984 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5b700e2a90 con 0x7f5b80105280 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b84e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f80750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59092/0 (socket says 172.21.15.71:59092) 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b84e00700 1 -- 172.21.15.71:0/145478021 learned_addr learned my addr 172.21.15.71:0/145478021 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b84e00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b640b2c20 0x7f5b640b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7f400700 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f8c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7fe00700 1 -- 172.21.15.71:0/145478021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 msgr2=0x556bf0f80750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f80750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7fe00700 1 -- 172.21.15.71:0/145478021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 msgr2=0x556bf0f8c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f8c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7fe00700 1 -- 172.21.15.71:0/145478021 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf0e66420 con 0x556bf0e00e40 2024-05-27T09:49:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b84e00700 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f80750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.430+0000 7f5b7f400700 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.431+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0e00e40 0x556bf0f80c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5b700dffd0 tx=0x7f5b7001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f49e4b0db87bbb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.431+0000 7f5b84e00700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b640b2c20 0x7f5b640b5130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009da0 tx=0x7f5b780096c0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.431+0000 7f5b75600700 1 -- 172.21.15.71:0/145478021 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700a92d0 con 0x556bf0e00e40 2024-05-27T09:49:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.431+0000 7f5b75600700 1 -- 172.21.15.71:0/145478021 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b700a9670 con 0x556bf0e00e40 2024-05-27T09:49:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.431+0000 7f5b75600700 1 -- 172.21.15.71:0/145478021 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700044f0 con 0x556bf0e00e40 2024-05-27T09:49:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.432+0000 7f5b958bab80 1 -- 172.21.15.71:0/145478021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0e00e40 msgr2=0x556bf0f80c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.432+0000 7f5b958bab80 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0e00e40 0x556bf0f80c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5b700dffd0 tx=0x7f5b7001ca20 comp rx=0 tx=0).stop 2024-05-27T09:49:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.432+0000 7f5b958bab80 1 -- 172.21.15.71:0/145478021 shutdown_connections 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.432+0000 7f5b958bab80 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.432+0000 7f5b958bab80 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f80750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.432+0000 7f5b958bab80 1 --2- 172.21.15.71:0/145478021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0e00e40 0x556bf0f80c90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.432+0000 7f5b958bab80 1 -- 172.21.15.71:0/145478021 >> 172.21.15.71:0/145478021 conn(0x556bf0e9a390 msgr2=0x556bf0f7b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.433+0000 7f5b958bab80 1 -- 172.21.15.71:0/145478021 shutdown_connections 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.433+0000 7f5b958bab80 1 -- 172.21.15.71:0/145478021 wait complete. 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.433+0000 7f5b958bab80 1 -- start start 2024-05-27T09:49:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.433+0000 7f5b958bab80 1 Processor -- start 2024-05-27T09:49:14.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f87240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0eec9f0 0x556bf0f87780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f87cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b958bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556bf0da3fa0 con 0x556bf0f8a2c0 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b958bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556bf0e3e760 con 0x556bf0eec9f0 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b958bab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556bf0f8cda0 con 0x556bf0e00e40 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b958bab80 10 client.0 _ll_register_callbacks cb 0x556bf0e47c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b84e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f87cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f87240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b84e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f87cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39426/0 (socket says 172.21.15.71:39426) 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b7f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0eec9f0 0x556bf0f87780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f87240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59104/0 (socket says 172.21.15.71:59104) 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.434+0000 7f5b84e00700 1 -- 172.21.15.71:0/1279730567 learned_addr learned my addr 172.21.15.71:0/1279730567 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b7fe00700 1 -- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0eec9f0 msgr2=0x556bf0f87780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0eec9f0 0x556bf0f87780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b7fe00700 1 -- 172.21.15.71:0/1279730567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 msgr2=0x556bf0f87cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f87cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b7fe00700 1 -- 172.21.15.71:0/1279730567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf0ded8d0 con 0x556bf0e00e40 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b7f400700 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0eec9f0 0x556bf0f87780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f87240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b700e2d30 tx=0x7f5b700aa070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff66c33169c737c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b6a000700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b6a000700 1 -- 172.21.15.71:0/1279730567 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700a92d0 con 0x556bf0e00e40 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b700a9670 con 0x556bf0e00e40 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.435+0000 7f5b6a000700 1 -- 172.21.15.71:0/1279730567 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5b700b2740 con 0x556bf0e00e40 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b6a000700 1 -- 172.21.15.71:0/1279730567 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b70003770 con 0x556bf0e00e40 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b958bab80 10 client.25564 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556bf0e6e060 con 0x556bf0e00e40 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b6a000700 1 -- 172.21.15.71:0/1279730567 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b700a9670 con 0x556bf0e00e40 2024-05-27T09:49:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b6a000700 1 -- 172.21.15.71:0/1279730567 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f5b700a54d0 con 0x556bf0e00e40 2024-05-27T09:49:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b958bab80 10 client.25564 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b958bab80 10 client.25564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b958bab80 20 client.25564 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf0f99b00 0x556bf0f9bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.436+0000 7f5b958bab80 4 client.25564 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.437+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bf0eafd90 con 0x556bf0f99b00 2024-05-27T09:49:14.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.437+0000 7f5b7f400700 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf0f99b00 0x556bf0f9bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.438+0000 7f5b7f400700 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf0f99b00 0x556bf0f9bf20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17f3f0c0c0ba0a8 server_cookie=39a335c1adb08e80 in_seq=0 out_seq=0 2024-05-27T09:49:14.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.438+0000 7f5b6a000700 10 client.25564 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:14.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.438+0000 7f5b6a000700 1 -- 172.21.15.71:0/1279730567 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x556bf0eafd90 con 0x556bf0f99b00 2024-05-27T09:49:14.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.438+0000 7f5b6a000700 10 client.25564 handle_command_reply: tid=0 2024-05-27T09:49:14.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.438+0000 7f5b958bab80 1 client.25564 shutdown 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 msgr2=0x556bf0f87240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f87240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b700e2d30 tx=0x7f5b700aa070 comp rx=0 tx=0).stop 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 shutdown_connections 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf0f99b00 0x556bf0f9bf20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f87cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f87240 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1279730567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0eec9f0 0x556bf0f87780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b6a000700 0 client.25564 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 >> 172.21.15.71:0/1279730567 conn(0x556bf0e9a390 msgr2=0x556bf0f80750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 shutdown_connections 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 1 -- 172.21.15.71:0/1279730567 wait complete. 2024-05-27T09:49:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.439+0000 7f5b958bab80 20 client.25564 trim_cache size 0 max 16384 2024-05-27T09:49:14.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.461+0000 7f5b958bab80 1 Processor -- start 2024-05-27T09:49:14.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.461+0000 7f5b958bab80 1 -- start start 2024-05-27T09:49:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.461+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0e00e40 0x556bf0f86240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.461+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f9ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b958bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801b3660 con 0x556bf0f8a2c0 2024-05-27T09:49:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b958bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801b0ef0 con 0x556bf0e00e40 2024-05-27T09:49:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b958bab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801aed40 con 0x556bf0eec9f0 2024-05-27T09:49:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0e00e40 0x556bf0f86240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39428/0 (socket says 172.21.15.71:39428) 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 -- 172.21.15.71:0/1766075627 learned_addr learned my addr 172.21.15.71:0/1766075627 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b7f400700 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f9ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 -- 172.21.15.71:0/1766075627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 msgr2=0x556bf0f9ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f9ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 -- 172.21.15.71:0/1766075627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0e00e40 msgr2=0x556bf0f86240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0e00e40 0x556bf0f86240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b84e00700 1 -- 172.21.15.71:0/1766075627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf0f88030 con 0x556bf0f8a2c0 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.462+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0e00e40 0x556bf0f86240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.463+0000 7f5b84e00700 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9f480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007630 tx=0x7f5b78006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf556c66852cdc3a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.463+0000 7f5b74c00700 1 -- 172.21.15.71:0/1766075627 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78007a70 con 0x556bf0f8a2c0 2024-05-27T09:49:14.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.463+0000 7f5b74c00700 1 -- 172.21.15.71:0/1766075627 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b78007c10 con 0x556bf0f8a2c0 2024-05-27T09:49:14.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.463+0000 7f5b74c00700 1 -- 172.21.15.71:0/1766075627 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7801f7f0 con 0x556bf0f8a2c0 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 -- 172.21.15.71:0/1766075627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 msgr2=0x556bf0f9f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9f480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007630 tx=0x7f5b78006000 comp rx=0 tx=0).stop 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 -- 172.21.15.71:0/1766075627 shutdown_connections 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9f480 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0e00e40 0x556bf0f86240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 --2- 172.21.15.71:0/1766075627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0eec9f0 0x556bf0f9ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 -- 172.21.15.71:0/1766075627 >> 172.21.15.71:0/1766075627 conn(0x556bf0e9a390 msgr2=0x556bf0f85b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 -- 172.21.15.71:0/1766075627 shutdown_connections 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.464+0000 7f5b958bab80 1 -- 172.21.15.71:0/1766075627 wait complete. 2024-05-27T09:49:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.465+0000 7f5b958bab80 1 -- start start 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.465+0000 7f5b958bab80 1 Processor -- start 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.465+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f9cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.465+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0eec9f0 0x556bf0f9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b958bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b958bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801af3b0 con 0x556bf0eec9f0 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b958bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801b0820 con 0x556bf0f8a2c0 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b958bab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801afa80 con 0x556bf0e00e40 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b958bab80 10 client.0 _ll_register_callbacks cb 0x556bf0f8cc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0eec9f0 0x556bf0f9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f9cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f9cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59122/0 (socket says 172.21.15.71:59122) 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 -- 172.21.15.71:0/3285826602 learned_addr learned my addr 172.21.15.71:0/3285826602 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0eec9f0 0x556bf0f9d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39430/0 (socket says 172.21.15.71:39430) 2024-05-27T09:49:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b84e00700 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 -- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 msgr2=0x556bf0f9d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 -- 172.21.15.71:0/3285826602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0eec9f0 msgr2=0x556bf0f9d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0eec9f0 0x556bf0f9d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.466+0000 7f5b7fe00700 1 -- 172.21.15.71:0/3285826602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf100bdc0 con 0x556bf0e00e40 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b7fe00700 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f9cf50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b700a9af0 tx=0x7f5b700a9b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0746d8eb5baec97 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b6a000700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b6a000700 1 -- 172.21.15.71:0/3285826602 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700c4230 con 0x556bf0e00e40 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b6a000700 1 -- 172.21.15.71:0/3285826602 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5b70003720 con 0x556bf0e00e40 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b78007c10 con 0x556bf0e00e40 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b6a000700 1 -- 172.21.15.71:0/3285826602 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b700a9670 con 0x556bf0e00e40 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b958bab80 10 client.25570 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556bf100d030 con 0x556bf0e00e40 2024-05-27T09:49:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b6a000700 1 -- 172.21.15.71:0/3285826602 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b78007c10 con 0x556bf0e00e40 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.467+0000 7f5b6a000700 1 -- 172.21.15.71:0/3285826602 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f5b700e02e0 con 0x556bf0e00e40 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b958bab80 10 client.25570 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b958bab80 10 client.25570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b958bab80 20 client.25570 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b958bab80 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf100d3f0 0x556bf100f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b958bab80 4 client.25570 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556bf0ea9570 con 0x556bf100d3f0 2024-05-27T09:49:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b7f400700 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf100d3f0 0x556bf100f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b7f400700 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf100d3f0 0x556bf100f810 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8122d532272c8675 server_cookie=bd69b3c3d78e1223 in_seq=0 out_seq=0 2024-05-27T09:49:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.468+0000 7f5b6a000700 10 client.25570 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b6a000700 1 -- 172.21.15.71:0/3285826602 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556bf0ea9570 con 0x556bf100d3f0 2024-05-27T09:49:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b6a000700 10 client.25570 handle_command_reply: tid=0 2024-05-27T09:49:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 client.25570 shutdown 2024-05-27T09:49:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 msgr2=0x556bf0f9cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f9cf50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b700a9af0 tx=0x7f5b700a9b60 comp rx=0 tx=0).stop 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 shutdown_connections 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556bf100d3f0 0x556bf100f810 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556bf0f8a2c0 0x556bf0f9d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bf0e00e40 0x556bf0f9cf50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b6a000700 0 client.25570 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 --2- 172.21.15.71:0/3285826602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556bf0eec9f0 0x556bf0f9d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 >> 172.21.15.71:0/3285826602 conn(0x556bf0e9a390 msgr2=0x556bf0f7b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 shutdown_connections 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 1 -- 172.21.15.71:0/3285826602 wait complete. 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.469+0000 7f5b958bab80 20 client.25570 trim_cache size 0 max 16384 2024-05-27T09:49:14.473 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:49:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "status": "no active scrubs running", 2024-05-27T09:49:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "scrubs": {} 2024-05-27T09:49:14.474 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:49:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.470+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b640b2c20 msgr2=0x7f5b640b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.470+0000 7f5b85800700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b640b2c20 0x7f5b640b5130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009da0 tx=0x7f5b780096c0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.470+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b80105280 msgr2=0x7f5b80102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.470+0000 7f5b85800700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b80105280 0x7f5b80102f70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000ec10 tx=0x7f5b7000ef20 comp rx=0 tx=0).stop 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.470+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 shutdown_connections 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.471+0000 7f5b85800700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b640b2c20 0x7f5b640b5130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.471+0000 7f5b85800700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8010e6f0 0x7f5b801039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.471+0000 7f5b85800700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b80105280 0x7f5b80102f70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.471+0000 7f5b85800700 1 --2- 172.21.15.71:0/2954511984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b80105bd0 0x7f5b801034b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.471+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 >> 172.21.15.71:0/2954511984 conn(0x7f5b80078ab0 msgr2=0x7f5b800fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.471+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 shutdown_connections 2024-05-27T09:49:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:14.471+0000 7f5b85800700 1 -- 172.21.15.71:0/2954511984 wait complete. 2024-05-27T09:49:14.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:14 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2048205044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:14.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:14 smithi122 ceph-mon[36436]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-05-27T09:49:14.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:14 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2048205044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:14.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:14 smithi071 ceph-mon[31451]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-05-27T09:49:14.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:14 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2048205044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:14.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:14 smithi072 ceph-mon[35951]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-05-27T09:49:15.029 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 149.4 --await-for 45.0' 2024-05-27T09:49:15.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 149.4 --await-for 45.0 2024-05-27T09:49:15.605 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-27T09:49:15.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:49:15.692 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:16.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:16 smithi071 ceph-mon[31451]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-05-27T09:49:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:16 smithi122 ceph-mon[36436]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-05-27T09:49:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:17.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:16 smithi072 ceph-mon[35951]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-05-27T09:49:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.170+0000 7ff643400700 1 -- 172.21.15.71:0/1822637311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 msgr2=0x7ff63c1058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.170+0000 7ff643400700 1 --2- 172.21.15.71:0/1822637311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c1058f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009990 tx=0x7ff62c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.170+0000 7ff643400700 1 -- 172.21.15.71:0/1822637311 shutdown_connections 2024-05-27T09:49:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.170+0000 7ff643400700 1 --2- 172.21.15.71:0/1822637311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff63c10e910 0x7ff63c110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.170+0000 7ff643400700 1 --2- 172.21.15.71:0/1822637311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c1058f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.170+0000 7ff643400700 1 --2- 172.21.15.71:0/1822637311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c105e30 0x7ff63c10e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.170+0000 7ff643400700 1 -- 172.21.15.71:0/1822637311 >> 172.21.15.71:0/1822637311 conn(0x7ff63c078df0 msgr2=0x7ff63c079230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.171+0000 7ff643400700 1 -- 172.21.15.71:0/1822637311 shutdown_connections 2024-05-27T09:49:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.171+0000 7ff643400700 1 -- 172.21.15.71:0/1822637311 wait complete. 2024-05-27T09:49:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.172+0000 7ff643400700 1 Processor -- start 2024-05-27T09:49:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.172+0000 7ff643400700 1 -- start start 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff643400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c19aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff643400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff63c105e30 0x7ff63c19b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff643400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c10e910 0x7ff63c19f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff643400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c1144b0 con 0x7ff63c105e30 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff643400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c114330 con 0x7ff63c1054e0 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff643400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c114630 con 0x7ff63c10e910 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff640a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c19aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff633e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff63c105e30 0x7ff63c19b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff640a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c19aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:43606/0 (socket says 172.21.15.71:43606) 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff640a00700 1 -- 172.21.15.71:0/620116283 learned_addr learned my addr 172.21.15.71:0/620116283 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.173+0000 7ff641400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c10e910 0x7ff63c19f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff640a00700 1 -- 172.21.15.71:0/620116283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c10e910 msgr2=0x7ff63c19f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff640a00700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c10e910 0x7ff63c19f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff640a00700 1 -- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff63c105e30 msgr2=0x7ff63c19b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff640a00700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff63c105e30 0x7ff63c19b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff640a00700 1 -- 172.21.15.71:0/620116283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c19fdb0 con 0x7ff63c1054e0 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff641400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c10e910 0x7ff63c19f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff640a00700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c19aee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff62c000c00 tx=0x7ff62c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.174+0000 7ff63a000700 1 -- 172.21.15.71:0/620116283 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c027070 con 0x7ff63c1054e0 2024-05-27T09:49:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.175+0000 7ff63a000700 1 -- 172.21.15.71:0/620116283 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff62c022470 con 0x7ff63c1054e0 2024-05-27T09:49:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.175+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c1a0040 con 0x7ff63c1054e0 2024-05-27T09:49:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.175+0000 7ff63a000700 1 -- 172.21.15.71:0/620116283 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c017650 con 0x7ff63c1054e0 2024-05-27T09:49:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.175+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c1a0520 con 0x7ff63c1054e0 2024-05-27T09:49:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.178+0000 7ff63a000700 1 -- 172.21.15.71:0/620116283 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7ff62c02a070 con 0x7ff63c1054e0 2024-05-27T09:49:18.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.180+0000 7ff63a000700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6200b29f0 0x7ff6200b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.180+0000 7ff651fb5b80 1 Processor -- start 2024-05-27T09:49:18.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.180+0000 7ff63a000700 1 -- 172.21.15.71:0/620116283 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff62c0e34e0 con 0x7ff63c1054e0 2024-05-27T09:49:18.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.180+0000 7ff651fb5b80 1 -- start start 2024-05-27T09:49:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.180+0000 7ff633e00700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6200b29f0 0x7ff6200b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e38dfd0 0x55db5e517250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e517790 0x55db5e5113a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e5118e0 0x55db5e511cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db5e43afd0 con 0x55db5e38dfd0 2024-05-27T09:49:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55db5e42ab70 con 0x55db5e5118e0 2024-05-27T09:49:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db5e42ebb0 con 0x55db5e517790 2024-05-27T09:49:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff633e00700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6200b29f0 0x7ff6200b4f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff63c1103d0 tx=0x7ff624009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff640a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e38dfd0 0x55db5e517250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff641400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e5118e0 0x55db5e511cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff640a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e38dfd0 0x55db5e517250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39442/0 (socket says 172.21.15.71:39442) 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff640a00700 1 -- 172.21.15.71:0/154489377 learned_addr learned my addr 172.21.15.71:0/154489377 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.181+0000 7ff633e00700 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e517790 0x55db5e5113a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff641400700 1 -- 172.21.15.71:0/154489377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e517790 msgr2=0x55db5e5113a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff641400700 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e517790 0x55db5e5113a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff641400700 1 -- 172.21.15.71:0/154489377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e38dfd0 msgr2=0x55db5e517250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff641400700 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e38dfd0 0x55db5e517250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff641400700 1 -- 172.21.15.71:0/154489377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db5e3f35b0 con 0x55db5e5118e0 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff640a00700 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e38dfd0 0x55db5e517250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:18.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff641400700 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e5118e0 0x55db5e511cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6340093a0 tx=0x7ff634009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f10b70d3880ea106 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:18.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff632000700 1 -- 172.21.15.71:0/154489377 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634019030 con 0x55db5e5118e0 2024-05-27T09:49:18.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff632000700 1 -- 172.21.15.71:0/154489377 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff634004bb0 con 0x55db5e5118e0 2024-05-27T09:49:18.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.182+0000 7ff632000700 1 -- 172.21.15.71:0/154489377 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634005040 con 0x55db5e5118e0 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.183+0000 7ff651fb5b80 1 -- 172.21.15.71:0/154489377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e5118e0 msgr2=0x55db5e511cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.183+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e5118e0 0x55db5e511cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6340093a0 tx=0x7ff634009920 comp rx=0 tx=0).stop 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 -- 172.21.15.71:0/154489377 shutdown_connections 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e5118e0 0x55db5e511cf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e38dfd0 0x55db5e517250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/154489377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e517790 0x55db5e5113a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 -- 172.21.15.71:0/154489377 >> 172.21.15.71:0/154489377 conn(0x55db5e3ee150 msgr2=0x55db5e508190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 -- 172.21.15.71:0/154489377 shutdown_connections 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 -- 172.21.15.71:0/154489377 wait complete. 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.184+0000 7ff651fb5b80 1 -- start start 2024-05-27T09:49:18.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 1 Processor -- start 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e51ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e51b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e51b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db5e331130 con 0x55db5e517790 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55db5e3cb8f0 con 0x55db5e38dfd0 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db5e51e260 con 0x55db5e5118e0 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.185+0000 7ff651fb5b80 10 client.0 _ll_register_callbacks cb 0x55db5e3d4e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e51ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e51ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:43614/0 (socket says 172.21.15.71:43614) 2024-05-27T09:49:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 -- 172.21.15.71:0/1434181993 learned_addr learned my addr 172.21.15.71:0/1434181993 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff633e00700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e51b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff641400700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e51b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 -- 172.21.15.71:0/1434181993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 msgr2=0x55db5e51b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e51b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 -- 172.21.15.71:0/1434181993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 msgr2=0x55db5e51b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e51b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 -- 172.21.15.71:0/1434181993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db5e37aa60 con 0x55db5e38dfd0 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff641400700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e51b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff640a00700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e51ae70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0aa520 tx=0x7ff62c0a9f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6571f388a44358 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff62aa00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.186+0000 7ff62aa00700 1 -- 172.21.15.71:0/1434181993 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0aaf20 con 0x55db5e38dfd0 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff62aa00700 1 -- 172.21.15.71:0/1434181993 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff62c0aac90 con 0x55db5e38dfd0 2024-05-27T09:49:18.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff634004bb0 con 0x55db5e38dfd0 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff62aa00700 1 -- 172.21.15.71:0/1434181993 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff62c0cd0b0 con 0x55db5e38dfd0 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff651fb5b80 10 client.25565 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db5e3fb1f0 con 0x55db5e38dfd0 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff62aa00700 1 -- 172.21.15.71:0/1434181993 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff634004bb0 con 0x55db5e38dfd0 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff62aa00700 1 -- 172.21.15.71:0/1434181993 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7ff62c0920f0 con 0x55db5e38dfd0 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff651fb5b80 10 client.25565 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff651fb5b80 10 client.25565 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff651fb5b80 20 client.25565 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.187+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e52af40 0x55db5e52d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.188+0000 7ff651fb5b80 4 client.25565 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.188+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db5e43cf20 con 0x55db5e52af40 2024-05-27T09:49:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.188+0000 7ff633e00700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e52af40 0x55db5e52d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.188+0000 7ff633e00700 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e52af40 0x55db5e52d380 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f44728d50684999 server_cookie=20f08cf49dabc99 in_seq=0 out_seq=0 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.188+0000 7ff62aa00700 10 client.25565 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.189+0000 7ff62aa00700 1 -- 172.21.15.71:0/1434181993 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55db5e43cf20 con 0x55db5e52af40 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.189+0000 7ff62aa00700 10 client.25565 handle_command_reply: tid=0 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.189+0000 7ff651fb5b80 1 client.25565 shutdown 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.189+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 msgr2=0x55db5e51ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.189+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e51ae70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0aa520 tx=0x7ff62c0a9f90 comp rx=0 tx=0).stop 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 shutdown_connections 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e52af40 0x55db5e52d380 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e51b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e51ae70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/1434181993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e51b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff62aa00700 0 client.25565 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 >> 172.21.15.71:0/1434181993 conn(0x55db5e3ee150 msgr2=0x55db5e50bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 shutdown_connections 2024-05-27T09:49:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 1 -- 172.21.15.71:0/1434181993 wait complete. 2024-05-27T09:49:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.190+0000 7ff651fb5b80 20 client.25565 trim_cache size 0 max 16384 2024-05-27T09:49:18.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 Processor -- start 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 -- start start 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e38dfd0 0x55db5e51d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e5118e0 0x55db5e50c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e517790 0x55db5e5272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c1af550 con 0x55db5e5118e0 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c1acde0 con 0x55db5e517790 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.212+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c1aac30 con 0x55db5e38dfd0 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e5118e0 0x55db5e50c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e5118e0 0x55db5e50c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39466/0 (socket says 172.21.15.71:39466) 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 -- 172.21.15.71:0/2901307683 learned_addr learned my addr 172.21.15.71:0/2901307683 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:18.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff641400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e517790 0x55db5e5272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff640a00700 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e38dfd0 0x55db5e51d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 -- 172.21.15.71:0/2901307683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e38dfd0 msgr2=0x55db5e51d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e38dfd0 0x55db5e51d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 -- 172.21.15.71:0/2901307683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e517790 msgr2=0x55db5e5272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e517790 0x55db5e5272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 -- 172.21.15.71:0/2901307683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db5e509800 con 0x55db5e5118e0 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff641400700 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e517790 0x55db5e5272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.213+0000 7ff633e00700 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e5118e0 0x55db5e50c7d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff624005950 tx=0x7ff624014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15c5e3908ee3130 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.214+0000 7ff631600700 1 -- 172.21.15.71:0/2901307683 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624004570 con 0x55db5e5118e0 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.214+0000 7ff631600700 1 -- 172.21.15.71:0/2901307683 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff624003e90 con 0x55db5e5118e0 2024-05-27T09:49:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.214+0000 7ff631600700 1 -- 172.21.15.71:0/2901307683 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6240053a0 con 0x55db5e5118e0 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2901307683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e5118e0 msgr2=0x55db5e50c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e5118e0 0x55db5e50c7d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff624005950 tx=0x7ff624014000 comp rx=0 tx=0).stop 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2901307683 shutdown_connections 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e517790 0x55db5e5272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e38dfd0 0x55db5e51d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2901307683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e5118e0 0x55db5e50c7d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2901307683 >> 172.21.15.71:0/2901307683 conn(0x55db5e3ee150 msgr2=0x55db5e5152e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2901307683 shutdown_connections 2024-05-27T09:49:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.215+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2901307683 wait complete. 2024-05-27T09:49:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 -- start start 2024-05-27T09:49:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 Processor -- start 2024-05-27T09:49:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e5234b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e5239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e50efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c1ab2a0 con 0x55db5e517790 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c1ac710 con 0x55db5e38dfd0 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c1ab970 con 0x55db5e5118e0 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.216+0000 7ff651fb5b80 10 client.0 _ll_register_callbacks cb 0x55db5e3d4e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e50efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e50efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39480/0 (socket says 172.21.15.71:39480) 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 -- 172.21.15.71:0/2242159993 learned_addr learned my addr 172.21.15.71:0/2242159993 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff633e00700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e5239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff640a00700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e5234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 -- 172.21.15.71:0/2242159993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 msgr2=0x55db5e5239f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e5239f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 -- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 msgr2=0x55db5e5234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e5234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff641400700 1 -- 172.21.15.71:0/2242159993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db5e50f4e0 con 0x55db5e517790 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff640a00700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e5234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.217+0000 7ff633e00700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e5239f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff641400700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e50efa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff6340093a0 tx=0x7ff6340156e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176f0456154f9c8c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff62aa00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff62aa00700 1 -- 172.21.15.71:0/2242159993 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634015be0 con 0x55db5e517790 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff624003e90 con 0x55db5e517790 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff62aa00700 1 -- 172.21.15.71:0/2242159993 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff634015d80 con 0x55db5e517790 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff62aa00700 1 -- 172.21.15.71:0/2242159993 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff634003a00 con 0x55db5e517790 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff651fb5b80 10 client.15465 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.218+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db5e59a8b0 con 0x55db5e517790 2024-05-27T09:49:18.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff62aa00700 1 -- 172.21.15.71:0/2242159993 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff624003e90 con 0x55db5e517790 2024-05-27T09:49:18.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff62aa00700 1 -- 172.21.15.71:0/2242159993 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7ff63401e6f0 con 0x55db5e517790 2024-05-27T09:49:18.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff651fb5b80 10 client.15465 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:18.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff651fb5b80 10 client.15465 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:49:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff651fb5b80 20 client.15465 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e59ad90 0x55db5e59d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff651fb5b80 4 client.15465 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.4, "await_for": 45.0}] 2024-05-27T09:49:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.4, "await_for": 45.0}) -- 0x55db5e436700 con 0x55db5e59ad90 2024-05-27T09:49:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.219+0000 7ff640a00700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e59ad90 0x55db5e59d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.220+0000 7ff640a00700 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e59ad90 0x55db5e59d1b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c32c704c2bd2b3 server_cookie=f68c9cbdb8de57f5 in_seq=0 out_seq=0 2024-05-27T09:49:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.220+0000 7ff62aa00700 10 client.15465 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:18.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff62aa00700 1 -- 172.21.15.71:0/2242159993 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55db5e436700 con 0x55db5e59ad90 2024-05-27T09:49:18.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff62aa00700 10 client.15465 handle_command_reply: tid=0 2024-05-27T09:49:18.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 client.15465 shutdown 2024-05-27T09:49:18.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 msgr2=0x55db5e50efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e50efa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff6340093a0 tx=0x7ff6340156e0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 shutdown_connections 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db5e59ad90 0x55db5e59d1b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db5e517790 0x55db5e50efa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db5e38dfd0 0x55db5e5234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 --2- 172.21.15.71:0/2242159993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db5e5118e0 0x55db5e5239f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 >> 172.21.15.71:0/2242159993 conn(0x55db5e3ee150 msgr2=0x55db5e517e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff62aa00700 0 client.15465 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 shutdown_connections 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 1 -- 172.21.15.71:0/2242159993 wait complete. 2024-05-27T09:49:18.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.227+0000 7ff651fb5b80 20 client.15465 trim_cache size 0 max 16384 2024-05-27T09:49:18.229 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:49:18.229 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 26, 2024-05-27T09:49:18.229 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:49:18.229 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 2, 2024-05-27T09:49:18.229 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:49:18.229 INFO:teuthology.orchestra.run.smithi071.stdout: "f1da88c": { 2024-05-27T09:49:18.229 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 2, 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 149.4, 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:49:18.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:18.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:18.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:18.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:18.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:18.231 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:49:18.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6200b29f0 msgr2=0x7ff6200b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6200b29f0 0x7ff6200b4f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff63c1103d0 tx=0x7ff624009260 comp rx=0 tx=0).stop 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 msgr2=0x7ff63c19aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c19aee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff62c000c00 tx=0x7ff62c0057c0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 shutdown_connections 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff6200b29f0 0x7ff6200b4f00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c10e910 0x7ff63c19f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63c1054e0 0x7ff63c19aee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 --2- 172.21.15.71:0/620116283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff63c105e30 0x7ff63c19b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 >> 172.21.15.71:0/620116283 conn(0x7ff63c078df0 msgr2=0x7ff63c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.228+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 shutdown_connections 2024-05-27T09:49:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:18.229+0000 7ff643400700 1 -- 172.21.15.71:0/620116283 wait complete. 2024-05-27T09:49:18.914 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:18 smithi071 ceph-mon[31451]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-05-27T09:49:18.914 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:18 smithi071 ceph-mon[31451]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-05-27T09:49:18.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:18 smithi122 ceph-mon[36436]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-05-27T09:49:18.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:18 smithi122 ceph-mon[36436]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-05-27T09:49:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:18 smithi072 ceph-mon[35951]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-05-27T09:49:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:18 smithi072 ceph-mon[35951]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-05-27T09:49:19.768 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f1da88c', quiesce took 10.0 seconds. Will release after: 19.4 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.508+0000 7f0053a00700 1 -- 172.21.15.71:0/4265786411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 msgr2=0x7f004c106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.508+0000 7f0053a00700 1 --2- 172.21.15.71:0/4265786411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 0x7f004c106970 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0038009990 tx=0x7f0038009ca0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.508+0000 7f0053a00700 1 -- 172.21.15.71:0/4265786411 shutdown_connections 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.508+0000 7f0053a00700 1 --2- 172.21.15.71:0/4265786411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c106eb0 0x7f004c113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.508+0000 7f0053a00700 1 --2- 172.21.15.71:0/4265786411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f004c10c5a0 0x7f004c10c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.508+0000 7f0053a00700 1 --2- 172.21.15.71:0/4265786411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 0x7f004c106970 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.508+0000 7f0053a00700 1 -- 172.21.15.71:0/4265786411 >> 172.21.15.71:0/4265786411 conn(0x7f004c102080 msgr2=0x7f004c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.509+0000 7f0053a00700 1 -- 172.21.15.71:0/4265786411 shutdown_connections 2024-05-27T09:49:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.509+0000 7f0053a00700 1 -- 172.21.15.71:0/4265786411 wait complete. 2024-05-27T09:49:20.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.512+0000 7f0053a00700 1 Processor -- start 2024-05-27T09:49:20.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.512+0000 7f0053a00700 1 -- start start 2024-05-27T09:49:20.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.513+0000 7f0053a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 0x7f004c19cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:20.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.513+0000 7f0053a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f004c106eb0 0x7f004c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:20.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.513+0000 7f0053a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c10c5a0 0x7f004c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:20.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.513+0000 7f0053a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f004c1166d0 con 0x7f004c10c5a0 2024-05-27T09:49:20.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.513+0000 7f0053a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f004c116550 con 0x7f004c106eb0 2024-05-27T09:49:20.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.513+0000 7f0053a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f004c116850 con 0x7f004c106560 2024-05-27T09:49:20.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c10c5a0 0x7f004c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:20.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 0x7f004c19cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:20.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c10c5a0 0x7f004c1a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39500/0 (socket says 172.21.15.71:39500) 2024-05-27T09:49:20.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 -- 172.21.15.71:0/1023121653 learned_addr learned my addr 172.21.15.71:0/1023121653 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:20.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f004be00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f004c106eb0 0x7f004c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 -- 172.21.15.71:0/1023121653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 msgr2=0x7f004c19cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 0x7f004c19cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 -- 172.21.15.71:0/1023121653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f004c106eb0 msgr2=0x7f004c19d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f004c106eb0 0x7f004c19d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.514+0000 7f0051a00700 1 -- 172.21.15.71:0/1023121653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c1a1eb0 con 0x7f004c10c5a0 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.515+0000 7f0051a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c10c5a0 0x7f004c1a1810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f004400ef30 tx=0x7f004400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.515+0000 7f0049600700 1 -- 172.21.15.71:0/1023121653 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00440092e0 con 0x7f004c10c5a0 2024-05-27T09:49:20.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.515+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004c1a2140 con 0x7f004c10c5a0 2024-05-27T09:49:20.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.515+0000 7f0049600700 1 -- 172.21.15.71:0/1023121653 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0044004bb0 con 0x7f004c10c5a0 2024-05-27T09:49:20.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.515+0000 7f0049600700 1 -- 172.21.15.71:0/1023121653 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044004020 con 0x7f004c10c5a0 2024-05-27T09:49:20.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.515+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f004c1a2650 con 0x7f004c10c5a0 2024-05-27T09:49:20.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.517+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004c0512b0 con 0x7f004c10c5a0 2024-05-27T09:49:20.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.520+0000 7f0049600700 1 -- 172.21.15.71:0/1023121653 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f004401b030 con 0x7f004c10c5a0 2024-05-27T09:49:20.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.521+0000 7f0049600700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00340b29f0 0x7f00340b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:20.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.521+0000 7f0049600700 1 -- 172.21.15.71:0/1023121653 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f00440e2b50 con 0x7f004c10c5a0 2024-05-27T09:49:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.522+0000 7f0051000700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00340b29f0 0x7f00340b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.522+0000 7f0051000700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00340b29f0 0x7f00340b4f00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f004c1079d0 tx=0x7f0040009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.525+0000 7f0049600700 1 -- 172.21.15.71:0/1023121653 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0044022020 con 0x7f004c10c5a0 2024-05-27T09:49:20.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.834+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f004c02e5e0 con 0x7f004c10c5a0 2024-05-27T09:49:20.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.835+0000 7f0049600700 1 -- 172.21.15.71:0/1023121653 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7f0044010040 con 0x7f004c10c5a0 2024-05-27T09:49:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:49:20.836 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:49:20.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.838+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00340b29f0 msgr2=0x7f00340b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:20.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.838+0000 7f0053a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00340b29f0 0x7f00340b4f00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f004c1079d0 tx=0x7f0040009260 comp rx=0 tx=0).stop 2024-05-27T09:49:20.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.838+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c10c5a0 msgr2=0x7f004c1a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:20.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.838+0000 7f0053a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c10c5a0 0x7f004c1a1810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f004400ef30 tx=0x7f004400c3a0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 shutdown_connections 2024-05-27T09:49:20.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00340b29f0 0x7f00340b4f00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f004c10c5a0 0x7f004c1a1810 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f004c106560 0x7f004c19cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 --2- 172.21.15.71:0/1023121653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f004c106eb0 0x7f004c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:20.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 >> 172.21.15.71:0/1023121653 conn(0x7f004c102080 msgr2=0x7f004c1048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:20.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 shutdown_connections 2024-05-27T09:49:20.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:20.839+0000 7f0053a00700 1 -- 172.21.15.71:0/1023121653 wait complete. 2024-05-27T09:49:20.840 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:49:20.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:20 smithi122 ceph-mon[36436]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-05-27T09:49:21.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:20 smithi071 ceph-mon[31451]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-05-27T09:49:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:20 smithi072 ceph-mon[35951]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-05-27T09:49:21.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-27T09:49:21.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:21 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1023121653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:22.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:21 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1023121653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:22.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:21 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1023121653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:22.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:22 smithi122 ceph-mon[36436]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-27T09:49:23.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:22 smithi071 ceph-mon[31451]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-27T09:49:23.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:22 smithi072 ceph-mon[35951]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-27T09:49:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.639+0000 7f5883e00700 1 -- 172.21.15.71:0/3611606084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58841043f0 msgr2=0x7f5884104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.639+0000 7f5883e00700 1 --2- 172.21.15.71:0/3611606084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58841043f0 0x7f5884104800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f58740099c0 tx=0x7f5874009cd0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.640+0000 7f5883e00700 1 -- 172.21.15.71:0/3611606084 shutdown_connections 2024-05-27T09:49:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.640+0000 7f5883e00700 1 --2- 172.21.15.71:0/3611606084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5884109670 0x7f5884110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.640+0000 7f5883e00700 1 --2- 172.21.15.71:0/3611606084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58841043f0 0x7f5884104800 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.640+0000 7f5883e00700 1 --2- 172.21.15.71:0/3611606084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884108d20 0x7f5884109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.640+0000 7f5883e00700 1 -- 172.21.15.71:0/3611606084 >> 172.21.15.71:0/3611606084 conn(0x7f5884079d00 msgr2=0x7f588407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.641+0000 7f5883e00700 1 -- 172.21.15.71:0/3611606084 shutdown_connections 2024-05-27T09:49:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.641+0000 7f5883e00700 1 -- 172.21.15.71:0/3611606084 wait complete. 2024-05-27T09:49:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.642+0000 7f5883e00700 1 Processor -- start 2024-05-27T09:49:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.642+0000 7f5883e00700 1 -- start start 2024-05-27T09:49:24.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58841043f0 0x7f588419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5884108d20 0x7f588419d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884109670 0x7f58841a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58841142f0 con 0x7f5884108d20 2024-05-27T09:49:24.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5884114170 con 0x7f58841043f0 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5884114470 con 0x7f5884109670 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884109670 0x7f58841a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5882a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58841043f0 0x7f588419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5882a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58841043f0 0x7f588419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40698/0 (socket says 172.21.15.71:40698) 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5883400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884109670 0x7f58841a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39906/0 (socket says 172.21.15.71:39906) 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5882a00700 1 -- 172.21.15.71:0/1546061418 learned_addr learned my addr 172.21.15.71:0/1546061418 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.643+0000 7f5882000700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5884108d20 0x7f588419d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.644+0000 7f5882a00700 1 -- 172.21.15.71:0/1546061418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884109670 msgr2=0x7f58841a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.644+0000 7f5882a00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884109670 0x7f58841a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.644+0000 7f5882a00700 1 -- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5884108d20 msgr2=0x7f588419d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.644+0000 7f5882a00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5884108d20 0x7f588419d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.644+0000 7f5882a00700 1 -- 172.21.15.71:0/1546061418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58841a1d70 con 0x7f58841043f0 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.645+0000 7f5883400700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884109670 0x7f58841a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.645+0000 7f5882a00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58841043f0 0x7f588419cea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5874006010 tx=0x7f5874005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.645+0000 7f587b400700 1 -- 172.21.15.71:0/1546061418 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874026070 con 0x7f58841043f0 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.646+0000 7f587b400700 1 -- 172.21.15.71:0/1546061418 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5874005680 con 0x7f58841043f0 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.646+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58841a2000 con 0x7f58841043f0 2024-05-27T09:49:24.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.646+0000 7f587b400700 1 -- 172.21.15.71:0/1546061418 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587400fb20 con 0x7f58841043f0 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.646+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58841a24e0 con 0x7f58841043f0 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.650+0000 7f587b400700 1 -- 172.21.15.71:0/1546061418 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5874029070 con 0x7f58841043f0 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.651+0000 7f589829db80 1 Processor -- start 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.651+0000 7f589829db80 1 -- start start 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f587b400700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f58680b29f0 0x7f58680b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f589829db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379dc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f589829db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379dcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f589829db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f589829db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563537909e40 con 0x56353785ce40 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f589829db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5635378f99e0 con 0x5635379e62c0 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f589829db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635378fda20 con 0x5635379489f0 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f587b400700 1 -- 172.21.15.71:0/1546061418 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f58740e2f60 con 0x7f58841043f0 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f5883400700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f58680b29f0 0x7f58680b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f5883400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f5883400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40710/0 (socket says 172.21.15.71:40710) 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f5883400700 1 -- 172.21.15.71:0/2365328093 learned_addr learned my addr 172.21.15.71:0/2365328093 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.652+0000 7f5882a00700 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5882a00700 1 -- 172.21.15.71:0/2365328093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 msgr2=0x5635379e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5882a00700 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5882a00700 1 -- 172.21.15.71:0/2365328093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 msgr2=0x5635379dcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5882a00700 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379dcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5882a00700 1 -- 172.21.15.71:0/2365328093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635378c2420 con 0x5635379489f0 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5883400700 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5882a00700 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379dc750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f58740e06e0 tx=0x7f58740a9b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=692305d2501bd8ca server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f5883400700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f58680b29f0 0x7f58680b4f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f587c009ec0 tx=0x7f587c009920 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.653+0000 7f586fe00700 1 -- 172.21.15.71:0/2365328093 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740aa300 con 0x5635379489f0 2024-05-27T09:49:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.654+0000 7f586fe00700 1 -- 172.21.15.71:0/2365328093 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58740ae6b0 con 0x5635379489f0 2024-05-27T09:49:24.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.654+0000 7f586fe00700 1 -- 172.21.15.71:0/2365328093 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740ae170 con 0x5635379489f0 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 -- 172.21.15.71:0/2365328093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 msgr2=0x5635379dc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379dc750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f58740e06e0 tx=0x7f58740a9b60 comp rx=0 tx=0).stop 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 -- 172.21.15.71:0/2365328093 shutdown_connections 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379dc750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 --2- 172.21.15.71:0/2365328093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379dcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 -- 172.21.15.71:0/2365328093 >> 172.21.15.71:0/2365328093 conn(0x5635378f6390 msgr2=0x5635379d7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 -- 172.21.15.71:0/2365328093 shutdown_connections 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 -- 172.21.15.71:0/2365328093 wait complete. 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.655+0000 7f589829db80 1 -- start start 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.656+0000 7f589829db80 1 Processor -- start 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f589829db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379e3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f589829db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379e3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f589829db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f589829db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5635377fffa0 con 0x56353785ce40 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f589829db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56353789a760 con 0x5635379e62c0 2024-05-27T09:49:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f589829db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635379f1430 con 0x5635379489f0 2024-05-27T09:49:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f589829db80 10 client.0 _ll_register_callbacks cb 0x5635378a3c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f5882a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f5882000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f5883400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f5882a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379e3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39476/0 (socket says 172.21.15.71:39476) 2024-05-27T09:49:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.657+0000 7f5882a00700 1 -- 172.21.15.71:0/3187726994 learned_addr learned my addr 172.21.15.71:0/3187726994 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f5882000700 1 -- 172.21.15.71:0/3187726994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 msgr2=0x5635379e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f5882000700 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f5882000700 1 -- 172.21.15.71:0/3187726994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 msgr2=0x5635379e3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f5882000700 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379e3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f5882000700 1 -- 172.21.15.71:0/3187726994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635378498d0 con 0x5635379489f0 2024-05-27T09:49:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f5882a00700 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379e3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f5882000700 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379e3990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f58841039d0 tx=0x7f58700119a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5374ed4cf5557e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f586cc00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f586cc00700 1 -- 172.21.15.71:0/3187726994 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870004460 con 0x5635379489f0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58740ae6b0 con 0x5635379489f0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f586cc00700 1 -- 172.21.15.71:0/3187726994 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5870003680 con 0x5635379489f0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f586cc00700 1 -- 172.21.15.71:0/3187726994 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5870003880 con 0x5635379489f0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.658+0000 7f589829db80 10 client.25606 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5635378ca060 con 0x5635379489f0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f586cc00700 1 -- 172.21.15.71:0/3187726994 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58740ae6b0 con 0x5635379489f0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f586cc00700 1 -- 172.21.15.71:0/3187726994 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f5870018070 con 0x5635379489f0 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f589829db80 10 client.25606 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f589829db80 10 client.25606 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:49:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f589829db80 20 client.25606 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f589829db80 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5635379fe450 0x563537a00870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f589829db80 4 client.25606 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.659+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56353790bd90 con 0x5635379fe450 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.660+0000 7f5882a00700 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5635379fe450 0x563537a00870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.660+0000 7f5882a00700 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5635379fe450 0x563537a00870 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91875ab9d48fc896 server_cookie=d0d6696215eb866 in_seq=0 out_seq=0 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.660+0000 7f586cc00700 10 client.25606 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.661+0000 7f586cc00700 1 -- 172.21.15.71:0/3187726994 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56353790bd90 con 0x5635379fe450 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.661+0000 7f586cc00700 10 client.25606 handle_command_reply: tid=0 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.661+0000 7f589829db80 1 client.25606 shutdown 2024-05-27T09:49:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 msgr2=0x5635379e3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379e3990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f58841039d0 tx=0x7f58700119a0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 shutdown_connections 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5635379fe450 0x563537a00870 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x5635379e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56353785ce40 0x5635379e3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 --2- 172.21.15.71:0/3187726994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635379489f0 0x5635379e3990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f586cc00700 0 client.25606 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 >> 172.21.15.71:0/3187726994 conn(0x5635378f6390 msgr2=0x5635379dc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 shutdown_connections 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 1 -- 172.21.15.71:0/3187726994 wait complete. 2024-05-27T09:49:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.662+0000 7f589829db80 20 client.25606 trim_cache size 0 max 16384 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.678+0000 7f589829db80 1 Processor -- start 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.678+0000 7f589829db80 1 -- start start 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f589829db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379de950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f589829db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379489f0 0x5635379fa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f589829db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x563537a06070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f589829db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58841af1c0 con 0x5635379489f0 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f589829db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f58841aca50 con 0x5635379e62c0 2024-05-27T09:49:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f589829db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f588410f040 con 0x56353785ce40 2024-05-27T09:49:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f5882000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379489f0 0x5635379fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f5882a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379de950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f5882a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379de950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39928/0 (socket says 172.21.15.71:39928) 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f5882a00700 1 -- 172.21.15.71:0/175959438 learned_addr learned my addr 172.21.15.71:0/175959438 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.679+0000 7f5883400700 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x563537a06070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f5882a00700 1 -- 172.21.15.71:0/175959438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 msgr2=0x563537a06070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f5882a00700 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x563537a06070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f5882a00700 1 -- 172.21.15.71:0/175959438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379489f0 msgr2=0x5635379fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f5882a00700 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379489f0 0x5635379fa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f5882a00700 1 -- 172.21.15.71:0/175959438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635379fbed0 con 0x56353785ce40 2024-05-27T09:49:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f5882a00700 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379de950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f58740a7570 tx=0x7f58740a62f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef52a9f47ae105cc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f586f400700 1 -- 172.21.15.71:0/175959438 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740c3020 con 0x56353785ce40 2024-05-27T09:49:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f586f400700 1 -- 172.21.15.71:0/175959438 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58740aa300 con 0x56353785ce40 2024-05-27T09:49:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.680+0000 7f586f400700 1 -- 172.21.15.71:0/175959438 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740a5c70 con 0x56353785ce40 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.681+0000 7f589829db80 1 -- 172.21.15.71:0/175959438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 msgr2=0x5635379de950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.681+0000 7f589829db80 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379de950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f58740a7570 tx=0x7f58740a62f0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 -- 172.21.15.71:0/175959438 shutdown_connections 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379e62c0 0x563537a06070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379de950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 --2- 172.21.15.71:0/175959438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379489f0 0x5635379fa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 -- 172.21.15.71:0/175959438 >> 172.21.15.71:0/175959438 conn(0x5635378f6390 msgr2=0x5635379de240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 -- 172.21.15.71:0/175959438 shutdown_connections 2024-05-27T09:49:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 -- 172.21.15.71:0/175959438 wait complete. 2024-05-27T09:49:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.682+0000 7f589829db80 1 -- start start 2024-05-27T09:49:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 1 Processor -- start 2024-05-27T09:49:24.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379489f0 0x5635379f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379e62c0 0x563537a66f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58841aaf10 con 0x5635379e62c0 2024-05-27T09:49:24.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f58841ac380 con 0x5635379489f0 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58841ab5e0 con 0x56353785ce40 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.683+0000 7f589829db80 10 client.0 _ll_register_callbacks cb 0x5635378a3c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379489f0 0x5635379f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5883400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379e62c0 0x563537a66f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379489f0 0x5635379f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40744/0 (socket says 172.21.15.71:40744) 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 -- 172.21.15.71:0/664893250 learned_addr learned my addr 172.21.15.71:0/664893250 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 -- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 msgr2=0x5635379f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379f15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 -- 172.21.15.71:0/664893250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379e62c0 msgr2=0x563537a66f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379e62c0 0x563537a66f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 -- 172.21.15.71:0/664893250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635379e4240 con 0x5635379489f0 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882a00700 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f5882000700 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379489f0 0x5635379f1b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f5870004510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef865c1afe22f19 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.684+0000 7f586cc00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.685+0000 7f586cc00700 1 -- 172.21.15.71:0/664893250 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870027040 con 0x5635379489f0 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.685+0000 7f586cc00700 1 -- 172.21.15.71:0/664893250 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5870003c20 con 0x5635379489f0 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.685+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58740aa300 con 0x5635379489f0 2024-05-27T09:49:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.685+0000 7f586cc00700 1 -- 172.21.15.71:0/664893250 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5870003e60 con 0x5635379489f0 2024-05-27T09:49:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.685+0000 7f589829db80 10 client.25595 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.685+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563537a682e0 con 0x5635379489f0 2024-05-27T09:49:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.685+0000 7f586cc00700 1 -- 172.21.15.71:0/664893250 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58740aa300 con 0x5635379489f0 2024-05-27T09:49:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f586cc00700 1 -- 172.21.15.71:0/664893250 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f587002a070 con 0x5635379489f0 2024-05-27T09:49:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f589829db80 10 client.25595 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f589829db80 10 client.25595 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f589829db80 20 client.25595 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f589829db80 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x563537a68a70 0x563537a6ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f589829db80 4 client.25595 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563537905570 con 0x563537a68a70 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.686+0000 7f5882a00700 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x563537a68a70 0x563537a6ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.687+0000 7f5882a00700 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x563537a68a70 0x563537a6ae90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6596956a6bfe60bc server_cookie=d8e65e3e14d466e5 in_seq=0 out_seq=0 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.687+0000 7f586cc00700 10 client.25595 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.687+0000 7f586cc00700 1 -- 172.21.15.71:0/664893250 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563537905570 con 0x563537a68a70 2024-05-27T09:49:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.687+0000 7f586cc00700 10 client.25595 handle_command_reply: tid=0 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.687+0000 7f589829db80 1 client.25595 shutdown 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.687+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379489f0 msgr2=0x5635379f1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.687+0000 7f589829db80 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379489f0 0x5635379f1b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f5870004510 comp rx=0 tx=0).stop 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 shutdown_connections 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x563537a68a70 0x563537a6ae90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635379e62c0 0x563537a66f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56353785ce40 0x5635379f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 --2- 172.21.15.71:0/664893250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5635379489f0 0x5635379f1b20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 >> 172.21.15.71:0/664893250 conn(0x5635378f6390 msgr2=0x5635379db120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f586cc00700 0 client.25595 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 shutdown_connections 2024-05-27T09:49:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 1 -- 172.21.15.71:0/664893250 wait complete. 2024-05-27T09:49:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.688+0000 7f589829db80 20 client.25595 trim_cache size 0 max 16384 2024-05-27T09:49:24.692 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:49:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f58680b29f0 msgr2=0x7f58680b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f58680b29f0 0x7f58680b4f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f587c009ec0 tx=0x7f587c009920 comp rx=0 tx=0).stop 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58841043f0 msgr2=0x7f588419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58841043f0 0x7f588419cea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5874006010 tx=0x7f5874005280 comp rx=0 tx=0).stop 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 shutdown_connections 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f58680b29f0 0x7f58680b4f00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5884109670 0x7f58841a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58841043f0 0x7f588419cea0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 --2- 172.21.15.71:0/1546061418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5884108d20 0x7f588419d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 >> 172.21.15.71:0/1546061418 conn(0x7f5884079d00 msgr2=0x7f5884101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 shutdown_connections 2024-05-27T09:49:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:24.689+0000 7f5883e00700 1 -- 172.21.15.71:0/1546061418 wait complete. 2024-05-27T09:49:24.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:24 smithi122 ceph-mon[36436]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-27T09:49:25.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:24 smithi071 ceph-mon[31451]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-27T09:49:25.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:24 smithi072 ceph-mon[35951]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-27T09:49:25.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-27T09:49:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.192+0000 7f0516800640 1 -- 172.21.15.71:0/1914432469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 msgr2=0x7f0510105870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.192+0000 7f0516800640 1 --2- 172.21.15.71:0/1914432469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 0x7f0510105870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0504009860 tx=0x7f050402a340 comp rx=0 tx=0).stop 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.192+0000 7f0516800640 1 -- 172.21.15.71:0/1914432469 shutdown_connections 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.192+0000 7f0516800640 1 --2- 172.21.15.71:0/1914432469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 0x7f05101127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.192+0000 7f0516800640 1 --2- 172.21.15.71:0/1914432469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f051010c170 0x7f0510105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.192+0000 7f0516800640 1 --2- 172.21.15.71:0/1914432469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 0x7f0510105870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.193+0000 7f0516800640 1 -- 172.21.15.71:0/1914432469 >> 172.21.15.71:0/1914432469 conn(0x7f05101013d0 msgr2=0x7f0510103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.193+0000 7f0516800640 1 -- 172.21.15.71:0/1914432469 shutdown_connections 2024-05-27T09:49:26.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.193+0000 7f0516800640 1 -- 172.21.15.71:0/1914432469 wait complete. 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.194+0000 7f0516800640 1 Processor -- start 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.194+0000 7f0516800640 1 -- start start 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.194+0000 7f0516800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 0x7f05101a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0516800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 0x7f05101a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0516800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f051010c170 0x7f051019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0516800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0510115ea0 con 0x7f051010c170 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0516800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0510115d20 con 0x7f0510106420 2024-05-27T09:49:26.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0516800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0510116020 con 0x7f051010bcd0 2024-05-27T09:49:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 0x7f05101a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f051010c170 0x7f051019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0514a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 0x7f05101a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 0x7f05101a25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40764/0 (socket says 172.21.15.71:40764) 2024-05-27T09:49:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 -- 172.21.15.71:0/2250922177 learned_addr learned my addr 172.21.15.71:0/2250922177 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 -- 172.21.15.71:0/2250922177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 msgr2=0x7f05101a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 0x7f05101a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 -- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f051010c170 msgr2=0x7f051019c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f051010c170 0x7f051019c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.195+0000 7f0515400640 1 -- 172.21.15.71:0/2250922177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051019ce50 con 0x7f0510106420 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.196+0000 7f0514a00640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 0x7f05101a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.196+0000 7f0515400640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 0x7f05101a25a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504032d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.196+0000 7f050e000640 1 -- 172.21.15.71:0/2250922177 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504040020 con 0x7f0510106420 2024-05-27T09:49:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.196+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051019d080 con 0x7f0510106420 2024-05-27T09:49:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.196+0000 7f050e000640 1 -- 172.21.15.71:0/2250922177 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0504030e10 con 0x7f0510106420 2024-05-27T09:49:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.196+0000 7f050e000640 1 -- 172.21.15.71:0/2250922177 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504037040 con 0x7f0510106420 2024-05-27T09:49:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.196+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05101a9340 con 0x7f0510106420 2024-05-27T09:49:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 Processor -- start 2024-05-27T09:49:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 -- start start 2024-05-27T09:49:26.201 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f050e000640 1 -- 172.21.15.71:0/2250922177 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0504043020 con 0x7f0510106420 2024-05-27T09:49:26.201 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974d81b0 0x56449787aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.201 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974af2f0 0x56449787afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x56449787b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5644977ebb90 con 0x5644974af2f0 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5644977db730 con 0x5644974b74d0 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.200+0000 7f051ede5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644977df770 con 0x5644974d81b0 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974d81b0 0x56449787aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974af2f0 0x56449787afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974d81b0 0x56449787aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39966/0 (socket says 172.21.15.71:39966) 2024-05-27T09:49:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 -- 172.21.15.71:0/3680775084 learned_addr learned my addr 172.21.15.71:0/3680775084 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0514a00640 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x56449787b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 -- 172.21.15.71:0/3680775084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 msgr2=0x56449787b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x56449787b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 -- 172.21.15.71:0/3680775084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974af2f0 msgr2=0x56449787afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974af2f0 0x56449787afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0515e00640 1 -- 172.21.15.71:0/3680775084 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644977748b0 con 0x5644974d81b0 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.201+0000 7f0514a00640 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x56449787b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.202+0000 7f0515e00640 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974d81b0 0x56449787aa60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0508009fd0 tx=0x7f05080118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f8f137416520844 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.202+0000 7f0502600640 1 -- 172.21.15.71:0/3680775084 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508004d20 con 0x5644974d81b0 2024-05-27T09:49:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.202+0000 7f0502600640 1 -- 172.21.15.71:0/3680775084 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0508004050 con 0x5644974d81b0 2024-05-27T09:49:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.202+0000 7f0502600640 1 -- 172.21.15.71:0/3680775084 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508005240 con 0x5644974d81b0 2024-05-27T09:49:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.203+0000 7f050e000640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04f80b29d0 0x7f04f80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.203+0000 7f0515400640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04f80b29d0 0x7f04f80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.203+0000 7f050e000640 1 -- 172.21.15.71:0/2250922177 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f0504102120 con 0x7f0510106420 2024-05-27T09:49:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.203+0000 7f051ede5740 1 -- 172.21.15.71:0/3680775084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974d81b0 msgr2=0x56449787aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.203+0000 7f051ede5740 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974d81b0 0x56449787aa60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0508009fd0 tx=0x7f05080118d0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f051ede5740 1 -- 172.21.15.71:0/3680775084 shutdown_connections 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f051ede5740 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x56449787b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f051ede5740 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974af2f0 0x56449787afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f051ede5740 1 --2- 172.21.15.71:0/3680775084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974d81b0 0x56449787aa60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f051ede5740 1 -- 172.21.15.71:0/3680775084 >> 172.21.15.71:0/3680775084 conn(0x5644974cc300 msgr2=0x564497877210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f051ede5740 1 -- 172.21.15.71:0/3680775084 shutdown_connections 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f0515400640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04f80b29d0 0x7f04f80b4ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564497878550 tx=0x7f0504105bd0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.204+0000 7f051ede5740 1 -- 172.21.15.71:0/3680775084 wait complete. 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.205+0000 7f051ede5740 1 -- start start 2024-05-27T09:49:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.205+0000 7f051ede5740 1 Processor -- start 2024-05-27T09:49:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f051ede5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497884ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f051ede5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974b74d0 0x564497885420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f051ede5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974d81b0 0x5644978996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f051ede5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5644974c1790 con 0x5644974b74d0 2024-05-27T09:49:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f051ede5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564497783bc0 con 0x5644974d81b0 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f051ede5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644978903a0 con 0x5644974af2f0 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f051ede5740 10 client.0 _ll_register_callbacks cb 0x564497761400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f0514a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974b74d0 0x564497885420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f0514a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974b74d0 0x564497885420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39514/0 (socket says 172.21.15.71:39514) 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.206+0000 7f0514a00640 1 -- 172.21.15.71:0/1103697737 learned_addr learned my addr 172.21.15.71:0/1103697737 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0515e00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497884ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0515e00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974d81b0 0x5644978996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0514a00640 1 -- 172.21.15.71:0/1103697737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 msgr2=0x564497884ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0514a00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497884ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0514a00640 1 -- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974d81b0 msgr2=0x5644978996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0514a00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974d81b0 0x5644978996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0514a00640 1 -- 172.21.15.71:0/1103697737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644974f0210 con 0x5644974b74d0 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0515e00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974d81b0 0x5644978996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f0514a00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974b74d0 0x564497885420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fd0 tx=0x7f04fc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee99d29baf5b691 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.207+0000 7f04f6a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.208+0000 7f04f6a00640 1 -- 172.21.15.71:0/1103697737 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc01c5f0 con 0x5644974b74d0 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.208+0000 7f04f6a00640 1 -- 172.21.15.71:0/1103697737 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f04fc01c790 con 0x5644974b74d0 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.208+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0508004050 con 0x5644974b74d0 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.208+0000 7f04f6a00640 1 -- 172.21.15.71:0/1103697737 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f04fc01c990 con 0x5644974b74d0 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.208+0000 7f051ede5740 10 client.15498 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.208+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5644975bc620 con 0x5644974b74d0 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.208+0000 7f04f6a00640 1 -- 172.21.15.71:0/1103697737 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0508004050 con 0x5644974b74d0 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f04f6a00640 1 -- 172.21.15.71:0/1103697737 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f04fc025c00 con 0x5644974b74d0 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f051ede5740 10 client.15498 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f051ede5740 10 client.15498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f051ede5740 20 client.15498 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f051ede5740 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564497496d80 0x56449789f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f051ede5740 4 client.15498 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644977edae0 con 0x564497496d80 2024-05-27T09:49:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.209+0000 7f0515e00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564497496d80 0x56449789f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.210+0000 7f04f6a00640 10 client.15498 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.210+0000 7f0515e00640 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564497496d80 0x56449789f770 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d312abef9164aaba server_cookie=908ffb3df731b9c0 in_seq=0 out_seq=0 2024-05-27T09:49:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f04f6a00640 1 -- 172.21.15.71:0/1103697737 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5644977edae0 con 0x564497496d80 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f04f6a00640 10 client.15498 handle_command_reply: tid=0 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 client.15498 shutdown 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974b74d0 msgr2=0x564497885420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974b74d0 0x564497885420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fd0 tx=0x7f04fc0107a0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 shutdown_connections 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974d81b0 0x5644978996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564497496d80 0x56449789f770 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974b74d0 0x564497885420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 --2- 172.21.15.71:0/1103697737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497884ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f04f6a00640 0 client.15498 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 >> 172.21.15.71:0/1103697737 conn(0x5644974cc300 msgr2=0x56449787a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.211+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 shutdown_connections 2024-05-27T09:49:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.212+0000 7f051ede5740 1 -- 172.21.15.71:0/1103697737 wait complete. 2024-05-27T09:49:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.212+0000 7f051ede5740 20 client.15498 trim_cache size 0 max 16384 2024-05-27T09:49:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.233+0000 7f051ede5740 1 Processor -- start 2024-05-27T09:49:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.233+0000 7f051ede5740 1 -- start start 2024-05-27T09:49:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f051ede5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974af2f0 0x5644978804e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f051ede5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974b74d0 0x56449787eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f051ede5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497899440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f051ede5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05101afff0 con 0x5644974d81b0 2024-05-27T09:49:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f051ede5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f05101ad8c0 con 0x5644974af2f0 2024-05-27T09:49:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f051ede5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05101ab750 con 0x5644974b74d0 2024-05-27T09:49:26.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f0515e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974af2f0 0x5644978804e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f0514a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974b74d0 0x56449787eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f0515e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974af2f0 0x5644978804e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40786/0 (socket says 172.21.15.71:40786) 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f0515e00640 1 -- 172.21.15.71:0/1322241598 learned_addr learned my addr 172.21.15.71:0/1322241598 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.234+0000 7f0515e00640 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497899440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0514a00640 1 -- 172.21.15.71:0/1322241598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974af2f0 msgr2=0x5644978804e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0514a00640 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974af2f0 0x5644978804e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0514a00640 1 -- 172.21.15.71:0/1322241598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 msgr2=0x564497899440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0514a00640 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497899440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0514a00640 1 -- 172.21.15.71:0/1322241598 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564497883220 con 0x5644974b74d0 2024-05-27T09:49:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0514a00640 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974b74d0 0x56449787eef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f04fc011010 tx=0x7f04fc009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2f95ff9d862d4d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:26.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0501c00640 1 -- 172.21.15.71:0/1322241598 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc000e60 con 0x5644974b74d0 2024-05-27T09:49:26.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0501c00640 1 -- 172.21.15.71:0/1322241598 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04fc01cd30 con 0x5644974b74d0 2024-05-27T09:49:26.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.235+0000 7f0501c00640 1 -- 172.21.15.71:0/1322241598 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc005650 con 0x5644974b74d0 2024-05-27T09:49:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 -- 172.21.15.71:0/1322241598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974b74d0 msgr2=0x56449787eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974b74d0 0x56449787eef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f04fc011010 tx=0x7f04fc009f60 comp rx=0 tx=0).stop 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 -- 172.21.15.71:0/1322241598 shutdown_connections 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497899440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974b74d0 0x56449787eef0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 --2- 172.21.15.71:0/1322241598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974af2f0 0x5644978804e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 -- 172.21.15.71:0/1322241598 >> 172.21.15.71:0/1322241598 conn(0x5644974cc300 msgr2=0x564497875810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.236+0000 7f051ede5740 1 -- 172.21.15.71:0/1322241598 shutdown_connections 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.237+0000 7f051ede5740 1 -- 172.21.15.71:0/1322241598 wait complete. 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.237+0000 7f051ede5740 1 -- start start 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.237+0000 7f051ede5740 1 Processor -- start 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f051ede5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497890c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f051ede5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x564497891150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f051ede5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497905da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f051ede5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05101abda0 con 0x5644974d81b0 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f051ede5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f05101ad1f0 con 0x5644974b74d0 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f051ede5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05101ac450 con 0x5644974af2f0 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f051ede5740 10 client.0 _ll_register_callbacks cb 0x7f04fc009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x564497891150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0515e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497890c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x564497891150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40790/0 (socket says 172.21.15.71:40790) 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 -- 172.21.15.71:0/2882751502 learned_addr learned my addr 172.21.15.71:0/2882751502 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0515e00640 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497905da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 -- 172.21.15.71:0/2882751502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 msgr2=0x564497890c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497890c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 -- 172.21.15.71:0/2882751502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 msgr2=0x564497905da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497905da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0514a00640 1 -- 172.21.15.71:0/2882751502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644979062e0 con 0x5644974b74d0 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.238+0000 7f0515e00640 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497905da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.239+0000 7f0514a00640 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x564497891150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04fc01e040 tx=0x7f04fc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e140f38559a371 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.239+0000 7f04f6a00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.239+0000 7f04f6a00640 1 -- 172.21.15.71:0/2882751502 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc033070 con 0x5644974b74d0 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.239+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04fc01cd30 con 0x5644974b74d0 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.239+0000 7f04f6a00640 1 -- 172.21.15.71:0/2882751502 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f04fc005240 con 0x5644974b74d0 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.239+0000 7f04f6a00640 1 -- 172.21.15.71:0/2882751502 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f04fc01c7f0 con 0x5644974b74d0 2024-05-27T09:49:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 10 client.25610 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5644979074e0 con 0x5644974b74d0 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f04f6a00640 1 -- 172.21.15.71:0/2882751502 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04fc01cd30 con 0x5644974b74d0 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f04f6a00640 1 -- 172.21.15.71:0/2882751502 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f04fc02e070 con 0x5644974b74d0 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 10 client.25610 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 20 client.25610 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56449746c1c0 0x564497909be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 4 client.25610 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.240+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644977e72c0 con 0x56449746c1c0 2024-05-27T09:49:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.241+0000 7f0515e00640 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56449746c1c0 0x564497909be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.241+0000 7f04f6a00640 10 client.25610 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.241+0000 7f0515e00640 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56449746c1c0 0x564497909be0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7690e4696ac5c4dc server_cookie=dfe9ea006c5f5bd0 in_seq=0 out_seq=0 2024-05-27T09:49:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.247+0000 7f04f6a00640 1 -- 172.21.15.71:0/2882751502 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5644977e72c0 con 0x56449746c1c0 2024-05-27T09:49:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.247+0000 7f04f6a00640 10 client.25610 handle_command_reply: tid=0 2024-05-27T09:49:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.247+0000 7f051ede5740 1 client.25610 shutdown 2024-05-27T09:49:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 msgr2=0x564497891150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x564497891150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04fc01e040 tx=0x7f04fc01c3f0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 shutdown_connections 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56449746c1c0 0x564497909be0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5644974d81b0 0x564497905da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644974b74d0 0x564497891150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f04f6a00640 0 client.25610 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 --2- 172.21.15.71:0/2882751502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644974af2f0 0x564497890c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 >> 172.21.15.71:0/2882751502 conn(0x5644974cc300 msgr2=0x564497876240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 shutdown_connections 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 1 -- 172.21.15.71:0/2882751502 wait complete. 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.248+0000 7f051ede5740 20 client.25610 trim_cache size 0 max 16384 2024-05-27T09:49:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:49:26.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:49:26.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:49:26.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04f80b29d0 msgr2=0x7f04f80b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04f80b29d0 0x7f04f80b4ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564497878550 tx=0x7f0504105bd0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 msgr2=0x7f05101a25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 0x7f05101a25a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504032d40 comp rx=0 tx=0).stop 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 shutdown_connections 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04f80b29d0 0x7f04f80b4ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f051010c170 0x7f051019c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051010bcd0 0x7f05101a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 --2- 172.21.15.71:0/2250922177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0510106420 0x7f05101a25a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 >> 172.21.15.71:0/2250922177 conn(0x7f05101013d0 msgr2=0x7f05101017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 shutdown_connections 2024-05-27T09:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:26.249+0000 7f0516800640 1 -- 172.21.15.71:0/2250922177 wait complete. 2024-05-27T09:49:26.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:26 smithi122 ceph-mon[36436]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-27T09:49:27.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:26 smithi071 ceph-mon[31451]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-27T09:49:27.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:26 smithi072 ceph-mon[35951]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-27T09:49:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 -- 172.21.15.71:0/1729603396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c105300 msgr2=0x7f8a7c105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 --2- 172.21.15.71:0/1729603396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c105300 0x7f8a7c105710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400b0a0 tx=0x7f8a7400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 -- 172.21.15.71:0/1729603396 shutdown_connections 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 --2- 172.21.15.71:0/1729603396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a7c10e730 0x7f8a7c110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 --2- 172.21.15.71:0/1729603396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c105300 0x7f8a7c105710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 --2- 172.21.15.71:0/1729603396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105c50 0x7f8a7c10e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 -- 172.21.15.71:0/1729603396 >> 172.21.15.71:0/1729603396 conn(0x7f8a7c078ab0 msgr2=0x7f8a7c078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 -- 172.21.15.71:0/1729603396 shutdown_connections 2024-05-27T09:49:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.544+0000 7f8a82000700 1 -- 172.21.15.71:0/1729603396 wait complete. 2024-05-27T09:49:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.545+0000 7f8a82000700 1 Processor -- start 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a82000700 1 -- start start 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a82000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105300 0x7f8a7c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a82000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a7c105c50 0x7f8a7c19d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a82000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c10e730 0x7f8a7c1a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a82000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c114290 con 0x7f8a7c10e730 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a82000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c114110 con 0x7f8a7c105300 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a82000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c114410 con 0x7f8a7c105c50 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.546+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105300 0x7f8a7c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a81600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c10e730 0x7f8a7c1a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105300 0x7f8a7c19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40808/0 (socket says 172.21.15.71:40808) 2024-05-27T09:49:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 -- 172.21.15.71:0/1775878826 learned_addr learned my addr 172.21.15.71:0/1775878826 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 -- 172.21.15.71:0/1775878826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a7c105c50 msgr2=0x7f8a7c19d3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T09:49:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a7c105c50 0x7f8a7c19d3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 -- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c10e730 msgr2=0x7f8a7c1a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c10e730 0x7f8a7c1a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 -- 172.21.15.71:0/1775878826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c1a1cf0 con 0x7f8a7c105300 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.547+0000 7f8a80c00700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105300 0x7f8a7c19ce20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400d010 tx=0x7f8a74004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.548+0000 7f8a79600700 1 -- 172.21.15.71:0/1775878826 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74021070 con 0x7f8a7c105300 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.548+0000 7f8a79600700 1 -- 172.21.15.71:0/1775878826 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a74007c40 con 0x7f8a7c105300 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.548+0000 7f8a79600700 1 -- 172.21.15.71:0/1775878826 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74004710 con 0x7f8a7c105300 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.548+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c1a1f80 con 0x7f8a7c105300 2024-05-27T09:49:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.548+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c1a2470 con 0x7f8a7c105300 2024-05-27T09:49:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.552+0000 7f8a79600700 1 -- 172.21.15.71:0/1775878826 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f8a74003a00 con 0x7f8a7c105300 2024-05-27T09:49:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 Processor -- start 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 -- start start 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a79600700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8a600b29f0 0x7f8a600b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a79600700 1 -- 172.21.15.71:0/1775878826 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8a7400f020 con 0x7f8a7c105300 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c37ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38410 0x5577e5c42ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c45020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5577e5b66e40 con 0x5577e5ab9e40 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5577e5b569e0 con 0x5577e5c38820 2024-05-27T09:49:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.554+0000 7f8a92118b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5577e5b5aa20 con 0x5577e5c38410 2024-05-27T09:49:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a81600700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8a600b29f0 0x7f8a600b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38410 0x5577e5c42ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38410 0x5577e5c42ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40014/0 (socket says 172.21.15.71:40014) 2024-05-27T09:49:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c37ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 -- 172.21.15.71:0/1943727996 learned_addr learned my addr 172.21.15.71:0/1943727996 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:28.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 -- 172.21.15.71:0/1943727996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 msgr2=0x5577e5c45020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c45020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 -- 172.21.15.71:0/1943727996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 msgr2=0x5577e5c37ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c37ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a7be00700 1 -- 172.21.15.71:0/1943727996 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577e5b1f420 con 0x5577e5c38410 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.555+0000 7f8a80c00700 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c37ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.556+0000 7f8a7be00700 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38410 0x5577e5c42ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009c00 tx=0x7f8a64009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65bee3e697ce84bd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.556+0000 7f8a81600700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8a600b29f0 0x7f8a600b4f00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009bf0 tx=0x7f8a6c011440 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.556+0000 7f8a72000700 1 -- 172.21.15.71:0/1943727996 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400eb90 con 0x5577e5c38410 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.556+0000 7f8a72000700 1 -- 172.21.15.71:0/1943727996 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6400ed30 con 0x5577e5c38410 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.556+0000 7f8a72000700 1 -- 172.21.15.71:0/1943727996 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640056c0 con 0x5577e5c38410 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 -- 172.21.15.71:0/1943727996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38410 msgr2=0x5577e5c42ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38410 0x5577e5c42ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009c00 tx=0x7f8a64009f10 comp rx=0 tx=0).stop 2024-05-27T09:49:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 -- 172.21.15.71:0/1943727996 shutdown_connections 2024-05-27T09:49:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c45020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c37ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1943727996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38410 0x5577e5c42ad0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 -- 172.21.15.71:0/1943727996 >> 172.21.15.71:0/1943727996 conn(0x5577e5b19fc0 msgr2=0x5577e5c33d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 -- 172.21.15.71:0/1943727996 shutdown_connections 2024-05-27T09:49:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.557+0000 7f8a92118b80 1 -- 172.21.15.71:0/1943727996 wait complete. 2024-05-27T09:49:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.558+0000 7f8a92118b80 1 -- start start 2024-05-27T09:49:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.558+0000 7f8a92118b80 1 Processor -- start 2024-05-27T09:49:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5ab9e40 0x5577e5c425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c42b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c43040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a92118b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5577e5a5cfa0 con 0x5577e5c38410 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a92118b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5577e5af7760 con 0x5577e5c38820 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a92118b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5577e5c45990 con 0x5577e5ab9e40 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a92118b80 10 client.0 _ll_register_callbacks cb 0x5577e5b00c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a81600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c43040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5ab9e40 0x5577e5c425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a81600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c43040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40832/0 (socket says 172.21.15.71:40832) 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a81600700 1 -- 172.21.15.71:0/881048743 learned_addr learned my addr 172.21.15.71:0/881048743 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.559+0000 7f8a7be00700 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c42b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a80c00700 1 -- 172.21.15.71:0/881048743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 msgr2=0x5577e5c43040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a80c00700 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c43040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a80c00700 1 -- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 msgr2=0x5577e5c42b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a80c00700 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c42b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a80c00700 1 -- 172.21.15.71:0/881048743 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577e5aa68d0 con 0x5577e5ab9e40 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a81600700 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c43040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a80c00700 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5ab9e40 0x5577e5c425c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a740e1330 tx=0x7f8a740099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb8344655ff4835f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a6aa00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a6aa00700 1 -- 172.21.15.71:0/881048743 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740cd040 con 0x5577e5ab9e40 2024-05-27T09:49:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a6aa00700 1 -- 172.21.15.71:0/881048743 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8a740ab3c0 con 0x5577e5ab9e40 2024-05-27T09:49:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.560+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a6400ed30 con 0x5577e5ab9e40 2024-05-27T09:49:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.561+0000 7f8a6aa00700 1 -- 172.21.15.71:0/881048743 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a7406f050 con 0x5577e5ab9e40 2024-05-27T09:49:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.561+0000 7f8a92118b80 10 client.25639 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.561+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5577e5b27060 con 0x5577e5ab9e40 2024-05-27T09:49:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.561+0000 7f8a6aa00700 1 -- 172.21.15.71:0/881048743 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6400ed30 con 0x5577e5ab9e40 2024-05-27T09:49:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a6aa00700 1 -- 172.21.15.71:0/881048743 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f8a74011070 con 0x5577e5ab9e40 2024-05-27T09:49:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a92118b80 10 client.25639 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a92118b80 10 client.25639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:49:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a92118b80 20 client.25639 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a92118b80 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5c528f0 0x5577e5c54d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a92118b80 4 client.25639 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577e5b68d90 con 0x5577e5c528f0 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.562+0000 7f8a7be00700 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5c528f0 0x5577e5c54d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.563+0000 7f8a6aa00700 10 client.25639 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.563+0000 7f8a7be00700 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5c528f0 0x5577e5c54d50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4f3acb87fd51da2 server_cookie=75a50afa76551cd4 in_seq=0 out_seq=0 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a6aa00700 1 -- 172.21.15.71:0/881048743 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5577e5b68d90 con 0x5577e5c528f0 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a6aa00700 10 client.25639 handle_command_reply: tid=0 2024-05-27T09:49:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 client.25639 shutdown 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5ab9e40 msgr2=0x5577e5c425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5ab9e40 0x5577e5c425c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a740e1330 tx=0x7f8a740099e0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 shutdown_connections 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5c528f0 0x5577e5c54d50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38820 0x5577e5c43040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5ab9e40 0x5577e5c425c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 --2- 172.21.15.71:0/881048743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c42b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.564+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 >> 172.21.15.71:0/881048743 conn(0x5577e5b19fc0 msgr2=0x5577e5c32ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.565+0000 7f8a6aa00700 0 client.25639 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.565+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 shutdown_connections 2024-05-27T09:49:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.565+0000 7f8a92118b80 1 -- 172.21.15.71:0/881048743 wait complete. 2024-05-27T09:49:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.565+0000 7f8a92118b80 20 client.25639 trim_cache size 0 max 16384 2024-05-27T09:49:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 Processor -- start 2024-05-27T09:49:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 -- start start 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5ab9e40 0x5577e5c41520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c3dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c4ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b3640 con 0x5577e5c38410 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b0ed0 con 0x5577e5ab9e40 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.582+0000 7f8a92118b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1aed40 con 0x5577e5c38820 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a7be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c3dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5ab9e40 0x5577e5c41520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a7be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c3dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39562/0 (socket says 172.21.15.71:39562) 2024-05-27T09:49:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5ab9e40 0x5577e5c41520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40846/0 (socket says 172.21.15.71:40846) 2024-05-27T09:49:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a7be00700 1 -- 172.21.15.71:0/1367884473 learned_addr learned my addr 172.21.15.71:0/1367884473 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a81600700 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c4ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a80c00700 1 -- 172.21.15.71:0/1367884473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 msgr2=0x5577e5c4ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a80c00700 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c4ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a80c00700 1 -- 172.21.15.71:0/1367884473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 msgr2=0x5577e5c3dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a80c00700 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c3dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a80c00700 1 -- 172.21.15.71:0/1367884473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577e5c341f0 con 0x5577e5ab9e40 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.583+0000 7f8a81600700 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c4ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.584+0000 7f8a80c00700 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5ab9e40 0x5577e5c41520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a740062a0 tx=0x7f8a740097e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54570b086bcfe711 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.584+0000 7f8a71600700 1 -- 172.21.15.71:0/1367884473 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740aaa60 con 0x5577e5ab9e40 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.584+0000 7f8a71600700 1 -- 172.21.15.71:0/1367884473 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740ab650 con 0x5577e5ab9e40 2024-05-27T09:49:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.584+0000 7f8a71600700 1 -- 172.21.15.71:0/1367884473 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740a68c0 con 0x5577e5ab9e40 2024-05-27T09:49:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 -- 172.21.15.71:0/1367884473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5ab9e40 msgr2=0x5577e5c41520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5ab9e40 0x5577e5c41520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a740062a0 tx=0x7f8a740097e0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 -- 172.21.15.71:0/1367884473 shutdown_connections 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c4ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5ab9e40 0x5577e5c41520 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 --2- 172.21.15.71:0/1367884473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5c38410 0x5577e5c3dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 -- 172.21.15.71:0/1367884473 >> 172.21.15.71:0/1367884473 conn(0x5577e5b19fc0 msgr2=0x5577e5c423a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.585+0000 7f8a92118b80 1 -- 172.21.15.71:0/1367884473 shutdown_connections 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.586+0000 7f8a92118b80 1 -- 172.21.15.71:0/1367884473 wait complete. 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.586+0000 7f8a92118b80 1 -- start start 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.586+0000 7f8a92118b80 1 Processor -- start 2024-05-27T09:49:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c4ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38410 0x5577e5c4b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a92118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c46280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a92118b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1af390 con 0x5577e5ab9e40 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a92118b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b0800 con 0x5577e5c38410 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a92118b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1afa60 con 0x5577e5c38820 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a92118b80 10 client.0 _ll_register_callbacks cb 0x5577e5b00c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c4ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a7be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38410 0x5577e5c4b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a7be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38410 0x5577e5c4b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40858/0 (socket says 172.21.15.71:40858) 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a7be00700 1 -- 172.21.15.71:0/969671778 learned_addr learned my addr 172.21.15.71:0/969671778 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a81600700 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c46280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.587+0000 7f8a80c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c4ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39578/0 (socket says 172.21.15.71:39578) 2024-05-27T09:49:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.588+0000 7f8a7be00700 1 -- 172.21.15.71:0/969671778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 msgr2=0x5577e5c46280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.588+0000 7f8a7be00700 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c46280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.588+0000 7f8a7be00700 1 -- 172.21.15.71:0/969671778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 msgr2=0x5577e5c4ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.588+0000 7f8a7be00700 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c4ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.588+0000 7f8a7be00700 1 -- 172.21.15.71:0/969671778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577e5c46a20 con 0x5577e5c38410 2024-05-27T09:49:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.588+0000 7f8a7be00700 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38410 0x5577e5c4b3b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400e7e0 tx=0x7f8a6400ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd55d248656d55fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.588+0000 7f8a6aa00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a6aa00700 1 -- 172.21.15.71:0/969671778 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6401d040 con 0x5577e5c38410 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a740ab650 con 0x5577e5c38410 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a6aa00700 1 -- 172.21.15.71:0/969671778 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f8a640056e0 con 0x5577e5c38410 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a6aa00700 1 -- 172.21.15.71:0/969671778 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a6400ee20 con 0x5577e5c38410 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a92118b80 10 client.25625 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5577e5cbce90 con 0x5577e5c38410 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a6aa00700 1 -- 172.21.15.71:0/969671778 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740ab650 con 0x5577e5c38410 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.589+0000 7f8a6aa00700 1 -- 172.21.15.71:0/969671778 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f8a6402e4d0 con 0x5577e5c38410 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.590+0000 7f8a92118b80 10 client.25625 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.590+0000 7f8a92118b80 10 client.25625 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.590+0000 7f8a92118b80 20 client.25625 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.590+0000 7f8a92118b80 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5cbd430 0x5577e5cbf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.590+0000 7f8a92118b80 4 client.25625 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.590+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577e5b62570 con 0x5577e5cbd430 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.590+0000 7f8a80c00700 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5cbd430 0x5577e5cbf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a80c00700 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5cbd430 0x5577e5cbf850 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be1e1fd55f02446b server_cookie=45c4cf2660e5a125 in_seq=0 out_seq=0 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a6aa00700 10 client.25625 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a6aa00700 1 -- 172.21.15.71:0/969671778 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577e5b62570 con 0x5577e5cbd430 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a6aa00700 10 client.25625 handle_command_reply: tid=0 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 client.25625 shutdown 2024-05-27T09:49:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38410 msgr2=0x5577e5c4b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38410 0x5577e5c4b3b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400e7e0 tx=0x7f8a6400ebc0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 shutdown_connections 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5577e5cbd430 0x5577e5cbf850 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5577e5c38820 0x5577e5c46280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577e5ab9e40 0x5577e5c4ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 --2- 172.21.15.71:0/969671778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5577e5c38410 0x5577e5c4b3b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.591+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 >> 172.21.15.71:0/969671778 conn(0x5577e5b19fc0 msgr2=0x5577e5c42dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.592+0000 7f8a6aa00700 0 client.25625 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.592+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 shutdown_connections 2024-05-27T09:49:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.592+0000 7f8a92118b80 1 -- 172.21.15.71:0/969671778 wait complete. 2024-05-27T09:49:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.592+0000 7f8a92118b80 20 client.25625 trim_cache size 0 max 16384 2024-05-27T09:49:28.596 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:49:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8a600b29f0 msgr2=0x7f8a600b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8a600b29f0 0x7f8a600b4f00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009bf0 tx=0x7f8a6c011440 comp rx=0 tx=0).stop 2024-05-27T09:49:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105300 msgr2=0x7f8a7c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105300 0x7f8a7c19ce20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400d010 tx=0x7f8a74004d00 comp rx=0 tx=0).stop 2024-05-27T09:49:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 shutdown_connections 2024-05-27T09:49:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8a600b29f0 0x7f8a600b4f00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a7c10e730 0x7f8a7c1a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a7c105300 0x7f8a7c19ce20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 --2- 172.21.15.71:0/1775878826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a7c105c50 0x7f8a7c19d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 >> 172.21.15.71:0/1775878826 conn(0x7f8a7c078ab0 msgr2=0x7f8a7c102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 shutdown_connections 2024-05-27T09:49:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:28.593+0000 7f8a82000700 1 -- 172.21.15.71:0/1775878826 wait complete. 2024-05-27T09:49:28.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:28 smithi122 ceph-mon[36436]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-05-27T09:49:28.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:28 smithi071 ceph-mon[31451]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-05-27T09:49:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:28 smithi072 ceph-mon[35951]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-05-27T09:49:29.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-27T09:49:29.966 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:30 smithi122 ceph-mon[36436]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-27T09:49:31.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:30 smithi071 ceph-mon[31451]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-27T09:49:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:30 smithi072 ceph-mon[35951]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.440+0000 7f7327200700 1 -- 172.21.15.71:0/139716449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102ee0 msgr2=0x7f7328110f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.440+0000 7f7327200700 1 --2- 172.21.15.71:0/139716449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102ee0 0x7f7328110f70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f732000b0a0 tx=0x7f732000b3b0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.441+0000 7f7327200700 1 -- 172.21.15.71:0/139716449 shutdown_connections 2024-05-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.441+0000 7f7327200700 1 --2- 172.21.15.71:0/139716449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102ee0 0x7f7328110f70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.441+0000 7f7327200700 1 --2- 172.21.15.71:0/139716449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 0x7f7328109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.441+0000 7f7327200700 1 --2- 172.21.15.71:0/139716449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7328102590 0x7f73281029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.441+0000 7f7327200700 1 -- 172.21.15.71:0/139716449 >> 172.21.15.71:0/139716449 conn(0x7f73280783a0 msgr2=0x7f73280787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:32.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.441+0000 7f7327200700 1 -- 172.21.15.71:0/139716449 shutdown_connections 2024-05-27T09:49:32.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.442+0000 7f7327200700 1 -- 172.21.15.71:0/139716449 wait complete. 2024-05-27T09:49:32.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.443+0000 7f7327200700 1 Processor -- start 2024-05-27T09:49:32.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.443+0000 7f7327200700 1 -- start start 2024-05-27T09:49:32.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7327200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102590 0x7f732819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7327200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7328102ee0 0x7f732819d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7327200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 0x7f73281a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7327200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73281143f0 con 0x7f7328102590 2024-05-27T09:49:32.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7327200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7328114270 con 0x7f7328109100 2024-05-27T09:49:32.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7327200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7328114570 con 0x7f7328102ee0 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7326800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 0x7f73281a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7325400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7328102ee0 0x7f732819d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7325e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102590 0x7f732819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7325400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7328102ee0 0x7f732819d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40066/0 (socket says 172.21.15.71:40066) 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7326800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 0x7f73281a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40866/0 (socket says 172.21.15.71:40866) 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.444+0000 7f7325400700 1 -- 172.21.15.71:0/1050621496 learned_addr learned my addr 172.21.15.71:0/1050621496 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7326800700 1 -- 172.21.15.71:0/1050621496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7328102ee0 msgr2=0x7f732819d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7326800700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7328102ee0 0x7f732819d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7326800700 1 -- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102590 msgr2=0x7f732819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7326800700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102590 0x7f732819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7326800700 1 -- 172.21.15.71:0/1050621496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73281a1d50 con 0x7f7328109100 2024-05-27T09:49:32.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7326800700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 0x7f73281a16b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f732000b070 tx=0x7f7320004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:32.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f731ea00700 1 -- 172.21.15.71:0/1050621496 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320021070 con 0x7f7328109100 2024-05-27T09:49:32.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73281a1fe0 con 0x7f7328109100 2024-05-27T09:49:32.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f731ea00700 1 -- 172.21.15.71:0/1050621496 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7320007e30 con 0x7f7328109100 2024-05-27T09:49:32.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f731ea00700 1 -- 172.21.15.71:0/1050621496 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200045f0 con 0x7f7328109100 2024-05-27T09:49:32.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.445+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281a9960 con 0x7f7328109100 2024-05-27T09:49:32.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.449+0000 7f731ea00700 1 -- 172.21.15.71:0/1050621496 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f7320007980 con 0x7f7328109100 2024-05-27T09:49:32.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.450+0000 7f733b78db80 1 Processor -- start 2024-05-27T09:49:32.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.450+0000 7f733b78db80 1 -- start start 2024-05-27T09:49:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f733b78db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f733b78db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db593fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f733b78db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db594b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f733b78db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555db586ce40 con 0x555db57bfe40 2024-05-27T09:49:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f733b78db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555db585c9e0 con 0x555db59492c0 2024-05-27T09:49:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f733b78db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555db5860a20 con 0x555db58ab9f0 2024-05-27T09:49:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f731ea00700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f730c0b29f0 0x7f730c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f7325400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f731ea00700 1 -- 172.21.15.71:0/1050621496 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f732000f020 con 0x7f7328109100 2024-05-27T09:49:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f7325400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40070/0 (socket says 172.21.15.71:40070) 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f7325400700 1 -- 172.21.15.71:0/864729895 learned_addr learned my addr 172.21.15.71:0/864729895 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.451+0000 7f7325400700 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db594b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7325e00700 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db593fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7325400700 1 -- 172.21.15.71:0/864729895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db58ab9f0 msgr2=0x555db593f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7325400700 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7325400700 1 -- 172.21.15.71:0/864729895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 msgr2=0x555db593fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7325400700 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db593fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7326800700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f730c0b29f0 0x7f730c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7325400700 1 -- 172.21.15.71:0/864729895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db5825420 con 0x555db59492c0 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7325400700 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db594b6e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7314009fd0 tx=0x7f7314009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8237e96f409f9833 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.452+0000 7f7313400700 1 -- 172.21.15.71:0/864729895 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314004030 con 0x555db59492c0 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.453+0000 7f7313400700 1 -- 172.21.15.71:0/864729895 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7314004830 con 0x555db59492c0 2024-05-27T09:49:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.453+0000 7f7313400700 1 -- 172.21.15.71:0/864729895 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314005380 con 0x555db59492c0 2024-05-27T09:49:32.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 -- 172.21.15.71:0/864729895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 msgr2=0x555db594b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f7326800700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f730c0b29f0 0x7f730c0b4f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73200a6d20 tx=0x7f7320009040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db594b6e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7314009fd0 tx=0x7f7314009260 comp rx=0 tx=0).stop 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 -- 172.21.15.71:0/864729895 shutdown_connections 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db594b6e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 --2- 172.21.15.71:0/864729895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db593fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 -- 172.21.15.71:0/864729895 >> 172.21.15.71:0/864729895 conn(0x555db5859390 msgr2=0x555db593a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 -- 172.21.15.71:0/864729895 shutdown_connections 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 -- 172.21.15.71:0/864729895 wait complete. 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.454+0000 7f733b78db80 1 -- start start 2024-05-27T09:49:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 1 Processor -- start 2024-05-27T09:49:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db57bfe40 0x555db5946290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db59467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db5946d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555db5762fa0 con 0x555db58ab9f0 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555db57fd760 con 0x555db59492c0 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555db594be00 con 0x555db57bfe40 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.455+0000 7f733b78db80 10 client.0 _ll_register_callbacks cb 0x555db5806c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db59467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db59467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39622/0 (socket says 172.21.15.71:39622) 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 -- 172.21.15.71:0/836488517 learned_addr learned my addr 172.21.15.71:0/836488517 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325400700 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db57bfe40 0x555db5946290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325400700 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db5946d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 -- 172.21.15.71:0/836488517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db57bfe40 msgr2=0x555db5946290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db57bfe40 0x555db5946290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 -- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 msgr2=0x555db5946d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db5946d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.456+0000 7f7325e00700 1 -- 172.21.15.71:0/836488517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db57ac8d0 con 0x555db58ab9f0 2024-05-27T09:49:32.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f7325e00700 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db59467d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7318012700 tx=0x7f7318012a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef5dc6382db7054 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:32.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f7307e00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f7307e00700 1 -- 172.21.15.71:0/836488517 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318004050 con 0x555db58ab9f0 2024-05-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7314004830 con 0x555db58ab9f0 2024-05-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f7307e00700 1 -- 172.21.15.71:0/836488517 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f73180041f0 con 0x555db58ab9f0 2024-05-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f7307e00700 1 -- 172.21.15.71:0/836488517 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f73180043f0 con 0x555db58ab9f0 2024-05-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f733b78db80 10 client.15534 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.457+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555db582d060 con 0x555db58ab9f0 2024-05-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f7307e00700 1 -- 172.21.15.71:0/836488517 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7314004830 con 0x555db58ab9f0 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f7307e00700 1 -- 172.21.15.71:0/836488517 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f731800f6e0 con 0x555db58ab9f0 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f733b78db80 10 client.15534 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f733b78db80 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f733b78db80 20 client.15534 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f733b78db80 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db5958e50 0x555db595b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f733b78db80 4 client.15534 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.458+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555db586ed90 con 0x555db5958e50 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.459+0000 7f7325400700 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db5958e50 0x555db595b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.459+0000 7f7325400700 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db5958e50 0x555db595b2a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3015fc3226693113 server_cookie=b9a24ef3b7547a23 in_seq=0 out_seq=0 2024-05-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.459+0000 7f7307e00700 10 client.15534 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f7307e00700 1 -- 172.21.15.71:0/836488517 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x555db586ed90 con 0x555db5958e50 2024-05-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f7307e00700 10 client.15534 handle_command_reply: tid=0 2024-05-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 client.15534 shutdown 2024-05-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 msgr2=0x555db59467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db59467d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7318012700 tx=0x7f7318012a10 comp rx=0 tx=0).stop 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 shutdown_connections 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db5958e50 0x555db595b2a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db59492c0 0x555db5946d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db57bfe40 0x555db5946290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 --2- 172.21.15.71:0/836488517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db59467d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f7307e00700 0 client.15534 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.460+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 >> 172.21.15.71:0/836488517 conn(0x555db5859390 msgr2=0x555db593a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.461+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 shutdown_connections 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.461+0000 7f733b78db80 1 -- 172.21.15.71:0/836488517 wait complete. 2024-05-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.461+0000 7f733b78db80 20 client.15534 trim_cache size 0 max 16384 2024-05-27T09:49:32.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 Processor -- start 2024-05-27T09:49:32.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 -- start start 2024-05-27T09:49:32.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db57bfe40 0x555db5954f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db593fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73281af070 con 0x555db58ab9f0 2024-05-27T09:49:32.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f73281ac900 con 0x555db57bfe40 2024-05-27T09:49:32.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.484+0000 7f733b78db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f732810ed50 con 0x555db59492c0 2024-05-27T09:49:32.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db57bfe40 0x555db5954f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db57bfe40 0x555db5954f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40890/0 (socket says 172.21.15.71:40890) 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325400700 1 -- 172.21.15.71:0/1909155679 learned_addr learned my addr 172.21.15.71:0/1909155679 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325400700 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db593fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325e00700 1 -- 172.21.15.71:0/1909155679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 msgr2=0x555db593fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325e00700 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db593fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325e00700 1 -- 172.21.15.71:0/1909155679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db57bfe40 msgr2=0x555db5954f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325e00700 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db57bfe40 0x555db5954f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325e00700 1 -- 172.21.15.71:0/1909155679 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db593ac50 con 0x555db58ab9f0 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.485+0000 7f7325400700 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db593fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.486+0000 7f7325e00700 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db593f750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f731800fc50 tx=0x7f7318009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740155fab7640acb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:32.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.486+0000 7f7312a00700 1 -- 172.21.15.71:0/1909155679 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731802b040 con 0x555db58ab9f0 2024-05-27T09:49:32.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.486+0000 7f7312a00700 1 -- 172.21.15.71:0/1909155679 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f731800fcd0 con 0x555db58ab9f0 2024-05-27T09:49:32.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.486+0000 7f7312a00700 1 -- 172.21.15.71:0/1909155679 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731800e3b0 con 0x555db58ab9f0 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.487+0000 7f733b78db80 1 -- 172.21.15.71:0/1909155679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 msgr2=0x555db593f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.487+0000 7f733b78db80 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db593f750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f731800fc50 tx=0x7f7318009f50 comp rx=0 tx=0).stop 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.487+0000 7f733b78db80 1 -- 172.21.15.71:0/1909155679 shutdown_connections 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.487+0000 7f733b78db80 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db593fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.487+0000 7f733b78db80 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db57bfe40 0x555db5954f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.487+0000 7f733b78db80 1 --2- 172.21.15.71:0/1909155679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db58ab9f0 0x555db593f750 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.487+0000 7f733b78db80 1 -- 172.21.15.71:0/1909155679 >> 172.21.15.71:0/1909155679 conn(0x555db5859390 msgr2=0x555db5944b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.488+0000 7f733b78db80 1 -- 172.21.15.71:0/1909155679 shutdown_connections 2024-05-27T09:49:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.488+0000 7f733b78db80 1 -- 172.21.15.71:0/1909155679 wait complete. 2024-05-27T09:49:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.488+0000 7f733b78db80 1 -- start start 2024-05-27T09:49:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.488+0000 7f733b78db80 1 Processor -- start 2024-05-27T09:49:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f733b78db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db59bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f733b78db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db58ab9f0 0x555db59bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f733b78db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db594c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f733b78db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73281aadc0 con 0x555db57bfe40 2024-05-27T09:49:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f733b78db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f73281ac230 con 0x555db58ab9f0 2024-05-27T09:49:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f733b78db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73281ab490 con 0x555db59492c0 2024-05-27T09:49:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f733b78db80 10 client.0 _ll_register_callbacks cb 0x555db5806c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f7325400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db59bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f7325400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db59bbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39638/0 (socket says 172.21.15.71:39638) 2024-05-27T09:49:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f7325400700 1 -- 172.21.15.71:0/3472894662 learned_addr learned my addr 172.21.15.71:0/3472894662 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.489+0000 7f7325e00700 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db58ab9f0 0x555db59bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7325400700 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db594c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7325400700 1 -- 172.21.15.71:0/3472894662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 msgr2=0x555db594c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7325400700 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db594c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7325400700 1 -- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db58ab9f0 msgr2=0x555db59bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7325400700 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db58ab9f0 0x555db59bc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7325400700 1 -- 172.21.15.71:0/3472894662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db5956880 con 0x555db57bfe40 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7325400700 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db59bbc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7314009690 tx=0x7f7314009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8616b2ebe0208fa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7307e00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7307e00700 1 -- 172.21.15.71:0/3472894662 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314027040 con 0x555db57bfe40 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f7307e00700 1 -- 172.21.15.71:0/3472894662 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f7314004e80 con 0x555db57bfe40 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.490+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f731800fcd0 con 0x555db57bfe40 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f7307e00700 1 -- 172.21.15.71:0/3472894662 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7314047050 con 0x555db57bfe40 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 10 client.15540 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555db59c3110 con 0x555db57bfe40 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f7307e00700 1 -- 172.21.15.71:0/3472894662 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f731800fcd0 con 0x555db57bfe40 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f7307e00700 1 -- 172.21.15.71:0/3472894662 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f731401d030 con 0x555db57bfe40 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 10 client.15540 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 20 client.15540 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db59c34d0 0x555db59c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 4 client.15540 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.491+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555db5868570 con 0x555db59c34d0 2024-05-27T09:49:32.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.492+0000 7f7325e00700 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db59c34d0 0x555db59c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.492+0000 7f7325e00700 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db59c34d0 0x555db59c58f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db9c8e2c1805501f server_cookie=a72fac27b8e2b299 in_seq=0 out_seq=0 2024-05-27T09:49:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.492+0000 7f7307e00700 10 client.15540 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f7307e00700 1 -- 172.21.15.71:0/3472894662 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555db5868570 con 0x555db59c34d0 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f7307e00700 10 client.15540 handle_command_reply: tid=0 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 client.15540 shutdown 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 msgr2=0x555db59bbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db59bbc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7314009690 tx=0x7f7314009cb0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 shutdown_connections 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555db59c34d0 0x555db59c58f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555db59492c0 0x555db594c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555db57bfe40 0x555db59bbc20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 --2- 172.21.15.71:0/3472894662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555db58ab9f0 0x555db59bc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 >> 172.21.15.71:0/3472894662 conn(0x555db5859390 msgr2=0x555db593f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f7307e00700 0 client.15540 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 shutdown_connections 2024-05-27T09:49:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 1 -- 172.21.15.71:0/3472894662 wait complete. 2024-05-27T09:49:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.493+0000 7f733b78db80 20 client.15540 trim_cache size 0 max 16384 2024-05-27T09:49:32.496 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:49:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f730c0b29f0 msgr2=0x7f730c0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f730c0b29f0 0x7f730c0b4f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73200a6d20 tx=0x7f7320009040 comp rx=0 tx=0).stop 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 msgr2=0x7f73281a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 0x7f73281a16b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f732000b070 tx=0x7f7320004c80 comp rx=0 tx=0).stop 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 shutdown_connections 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f730c0b29f0 0x7f730c0b4f00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7328109100 0x7f73281a16b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7328102590 0x7f732819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 --2- 172.21.15.71:0/1050621496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7328102ee0 0x7f732819d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 >> 172.21.15.71:0/1050621496 conn(0x7f73280783a0 msgr2=0x7f73280ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.494+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 shutdown_connections 2024-05-27T09:49:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:32.495+0000 7f7327200700 1 -- 172.21.15.71:0/1050621496 wait complete. 2024-05-27T09:49:32.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:32 smithi071 ceph-mon[31451]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-05-27T09:49:32.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:32 smithi122 ceph-mon[36436]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-05-27T09:49:33.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:32 smithi072 ceph-mon[35951]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-05-27T09:49:34.550 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-27T09:49:34.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-27T09:49:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:34 smithi122 ceph-mon[36436]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:49:35.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:34 smithi071 ceph-mon[31451]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:49:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:34 smithi072 ceph-mon[35951]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:49:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:36.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:36 smithi071 ceph-mon[31451]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:49:36.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:36 smithi122 ceph-mon[36436]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:49:37.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:36 smithi072 ceph-mon[35951]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-27T09:49:37.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 -- 172.21.15.71:0/1503964196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c1043f0 msgr2=0x7f3c1c104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 --2- 172.21.15.71:0/1503964196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c1043f0 0x7f3c1c104800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3c100098f0 tx=0x7f3c10009c00 comp rx=0 tx=0).stop 2024-05-27T09:49:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 -- 172.21.15.71:0/1503964196 shutdown_connections 2024-05-27T09:49:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 --2- 172.21.15.71:0/1503964196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c1c109670 0x7f3c1c110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 --2- 172.21.15.71:0/1503964196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c1043f0 0x7f3c1c104800 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 --2- 172.21.15.71:0/1503964196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1c108d20 0x7f3c1c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 -- 172.21.15.71:0/1503964196 >> 172.21.15.71:0/1503964196 conn(0x7f3c1c079d00 msgr2=0x7f3c1c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 -- 172.21.15.71:0/1503964196 shutdown_connections 2024-05-27T09:49:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.462+0000 7f3c22a00700 1 -- 172.21.15.71:0/1503964196 wait complete. 2024-05-27T09:49:37.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.463+0000 7f3c22a00700 1 Processor -- start 2024-05-27T09:49:37.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.463+0000 7f3c22a00700 1 -- start start 2024-05-27T09:49:37.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c22a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1c1043f0 0x7f3c1c19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c22a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c108d20 0x7f3c1c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c22a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c1c109670 0x7f3c1c1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c22a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1142f0 con 0x7f3c1c1043f0 2024-05-27T09:49:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c22a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c114170 con 0x7f3c1c108d20 2024-05-27T09:49:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c22a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c114470 con 0x7f3c1c109670 2024-05-27T09:49:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c21600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1c1043f0 0x7f3c1c19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c20c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c108d20 0x7f3c1c19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c20c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c108d20 0x7f3c1c19d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49838/0 (socket says 172.21.15.71:49838) 2024-05-27T09:49:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.464+0000 7f3c20c00700 1 -- 172.21.15.71:0/2957436012 learned_addr learned my addr 172.21.15.71:0/2957436012 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c22000700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c1c109670 0x7f3c1c1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c20c00700 1 -- 172.21.15.71:0/2957436012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c1c109670 msgr2=0x7f3c1c1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c20c00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c1c109670 0x7f3c1c1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c20c00700 1 -- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1c1043f0 msgr2=0x7f3c1c19d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c20c00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1c1043f0 0x7f3c1c19d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c20c00700 1 -- 172.21.15.71:0/2957436012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c1a1ef0 con 0x7f3c1c108d20 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c21600700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1c1043f0 0x7f3c1c19d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.465+0000 7f3c20c00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c108d20 0x7f3c1c19d5c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800ec70 tx=0x7f3c0800ef80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.466+0000 7f3c1a000700 1 -- 172.21.15.71:0/2957436012 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800cc90 con 0x7f3c1c108d20 2024-05-27T09:49:37.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.466+0000 7f3c1a000700 1 -- 172.21.15.71:0/2957436012 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c0800ce30 con 0x7f3c1c108d20 2024-05-27T09:49:37.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.466+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c1a21e0 con 0x7f3c1c108d20 2024-05-27T09:49:37.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.466+0000 7f3c1a000700 1 -- 172.21.15.71:0/2957436012 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08010430 con 0x7f3c1c108d20 2024-05-27T09:49:37.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.466+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c1a9b00 con 0x7f3c1c108d20 2024-05-27T09:49:37.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.471+0000 7f3c1a000700 1 -- 172.21.15.71:0/2957436012 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f3c08003680 con 0x7f3c1c108d20 2024-05-27T09:49:37.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.473+0000 7f3c32ad2b80 1 Processor -- start 2024-05-27T09:49:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.473+0000 7f3c1a000700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3c040b29f0 0x7f3c040b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.473+0000 7f3c32ad2b80 1 -- start start 2024-05-27T09:49:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.473+0000 7f3c1a000700 1 -- 172.21.15.71:0/2957436012 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f3c080e2950 con 0x7f3c1c108d20 2024-05-27T09:49:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.473+0000 7f3c22000700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3c040b29f0 0x7f3c040b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5117c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5118570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f512d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5589f5046ec0 con 0x5589f5118160 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5589f5036a60 con 0x5589f4f99ec0 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5589f503aaa0 con 0x5589f512b360 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c21600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5117c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c21600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5117c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49844/0 (socket says 172.21.15.71:49844) 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c21600700 1 -- 172.21.15.71:0/388075888 learned_addr learned my addr 172.21.15.71:0/388075888 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.474+0000 7f3c22000700 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f512d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.475+0000 7f3c21600700 1 -- 172.21.15.71:0/388075888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 msgr2=0x5589f512d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.475+0000 7f3c21600700 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f512d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.475+0000 7f3c21600700 1 -- 172.21.15.71:0/388075888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 msgr2=0x5589f5118570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.475+0000 7f3c21600700 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5118570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.475+0000 7f3c21600700 1 -- 172.21.15.71:0/388075888 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f4fff4a0 con 0x5589f4f99ec0 2024-05-27T09:49:37.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.475+0000 7f3c21600700 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5117c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009230 tx=0x7f3c1000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f78203641354f6ec server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:37.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.476+0000 7f3c0ea00700 1 -- 172.21.15.71:0/388075888 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000f660 con 0x5589f4f99ec0 2024-05-27T09:49:37.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.476+0000 7f3c0ea00700 1 -- 172.21.15.71:0/388075888 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c100054f0 con 0x5589f4f99ec0 2024-05-27T09:49:37.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.476+0000 7f3c0ea00700 1 -- 172.21.15.71:0/388075888 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000ba40 con 0x5589f4f99ec0 2024-05-27T09:49:37.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/388075888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 msgr2=0x5589f5117c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c22000700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3c040b29f0 0x7f3c040b4f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400fda0 tx=0x7f3c14009920 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:37.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5117c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009230 tx=0x7f3c1000bf60 comp rx=0 tx=0).stop 2024-05-27T09:49:37.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/388075888 shutdown_connections 2024-05-27T09:49:37.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f512d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5117c20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/388075888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5118570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.477+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/388075888 >> 172.21.15.71:0/388075888 conn(0x5589f4ffa040 msgr2=0x5589f5113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:37.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.478+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/388075888 shutdown_connections 2024-05-27T09:49:37.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.478+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/388075888 wait complete. 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.478+0000 7f3c32ad2b80 1 -- start start 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.479+0000 7f3c32ad2b80 1 Processor -- start 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f4f99ec0 0x5589f5128410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5128950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f512b360 0x5589f5128e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5589f4f3d020 con 0x5589f5118160 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5589f4fd77e0 con 0x5589f512b360 2024-05-27T09:49:37.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5589f512e1a0 con 0x5589f4f99ec0 2024-05-27T09:49:37.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c32ad2b80 10 client.0 _ll_register_callbacks cb 0x5589f4fe0cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:37.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c21600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f4f99ec0 0x5589f5128410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c21600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f4f99ec0 0x5589f5128410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:47244/0 (socket says 172.21.15.71:47244) 2024-05-27T09:49:37.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.480+0000 7f3c21600700 1 -- 172.21.15.71:0/3983005989 learned_addr learned my addr 172.21.15.71:0/3983005989 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c21600700 1 -- 172.21.15.71:0/3983005989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f512b360 msgr2=0x5589f5128e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c21600700 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f512b360 0x5589f5128e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c21600700 1 -- 172.21.15.71:0/3983005989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 msgr2=0x5589f5128950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c20c00700 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5128950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c21600700 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5128950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c21600700 1 -- 172.21.15.71:0/3983005989 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589f4f86950 con 0x5589f4f99ec0 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c20c00700 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5128950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c21600700 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f4f99ec0 0x5589f5128410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000a010 tx=0x7f3c1000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6925334c6e02adb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:37.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.481+0000 7f3c03400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:37.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.482+0000 7f3c03400700 1 -- 172.21.15.71:0/3983005989 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10032020 con 0x5589f4f99ec0 2024-05-27T09:49:37.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.482+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c100054f0 con 0x5589f4f99ec0 2024-05-27T09:49:37.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.482+0000 7f3c03400700 1 -- 172.21.15.71:0/3983005989 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f3c1000bab0 con 0x5589f4f99ec0 2024-05-27T09:49:37.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.482+0000 7f3c03400700 1 -- 172.21.15.71:0/3983005989 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3c1003d050 con 0x5589f4f99ec0 2024-05-27T09:49:37.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.482+0000 7f3c32ad2b80 10 client.25675 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:37.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.482+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5589f50070e0 con 0x5589f4f99ec0 2024-05-27T09:49:37.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.483+0000 7f3c03400700 1 -- 172.21.15.71:0/3983005989 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c100056a0 con 0x5589f4f99ec0 2024-05-27T09:49:37.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.484+0000 7f3c03400700 1 -- 172.21.15.71:0/3983005989 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f3c1002c4c0 con 0x5589f4f99ec0 2024-05-27T09:49:37.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.484+0000 7f3c32ad2b80 10 client.25675 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:37.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.484+0000 7f3c32ad2b80 10 client.25675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:37.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.484+0000 7f3c32ad2b80 20 client.25675 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:37.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.484+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f513b070 0x5589f513d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.484+0000 7f3c32ad2b80 4 client.25675 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:37.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.484+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3c100054f0 con 0x5589f513b070 2024-05-27T09:49:37.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.485+0000 7f3c20c00700 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f513b070 0x5589f513d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.485+0000 7f3c03400700 10 client.25675 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:37.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.485+0000 7f3c20c00700 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f513b070 0x5589f513d490 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72eb2d7e10445e8b server_cookie=e08253e5969e6944 in_seq=0 out_seq=0 2024-05-27T09:49:37.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.486+0000 7f3c03400700 1 -- 172.21.15.71:0/3983005989 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x7f3c100054f0 con 0x5589f513b070 2024-05-27T09:49:37.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.486+0000 7f3c03400700 10 client.25675 handle_command_reply: tid=0 2024-05-27T09:49:37.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.486+0000 7f3c32ad2b80 1 client.25675 shutdown 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.486+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f4f99ec0 msgr2=0x5589f5128410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.486+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f4f99ec0 0x5589f5128410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000a010 tx=0x7f3c1000f740 comp rx=0 tx=0).stop 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 shutdown_connections 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f513b070 0x5589f513d490 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f512b360 0x5589f5128e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f4f99ec0 0x5589f5128410 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3983005989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f5128950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 >> 172.21.15.71:0/3983005989 conn(0x5589f4ffa040 msgr2=0x5589f5113070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c03400700 0 client.25675 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 shutdown_connections 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.487+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3983005989 wait complete. 2024-05-27T09:49:37.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.488+0000 7f3c32ad2b80 20 client.25675 trim_cache size 0 max 16384 2024-05-27T09:49:37.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.528+0000 7f3c32ad2b80 1 Processor -- start 2024-05-27T09:49:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.528+0000 7f3c32ad2b80 1 -- start start 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f512a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f5118160 0x5589f5137470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f512b360 0x5589f5125670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1af200 con 0x5589f512b360 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1aca90 con 0x5589f4f99ec0 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1058a0 con 0x5589f5118160 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c21600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f512a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c20c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f5118160 0x5589f5137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c21600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f512a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49858/0 (socket says 172.21.15.71:49858) 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.529+0000 7f3c21600700 1 -- 172.21.15.71:0/3773887169 learned_addr learned my addr 172.21.15.71:0/3773887169 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c22000700 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f512b360 0x5589f5125670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c20c00700 1 -- 172.21.15.71:0/3773887169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 msgr2=0x5589f512a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c20c00700 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f512a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c20c00700 1 -- 172.21.15.71:0/3773887169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f512b360 msgr2=0x5589f5125670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c20c00700 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f512b360 0x5589f5125670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c20c00700 1 -- 172.21.15.71:0/3773887169 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f5129200 con 0x5589f5118160 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c22000700 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f512b360 0x5589f5125670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.530+0000 7f3c20c00700 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f5118160 0x5589f5137470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c080e0070 tx=0x7f3c08003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a792c8188e12d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.531+0000 7f3c0e000700 1 -- 172.21.15.71:0/3773887169 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c080a9710 con 0x5589f5118160 2024-05-27T09:49:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.531+0000 7f3c0e000700 1 -- 172.21.15.71:0/3773887169 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c080aa300 con 0x5589f5118160 2024-05-27T09:49:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.531+0000 7f3c0e000700 1 -- 172.21.15.71:0/3773887169 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c080a9e60 con 0x5589f5118160 2024-05-27T09:49:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3773887169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f5118160 msgr2=0x5589f5137470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f5118160 0x5589f5137470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c080e0070 tx=0x7f3c08003970 comp rx=0 tx=0).stop 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3773887169 shutdown_connections 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f512b360 0x5589f5125670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f512a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/3773887169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f5118160 0x5589f5137470 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3773887169 >> 172.21.15.71:0/3773887169 conn(0x5589f4ffa040 msgr2=0x5589f511a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3773887169 shutdown_connections 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.532+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/3773887169 wait complete. 2024-05-27T09:49:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.533+0000 7f3c32ad2b80 1 -- start start 2024-05-27T09:49:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.533+0000 7f3c32ad2b80 1 Processor -- start 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.534+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.534+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f513d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.534+0000 7f3c32ad2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f513d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.534+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c19e3d0 con 0x5589f5118160 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.534+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1ac3c0 con 0x5589f4f99ec0 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.534+0000 7f3c32ad2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1ab7f0 con 0x5589f512b360 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.534+0000 7f3c32ad2b80 10 client.0 _ll_register_callbacks cb 0x5589f4fe0cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c20c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f513d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c21600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c20c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f513d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35772/0 (socket says 172.21.15.71:35772) 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c20c00700 1 -- 172.21.15.71:0/2084582900 learned_addr learned my addr 172.21.15.71:0/2084582900 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c22000700 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f513d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c21600700 1 -- 172.21.15.71:0/2084582900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 msgr2=0x5589f513d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c21600700 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f513d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c21600700 1 -- 172.21.15.71:0/2084582900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 msgr2=0x5589f513d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c21600700 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f513d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c21600700 1 -- 172.21.15.71:0/2084582900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589f513dea0 con 0x5589f4f99ec0 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c20c00700 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f513d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.535+0000 7f3c21600700 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5140cf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005950 tx=0x7f3c1002cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e91b095e37b34f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.536+0000 7f3c03400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.536+0000 7f3c03400700 1 -- 172.21.15.71:0/2084582900 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10032040 con 0x5589f4f99ec0 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.536+0000 7f3c03400700 1 -- 172.21.15.71:0/2084582900 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f3c100055d0 con 0x5589f4f99ec0 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.536+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c080aa300 con 0x5589f4f99ec0 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.536+0000 7f3c03400700 1 -- 172.21.15.71:0/2084582900 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3c1002c640 con 0x5589f4f99ec0 2024-05-27T09:49:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.536+0000 7f3c32ad2b80 10 client.25658 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.536+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5589f511bae0 con 0x5589f4f99ec0 2024-05-27T09:49:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.537+0000 7f3c03400700 1 -- 172.21.15.71:0/2084582900 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c1000bd60 con 0x5589f4f99ec0 2024-05-27T09:49:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c03400700 1 -- 172.21.15.71:0/2084582900 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f3c10003cc0 con 0x5589f4f99ec0 2024-05-27T09:49:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c32ad2b80 10 client.25658 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c32ad2b80 10 client.25658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c32ad2b80 20 client.25658 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f511c190 0x5589f511e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c32ad2b80 4 client.25658 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f3c080aa300 con 0x5589f511c190 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.538+0000 7f3c20c00700 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f511c190 0x5589f511e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.539+0000 7f3c20c00700 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f511c190 0x5589f511e5b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4461237779670a6 server_cookie=657beea140f10de1 in_seq=0 out_seq=0 2024-05-27T09:49:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.539+0000 7f3c03400700 10 client.25658 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.540+0000 7f3c03400700 1 -- 172.21.15.71:0/2084582900 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f3c080aa300 con 0x5589f511c190 2024-05-27T09:49:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.540+0000 7f3c03400700 10 client.25658 handle_command_reply: tid=0 2024-05-27T09:49:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.540+0000 7f3c32ad2b80 1 client.25658 shutdown 2024-05-27T09:49:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 msgr2=0x5589f5140cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5140cf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005950 tx=0x7f3c1002cad0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 shutdown_connections 2024-05-27T09:49:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5589f511c190 0x5589f511e5b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f512b360 0x5589f513d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589f4f99ec0 0x5589f5140cf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 --2- 172.21.15.71:0/2084582900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589f5118160 0x5589f513d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c03400700 0 client.25658 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.541+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 >> 172.21.15.71:0/2084582900 conn(0x5589f4ffa040 msgr2=0x5589f511a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.542+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 shutdown_connections 2024-05-27T09:49:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.542+0000 7f3c32ad2b80 1 -- 172.21.15.71:0/2084582900 wait complete. 2024-05-27T09:49:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.542+0000 7f3c32ad2b80 20 client.25658 trim_cache size 0 max 16384 2024-05-27T09:49:37.544 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:49:37.544 INFO:teuthology.orchestra.run.smithi071.stdout: "return_code": 0, 2024-05-27T09:49:37.544 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_tag": "3d179a55-c816-4c10-ba41-af3bb487440e", 2024-05-27T09:49:37.544 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": "asynchronous" 2024-05-27T09:49:37.544 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3c040b29f0 msgr2=0x7f3c040b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3c040b29f0 0x7f3c040b4f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400fda0 tx=0x7f3c14009920 comp rx=0 tx=0).stop 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c108d20 msgr2=0x7f3c1c19d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c108d20 0x7f3c1c19d5c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800ec70 tx=0x7f3c0800ef80 comp rx=0 tx=0).stop 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 shutdown_connections 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3c040b29f0 0x7f3c040b4f00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c1c109670 0x7f3c1c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1c1043f0 0x7f3c1c19d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 --2- 172.21.15.71:0/2957436012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c108d20 0x7f3c1c19d5c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.543+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 >> 172.21.15.71:0/2957436012 conn(0x7f3c1c079d00 msgr2=0x7f3c1c102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.544+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 shutdown_connections 2024-05-27T09:49:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:37.544+0000 7f3c22a00700 1 -- 172.21.15.71:0/2957436012 wait complete. 2024-05-27T09:49:38.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-27T09:49:38.866 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:38.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:38 smithi122 ceph-mon[36436]: scrub queued for path: / 2024-05-27T09:49:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:38 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:38 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:49:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:38 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:38 smithi122 ceph-mon[36436]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-05-27T09:49:38.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:38 smithi122 ceph-mon[36436]: scrub summary: idle 2024-05-27T09:49:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:38 smithi071 ceph-mon[31451]: scrub queued for path: / 2024-05-27T09:49:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:38 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:38 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:49:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:38 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:38 smithi071 ceph-mon[31451]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-05-27T09:49:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:38 smithi071 ceph-mon[31451]: scrub summary: idle 2024-05-27T09:49:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:38 smithi072 ceph-mon[35951]: scrub queued for path: / 2024-05-27T09:49:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:38 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:38 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:49:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:38 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:49:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:38 smithi072 ceph-mon[35951]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-05-27T09:49:39.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:38 smithi072 ceph-mon[35951]: scrub summary: idle 2024-05-27T09:49:39.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:49:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.526+0000 7f1af7200640 1 -- 172.21.15.71:0/2295195193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810ecc0 msgr2=0x7f1af810f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.526+0000 7f1af7200640 1 --2- 172.21.15.71:0/2295195193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810ecc0 0x7f1af810f0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40074e0 tx=0x7f1ae402b060 comp rx=0 tx=0).stop 2024-05-27T09:49:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.527+0000 7f1af7200640 1 -- 172.21.15.71:0/2295195193 shutdown_connections 2024-05-27T09:49:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.527+0000 7f1af7200640 1 --2- 172.21.15.71:0/2295195193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1af810f780 0x7f1af8116f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.527+0000 7f1af7200640 1 --2- 172.21.15.71:0/2295195193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810ecc0 0x7f1af810f0f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.527+0000 7f1af7200640 1 --2- 172.21.15.71:0/2295195193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 0x7f1af810ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.527+0000 7f1af7200640 1 -- 172.21.15.71:0/2295195193 >> 172.21.15.71:0/2295195193 conn(0x7f1af806fb90 msgr2=0x7f1af806ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.527+0000 7f1af7200640 1 -- 172.21.15.71:0/2295195193 shutdown_connections 2024-05-27T09:49:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.527+0000 7f1af7200640 1 -- 172.21.15.71:0/2295195193 wait complete. 2024-05-27T09:49:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.528+0000 7f1af7200640 1 Processor -- start 2024-05-27T09:49:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.528+0000 7f1af7200640 1 -- start start 2024-05-27T09:49:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af7200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 0x7f1af81a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1af810ecc0 0x7f1af81a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af7200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810f780 0x7f1af81a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1af811a260 con 0x7f1af810ecc0 2024-05-27T09:49:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 0x7f1af81a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 0x7f1af81a2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49892/0 (socket says 172.21.15.71:49892) 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af5e00640 1 -- 172.21.15.71:0/3856979058 learned_addr learned my addr 172.21.15.71:0/3856979058 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af6800640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810f780 0x7f1af81a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1af811a0e0 con 0x7f1af810a730 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1af811a3e0 con 0x7f1af810f780 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.529+0000 7f1af5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1af810ecc0 0x7f1af81a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.530+0000 7f1af6800640 1 -- 172.21.15.71:0/3856979058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 msgr2=0x7f1af81a2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.530+0000 7f1af6800640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 0x7f1af81a2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.530+0000 7f1af6800640 1 -- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1af810ecc0 msgr2=0x7f1af81a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.530+0000 7f1af6800640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1af810ecc0 0x7f1af81a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.530+0000 7f1af6800640 1 -- 172.21.15.71:0/3856979058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af81a1890 con 0x7f1af810f780 2024-05-27T09:49:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.530+0000 7f1af5400640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1af810ecc0 0x7f1af81a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.530+0000 7f1af5e00640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 0x7f1af81a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.531+0000 7f1af6800640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810f780 0x7f1af81a10a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009fd0 tx=0x7f1af000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.531+0000 7f1aeea00640 1 -- 172.21.15.71:0/3856979058 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af000ce20 con 0x7f1af810f780 2024-05-27T09:49:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.531+0000 7f1aeea00640 1 -- 172.21.15.71:0/3856979058 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1af0005020 con 0x7f1af810f780 2024-05-27T09:49:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.531+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af81b5970 con 0x7f1af810f780 2024-05-27T09:49:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.531+0000 7f1aeea00640 1 -- 172.21.15.71:0/3856979058 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0010690 con 0x7f1af810f780 2024-05-27T09:49:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.532+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af81b5e40 con 0x7f1af810f780 2024-05-27T09:49:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.536+0000 7f1b039a6740 1 Processor -- start 2024-05-27T09:49:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.538+0000 7f1aeea00640 1 -- 172.21.15.71:0/3856979058 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f1af00054d0 con 0x7f1af810f780 2024-05-27T09:49:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.538+0000 7f1b039a6740 1 -- start start 2024-05-27T09:49:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572a61b0 0x55e157648a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e15727d2f0 0x55e157648fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572854d0 0x55e1576494e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1b039a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e1575b9b90 con 0x55e1572854d0 2024-05-27T09:49:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1b039a6740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e1575a9730 con 0x55e1572a61b0 2024-05-27T09:49:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1b039a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e1575ad770 con 0x55e15727d2f0 2024-05-27T09:49:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1af5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e15727d2f0 0x55e157648fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1af5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572854d0 0x55e1576494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.539+0000 7f1af5400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572a61b0 0x55e157648a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e15727d2f0 0x55e157648fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:47302/0 (socket says 172.21.15.71:47302) 2024-05-27T09:49:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5e00640 1 -- 172.21.15.71:0/2538180102 learned_addr learned my addr 172.21.15.71:0/2538180102 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5e00640 1 -- 172.21.15.71:0/2538180102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572a61b0 msgr2=0x55e157648a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5e00640 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572a61b0 0x55e157648a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5e00640 1 -- 172.21.15.71:0/2538180102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572854d0 msgr2=0x55e1576494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5e00640 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572854d0 0x55e1576494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5e00640 1 -- 172.21.15.71:0/2538180102 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1575428b0 con 0x55e15727d2f0 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.540+0000 7f1af5400640 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572854d0 0x55e1576494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.541+0000 7f1aeea00640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1adc0b29d0 0x7f1adc0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.541+0000 7f1aeea00640 1 -- 172.21.15.71:0/3856979058 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1af00e2c50 con 0x7f1af810f780 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.541+0000 7f1af5400640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1adc0b29d0 0x7f1adc0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.541+0000 7f1af5e00640 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e15727d2f0 0x55e157648fa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009fd0 tx=0x7f1ae8011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c15a05cef67859 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.542+0000 7f1ae3000640 1 -- 172.21.15.71:0/2538180102 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae801e070 con 0x55e15727d2f0 2024-05-27T09:49:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.542+0000 7f1ae3000640 1 -- 172.21.15.71:0/2538180102 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae800fba0 con 0x55e15727d2f0 2024-05-27T09:49:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.542+0000 7f1ae3000640 1 -- 172.21.15.71:0/2538180102 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8019cb0 con 0x55e15727d2f0 2024-05-27T09:49:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 -- 172.21.15.71:0/2538180102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e15727d2f0 msgr2=0x55e157648fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1af5400640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1adc0b29d0 0x7f1adc0b4ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4005ab0 tx=0x7f1ae400d000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e15727d2f0 0x55e157648fa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009fd0 tx=0x7f1ae8011ae0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 -- 172.21.15.71:0/2538180102 shutdown_connections 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572854d0 0x55e1576494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e15727d2f0 0x55e157648fa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2538180102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572a61b0 0x55e157648a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 -- 172.21.15.71:0/2538180102 >> 172.21.15.71:0/2538180102 conn(0x55e15729a300 msgr2=0x55e157645210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 -- 172.21.15.71:0/2538180102 shutdown_connections 2024-05-27T09:49:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.543+0000 7f1b039a6740 1 -- 172.21.15.71:0/2538180102 wait complete. 2024-05-27T09:49:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.544+0000 7f1b039a6740 1 -- start start 2024-05-27T09:49:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.544+0000 7f1b039a6740 1 Processor -- start 2024-05-27T09:49:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e157652c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e157653140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e15765eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1b039a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e15728f790 con 0x55e15727d2f0 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1b039a6740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e157551bc0 con 0x55e1572854d0 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1b039a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e157655b90 con 0x55e1572a61b0 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1b039a6740 10 client.0 _ll_register_callbacks cb 0x55e15752f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1af5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e157652c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1af5400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e157653140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1af5400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e157653140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49918/0 (socket says 172.21.15.71:49918) 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1af5400640 1 -- 172.21.15.71:0/964378554 learned_addr learned my addr 172.21.15.71:0/964378554 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.545+0000 7f1af6800640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e15765eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af5e00640 1 -- 172.21.15.71:0/964378554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 msgr2=0x55e15765eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af5e00640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e15765eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af5e00640 1 -- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 msgr2=0x55e157653140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af5e00640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e157653140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af5e00640 1 -- 172.21.15.71:0/964378554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1572be210 con 0x55e15727d2f0 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af5400640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e157653140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af6800640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e15765eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1af5e00640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e157652c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55e157649e10 tx=0x7f1ae800ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bc8b31e5bb2753 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.546+0000 7f1ad7400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1ad7400640 1 -- 172.21.15.71:0/964378554 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae801e040 con 0x55e15727d2f0 2024-05-27T09:49:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1ad7400640 1 -- 172.21.15.71:0/964378554 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1ae800f770 con 0x55e15727d2f0 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae800fba0 con 0x55e15727d2f0 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1ad7400640 1 -- 172.21.15.71:0/964378554 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1ae800f970 con 0x55e15727d2f0 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1b039a6740 10 client.15561 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e15738a620 con 0x55e15727d2f0 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1ad7400640 1 -- 172.21.15.71:0/964378554 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae800fba0 con 0x55e15727d2f0 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.547+0000 7f1ad7400640 1 -- 172.21.15.71:0/964378554 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f1ae8021070 con 0x55e15727d2f0 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.548+0000 7f1b039a6740 10 client.15561 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.548+0000 7f1b039a6740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.548+0000 7f1b039a6740 20 client.15561 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.548+0000 7f1b039a6740 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e157264d80 0x55e157664d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.548+0000 7f1b039a6740 4 client.15561 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.548+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1575bbae0 con 0x55e157264d80 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.548+0000 7f1af5400640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e157264d80 0x55e157664d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.549+0000 7f1ad7400640 10 client.15561 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.549+0000 7f1af5400640 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e157264d80 0x55e157664d20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b015af957f210386 server_cookie=bdf235c6d98b308d in_seq=0 out_seq=0 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1ad7400640 1 -- 172.21.15.71:0/964378554 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55e1575bbae0 con 0x55e157264d80 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1ad7400640 10 client.15561 handle_command_reply: tid=0 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 client.15561 shutdown 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 msgr2=0x55e157652c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e157652c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55e157649e10 tx=0x7f1ae800ff80 comp rx=0 tx=0).stop 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 shutdown_connections 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e15765eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e157653140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e157264d80 0x55e157664d20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 --2- 172.21.15.71:0/964378554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e157652c00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 >> 172.21.15.71:0/964378554 conn(0x55e15729a300 msgr2=0x55e157648830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1ad7400640 0 client.15561 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.550+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 shutdown_connections 2024-05-27T09:49:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.551+0000 7f1b039a6740 1 -- 172.21.15.71:0/964378554 wait complete. 2024-05-27T09:49:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.551+0000 7f1b039a6740 20 client.15561 trim_cache size 0 max 16384 2024-05-27T09:49:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.571+0000 7f1b039a6740 1 Processor -- start 2024-05-27T09:49:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.571+0000 7f1b039a6740 1 -- start start 2024-05-27T09:49:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e15727d2f0 0x55e157655330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572854d0 0x55e157644240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572a61b0 0x55e157652ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1b039a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1af81c0f40 con 0x55e1572a61b0 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1b039a6740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1af81be810 con 0x55e15727d2f0 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1b039a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1af81bc660 con 0x55e1572854d0 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1af6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572a61b0 0x55e157652ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1af6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572a61b0 0x55e157652ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35832/0 (socket says 172.21.15.71:35832) 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1af5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572854d0 0x55e157644240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1af6800640 1 -- 172.21.15.71:0/3177241393 learned_addr learned my addr 172.21.15.71:0/3177241393 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.572+0000 7f1af5e00640 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e15727d2f0 0x55e157655330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1af5400640 1 -- 172.21.15.71:0/3177241393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e15727d2f0 msgr2=0x55e157655330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1af5400640 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e15727d2f0 0x55e157655330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1af5400640 1 -- 172.21.15.71:0/3177241393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572a61b0 msgr2=0x55e157652ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1af5400640 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572a61b0 0x55e157652ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1af5400640 1 -- 172.21.15.71:0/3177241393 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e157645e00 con 0x55e1572854d0 2024-05-27T09:49:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1af5400640 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572854d0 0x55e157644240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55e157665260 tx=0x7f1ae400ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a1134b7772a2f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1ae2600640 1 -- 172.21.15.71:0/3177241393 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4008510 con 0x55e1572854d0 2024-05-27T09:49:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1ae2600640 1 -- 172.21.15.71:0/3177241393 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae405a070 con 0x55e1572854d0 2024-05-27T09:49:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.573+0000 7f1ae2600640 1 -- 172.21.15.71:0/3177241393 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4054b70 con 0x55e1572854d0 2024-05-27T09:49:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 -- 172.21.15.71:0/3177241393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572854d0 msgr2=0x55e157644240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572854d0 0x55e157644240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55e157665260 tx=0x7f1ae400ac00 comp rx=0 tx=0).stop 2024-05-27T09:49:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 -- 172.21.15.71:0/3177241393 shutdown_connections 2024-05-27T09:49:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e1572a61b0 0x55e157652ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572854d0 0x55e157644240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 --2- 172.21.15.71:0/3177241393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e15727d2f0 0x55e157655330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 -- 172.21.15.71:0/3177241393 >> 172.21.15.71:0/3177241393 conn(0x55e15729a300 msgr2=0x55e157652490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 -- 172.21.15.71:0/3177241393 shutdown_connections 2024-05-27T09:49:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 -- 172.21.15.71:0/3177241393 wait complete. 2024-05-27T09:49:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.575+0000 7f1b039a6740 1 -- start start 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.576+0000 7f1b039a6740 1 Processor -- start 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.576+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e15765b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.576+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e15765b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1b039a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e157655e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1b039a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1af81bccd0 con 0x55e15727d2f0 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1b039a6740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1af81be140 con 0x55e1572854d0 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1b039a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1af81bd3a0 con 0x55e1572a61b0 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1b039a6740 10 client.0 _ll_register_callbacks cb 0x7f1ae801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e157655e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e157655e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:47324/0 (socket says 172.21.15.71:47324) 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 -- 172.21.15.71:0/2539067040 learned_addr learned my addr 172.21.15.71:0/2539067040 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af5e00640 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e15765b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af5400640 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e15765b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 -- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 msgr2=0x55e15765b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e15765b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 -- 172.21.15.71:0/2539067040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 msgr2=0x55e15765b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e15765b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.577+0000 7f1af6800640 1 -- 172.21.15.71:0/2539067040 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1576565e0 con 0x55e1572a61b0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.578+0000 7f1af6800640 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e157655e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1af0005fd0 tx=0x7f1af00aa430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=121d1cc122216705 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.578+0000 7f1ad7400640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.578+0000 7f1ad7400640 1 -- 172.21.15.71:0/2539067040 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af00c8070 con 0x55e1572a61b0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.578+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae405a070 con 0x55e1572a61b0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.578+0000 7f1ad7400640 1 -- 172.21.15.71:0/2539067040 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1af00a9370 con 0x55e1572a61b0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.578+0000 7f1ad7400640 1 -- 172.21.15.71:0/2539067040 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1af008b050 con 0x55e1572a61b0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 10 client.25699 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e1576cbc80 con 0x55e1572a61b0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1ad7400640 1 -- 172.21.15.71:0/2539067040 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae405a070 con 0x55e1572a61b0 2024-05-27T09:49:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1ad7400640 1 -- 172.21.15.71:0/2539067040 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f1af00a8bd0 con 0x55e1572a61b0 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 10 client.25699 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 10 client.25699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 20 client.25699 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e15723a1c0 0x55e1576ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 4 client.25699 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.579+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e1575b52c0 con 0x55e15723a1c0 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.580+0000 7f1af5e00640 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e15723a1c0 0x55e1576ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.580+0000 7f1af5e00640 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e15723a1c0 0x55e1576ce3f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a9f1e01de5a7202 server_cookie=e217362dbb72abb3 in_seq=0 out_seq=0 2024-05-27T09:49:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.580+0000 7f1ad7400640 10 client.25699 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.584+0000 7f1ad7400640 1 -- 172.21.15.71:0/2539067040 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e1575b52c0 con 0x55e15723a1c0 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.584+0000 7f1ad7400640 10 client.25699 handle_command_reply: tid=0 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.584+0000 7f1b039a6740 1 client.25699 shutdown 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.584+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 msgr2=0x55e157655e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.584+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e157655e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1af0005fd0 tx=0x7f1af00aa430 comp rx=0 tx=0).stop 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 shutdown_connections 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1572a61b0 0x55e157655e50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e1572854d0 0x55e15765b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e15723a1c0 0x55e1576ce3f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 --2- 172.21.15.71:0/2539067040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e15727d2f0 0x55e15765b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 >> 172.21.15.71:0/2539067040 conn(0x55e15729a300 msgr2=0x55e157643fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1ad7400640 0 client.25699 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 shutdown_connections 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 1 -- 172.21.15.71:0/2539067040 wait complete. 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.585+0000 7f1b039a6740 20 client.25699 trim_cache size 0 max 16384 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:49:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:49:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1adc0b29d0 msgr2=0x7f1adc0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1adc0b29d0 0x7f1adc0b4ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4005ab0 tx=0x7f1ae400d000 comp rx=0 tx=0).stop 2024-05-27T09:49:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810f780 msgr2=0x7f1af81a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810f780 0x7f1af81a10a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009fd0 tx=0x7f1af000ef10 comp rx=0 tx=0).stop 2024-05-27T09:49:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 shutdown_connections 2024-05-27T09:49:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1adc0b29d0 0x7f1adc0b4ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af810f780 0x7f1af81a10a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1af810ecc0 0x7f1af81a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 --2- 172.21.15.71:0/3856979058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1af810a730 0x7f1af81a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 >> 172.21.15.71:0/3856979058 conn(0x7f1af806fb90 msgr2=0x7f1af810dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 shutdown_connections 2024-05-27T09:49:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:39.586+0000 7f1af7200640 1 -- 172.21.15.71:0/3856979058 wait complete. 2024-05-27T09:49:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:40 smithi122 ceph-mon[36436]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:49:41.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:40 smithi071 ceph-mon[31451]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:49:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:40 smithi072 ceph-mon[35951]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-27T09:49:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:42.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:42 smithi122 ceph-mon[36436]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-27T09:49:42.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:42 smithi071 ceph-mon[31451]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-27T09:49:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:42 smithi072 ceph-mon[35951]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-27T09:49:44.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 -- 172.21.15.71:0/4285002104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 msgr2=0x7fa218109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 --2- 172.21.15.71:0/4285002104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 0x7fa218109130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa2040099c0 tx=0x7fa204009cd0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 -- 172.21.15.71:0/4285002104 shutdown_connections 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 --2- 172.21.15.71:0/4285002104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218109670 0x7fa218110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 --2- 172.21.15.71:0/4285002104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 0x7fa218104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 --2- 172.21.15.71:0/4285002104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 0x7fa218109130 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 -- 172.21.15.71:0/4285002104 >> 172.21.15.71:0/4285002104 conn(0x7fa218079d00 msgr2=0x7fa21807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 -- 172.21.15.71:0/4285002104 shutdown_connections 2024-05-27T09:49:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.047+0000 7fa21f000700 1 -- 172.21.15.71:0/4285002104 wait complete. 2024-05-27T09:49:44.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.048+0000 7fa21f000700 1 Processor -- start 2024-05-27T09:49:44.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.049+0000 7fa21f000700 1 -- start start 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.049+0000 7fa21f000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 0x7fa2181a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.049+0000 7fa21f000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 0x7fa2181a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.049+0000 7fa21f000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218109670 0x7fa21819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.049+0000 7fa21f000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2181142f0 con 0x7fa2181043f0 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.049+0000 7fa21f000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa218114170 con 0x7fa218109670 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.049+0000 7fa21f000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa218114470 con 0x7fa218108d20 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 0x7fa2181a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21d200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 0x7fa2181a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 0x7fa2181a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33434/0 (socket says 172.21.15.71:33434) 2024-05-27T09:49:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 -- 172.21.15.71:0/2908707987 learned_addr learned my addr 172.21.15.71:0/2908707987 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:44.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 -- 172.21.15.71:0/2908707987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 msgr2=0x7fa2181a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 0x7fa2181a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 -- 172.21.15.71:0/2908707987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218109670 msgr2=0x7fa21819aaf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218109670 0x7fa21819aaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.050+0000 7fa21dc00700 1 -- 172.21.15.71:0/2908707987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21819b1d0 con 0x7fa2181043f0 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.051+0000 7fa21dc00700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 0x7fa2181a08b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00e9a0 tx=0x7fa20c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.051+0000 7fa216000700 1 -- 172.21.15.71:0/2908707987 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00cbd0 con 0x7fa2181043f0 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.051+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21819b4c0 con 0x7fa2181043f0 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.051+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2181a7760 con 0x7fa2181043f0 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.052+0000 7fa216000700 1 -- 172.21.15.71:0/2908707987 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20c00cd70 con 0x7fa2181043f0 2024-05-27T09:49:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.052+0000 7fa216000700 1 -- 172.21.15.71:0/2908707987 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c026060 con 0x7fa2181043f0 2024-05-27T09:49:44.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.057+0000 7fa216000700 1 -- 172.21.15.71:0/2908707987 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fa20c018680 con 0x7fa2181043f0 2024-05-27T09:49:44.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.057+0000 7fa22f073b80 1 Processor -- start 2024-05-27T09:49:44.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.057+0000 7fa22f073b80 1 -- start start 2024-05-27T09:49:44.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.058+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eecb1e40 0x5576eee2fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.058+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.058+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30820 0x5576eee3d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.058+0000 7fa22f073b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576eed5ee40 con 0x5576eee30820 2024-05-27T09:49:44.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.058+0000 7fa22f073b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5576eed4e9e0 con 0x5576eecb1e40 2024-05-27T09:49:44.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.058+0000 7fa22f073b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5576eed52a20 con 0x5576eee30410 2024-05-27T09:49:44.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.058+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eecb1e40 0x5576eee2fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eecb1e40 0x5576eee2fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52456/0 (socket says 172.21.15.71:52456) 2024-05-27T09:49:44.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21e600700 1 -- 172.21.15.71:0/3780257817 learned_addr learned my addr 172.21.15.71:0/3780257817 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:44.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21dc00700 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21d200700 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30820 0x5576eee3d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa216000700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa2000b2a70 0x7fa2000b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa216000700 1 -- 172.21.15.71:0/2908707987 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa20c0e2830 con 0x7fa2181043f0 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21e600700 1 -- 172.21.15.71:0/3780257817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 msgr2=0x5576eee3aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21e600700 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21e600700 1 -- 172.21.15.71:0/3780257817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30820 msgr2=0x5576eee3d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.059+0000 7fa21e600700 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30820 0x5576eee3d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.060+0000 7fa21e600700 1 -- 172.21.15.71:0/3780257817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576eed17420 con 0x5576eecb1e40 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.060+0000 7fa21d200700 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30820 0x5576eee3d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.060+0000 7fa21e600700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa2000b2a70 0x7fa2000b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.060+0000 7fa21e600700 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eecb1e40 0x5576eee2fed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa21000e4d0 tx=0x7fa210009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=233efa146a2d2d3b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:44.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.061+0000 7fa20aa00700 1 -- 172.21.15.71:0/3780257817 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210007d00 con 0x5576eecb1e40 2024-05-27T09:49:44.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.061+0000 7fa20aa00700 1 -- 172.21.15.71:0/3780257817 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa210017930 con 0x5576eecb1e40 2024-05-27T09:49:44.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.061+0000 7fa20aa00700 1 -- 172.21.15.71:0/3780257817 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100226d0 con 0x5576eecb1e40 2024-05-27T09:49:44.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 -- 172.21.15.71:0/3780257817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eecb1e40 msgr2=0x5576eee2fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eecb1e40 0x5576eee2fed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa21000e4d0 tx=0x7fa210009920 comp rx=0 tx=0).stop 2024-05-27T09:49:44.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa21e600700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa2000b2a70 0x7fa2000b4f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa21001f000 tx=0x7fa21001c000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:44.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 -- 172.21.15.71:0/3780257817 shutdown_connections 2024-05-27T09:49:44.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30820 0x5576eee3d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eecb1e40 0x5576eee2fed0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3780257817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 -- 172.21.15.71:0/3780257817 >> 172.21.15.71:0/3780257817 conn(0x5576eed11fc0 msgr2=0x5576eee2bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:44.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 -- 172.21.15.71:0/3780257817 shutdown_connections 2024-05-27T09:49:44.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.062+0000 7fa22f073b80 1 -- 172.21.15.71:0/3780257817 wait complete. 2024-05-27T09:49:44.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.063+0000 7fa22f073b80 1 -- start start 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.063+0000 7fa22f073b80 1 Processor -- start 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eecb1e40 0x5576eee3a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee3b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa22f073b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576eec54fa0 con 0x5576eee30410 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa22f073b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5576eecef760 con 0x5576eee30820 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa22f073b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5576eee41da0 con 0x5576eecb1e40 2024-05-27T09:49:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa22f073b80 10 client.0 _ll_register_callbacks cb 0x5576eecf8c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa21d200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee3b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa21dc00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eecb1e40 0x5576eee3a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee3b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52462/0 (socket says 172.21.15.71:52462) 2024-05-27T09:49:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.064+0000 7fa21e600700 1 -- 172.21.15.71:0/1037061554 learned_addr learned my addr 172.21.15.71:0/1037061554 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa21dc00700 1 -- 172.21.15.71:0/1037061554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 msgr2=0x5576eee3b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa21dc00700 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee3b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa21dc00700 1 -- 172.21.15.71:0/1037061554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30410 msgr2=0x5576eee3aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa21dc00700 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa21dc00700 1 -- 172.21.15.71:0/1037061554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576eec9e8d0 con 0x5576eecb1e40 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa21dc00700 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eecb1e40 0x5576eee3a590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0dff50 tx=0x7fa20c0aa020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc2576882ec99c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa1ff400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa1ff400700 1 -- 172.21.15.71:0/1037061554 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0a9250 con 0x5576eecb1e40 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa1ff400700 1 -- 172.21.15.71:0/1037061554 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa20c0e2df0 con 0x5576eecb1e40 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa210017930 con 0x5576eecb1e40 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa1ff400700 1 -- 172.21.15.71:0/1037061554 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa20c0a5270 con 0x5576eecb1e40 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa22f073b80 10 client.25711 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.065+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5576eed1f060 con 0x5576eecb1e40 2024-05-27T09:49:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.066+0000 7fa1ff400700 1 -- 172.21.15.71:0/1037061554 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa210017930 con 0x5576eecb1e40 2024-05-27T09:49:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa1ff400700 1 -- 172.21.15.71:0/1037061554 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fa20c0e4ce0 con 0x5576eecb1e40 2024-05-27T09:49:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa22f073b80 10 client.25711 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa22f073b80 10 client.25711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa22f073b80 20 client.25711 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa22f073b80 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eee3ff40 0x5576eee40380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa22f073b80 4 client.25711 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576eed60d90 con 0x5576eee3ff40 2024-05-27T09:49:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.069+0000 7fa21d200700 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eee3ff40 0x5576eee40380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.070+0000 7fa21d200700 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eee3ff40 0x5576eee40380 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=251e89b1db4a4b2e server_cookie=ef47ecc278f5bf4d in_seq=0 out_seq=0 2024-05-27T09:49:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.070+0000 7fa1ff400700 10 client.25711 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:44.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa1ff400700 1 -- 172.21.15.71:0/1037061554 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5576eed60d90 con 0x5576eee3ff40 2024-05-27T09:49:44.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa1ff400700 10 client.25711 handle_command_reply: tid=0 2024-05-27T09:49:44.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 client.25711 shutdown 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eecb1e40 msgr2=0x5576eee3a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eecb1e40 0x5576eee3a590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0dff50 tx=0x7fa20c0aa020 comp rx=0 tx=0).stop 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 shutdown_connections 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eee3ff40 0x5576eee40380 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee3b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eecb1e40 0x5576eee3a590 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 --2- 172.21.15.71:0/1037061554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eee30410 0x5576eee3aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 >> 172.21.15.71:0/1037061554 conn(0x5576eed11fc0 msgr2=0x5576eee2aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.071+0000 7fa1ff400700 0 client.25711 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.072+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 shutdown_connections 2024-05-27T09:49:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.072+0000 7fa22f073b80 1 -- 172.21.15.71:0/1037061554 wait complete. 2024-05-27T09:49:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.072+0000 7fa22f073b80 20 client.25711 trim_cache size 0 max 16384 2024-05-27T09:49:44.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 Processor -- start 2024-05-27T09:49:44.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 -- start start 2024-05-27T09:49:44.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee35d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee4a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800fdc0 con 0x5576eecb1e40 2024-05-27T09:49:44.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800d650 con 0x5576eee30820 2024-05-27T09:49:44.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.095+0000 7fa22f073b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800b4a0 con 0x5576eee30410 2024-05-27T09:49:44.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee4a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee4a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52476/0 (socket says 172.21.15.71:52476) 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 -- 172.21.15.71:0/2817867950 learned_addr learned my addr 172.21.15.71:0/2817867950 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21dc00700 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee35d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21d200700 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 -- 172.21.15.71:0/2817867950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 msgr2=0x5576eee3c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 -- 172.21.15.71:0/2817867950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 msgr2=0x5576eee35d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee35d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 -- 172.21.15.71:0/2817867950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576eee2d350 con 0x5576eee30820 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21d200700 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:44.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.096+0000 7fa21e600700 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee4a770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa210022630 tx=0x7fa210024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5eec47b25c954c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:44.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.097+0000 7fa20a000700 1 -- 172.21.15.71:0/2817867950 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21003a070 con 0x5576eee30820 2024-05-27T09:49:44.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.097+0000 7fa20a000700 1 -- 172.21.15.71:0/2817867950 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa210007c80 con 0x5576eee30820 2024-05-27T09:49:44.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.097+0000 7fa20a000700 1 -- 172.21.15.71:0/2817867950 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21002cb60 con 0x5576eee30820 2024-05-27T09:49:44.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.098+0000 7fa22f073b80 1 -- 172.21.15.71:0/2817867950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 msgr2=0x5576eee4a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.098+0000 7fa22f073b80 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee4a770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa210022630 tx=0x7fa210024000 comp rx=0 tx=0).stop 2024-05-27T09:49:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.098+0000 7fa22f073b80 1 -- 172.21.15.71:0/2817867950 shutdown_connections 2024-05-27T09:49:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.098+0000 7fa22f073b80 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eee4a770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.098+0000 7fa22f073b80 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee35d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.098+0000 7fa22f073b80 1 --2- 172.21.15.71:0/2817867950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee3c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.098+0000 7fa22f073b80 1 -- 172.21.15.71:0/2817867950 >> 172.21.15.71:0/2817867950 conn(0x5576eed11fc0 msgr2=0x5576eee4a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.099+0000 7fa22f073b80 1 -- 172.21.15.71:0/2817867950 shutdown_connections 2024-05-27T09:49:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.099+0000 7fa22f073b80 1 -- 172.21.15.71:0/2817867950 wait complete. 2024-05-27T09:49:44.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.099+0000 7fa22f073b80 1 -- start start 2024-05-27T09:49:44.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 1 Processor -- start 2024-05-27T09:49:44.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee4de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee4e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eeead7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800bb10 con 0x5576eecb1e40 2024-05-27T09:49:44.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800cf80 con 0x5576eee30820 2024-05-27T09:49:44.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800c1e0 con 0x5576eee30410 2024-05-27T09:49:44.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.100+0000 7fa22f073b80 10 client.0 _ll_register_callbacks cb 0x5576eecf8c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:44.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eeead7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21dc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee4de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eeead7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52484/0 (socket says 172.21.15.71:52484) 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21e600700 1 -- 172.21.15.71:0/3761526212 learned_addr learned my addr 172.21.15.71:0/3761526212 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21d200700 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee4e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21dc00700 1 -- 172.21.15.71:0/3761526212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 msgr2=0x5576eee4e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21dc00700 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee4e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21dc00700 1 -- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 msgr2=0x5576eeead7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21dc00700 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eeead7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21dc00700 1 -- 172.21.15.71:0/3761526212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576eee3b380 con 0x5576eecb1e40 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.101+0000 7fa21e600700 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eeead7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.102+0000 7fa21dc00700 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee4de60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00c5b0 tx=0x7fa20c0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a41bbb4fa1509a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.102+0000 7fa1ff400700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.102+0000 7fa1ff400700 1 -- 172.21.15.71:0/3761526212 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0a9250 con 0x5576eecb1e40 2024-05-27T09:49:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.102+0000 7fa1ff400700 1 -- 172.21.15.71:0/3761526212 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa20c0a5770 con 0x5576eecb1e40 2024-05-27T09:49:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.102+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa210007c80 con 0x5576eecb1e40 2024-05-27T09:49:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.102+0000 7fa1ff400700 1 -- 172.21.15.71:0/3761526212 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa20c0a95f0 con 0x5576eecb1e40 2024-05-27T09:49:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.102+0000 7fa22f073b80 10 client.15585 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5576eeeb4ea0 con 0x5576eecb1e40 2024-05-27T09:49:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa1ff400700 1 -- 172.21.15.71:0/3761526212 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa210007c80 con 0x5576eecb1e40 2024-05-27T09:49:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa1ff400700 1 -- 172.21.15.71:0/3761526212 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fa20c0cc0b0 con 0x5576eecb1e40 2024-05-27T09:49:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa22f073b80 10 client.15585 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa22f073b80 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa22f073b80 20 client.15585 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eeeb5360 0x5576eeeb7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:44.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa22f073b80 4 client.15585 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-27T09:49:44.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.103+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576eed5a570 con 0x5576eeeb5360 2024-05-27T09:49:44.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.104+0000 7fa21d200700 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eeeb5360 0x5576eeeb7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:44.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.104+0000 7fa1ff400700 10 client.15585 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:44.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.104+0000 7fa21d200700 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eeeb5360 0x5576eeeb7780 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60c5157ed32535d server_cookie=9ed3630d14ccf8dd in_seq=0 out_seq=0 2024-05-27T09:49:44.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa1ff400700 1 -- 172.21.15.71:0/3761526212 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5576eed5a570 con 0x5576eeeb5360 2024-05-27T09:49:44.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa1ff400700 10 client.15585 handle_command_reply: tid=0 2024-05-27T09:49:44.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 client.15585 shutdown 2024-05-27T09:49:44.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 msgr2=0x5576eee4de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee4de60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00c5b0 tx=0x7fa20c0092d0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 shutdown_connections 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576eeeb5360 0x5576eeeb7780 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576eee30820 0x5576eeead7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576eecb1e40 0x5576eee4de60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 --2- 172.21.15.71:0/3761526212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576eee30410 0x5576eee4e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 >> 172.21.15.71:0/3761526212 conn(0x5576eed11fc0 msgr2=0x5576eee3a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.105+0000 7fa1ff400700 0 client.15585 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.106+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 shutdown_connections 2024-05-27T09:49:44.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.106+0000 7fa22f073b80 1 -- 172.21.15.71:0/3761526212 wait complete. 2024-05-27T09:49:44.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.106+0000 7fa22f073b80 20 client.15585 trim_cache size 0 max 16384 2024-05-27T09:49:44.109 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:49:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "status": "no active scrubs running", 2024-05-27T09:49:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "scrubs": {} 2024-05-27T09:49:44.109 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:49:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa2000b2a70 msgr2=0x7fa2000b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa2000b2a70 0x7fa2000b4f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa21001f000 tx=0x7fa21001c000 comp rx=0 tx=0).stop 2024-05-27T09:49:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 msgr2=0x7fa2181a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 0x7fa2181a08b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00e9a0 tx=0x7fa20c00ecb0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 shutdown_connections 2024-05-27T09:49:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa2000b2a70 0x7fa2000b4f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218109670 0x7fa21819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2181043f0 0x7fa2181a08b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 --2- 172.21.15.71:0/2908707987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa218108d20 0x7fa2181a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:44.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 >> 172.21.15.71:0/2908707987 conn(0x7fa218079d00 msgr2=0x7fa218101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:44.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 shutdown_connections 2024-05-27T09:49:44.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:44.107+0000 7fa21f000700 1 -- 172.21.15.71:0/2908707987 wait complete. 2024-05-27T09:49:44.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:44 smithi071 ceph-mon[31451]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:44.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:44 smithi122 ceph-mon[36436]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:44 smithi072 ceph-mon[35951]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:45.347 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-27T09:49:45.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:49:45.993 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 -- 172.21.15.71:0/1507158658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 msgr2=0x7f1f58104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 --2- 172.21.15.71:0/1507158658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 0x7f1f58104800 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f480099c0 tx=0x7f1f48009cd0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 -- 172.21.15.71:0/1507158658 shutdown_connections 2024-05-27T09:49:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 --2- 172.21.15.71:0/1507158658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f58109670 0x7f1f58110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 --2- 172.21.15.71:0/1507158658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 0x7f1f58104800 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 --2- 172.21.15.71:0/1507158658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f58108d20 0x7f1f58109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 -- 172.21.15.71:0/1507158658 >> 172.21.15.71:0/1507158658 conn(0x7f1f58079d00 msgr2=0x7f1f5807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.087+0000 7f1f5d400700 1 -- 172.21.15.71:0/1507158658 shutdown_connections 2024-05-27T09:49:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.088+0000 7f1f5d400700 1 -- 172.21.15.71:0/1507158658 wait complete. 2024-05-27T09:49:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.089+0000 7f1f5d400700 1 Processor -- start 2024-05-27T09:49:46.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.089+0000 7f1f5d400700 1 -- start start 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f5d400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 0x7f1f5810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f5d400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f58108d20 0x7f1f5810eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f5d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f58109670 0x7f1f581ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f5d400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f580775c0 con 0x7f1f581043f0 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f5d400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58077440 con 0x7f1f58109670 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f5d400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58077740 con 0x7f1f58108d20 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f57e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 0x7f1f5810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f57e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 0x7f1f5810e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33472/0 (socket says 172.21.15.71:33472) 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f57e00700 1 -- 172.21.15.71:0/2384368129 learned_addr learned my addr 172.21.15.71:0/2384368129 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.090+0000 7f1f57400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f58108d20 0x7f1f5810eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.091+0000 7f1f5ca00700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f58109670 0x7f1f581ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.091+0000 7f1f57400700 1 -- 172.21.15.71:0/2384368129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f58109670 msgr2=0x7f1f581ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.091+0000 7f1f57400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f58109670 0x7f1f581ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.091+0000 7f1f57400700 1 -- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 msgr2=0x7f1f5810e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.091+0000 7f1f57400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 0x7f1f5810e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.091+0000 7f1f57400700 1 -- 172.21.15.71:0/2384368129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5806d1d0 con 0x7f1f58108d20 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.091+0000 7f1f5ca00700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f58109670 0x7f1f581ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.092+0000 7f1f57400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f58108d20 0x7f1f5810eb10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e9c0 tx=0x7f1f4400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.092+0000 7f1f54c00700 1 -- 172.21.15.71:0/2384368129 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400cbd0 con 0x7f1f58108d20 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.092+0000 7f1f54c00700 1 -- 172.21.15.71:0/2384368129 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4400cd70 con 0x7f1f58108d20 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.092+0000 7f1f54c00700 1 -- 172.21.15.71:0/2384368129 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44018680 con 0x7f1f58108d20 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.092+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5806d4c0 con 0x7f1f58108d20 2024-05-27T09:49:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.092+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5806d9b0 con 0x7f1f58108d20 2024-05-27T09:49:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.094+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f581058a0 con 0x7f1f58108d20 2024-05-27T09:49:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.099+0000 7f1f54c00700 1 -- 172.21.15.71:0/2384368129 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f1f44010430 con 0x7f1f58108d20 2024-05-27T09:49:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.100+0000 7f1f54c00700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f3c0b29f0 0x7f1f3c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.101+0000 7f1f54c00700 1 -- 172.21.15.71:0/2384368129 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1f440e2c30 con 0x7f1f58108d20 2024-05-27T09:49:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.101+0000 7f1f57e00700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f3c0b29f0 0x7f1f3c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.101+0000 7f1f54c00700 1 -- 172.21.15.71:0/2384368129 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1f440aa5e0 con 0x7f1f58108d20 2024-05-27T09:49:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.102+0000 7f1f57e00700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f3c0b29f0 0x7f1f3c0b4f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009990 tx=0x7f1f4801a040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:46.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.387+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f580512b0 con 0x7f1f58108d20 2024-05-27T09:49:46.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.389+0000 7f1f54c00700 1 -- 172.21.15.71:0/2384368129 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7f1f440a9ee0 con 0x7f1f58108d20 2024-05-27T09:49:46.390 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:49:46.390 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f3c0b29f0 msgr2=0x7f1f3c0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f3c0b29f0 0x7f1f3c0b4f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009990 tx=0x7f1f4801a040 comp rx=0 tx=0).stop 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f58108d20 msgr2=0x7f1f5810eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f58108d20 0x7f1f5810eb10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e9c0 tx=0x7f1f4400ecd0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 shutdown_connections 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f3c0b29f0 0x7f1f3c0b4f00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f58109670 0x7f1f581ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f581043f0 0x7f1f5810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 --2- 172.21.15.71:0/2384368129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f58108d20 0x7f1f5810eb10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:46.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 >> 172.21.15.71:0/2384368129 conn(0x7f1f58079d00 msgr2=0x7f1f58101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:46.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 shutdown_connections 2024-05-27T09:49:46.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:46.392+0000 7f1f5d400700 1 -- 172.21.15.71:0/2384368129 wait complete. 2024-05-27T09:49:46.396 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:49:46.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:46 smithi122 ceph-mon[36436]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:46.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:46 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2384368129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:47.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:46 smithi071 ceph-mon[31451]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:47.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:46 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2384368129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:46 smithi072 ceph-mon[35951]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:46 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2384368129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:47.716 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id f1da88c --release --await' 2024-05-27T09:49:47.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id f1da88c --release --await 2024-05-27T09:49:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:48 smithi122 ceph-mon[36436]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-27T09:49:49.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:48 smithi071 ceph-mon[31451]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-27T09:49:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:48 smithi072 ceph-mon[35951]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-27T09:49:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:49.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 -- 172.21.15.71:0/3844660751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 msgr2=0x7fd4d0110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:49.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3844660751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 0x7fd4d0110fd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009fc0 tx=0x7fd4c800b330 comp rx=0 tx=0).stop 2024-05-27T09:49:49.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 -- 172.21.15.71:0/3844660751 shutdown_connections 2024-05-27T09:49:49.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3844660751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 0x7fd4d0110fd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3844660751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01043f0 0x7fd4d0104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3844660751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d0108d20 0x7fd4d0109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 -- 172.21.15.71:0/3844660751 >> 172.21.15.71:0/3844660751 conn(0x7fd4d0079d00 msgr2=0x7fd4d007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:49.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 -- 172.21.15.71:0/3844660751 shutdown_connections 2024-05-27T09:49:49.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.280+0000 7fd4cf200700 1 -- 172.21.15.71:0/3844660751 wait complete. 2024-05-27T09:49:49.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.282+0000 7fd4cf200700 1 Processor -- start 2024-05-27T09:49:49.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.282+0000 7fd4cf200700 1 -- start start 2024-05-27T09:49:49.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.282+0000 7fd4cf200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01043f0 0x7fd4d01a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:49.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cf200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d0108d20 0x7fd4d01a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:49.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cf200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 0x7fd4d01ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:49.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cf200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d01142a0 con 0x7fd4d01043f0 2024-05-27T09:49:49.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cf200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d0114120 con 0x7fd4d0108d20 2024-05-27T09:49:49.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cf200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d0114420 con 0x7fd4d0109670 2024-05-27T09:49:49.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cde00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01043f0 0x7fd4d01a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:49.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cde00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01043f0 0x7fd4d01a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33492/0 (socket says 172.21.15.71:33492) 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.283+0000 7fd4cde00700 1 -- 172.21.15.71:0/3151501246 learned_addr learned my addr 172.21.15.71:0/3151501246 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.284+0000 7fd4ce800700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 0x7fd4d01ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.284+0000 7fd4ce800700 1 -- 172.21.15.71:0/3151501246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d0108d20 msgr2=0x7fd4d01a24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.284+0000 7fd4ce800700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d0108d20 0x7fd4d01a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.284+0000 7fd4ce800700 1 -- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01043f0 msgr2=0x7fd4d01a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.284+0000 7fd4ce800700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01043f0 0x7fd4d01a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.284+0000 7fd4ce800700 1 -- 172.21.15.71:0/3151501246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d01ad540 con 0x7fd4d0109670 2024-05-27T09:49:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.284+0000 7fd4ce800700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 0x7fd4d01ad000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8015000 tx=0x7fd4c800cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:49.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.285+0000 7fd4c6a00700 1 -- 172.21.15.71:0/3151501246 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8021070 con 0x7fd4d0109670 2024-05-27T09:49:49.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.285+0000 7fd4c6a00700 1 -- 172.21.15.71:0/3151501246 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c801d450 con 0x7fd4d0109670 2024-05-27T09:49:49.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.285+0000 7fd4c6a00700 1 -- 172.21.15.71:0/3151501246 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80052a0 con 0x7fd4d0109670 2024-05-27T09:49:49.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.285+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d01ad710 con 0x7fd4d0109670 2024-05-27T09:49:49.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.285+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d01adb70 con 0x7fd4d0109670 2024-05-27T09:49:49.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.287+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d00512b0 con 0x7fd4d0109670 2024-05-27T09:49:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.291+0000 7fd4c6a00700 1 -- 172.21.15.71:0/3151501246 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd4c8024070 con 0x7fd4d0109670 2024-05-27T09:49:49.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.294+0000 7fd4c6a00700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd4b40b2bc0 0x7fd4b40b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:49.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.294+0000 7fd4c6a00700 1 -- 172.21.15.71:0/3151501246 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fd4c800f020 con 0x7fd4d0109670 2024-05-27T09:49:49.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.294+0000 7fd4c6a00700 1 -- 172.21.15.71:0/3151501246 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd4c802b020 con 0x7fd4d0109670 2024-05-27T09:49:49.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.296+0000 7fd4cde00700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd4b40b2bc0 0x7fd4b40b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.297+0000 7fd4cde00700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd4b40b2bc0 0x7fd4b40b50d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005950 tx=0x7fd4c0009310 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:49.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.827+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4d01ade60 con 0x7fd4d0109670 2024-05-27T09:49:49.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.828+0000 7fd4c6a00700 1 -- 172.21.15.71:0/3151501246 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7fd4c80ab8e0 con 0x7fd4d0109670 2024-05-27T09:49:49.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:49:49.831 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:49:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd4b40b2bc0 msgr2=0x7fd4b40b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd4b40b2bc0 0x7fd4b40b50d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005950 tx=0x7fd4c0009310 comp rx=0 tx=0).stop 2024-05-27T09:49:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 msgr2=0x7fd4d01ad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 0x7fd4d01ad000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8015000 tx=0x7fd4c800cc30 comp rx=0 tx=0).stop 2024-05-27T09:49:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 shutdown_connections 2024-05-27T09:49:49.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd4b40b2bc0 0x7fd4b40b50d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4d0109670 0x7fd4d01ad000 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01043f0 0x7fd4d01a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 --2- 172.21.15.71:0/3151501246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d0108d20 0x7fd4d01a24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:49.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 >> 172.21.15.71:0/3151501246 conn(0x7fd4d0079d00 msgr2=0x7fd4d0102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:49.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.832+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 shutdown_connections 2024-05-27T09:49:49.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:49.833+0000 7fd4cf200700 1 -- 172.21.15.71:0/3151501246 wait complete. 2024-05-27T09:49:49.836 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:49:50.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-27T09:49:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:50 smithi122 ceph-mon[36436]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:50.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:50 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3151501246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:50 smithi071 ceph-mon[31451]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:51.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:50 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3151501246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:50 smithi072 ceph-mon[35951]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-27T09:49:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:50 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3151501246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:49:51.437 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:52.674 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:49:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 26, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 4, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "f1da88c": { 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 4, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 149.4, 2024-05-27T09:49:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:49:52.676 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:49:52.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 -- 172.21.15.71:0/3024109029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 msgr2=0x7f0500104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 --2- 172.21.15.71:0/3024109029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 0x7f0500104810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04f00099c0 tx=0x7f04f0009cd0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 -- 172.21.15.71:0/3024109029 shutdown_connections 2024-05-27T09:49:52.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 --2- 172.21.15.71:0/3024109029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0500109680 0x7f0500110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 --2- 172.21.15.71:0/3024109029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 0x7f0500104810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 --2- 172.21.15.71:0/3024109029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0500108d30 0x7f0500109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 -- 172.21.15.71:0/3024109029 >> 172.21.15.71:0/3024109029 conn(0x7f0500079d40 msgr2=0x7f050007a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.499+0000 7f04ffe00700 1 -- 172.21.15.71:0/3024109029 shutdown_connections 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.501+0000 7f04ffe00700 1 -- 172.21.15.71:0/3024109029 wait complete. 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.502+0000 7f04ffe00700 1 Processor -- start 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.502+0000 7f04ffe00700 1 -- start start 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04ffe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 0x7f05001a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04ffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0500108d30 0x7f05001a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04ffe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0500109680 0x7f050019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04ffe00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0500114300 con 0x7f0500109680 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04ffe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0500114180 con 0x7f0500108d30 2024-05-27T09:49:52.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04ffe00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0500114480 con 0x7f0500104400 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04fe000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0500108d30 0x7f05001a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04fe000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0500108d30 0x7f05001a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52532/0 (socket says 172.21.15.71:52532) 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.503+0000 7f04fe000700 1 -- 172.21.15.71:0/47285391 learned_addr learned my addr 172.21.15.71:0/47285391 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.504+0000 7f04fea00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 0x7f05001a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.504+0000 7f04fea00700 1 -- 172.21.15.71:0/47285391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0500108d30 msgr2=0x7f05001a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.504+0000 7f04fea00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0500108d30 0x7f05001a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.504+0000 7f04fea00700 1 -- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0500109680 msgr2=0x7f050019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.504+0000 7f04fea00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0500109680 0x7f050019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.504+0000 7f04fea00700 1 -- 172.21.15.71:0/47285391 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050019b130 con 0x7f0500104400 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.504+0000 7f04fea00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 0x7f05001a0860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f04f00098e0 tx=0x7f04f00055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.505+0000 7f0504a00700 1 -- 172.21.15.71:0/47285391 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0026070 con 0x7f0500104400 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.505+0000 7f0504a00700 1 -- 172.21.15.71:0/47285391 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f000f460 con 0x7f0500104400 2024-05-27T09:49:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.505+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050019b3c0 con 0x7f0500104400 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.505+0000 7f0504a00700 1 -- 172.21.15.71:0/47285391 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0009e60 con 0x7f0500104400 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.505+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05000759e0 con 0x7f0500104400 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.511+0000 7f0504a00700 1 -- 172.21.15.71:0/47285391 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f04f0029070 con 0x7f0500104400 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.512+0000 7f05149e4b80 1 Processor -- start 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.513+0000 7f05149e4b80 1 -- start start 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.513+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4828dcf40 0x55b482a5c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.513+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a66050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.513+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b482a5ce00 0x55b482a685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.513+0000 7f05149e4b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b482989f40 con 0x55b4828dcf40 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.513+0000 7f05149e4b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b482979ae0 con 0x55b482a5c9f0 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.513+0000 7f05149e4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b48297db20 con 0x55b482a5ce00 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.514+0000 7f04fea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a66050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.514+0000 7f04fea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a66050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52546/0 (socket says 172.21.15.71:52546) 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.514+0000 7f04fea00700 1 -- 172.21.15.71:0/3758886136 learned_addr learned my addr 172.21.15.71:0/3758886136 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.514+0000 7f04ff400700 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4828dcf40 0x55b482a5c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.514+0000 7f0504a00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04e40b2a70 0x7f04e40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.514+0000 7f04fe000700 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b482a5ce00 0x55b482a685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.515+0000 7f0504a00700 1 -- 172.21.15.71:0/47285391 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f04f00e2f20 con 0x7f0500104400 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.515+0000 7f04fea00700 1 -- 172.21.15.71:0/3758886136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b482a5ce00 msgr2=0x55b482a685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.515+0000 7f04fea00700 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b482a5ce00 0x55b482a685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.515+0000 7f04fea00700 1 -- 172.21.15.71:0/3758886136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4828dcf40 msgr2=0x55b482a5c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.515+0000 7f04fea00700 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4828dcf40 0x55b482a5c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.515+0000 7f04fea00700 1 -- 172.21.15.71:0/3758886136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b482942520 con 0x55b482a5c9f0 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.515+0000 7f04ff400700 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4828dcf40 0x55b482a5c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.516+0000 7f04ff400700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04e40b2a70 0x7f04e40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.516+0000 7f04fea00700 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a66050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f04f00e0580 tx=0x7f04f0009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44402c611143c3a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.516+0000 7f04f4c00700 1 -- 172.21.15.71:0/3758886136 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00a6120 con 0x55b482a5c9f0 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.516+0000 7f04f4c00700 1 -- 172.21.15.71:0/3758886136 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f00a9d70 con 0x55b482a5c9f0 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.516+0000 7f04f4c00700 1 -- 172.21.15.71:0/3758886136 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00a99d0 con 0x55b482a5c9f0 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.517+0000 7f05149e4b80 1 -- 172.21.15.71:0/3758886136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 msgr2=0x55b482a66050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.517+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a66050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f04f00e0580 tx=0x7f04f0009310 comp rx=0 tx=0).stop 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.517+0000 7f04ff400700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04e40b2a70 0x7f04e40b4f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009fd0 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.518+0000 7f05149e4b80 1 -- 172.21.15.71:0/3758886136 shutdown_connections 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.518+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b482a5ce00 0x55b482a685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.518+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4828dcf40 0x55b482a5c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.518+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3758886136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a66050 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.518+0000 7f05149e4b80 1 -- 172.21.15.71:0/3758886136 >> 172.21.15.71:0/3758886136 conn(0x55b48293d0c0 msgr2=0x55b482a572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.518+0000 7f05149e4b80 1 -- 172.21.15.71:0/3758886136 shutdown_connections 2024-05-27T09:49:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.518+0000 7f05149e4b80 1 -- 172.21.15.71:0/3758886136 wait complete. 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.519+0000 7f05149e4b80 1 -- start start 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.519+0000 7f05149e4b80 1 Processor -- start 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a65b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a66090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 0x55b482a665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f05149e4b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b4828800a0 con 0x55b482a5c9f0 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f05149e4b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b48291a860 con 0x55b482a5ce00 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f05149e4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b482a68cd0 con 0x55b4828dcf40 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f05149e4b80 10 client.0 _ll_register_callbacks cb 0x55b482923d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f04fea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a65b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f04fea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a65b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58734/0 (socket says 172.21.15.71:58734) 2024-05-27T09:49:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f04fea00700 1 -- 172.21.15.71:0/3859110443 learned_addr learned my addr 172.21.15.71:0/3859110443 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.520+0000 7f04ff400700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 0x55b482a665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.521+0000 7f04fea00700 1 -- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 msgr2=0x55b482a665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.521+0000 7f04fea00700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 0x55b482a665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.521+0000 7f04fea00700 1 -- 172.21.15.71:0/3859110443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 msgr2=0x55b482a66090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04fe000700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a66090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04fea00700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a66090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04fea00700 1 -- 172.21.15.71:0/3859110443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4828c99d0 con 0x55b4828dcf40 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04fe000700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a66090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04fea00700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a65b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f04f0006010 tx=0x7f04f00a9af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1fc32b76101ad0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04e9600700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04e9600700 1 -- 172.21.15.71:0/3859110443 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00a9bb0 con 0x55b4828dcf40 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.522+0000 7f04e9600700 1 -- 172.21.15.71:0/3859110443 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f04f00aa6d0 con 0x55b4828dcf40 2024-05-27T09:49:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.523+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04f00a9d70 con 0x55b4828dcf40 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.523+0000 7f04e9600700 1 -- 172.21.15.71:0/3859110443 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f04f00aa030 con 0x55b4828dcf40 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.523+0000 7f05149e4b80 10 client.25738 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.523+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b48294a160 con 0x55b4828dcf40 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.523+0000 7f04e9600700 1 -- 172.21.15.71:0/3859110443 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f00a9d70 con 0x55b4828dcf40 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f04e9600700 1 -- 172.21.15.71:0/3859110443 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f04f00e6030 con 0x55b4828dcf40 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f05149e4b80 10 client.25738 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f05149e4b80 10 client.25738 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f05149e4b80 20 client.25738 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482a75a30 0x55b482a77e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f05149e4b80 4 client.25738 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b48298be90 con 0x55b482a75a30 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.526+0000 7f04fe000700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482a75a30 0x55b482a77e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.527+0000 7f04fe000700 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482a75a30 0x55b482a77e50 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c691bf85fb49ae7 server_cookie=90e7d86306c195cc in_seq=0 out_seq=0 2024-05-27T09:49:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.527+0000 7f04e9600700 10 client.25738 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f04e9600700 1 -- 172.21.15.71:0/3859110443 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55b48298be90 con 0x55b482a75a30 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f04e9600700 10 client.25738 handle_command_reply: tid=0 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 client.25738 shutdown 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 msgr2=0x55b482a65b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a65b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f04f0006010 tx=0x7f04f00a9af0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 shutdown_connections 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482a75a30 0x55b482a77e50 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 0x55b482a665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a65b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 --2- 172.21.15.71:0/3859110443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a66090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 >> 172.21.15.71:0/3859110443 conn(0x55b48293d0c0 msgr2=0x55b482a5ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.528+0000 7f04e9600700 0 client.25738 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.529+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 shutdown_connections 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.529+0000 7f05149e4b80 1 -- 172.21.15.71:0/3859110443 wait complete. 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.529+0000 7f05149e4b80 20 client.25738 trim_cache size 0 max 16384 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 Processor -- start 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 -- start start 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a5b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a67870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 0x55b482a60f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05001b3630 con 0x55b482a5c9f0 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f05001b0ec0 con 0x55b482a5ce00 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.570+0000 7f05149e4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05001aed10 con 0x55b4828dcf40 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a5b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a5b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58742/0 (socket says 172.21.15.71:58742) 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 -- 172.21.15.71:0/719734687 learned_addr learned my addr 172.21.15.71:0/719734687 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 -- 172.21.15.71:0/719734687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 msgr2=0x55b482a60f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 --2- 172.21.15.71:0/719734687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 0x55b482a60f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 -- 172.21.15.71:0/719734687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 msgr2=0x55b482a67870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 --2- 172.21.15.71:0/719734687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a67870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.571+0000 7f04fea00700 1 -- 172.21.15.71:0/719734687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b482a640c0 con 0x55b4828dcf40 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.572+0000 7f04fea00700 1 --2- 172.21.15.71:0/719734687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a5b630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f04f00ae750 tx=0x7f04f00a6250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58296956ad162cd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.572+0000 7f04ebe00700 1 -- 172.21.15.71:0/719734687 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00aa260 con 0x55b4828dcf40 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.572+0000 7f04ebe00700 1 -- 172.21.15.71:0/719734687 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f00aa6d0 con 0x55b4828dcf40 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.572+0000 7f04ebe00700 1 -- 172.21.15.71:0/719734687 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0003c30 con 0x55b4828dcf40 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.573+0000 7f05149e4b80 1 -- 172.21.15.71:0/719734687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 msgr2=0x55b482a5b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.573+0000 7f05149e4b80 1 --2- 172.21.15.71:0/719734687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a5b630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f04f00ae750 tx=0x7f04f00a6250 comp rx=0 tx=0).stop 2024-05-27T09:49:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 -- 172.21.15.71:0/719734687 shutdown_connections 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 --2- 172.21.15.71:0/719734687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5ce00 0x55b482a60f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 --2- 172.21.15.71:0/719734687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a5b630 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 --2- 172.21.15.71:0/719734687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5c9f0 0x55b482a67870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 -- 172.21.15.71:0/719734687 >> 172.21.15.71:0/719734687 conn(0x55b48293d0c0 msgr2=0x55b482a66360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 -- 172.21.15.71:0/719734687 shutdown_connections 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 -- 172.21.15.71:0/719734687 wait complete. 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.575+0000 7f05149e4b80 1 -- start start 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.576+0000 7f05149e4b80 1 Processor -- start 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a6a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f05149e4b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5ce00 0x55b482a6af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f05149e4b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05001af380 con 0x55b482a5ce00 2024-05-27T09:49:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f05149e4b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f05001b07f0 con 0x55b482a5c9f0 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f05149e4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05001afa50 con 0x55b4828dcf40 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f05149e4b80 10 client.0 _ll_register_callbacks cb 0x55b482923d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f04fea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f04fea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a6e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58746/0 (socket says 172.21.15.71:58746) 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f04fea00700 1 -- 172.21.15.71:0/569359116 learned_addr learned my addr 172.21.15.71:0/569359116 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f04fe000700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a6a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f04fea00700 1 -- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 msgr2=0x55b482a6a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f04fea00700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a6a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.577+0000 7f04ff400700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5ce00 0x55b482a6af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04fea00700 1 -- 172.21.15.71:0/569359116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5ce00 msgr2=0x55b482a6af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04fea00700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5ce00 0x55b482a6af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04fea00700 1 -- 172.21.15.71:0/569359116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b482a6b6b0 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04fe000700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a6a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04fea00700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a6e630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04f00b31f0 tx=0x7f04f00b2f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db235e557182767c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04e9600700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04e9600700 1 -- 172.21.15.71:0/569359116 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00ae300 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04f00aa6d0 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.578+0000 7f04e9600700 1 -- 172.21.15.71:0/569359116 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f04f00a94c0 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f04e9600700 1 -- 172.21.15.71:0/569359116 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f04f00a9700 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 10 client.25744 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b482a6b6b0 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f04e9600700 1 -- 172.21.15.71:0/569359116 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f00aa6d0 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f04e9600700 1 -- 172.21.15.71:0/569359116 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f04f00a4980 con 0x55b4828dcf40 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 10 client.25744 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 10 client.25744 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:49:52.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 20 client.25744 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482ae9eb0 0x55b482aec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 4 client.25744 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f1da88c", "release": true, "await": true}] 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.579+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f1da88c", "release": true, "await": true}) -- 0x55b482985670 con 0x55b482ae9eb0 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.580+0000 7f04fe000700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482ae9eb0 0x55b482aec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.581+0000 7f04fe000700 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482ae9eb0 0x55b482aec2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466bba5d7b83065c server_cookie=68ae9e519d7f2bae in_seq=0 out_seq=0 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.581+0000 7f04e9600700 10 client.25744 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.582+0000 7f04e9600700 1 -- 172.21.15.71:0/569359116 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55b482985670 con 0x55b482ae9eb0 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.582+0000 7f04e9600700 10 client.25744 handle_command_reply: tid=0 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.582+0000 7f05149e4b80 1 client.25744 shutdown 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 msgr2=0x55b482a6e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a6e630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04f00b31f0 tx=0x7f04f00b2f30 comp rx=0 tx=0).stop 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 shutdown_connections 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55b482ae9eb0 0x55b482aec2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b482a5ce00 0x55b482a6af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4828dcf40 0x55b482a6e630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 --2- 172.21.15.71:0/569359116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b482a5c9f0 0x55b482a6a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 >> 172.21.15.71:0/569359116 conn(0x55b48293d0c0 msgr2=0x55b482a71750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f04e9600700 0 client.25744 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 shutdown_connections 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 1 -- 172.21.15.71:0/569359116 wait complete. 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.583+0000 7f05149e4b80 20 client.25744 trim_cache size 0 max 16384 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.584+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04e40b2a70 msgr2=0x7f04e40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.584+0000 7f04ffe00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04e40b2a70 0x7f04e40b4f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009fd0 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.584+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 msgr2=0x7f05001a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.584+0000 7f04ffe00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 0x7f05001a0860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f04f00098e0 tx=0x7f04f00055f0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.586+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 shutdown_connections 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.586+0000 7f04ffe00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f04e40b2a70 0x7f04e40b4f80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.586+0000 7f04ffe00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0500109680 0x7f050019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.586+0000 7f04ffe00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0500104400 0x7f05001a0860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.586+0000 7f04ffe00700 1 --2- 172.21.15.71:0/47285391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0500108d30 0x7f05001a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.586+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 >> 172.21.15.71:0/47285391 conn(0x7f0500079d40 msgr2=0x7f05001027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.587+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 shutdown_connections 2024-05-27T09:49:52.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:52.587+0000 7f04ffe00700 1 -- 172.21.15.71:0/47285391 wait complete. 2024-05-27T09:49:52.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:52 smithi071 ceph-mon[31451]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-27T09:49:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 -- 172.21.15.71:0/1855933464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f215010b610 msgr2=0x7f215010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 --2- 172.21.15.71:0/1855933464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f215010b610 0x7f215010da30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2138009860 tx=0x7f213802a340 comp rx=0 tx=0).stop 2024-05-27T09:49:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 -- 172.21.15.71:0/1855933464 shutdown_connections 2024-05-27T09:49:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 --2- 172.21.15.71:0/1855933464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010e000 0x7f21501104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 --2- 172.21.15.71:0/1855933464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f215010b610 0x7f215010da30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 --2- 172.21.15.71:0/1855933464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2150104bb0 0x7f2150104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 -- 172.21.15.71:0/1855933464 >> 172.21.15.71:0/1855933464 conn(0x7f21500fe210 msgr2=0x7f2150100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.900+0000 7f2155c00640 1 -- 172.21.15.71:0/1855933464 shutdown_connections 2024-05-27T09:49:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.901+0000 7f2155c00640 1 -- 172.21.15.71:0/1855933464 wait complete. 2024-05-27T09:49:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 Processor -- start 2024-05-27T09:49:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 -- start start 2024-05-27T09:49:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2150104bb0 0x7f2150198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010b610 0x7f2150198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f215010e000 0x7f215019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2150111a70 con 0x7f2150104bb0 2024-05-27T09:49:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f21501118f0 con 0x7f215010b610 2024-05-27T09:49:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.902+0000 7f2155c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2150111bf0 con 0x7f215010e000 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010b610 0x7f2150198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010b610 0x7f2150198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52596/0 (socket says 172.21.15.71:52596) 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 -- 172.21.15.71:0/1656672256 learned_addr learned my addr 172.21.15.71:0/1656672256 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f214fe00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2150104bb0 0x7f2150198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 -- 172.21.15.71:0/1656672256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f215010e000 msgr2=0x7f215019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f215010e000 0x7f215019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 -- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2150104bb0 msgr2=0x7f2150198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2150104bb0 0x7f2150198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f2147400640 1 -- 172.21.15.71:0/1656672256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215019d290 con 0x7f215010b610 2024-05-27T09:49:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.903+0000 7f214fe00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2150104bb0 0x7f2150198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.904+0000 7f2147400640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010b610 0x7f2150198990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2138035040 tx=0x7f2138032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.904+0000 7f214d600640 1 -- 172.21.15.71:0/1656672256 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138037040 con 0x7f215010b610 2024-05-27T09:49:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.904+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215019d520 con 0x7f215010b610 2024-05-27T09:49:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.904+0000 7f214d600640 1 -- 172.21.15.71:0/1656672256 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2138041070 con 0x7f215010b610 2024-05-27T09:49:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.904+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215019da00 con 0x7f215010b610 2024-05-27T09:49:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.904+0000 7f214d600640 1 -- 172.21.15.71:0/1656672256 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138003850 con 0x7f215010b610 2024-05-27T09:49:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.907+0000 7f215e234740 1 Processor -- start 2024-05-27T09:49:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f215e234740 1 -- start start 2024-05-27T09:49:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f215e234740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39b11b0 0x5593c3d53a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f215e234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d53fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f215e234740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 0x5593c3d544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f215e234740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5593c3cc4b90 con 0x5593c39b11b0 2024-05-27T09:49:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f215e234740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5593c3cb4730 con 0x5593c39904d0 2024-05-27T09:49:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f215e234740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5593c3cb8770 con 0x5593c39882f0 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f214fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d53fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.908+0000 7f214fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d53fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58776/0 (socket says 172.21.15.71:58776) 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.909+0000 7f214fe00640 1 -- 172.21.15.71:0/3892235595 learned_addr learned my addr 172.21.15.71:0/3892235595 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.909+0000 7f2155200640 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39b11b0 0x5593c3d53a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.909+0000 7f214fe00640 1 -- 172.21.15.71:0/3892235595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 msgr2=0x5593c3d544e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.909+0000 7f214fe00640 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 0x5593c3d544e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.909+0000 7f214fe00640 1 -- 172.21.15.71:0/3892235595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39b11b0 msgr2=0x5593c3d53a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.909+0000 7f214fe00640 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39b11b0 0x5593c3d53a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.909+0000 7f214fe00640 1 -- 172.21.15.71:0/3892235595 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593c3c4d8b0 con 0x5593c39882f0 2024-05-27T09:49:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.910+0000 7f214fe00640 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d53fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f214000ffc0 tx=0x7f2140005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a96945fddb0f62 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.910+0000 7f214d600640 1 -- 172.21.15.71:0/1656672256 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2138004050 con 0x7f215010b610 2024-05-27T09:49:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.910+0000 7f2145600640 1 -- 172.21.15.71:0/3892235595 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140005020 con 0x5593c39882f0 2024-05-27T09:49:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.910+0000 7f2145600640 1 -- 172.21.15.71:0/3892235595 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2140005670 con 0x5593c39882f0 2024-05-27T09:49:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.910+0000 7f2145600640 1 -- 172.21.15.71:0/3892235595 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214001b6d0 con 0x5593c39882f0 2024-05-27T09:49:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.911+0000 7f215e234740 1 -- 172.21.15.71:0/3892235595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 msgr2=0x5593c3d53fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.911+0000 7f215e234740 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d53fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f214000ffc0 tx=0x7f2140005f90 comp rx=0 tx=0).stop 2024-05-27T09:49:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.911+0000 7f215e234740 1 -- 172.21.15.71:0/3892235595 shutdown_connections 2024-05-27T09:49:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.911+0000 7f215e234740 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 0x5593c3d544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.911+0000 7f215e234740 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d53fa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.911+0000 7f215e234740 1 --2- 172.21.15.71:0/3892235595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39b11b0 0x5593c3d53a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.911+0000 7f215e234740 1 -- 172.21.15.71:0/3892235595 >> 172.21.15.71:0/3892235595 conn(0x5593c39a5300 msgr2=0x5593c3d50210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.912+0000 7f214d600640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f21340b29d0 0x7f21340b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.913+0000 7f214fe00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f21340b29d0 0x7f21340b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.913+0000 7f214d600640 1 -- 172.21.15.71:0/1656672256 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2138101fa0 con 0x7f215010b610 2024-05-27T09:49:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.913+0000 7f215e234740 1 -- 172.21.15.71:0/3892235595 shutdown_connections 2024-05-27T09:49:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.913+0000 7f215e234740 1 -- 172.21.15.71:0/3892235595 wait complete. 2024-05-27T09:49:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.914+0000 7f215e234740 1 -- start start 2024-05-27T09:49:52.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.914+0000 7f215e234740 1 Processor -- start 2024-05-27T09:49:52.915 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.915+0000 7f214fe00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f21340b29d0 0x7f21340b4ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2140011010 tx=0x7f2140000bc0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.915+0000 7f215e234740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d6c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f215e234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39904d0 0x5593c3d6caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f215e234740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f214fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d6c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f214fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d6c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33574/0 (socket says 172.21.15.71:33574) 2024-05-27T09:49:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f214fe00640 1 -- 172.21.15.71:0/2099784511 learned_addr learned my addr 172.21.15.71:0/2099784511 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5593c399a790 con 0x5593c39882f0 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5593c3c5cbc0 con 0x5593c39b11b0 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5593c3d60b90 con 0x5593c39904d0 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.916+0000 7f2147400640 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39904d0 0x5593c3d6caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.917+0000 7f214fe00640 1 -- 172.21.15.71:0/2099784511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39904d0 msgr2=0x5593c3d6caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.917+0000 7f214fe00640 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39904d0 0x5593c3d6caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.917+0000 7f214fe00640 1 -- 172.21.15.71:0/2099784511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 msgr2=0x5593c3d669a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.917+0000 7f214fe00640 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d669a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.917+0000 7f214fe00640 1 -- 172.21.15.71:0/2099784511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593c39c9210 con 0x5593c39882f0 2024-05-27T09:49:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.917+0000 7f214fe00640 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d6c5b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f214001e000 tx=0x7f2140004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a056aefab4bd0d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f213e000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f2147400640 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39904d0 0x5593c3d6caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f215e234740 10 client.0 _ll_register_callbacks cb 0x5593c3c3a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2140005670 con 0x5593c39882f0 2024-05-27T09:49:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f213e000640 1 -- 172.21.15.71:0/2099784511 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140035060 con 0x5593c39882f0 2024-05-27T09:49:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f213e000640 1 -- 172.21.15.71:0/2099784511 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f214001bcf0 con 0x5593c39882f0 2024-05-27T09:49:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f213e000640 1 -- 172.21.15.71:0/2099784511 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2140004c10 con 0x5593c39882f0 2024-05-27T09:49:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f215e234740 10 client.15615 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.918+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5593c3a95620 con 0x5593c39882f0 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.919+0000 7f213e000640 1 -- 172.21.15.71:0/2099784511 <== mon.0 v2:172.21.15.71:3300/0 4 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f2140025460 con 0x5593c39882f0 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.919+0000 7f215e234740 10 client.15615 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.919+0000 7f215e234740 10 client.15615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.919+0000 7f215e234740 20 client.15615 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.919+0000 7f215e234740 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c396fd80 0x5593c3d78250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.919+0000 7f215e234740 4 client.15615 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.919+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593c3cc6ae0 con 0x5593c396fd80 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.920+0000 7f2147400640 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c396fd80 0x5593c3d78250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.920+0000 7f213e000640 10 client.15615 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.920+0000 7f2147400640 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c396fd80 0x5593c3d78250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a87ff5e42ff96df server_cookie=b89d2f55ccae8f4 in_seq=0 out_seq=0 2024-05-27T09:49:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.921+0000 7f213e000640 1 -- 172.21.15.71:0/2099784511 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5593c3cc6ae0 con 0x5593c396fd80 2024-05-27T09:49:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.921+0000 7f213e000640 10 client.15615 handle_command_reply: tid=0 2024-05-27T09:49:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.921+0000 7f215e234740 1 client.15615 shutdown 2024-05-27T09:49:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.921+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 msgr2=0x5593c3d6c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.921+0000 7f215e234740 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d6c5b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f214001e000 tx=0x7f2140004e30 comp rx=0 tx=0).stop 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 shutdown_connections 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39904d0 0x5593c3d6caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c396fd80 0x5593c3d78250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 --2- 172.21.15.71:0/2099784511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d6c5b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 >> 172.21.15.71:0/2099784511 conn(0x5593c39a5300 msgr2=0x5593c3d55780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f213e000640 0 client.15615 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 shutdown_connections 2024-05-27T09:49:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 1 -- 172.21.15.71:0/2099784511 wait complete. 2024-05-27T09:49:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.922+0000 7f215e234740 20 client.15615 trim_cache size 0 max 16384 2024-05-27T09:49:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 Processor -- start 2024-05-27T09:49:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 -- start start 2024-05-27T09:49:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d60060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 0x5593c3d61df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39b11b0 0x5593c3d54020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21501afec0 con 0x5593c39882f0 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f21501ad790 con 0x5593c39904d0 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.953+0000 7f215e234740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f21501ab5e0 con 0x5593c39b11b0 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f214fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d60060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f214fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d60060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33584/0 (socket says 172.21.15.71:33584) 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f214fe00640 1 -- 172.21.15.71:0/3853643934 learned_addr learned my addr 172.21.15.71:0/3853643934 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f2147400640 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 0x5593c3d61df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f2155200640 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39b11b0 0x5593c3d54020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f2155200640 1 -- 172.21.15.71:0/3853643934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 msgr2=0x5593c3d61df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f2155200640 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 0x5593c3d61df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f2155200640 1 -- 172.21.15.71:0/3853643934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 msgr2=0x5593c3d60060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f2155200640 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d60060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f2155200640 1 -- 172.21.15.71:0/3853643934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593c3d64f10 con 0x5593c39b11b0 2024-05-27T09:49:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.954+0000 7f214fe00640 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d60060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.955+0000 7f2155200640 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39b11b0 0x5593c3d54020 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2148009a60 tx=0x7f21480098b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31cb48316ae8f7e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.955+0000 7f2144c00640 1 -- 172.21.15.71:0/3853643934 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214801c070 con 0x5593c39b11b0 2024-05-27T09:49:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.955+0000 7f2144c00640 1 -- 172.21.15.71:0/3853643934 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2148003d80 con 0x5593c39b11b0 2024-05-27T09:49:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.955+0000 7f2144c00640 1 -- 172.21.15.71:0/3853643934 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148017a90 con 0x5593c39b11b0 2024-05-27T09:49:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 -- 172.21.15.71:0/3853643934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39b11b0 msgr2=0x5593c3d54020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39b11b0 0x5593c3d54020 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2148009a60 tx=0x7f21480098b0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 -- 172.21.15.71:0/3853643934 shutdown_connections 2024-05-27T09:49:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39b11b0 0x5593c3d54020 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39904d0 0x5593c3d61df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 --2- 172.21.15.71:0/3853643934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39882f0 0x5593c3d60060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 -- 172.21.15.71:0/3853643934 >> 172.21.15.71:0/3853643934 conn(0x5593c39a5300 msgr2=0x5593c3d53910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 -- 172.21.15.71:0/3853643934 shutdown_connections 2024-05-27T09:49:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.956+0000 7f215e234740 1 -- 172.21.15.71:0/3853643934 wait complete. 2024-05-27T09:49:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.957+0000 7f215e234740 1 -- start start 2024-05-27T09:49:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.957+0000 7f215e234740 1 Processor -- start 2024-05-27T09:49:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f215e234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d6d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f215e234740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39904d0 0x5593c3d6d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f215e234740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d6dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f215e234740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21501abc50 con 0x5593c39904d0 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f215e234740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f21501ad0c0 con 0x5593c39b11b0 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f215e234740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f21501ac320 con 0x5593c39882f0 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f215e234740 10 client.0 _ll_register_callbacks cb 0x7f2148009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f2155200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d6dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f214fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d6d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f2147400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39904d0 0x5593c3d6d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f214fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d6d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58806/0 (socket says 172.21.15.71:58806) 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.958+0000 7f214fe00640 1 -- 172.21.15.71:0/2904652187 learned_addr learned my addr 172.21.15.71:0/2904652187 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f214fe00640 1 -- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 msgr2=0x5593c3d6dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f214fe00640 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d6dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f214fe00640 1 -- 172.21.15.71:0/2904652187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39904d0 msgr2=0x5593c3d6d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f214fe00640 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39904d0 0x5593c3d6d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f214fe00640 1 -- 172.21.15.71:0/2904652187 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593c3dde840 con 0x5593c39882f0 2024-05-27T09:49:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f2155200640 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d6dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:49:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f2147400640 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39904d0 0x5593c3d6d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:49:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f214fe00640 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d6d180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f214000f7c0 tx=0x7f214000e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627877b11c13d96a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.959+0000 7f213e000640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.960+0000 7f213e000640 1 -- 172.21.15.71:0/2904652187 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140035070 con 0x5593c39882f0 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.960+0000 7f213e000640 1 -- 172.21.15.71:0/2904652187 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2140020040 con 0x5593c39882f0 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.960+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2148003d80 con 0x5593c39882f0 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.960+0000 7f213e000640 1 -- 172.21.15.71:0/2904652187 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f214004a050 con 0x5593c39882f0 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.960+0000 7f215e234740 10 client.25759 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.960+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5593c3ddfa70 con 0x5593c39882f0 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.961+0000 7f213e000640 1 -- 172.21.15.71:0/2904652187 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f214003f020 con 0x5593c39882f0 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f213e000640 1 -- 172.21.15.71:0/2904652187 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f214003a480 con 0x5593c39882f0 2024-05-27T09:49:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f215e234740 10 client.25759 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f215e234740 10 client.25759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f215e234740 20 client.25759 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f215e234740 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c39451c0 0x5593c3de2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f215e234740 4 client.25759 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f2148003d80 con 0x5593c39451c0 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.962+0000 7f2147400640 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c39451c0 0x5593c3de2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.963+0000 7f213e000640 10 client.25759 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.963+0000 7f2147400640 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c39451c0 0x5593c3de2130 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a27bb82cc704b638 server_cookie=7823075b26e5b66d in_seq=0 out_seq=0 2024-05-27T09:49:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.967+0000 7f213e000640 1 -- 172.21.15.71:0/2904652187 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f2148003d80 con 0x5593c39451c0 2024-05-27T09:49:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.967+0000 7f213e000640 10 client.25759 handle_command_reply: tid=0 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.967+0000 7f215e234740 1 client.25759 shutdown 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.967+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 msgr2=0x5593c3d6d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.967+0000 7f215e234740 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d6d180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f214000f7c0 tx=0x7f214000e000 comp rx=0 tx=0).stop 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 shutdown_connections 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5593c39b11b0 0x5593c3d6dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5593c39451c0 0x5593c3de2130 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593c39904d0 0x5593c3d6d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 --2- 172.21.15.71:0/2904652187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593c39882f0 0x5593c3d6d180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 >> 172.21.15.71:0/2904652187 conn(0x5593c39a5300 msgr2=0x5593c3d55670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f213e000640 0 client.25759 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:49:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 shutdown_connections 2024-05-27T09:49:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 1 -- 172.21.15.71:0/2904652187 wait complete. 2024-05-27T09:49:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.968+0000 7f215e234740 20 client.25759 trim_cache size 0 max 16384 2024-05-27T09:49:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:49:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:49:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f21340b29d0 msgr2=0x7f21340b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f21340b29d0 0x7f21340b4ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2140011010 tx=0x7f2140000bc0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010b610 msgr2=0x7f2150198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010b610 0x7f2150198990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2138035040 tx=0x7f2138032d50 comp rx=0 tx=0).stop 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 shutdown_connections 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f21340b29d0 0x7f21340b4ee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f215010e000 0x7f215019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215010b610 0x7f2150198990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 --2- 172.21.15.71:0/1656672256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2150104bb0 0x7f2150198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.969+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 >> 172.21.15.71:0/1656672256 conn(0x7f21500fe210 msgr2=0x7f215010e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.971+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 shutdown_connections 2024-05-27T09:49:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:49:52.971+0000 7f2155c00640 1 -- 172.21.15.71:0/1656672256 wait complete. 2024-05-27T09:49:52.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:52 smithi122 ceph-mon[36436]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-27T09:49:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:52 smithi072 ceph-mon[35951]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-27T09:49:53.690 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f1da88c', total seconds elapsed: 44.0 2024-05-27T09:49:54.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:54 smithi122 ceph-mon[36436]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:49:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:54 smithi071 ceph-mon[31451]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:49:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:54 smithi072 ceph-mon[35951]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:49:55.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.088+0000 7f999f200700 1 -- 172.21.15.71:0/9736918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0105bd0 msgr2=0x7f99a010e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.088+0000 7f999f200700 1 --2- 172.21.15.71:0/9736918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0105bd0 0x7f99a010e120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f998c009990 tx=0x7f998c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.088+0000 7f999f200700 1 -- 172.21.15.71:0/9736918 shutdown_connections 2024-05-27T09:49:55.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.088+0000 7f999f200700 1 --2- 172.21.15.71:0/9736918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a010e6f0 0x7f99a0110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.088+0000 7f999f200700 1 --2- 172.21.15.71:0/9736918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99a0105280 0x7f99a0105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.088+0000 7f999f200700 1 --2- 172.21.15.71:0/9736918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0105bd0 0x7f99a010e120 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.088+0000 7f999f200700 1 -- 172.21.15.71:0/9736918 >> 172.21.15.71:0/9736918 conn(0x7f99a0078ab0 msgr2=0x7f99a0078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:55.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.089+0000 7f999f200700 1 -- 172.21.15.71:0/9736918 shutdown_connections 2024-05-27T09:49:55.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.089+0000 7f999f200700 1 -- 172.21.15.71:0/9736918 wait complete. 2024-05-27T09:49:55.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.091+0000 7f999f200700 1 Processor -- start 2024-05-27T09:49:55.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.091+0000 7f999f200700 1 -- start start 2024-05-27T09:49:55.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.091+0000 7f999f200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a0105280 0x7f99a019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999f200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99a010e6f0 0x7f99a019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999f200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0198990 0x7f99a0198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999f200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99a0112110 con 0x7f99a0198990 2024-05-27T09:49:55.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999f200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99a0111f90 con 0x7f99a0105280 2024-05-27T09:49:55.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999f200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99a0112290 con 0x7f99a010e6f0 2024-05-27T09:49:55.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999d400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99a010e6f0 0x7f99a019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999d400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99a010e6f0 0x7f99a019ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41980/0 (socket says 172.21.15.71:41980) 2024-05-27T09:49:55.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999d400700 1 -- 172.21.15.71:0/3187085021 learned_addr learned my addr 172.21.15.71:0/3187085021 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:55.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999de00700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a0105280 0x7f99a019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.092+0000 7f999e800700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0198990 0x7f99a0198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.093+0000 7f999de00700 1 -- 172.21.15.71:0/3187085021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99a010e6f0 msgr2=0x7f99a019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.093+0000 7f999de00700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99a010e6f0 0x7f99a019ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.093+0000 7f999de00700 1 -- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0198990 msgr2=0x7f99a0198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.093+0000 7f999de00700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0198990 0x7f99a0198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.093+0000 7f999de00700 1 -- 172.21.15.71:0/3187085021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a0199520 con 0x7f99a0105280 2024-05-27T09:49:55.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.093+0000 7f999de00700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a0105280 0x7f99a019e7f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f999000e9f0 tx=0x7f999000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:55.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.094+0000 7f9996a00700 1 -- 172.21.15.71:0/3187085021 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999000cbd0 con 0x7f99a0105280 2024-05-27T09:49:55.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.094+0000 7f9996a00700 1 -- 172.21.15.71:0/3187085021 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999000cd70 con 0x7f99a0105280 2024-05-27T09:49:55.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.094+0000 7f9996a00700 1 -- 172.21.15.71:0/3187085021 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990018680 con 0x7f99a0105280 2024-05-27T09:49:55.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.094+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a019f5f0 con 0x7f99a0105280 2024-05-27T09:49:55.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.094+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a019fae0 con 0x7f99a0105280 2024-05-27T09:49:55.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.098+0000 7f9996a00700 1 -- 172.21.15.71:0/3187085021 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f9990018820 con 0x7f99a0105280 2024-05-27T09:49:55.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.100+0000 7f9996a00700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99840b2a70 0x7f99840b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.100+0000 7f9996a00700 1 -- 172.21.15.71:0/3187085021 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f99900e28a0 con 0x7f99a0105280 2024-05-27T09:49:55.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.101+0000 7f999d400700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99840b2a70 0x7f99840b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.101+0000 7f99b3cf1b80 1 Processor -- start 2024-05-27T09:49:55.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.102+0000 7f99b3cf1b80 1 -- start start 2024-05-27T09:49:55.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.102+0000 7f999d400700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99840b2a70 0x7f99840b4f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99a01026e0 tx=0x7f998c005fb0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f50ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51410 0x5589a2f5bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51820 0x5589a2f5e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5589a2e7fe40 con 0x5589a2f51410 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5589a2e6f9e0 con 0x5589a2f51820 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5589a2e73a20 con 0x5589a2dd2e40 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f999de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f50ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f999de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f50ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41988/0 (socket says 172.21.15.71:41988) 2024-05-27T09:49:55.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.103+0000 7f999de00700 1 -- 172.21.15.71:0/2314181517 learned_addr learned my addr 172.21.15.71:0/2314181517 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:55.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.104+0000 7f999e800700 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51820 0x5589a2f5e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.104+0000 7f999de00700 1 -- 172.21.15.71:0/2314181517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51820 msgr2=0x5589a2f5e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:55.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.104+0000 7f999de00700 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51820 0x5589a2f5e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.104+0000 7f999de00700 1 -- 172.21.15.71:0/2314181517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51410 msgr2=0x5589a2f5bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:49:55.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.104+0000 7f999de00700 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51410 0x5589a2f5bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.104+0000 7f999de00700 1 -- 172.21.15.71:0/2314181517 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a2e38420 con 0x5589a2dd2e40 2024-05-27T09:49:55.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.104+0000 7f999e800700 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51820 0x5589a2f5e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:55.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.105+0000 7f999de00700 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f50ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99900a5bd0 tx=0x7f99900a93e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c592bf55346baca server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:55.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.105+0000 7f998b400700 1 -- 172.21.15.71:0/2314181517 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99900aa250 con 0x5589a2dd2e40 2024-05-27T09:49:55.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.105+0000 7f998b400700 1 -- 172.21.15.71:0/2314181517 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99900a9b50 con 0x5589a2dd2e40 2024-05-27T09:49:55.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.105+0000 7f998b400700 1 -- 172.21.15.71:0/2314181517 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99900b2780 con 0x5589a2dd2e40 2024-05-27T09:49:55.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2314181517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 msgr2=0x5589a2f50ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f50ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99900a5bd0 tx=0x7f99900a93e0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2314181517 shutdown_connections 2024-05-27T09:49:55.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51820 0x5589a2f5e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f50ed0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2314181517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51410 0x5589a2f5bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2314181517 >> 172.21.15.71:0/2314181517 conn(0x5589a2e32fc0 msgr2=0x5589a2f4cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:55.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2314181517 shutdown_connections 2024-05-27T09:49:55.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.107+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2314181517 wait complete. 2024-05-27T09:49:55.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.108+0000 7f99b3cf1b80 1 -- start start 2024-05-27T09:49:55.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 1 Processor -- start 2024-05-27T09:49:55.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f5b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51820 0x5589a2f5c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5589a2d75fa0 con 0x5589a2f51820 2024-05-27T09:49:55.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5589a2e10760 con 0x5589a2f51410 2024-05-27T09:49:55.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5589a2f6f9a0 con 0x5589a2dd2e40 2024-05-27T09:49:55.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.109+0000 7f99b3cf1b80 10 client.0 _ll_register_callbacks cb 0x5589a2e19c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.110+0000 7f999de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f5b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.110+0000 7f999de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f5b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42000/0 (socket says 172.21.15.71:42000) 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.110+0000 7f999de00700 1 -- 172.21.15.71:0/3181150225 learned_addr learned my addr 172.21.15.71:0/3181150225 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.110+0000 7f999e800700 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51820 0x5589a2f5c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.110+0000 7f999d400700 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f999de00700 1 -- 172.21.15.71:0/3181150225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 msgr2=0x5589a2f5bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f999de00700 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f999de00700 1 -- 172.21.15.71:0/3181150225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51820 msgr2=0x5589a2f5c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f999de00700 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51820 0x5589a2f5c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f999de00700 1 -- 172.21.15.71:0/3181150225 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a2dbf8d0 con 0x5589a2dd2e40 2024-05-27T09:49:55.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f999de00700 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f5b600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99900a9ae0 tx=0x7f999000cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1bfb5667b5b107 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f997fe00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.111+0000 7f997fe00700 1 -- 172.21.15.71:0/3181150225 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99900c9060 con 0x5589a2dd2e40 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.112+0000 7f997fe00700 1 -- 172.21.15.71:0/3181150225 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f99900a6140 con 0x5589a2dd2e40 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.112+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99900a9b50 con 0x5589a2dd2e40 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.112+0000 7f997fe00700 1 -- 172.21.15.71:0/3181150225 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f99900c2070 con 0x5589a2dd2e40 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.112+0000 7f99b3cf1b80 10 client.25771 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.112+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5589a2e40060 con 0x5589a2dd2e40 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f997fe00700 1 -- 172.21.15.71:0/3181150225 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99900a9b50 con 0x5589a2dd2e40 2024-05-27T09:49:55.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f997fe00700 1 -- 172.21.15.71:0/3181150225 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f99900a55c0 con 0x5589a2dd2e40 2024-05-27T09:49:55.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f99b3cf1b80 10 client.25771 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:55.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f99b3cf1b80 10 client.25771 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:49:55.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f99b3cf1b80 20 client.25771 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:55.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2f7ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f99b3cf1b80 4 client.25771 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:55.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.113+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589a2e81d90 con 0x5589a2f7c790 2024-05-27T09:49:55.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.115+0000 7f999d400700 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2f7ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.116+0000 7f997fe00700 10 client.25771 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:55.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.116+0000 7f999d400700 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2f7ebb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=470d727d6b7aa042 server_cookie=5cbf643d3f9fd803 in_seq=0 out_seq=0 2024-05-27T09:49:55.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.116+0000 7f997fe00700 1 -- 172.21.15.71:0/3181150225 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5589a2e81d90 con 0x5589a2f7c790 2024-05-27T09:49:55.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.116+0000 7f997fe00700 10 client.25771 handle_command_reply: tid=0 2024-05-27T09:49:55.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.117+0000 7f99b3cf1b80 1 client.25771 shutdown 2024-05-27T09:49:55.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.117+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 msgr2=0x5589a2f5b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.117+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f5b600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99900a9ae0 tx=0x7f999000cf20 comp rx=0 tx=0).stop 2024-05-27T09:49:55.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 shutdown_connections 2024-05-27T09:49:55.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2f7ebb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2f51820 0x5589a2f5c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f997fe00700 0 client.25771 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:55.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2dd2e40 0x5589a2f5b600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/3181150225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 >> 172.21.15.71:0/3181150225 conn(0x5589a2e32fc0 msgr2=0x5589a2f4bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 shutdown_connections 2024-05-27T09:49:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.118+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/3181150225 wait complete. 2024-05-27T09:49:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.119+0000 7f99b3cf1b80 20 client.25771 trim_cache size 0 max 16384 2024-05-27T09:49:55.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.144+0000 7f99b3cf1b80 1 Processor -- start 2024-05-27T09:49:55.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.144+0000 7f99b3cf1b80 1 -- start start 2024-05-27T09:49:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f5a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99a006f0f0 con 0x5589a2dd2e40 2024-05-27T09:49:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99a01a7270 con 0x5589a2f51410 2024-05-27T09:49:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99a01a50c0 con 0x5589a2f51820 2024-05-27T09:49:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f999d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f999e800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f999d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51654/0 (socket says 172.21.15.71:51654) 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.145+0000 7f999d400700 1 -- 172.21.15.71:0/955869626 learned_addr learned my addr 172.21.15.71:0/955869626 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999d400700 1 -- 172.21.15.71:0/955869626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 msgr2=0x5589a2f557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999d400700 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999d400700 1 -- 172.21.15.71:0/955869626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 msgr2=0x5589a2f5a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999de00700 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f5a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999d400700 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f5a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999d400700 1 -- 172.21.15.71:0/955869626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a2f59b70 con 0x5589a2f51410 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999de00700 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f5a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.146+0000 7f999d400700 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5daa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b2e0 tx=0x7f998c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68dc5b6312a00a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.147+0000 7f998aa00700 1 -- 172.21.15.71:0/955869626 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c004d80 con 0x5589a2f51410 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.147+0000 7f998aa00700 1 -- 172.21.15.71:0/955869626 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f998c035030 con 0x5589a2f51410 2024-05-27T09:49:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.147+0000 7f998aa00700 1 -- 172.21.15.71:0/955869626 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c00b860 con 0x5589a2f51410 2024-05-27T09:49:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/955869626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 msgr2=0x5589a2f5daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5daa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b2e0 tx=0x7f998c01f000 comp rx=0 tx=0).stop 2024-05-27T09:49:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/955869626 shutdown_connections 2024-05-27T09:49:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f5a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/955869626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f5daa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/955869626 >> 172.21.15.71:0/955869626 conn(0x5589a2e32fc0 msgr2=0x5589a2f77c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/955869626 shutdown_connections 2024-05-27T09:49:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.148+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/955869626 wait complete. 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.149+0000 7f99b3cf1b80 1 -- start start 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.149+0000 7f99b3cf1b80 1 Processor -- start 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f81f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f7f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f99b3cf1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f7f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99a01a5730 con 0x5589a2dd2e40 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99a01a6ba0 con 0x5589a2f51410 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f99b3cf1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99a01a5e00 con 0x5589a2f51820 2024-05-27T09:49:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f99b3cf1b80 10 client.0 _ll_register_callbacks cb 0x5589a2e19c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:55.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f999de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f81f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f999de00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f81f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55576/0 (socket says 172.21.15.71:55576) 2024-05-27T09:49:55.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.150+0000 7f999de00700 1 -- 172.21.15.71:0/2569558629 learned_addr learned my addr 172.21.15.71:0/2569558629 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:55.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999d400700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f7f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999e800700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f7f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999de00700 1 -- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 msgr2=0x5589a2f7f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:55.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999de00700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f7f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999de00700 1 -- 172.21.15.71:0/2569558629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 msgr2=0x5589a2f7f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:55.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999de00700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f7f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999de00700 1 -- 172.21.15.71:0/2569558629 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a2f7fd70 con 0x5589a2dd2e40 2024-05-27T09:49:55.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999d400700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f7f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:55.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f999de00700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f81f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f99900a59b0 tx=0x7f9990000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c999d30e013a24 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:55.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.151+0000 7f997fe00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:49:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.152+0000 7f997fe00700 1 -- 172.21.15.71:0/2569558629 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99900c9040 con 0x5589a2dd2e40 2024-05-27T09:49:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.152+0000 7f997fe00700 1 -- 172.21.15.71:0/2569558629 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9990018b10 con 0x5589a2dd2e40 2024-05-27T09:49:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.152+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f998c035030 con 0x5589a2dd2e40 2024-05-27T09:49:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.152+0000 7f997fe00700 1 -- 172.21.15.71:0/2569558629 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f99900aa250 con 0x5589a2dd2e40 2024-05-27T09:49:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.152+0000 7f99b3cf1b80 10 client.15633 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.152+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5589a2fe6b40 con 0x5589a2dd2e40 2024-05-27T09:49:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.152+0000 7f997fe00700 1 -- 172.21.15.71:0/2569558629 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f998c035030 con 0x5589a2dd2e40 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f997fe00700 1 -- 172.21.15.71:0/2569558629 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f99900cc0d0 con 0x5589a2dd2e40 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f99b3cf1b80 10 client.15633 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f99b3cf1b80 10 client.15633 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f99b3cf1b80 20 client.15633 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2fe9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f99b3cf1b80 4 client.15633 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589a2e7b570 con 0x5589a2f7c790 2024-05-27T09:49:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.153+0000 7f999d400700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2fe9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.154+0000 7f999d400700 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2fe9130 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4d4e689d7865aa2 server_cookie=a96b8037fbb27329 in_seq=0 out_seq=0 2024-05-27T09:49:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.154+0000 7f997fe00700 10 client.15633 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.154+0000 7f997fe00700 1 -- 172.21.15.71:0/2569558629 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589a2e7b570 con 0x5589a2f7c790 2024-05-27T09:49:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.154+0000 7f997fe00700 10 client.15633 handle_command_reply: tid=0 2024-05-27T09:49:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.154+0000 7f99b3cf1b80 1 client.15633 shutdown 2024-05-27T09:49:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 msgr2=0x5589a2f81f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f81f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f99900a59b0 tx=0x7f9990000bc0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 shutdown_connections 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x5589a2f7c790 0x5589a2fe9130 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a2f51820 0x5589a2f7f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5589a2dd2e40 0x5589a2f81f70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 --2- 172.21.15.71:0/2569558629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5589a2f51410 0x5589a2f7f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 >> 172.21.15.71:0/2569558629 conn(0x5589a2e32fc0 msgr2=0x5589a2f5b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f997fe00700 0 client.15633 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.155+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 shutdown_connections 2024-05-27T09:49:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.156+0000 7f99b3cf1b80 1 -- 172.21.15.71:0/2569558629 wait complete. 2024-05-27T09:49:55.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.156+0000 7f99b3cf1b80 20 client.15633 trim_cache size 0 max 16384 2024-05-27T09:49:55.158 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:49:55.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99840b2a70 msgr2=0x7f99840b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99840b2a70 0x7f99840b4f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99a01026e0 tx=0x7f998c005fb0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a0105280 msgr2=0x7f99a019e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a0105280 0x7f99a019e7f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f999000e9f0 tx=0x7f999000ed00 comp rx=0 tx=0).stop 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 shutdown_connections 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99840b2a70 0x7f99840b4f80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99a0198990 0x7f99a0198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a0105280 0x7f99a019e7f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 --2- 172.21.15.71:0/3187085021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99a010e6f0 0x7f99a019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 >> 172.21.15.71:0/3187085021 conn(0x7f99a0078ab0 msgr2=0x7f99a00fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 shutdown_connections 2024-05-27T09:49:55.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:55.158+0000 7f999f200700 1 -- 172.21.15.71:0/3187085021 wait complete. 2024-05-27T09:49:56.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-27T09:49:56.485 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:49:56.926 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:56 smithi071 ceph-mon[31451]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:49:56.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:56 smithi122 ceph-mon[36436]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:49:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:56 smithi072 ceph-mon[35951]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 -- 172.21.15.71:0/4253817152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3bc0764a0 msgr2=0x7fe3bc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 --2- 172.21.15.71:0/4253817152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc114c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009990 tx=0x7fe3a8009ca0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 -- 172.21.15.71:0/4253817152 shutdown_connections 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 --2- 172.21.15.71:0/4253817152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3bc115170 0x7fe3bc117590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 --2- 172.21.15.71:0/4253817152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc075b50 0x7fe3bc075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 --2- 172.21.15.71:0/4253817152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc114c30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 -- 172.21.15.71:0/4253817152 >> 172.21.15.71:0/4253817152 conn(0x7fe3bc079d00 msgr2=0x7fe3bc07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 -- 172.21.15.71:0/4253817152 shutdown_connections 2024-05-27T09:49:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.840+0000 7fe3c2000700 1 -- 172.21.15.71:0/4253817152 wait complete. 2024-05-27T09:49:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.842+0000 7fe3c2000700 1 Processor -- start 2024-05-27T09:49:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.842+0000 7fe3c2000700 1 -- start start 2024-05-27T09:49:58.843 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:49:58 smithi071 ceph-mon[31451]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-27T09:49:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.843+0000 7fe3c2000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3bc075b50 0x7fe3bc1a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.843+0000 7fe3c2000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.843+0000 7fe3c2000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3bc115170 0x7fe3bc1a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.843+0000 7fe3c2000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc11a910 con 0x7fe3bc0764a0 2024-05-27T09:49:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.843+0000 7fe3c2000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc11a790 con 0x7fe3bc075b50 2024-05-27T09:49:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.843+0000 7fe3c2000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc11aa90 con 0x7fe3bc115170 2024-05-27T09:49:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc1a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55594/0 (socket says 172.21.15.71:55594) 2024-05-27T09:49:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 -- 172.21.15.71:0/776613414 learned_addr learned my addr 172.21.15.71:0/776613414 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 -- 172.21.15.71:0/776613414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3bc115170 msgr2=0x7fe3bc1a5af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:49:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3bc115170 0x7fe3bc1a5af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 -- 172.21.15.71:0/776613414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3bc075b50 msgr2=0x7fe3bc1a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3bc075b50 0x7fe3bc1a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.844+0000 7fe3bbe00700 1 -- 172.21.15.71:0/776613414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc1a6190 con 0x7fe3bc0764a0 2024-05-27T09:49:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.845+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc1a1860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80057c0 tx=0x7fe3a8005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.846+0000 7fe3b9600700 1 -- 172.21.15.71:0/776613414 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8027070 con 0x7fe3bc0764a0 2024-05-27T09:49:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.846+0000 7fe3b9600700 1 -- 172.21.15.71:0/776613414 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a8022470 con 0x7fe3bc0764a0 2024-05-27T09:49:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.846+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc1a6420 con 0x7fe3bc0764a0 2024-05-27T09:49:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.846+0000 7fe3b9600700 1 -- 172.21.15.71:0/776613414 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8017650 con 0x7fe3bc0764a0 2024-05-27T09:49:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.847+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc1adda0 con 0x7fe3bc0764a0 2024-05-27T09:49:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.852+0000 7fe3b9600700 1 -- 172.21.15.71:0/776613414 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fe3a802a070 con 0x7fe3bc0764a0 2024-05-27T09:49:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.854+0000 7fe3d20c7b80 1 Processor -- start 2024-05-27T09:49:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.854+0000 7fe3d20c7b80 1 -- start start 2024-05-27T09:49:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.854+0000 7fe3b9600700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3a40b2a70 0x7fe3a40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe14de40 0x562cbe2cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc410 0x562cbe2d6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562cbe1fae40 con 0x562cbe2cc410 2024-05-27T09:49:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562cbe1ea9e0 con 0x562cbe14de40 2024-05-27T09:49:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562cbe1eea20 con 0x562cbe2cc820 2024-05-27T09:49:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3b9600700 1 -- 172.21.15.71:0/776613414 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fe3a80e3480 con 0x7fe3bc0764a0 2024-05-27T09:49:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3c1600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3c1600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42044/0 (socket says 172.21.15.71:42044) 2024-05-27T09:49:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3c1600700 1 -- 172.21.15.71:0/3676285946 learned_addr learned my addr 172.21.15.71:0/3676285946 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.855+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe14de40 0x562cbe2cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3c1600700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3a40b2a70 0x7fe3a40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3c0c00700 1 -- 172.21.15.71:0/3676285946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 msgr2=0x562cbe2d9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3c0c00700 1 -- 172.21.15.71:0/3676285946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc410 msgr2=0x562cbe2d6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc410 0x562cbe2d6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc410 0x562cbe2d6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3c0c00700 1 -- 172.21.15.71:0/3676285946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cbe1b3420 con 0x562cbe14de40 2024-05-27T09:49:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.856+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc410 0x562cbe2d6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:49:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.857+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe14de40 0x562cbe2cbed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009b20 tx=0x7fe3b0009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eaf6a7c623447ae server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.857+0000 7fe3c1600700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3a40b2a70 0x7fe3a40b4f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x562cbe2cccb0 tx=0x7fe3b4004ad0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.857+0000 7fe3ae000700 1 -- 172.21.15.71:0/3676285946 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000ea40 con 0x562cbe14de40 2024-05-27T09:49:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.857+0000 7fe3ae000700 1 -- 172.21.15.71:0/3676285946 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b000ebe0 con 0x562cbe14de40 2024-05-27T09:49:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.857+0000 7fe3ae000700 1 -- 172.21.15.71:0/3676285946 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0018660 con 0x562cbe14de40 2024-05-27T09:49:58.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.858+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3676285946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe14de40 msgr2=0x562cbe2cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.858+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe14de40 0x562cbe2cbed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009b20 tx=0x7fe3b0009e30 comp rx=0 tx=0).stop 2024-05-27T09:49:58.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.859+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3676285946 shutdown_connections 2024-05-27T09:49:58.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.859+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.859+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe14de40 0x562cbe2cbed0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.859+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3676285946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc410 0x562cbe2d6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.859+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3676285946 >> 172.21.15.71:0/3676285946 conn(0x562cbe1adfc0 msgr2=0x562cbe2c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:58.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.859+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3676285946 shutdown_connections 2024-05-27T09:49:58.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.859+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3676285946 wait complete. 2024-05-27T09:49:58.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.860+0000 7fe3d20c7b80 1 -- start start 2024-05-27T09:49:58.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.860+0000 7fe3d20c7b80 1 Processor -- start 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.861+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.861+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2d6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.861+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.861+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562cbe0f0fa0 con 0x562cbe14de40 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.861+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562cbe18b760 con 0x562cbe2cc410 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.861+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562cbe2ea9a0 con 0x562cbe2cc820 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.861+0000 7fe3d20c7b80 10 client.0 _ll_register_callbacks cb 0x562cbe194c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.862+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2d6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.862+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2d6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51702/0 (socket says 172.21.15.71:51702) 2024-05-27T09:49:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.862+0000 7fe3bbe00700 1 -- 172.21.15.71:0/1695011869 learned_addr learned my addr 172.21.15.71:0/1695011869 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:58.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.862+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.862+0000 7fe3c1600700 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3bbe00700 1 -- 172.21.15.71:0/1695011869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 msgr2=0x562cbe2d6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:58.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3bbe00700 1 -- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 msgr2=0x562cbe2d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:58.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3bbe00700 1 -- 172.21.15.71:0/1695011869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cbe13a8d0 con 0x562cbe2cc410 2024-05-27T09:49:58.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2d6a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80aa520 tx=0x7fe3a80a9f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bab6c641806dbb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3a2a00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3a2a00700 1 -- 172.21.15.71:0/1695011869 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80aaf20 con 0x562cbe2cc410 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3a2a00700 1 -- 172.21.15.71:0/1695011869 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fe3a80b10d0 con 0x562cbe2cc410 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.863+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b000ebe0 con 0x562cbe2cc410 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.864+0000 7fe3a2a00700 1 -- 172.21.15.71:0/1695011869 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe3a80cd0b0 con 0x562cbe2cc410 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.864+0000 7fe3d20c7b80 10 client.25745 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.864+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cbe1bb060 con 0x562cbe2cc410 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.864+0000 7fe3a2a00700 1 -- 172.21.15.71:0/1695011869 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b000ebe0 con 0x562cbe2cc410 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.865+0000 7fe3a2a00700 1 -- 172.21.15.71:0/1695011869 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fe3a80b3160 con 0x562cbe2cc410 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.865+0000 7fe3d20c7b80 10 client.25745 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.865+0000 7fe3d20c7b80 10 client.25745 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.865+0000 7fe3d20c7b80 20 client.25745 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.865+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe2f7890 0x562cbe2f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.865+0000 7fe3d20c7b80 4 client.25745 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:49:58.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.865+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cbe1fcd90 con 0x562cbe2f7890 2024-05-27T09:49:58.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.866+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe2f7890 0x562cbe2f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.867+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe2f7890 0x562cbe2f9d40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98728140a94007b5 server_cookie=49da71b8a1579b2f in_seq=0 out_seq=0 2024-05-27T09:49:58.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.867+0000 7fe3a2a00700 10 client.25745 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:58.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.868+0000 7fe3a2a00700 1 -- 172.21.15.71:0/1695011869 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x562cbe1fcd90 con 0x562cbe2f7890 2024-05-27T09:49:58.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.868+0000 7fe3a2a00700 10 client.25745 handle_command_reply: tid=0 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.868+0000 7fe3d20c7b80 1 client.25745 shutdown 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 msgr2=0x562cbe2d6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2d6a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80aa520 tx=0x7fe3a80a9f90 comp rx=0 tx=0).stop 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 shutdown_connections 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe2f7890 0x562cbe2f9d40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3a2a00700 0 client.25745 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1695011869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2d6a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 >> 172.21.15.71:0/1695011869 conn(0x562cbe1adfc0 msgr2=0x562cbe2c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 shutdown_connections 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1695011869 wait complete. 2024-05-27T09:49:58.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.869+0000 7fe3d20c7b80 20 client.25745 trim_cache size 0 max 16384 2024-05-27T09:49:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.900+0000 7fe3d20c7b80 1 Processor -- start 2024-05-27T09:49:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.900+0000 7fe3d20c7b80 1 -- start start 2024-05-27T09:49:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc06e490 con 0x562cbe14de40 2024-05-27T09:49:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc10f760 con 0x562cbe2cc410 2024-05-27T09:49:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc10d5b0 con 0x562cbe2cc820 2024-05-27T09:49:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3c1600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51710/0 (socket says 172.21.15.71:51710) 2024-05-27T09:49:58.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3c1600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42066/0 (socket says 172.21.15.71:42066) 2024-05-27T09:49:58.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3bbe00700 1 -- 172.21.15.71:0/1764535656 learned_addr learned my addr 172.21.15.71:0/1764535656 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:58.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.901+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.902+0000 7fe3c0c00700 1 -- 172.21.15.71:0/1764535656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 msgr2=0x562cbe2d89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:58.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.902+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.902+0000 7fe3c0c00700 1 -- 172.21.15.71:0/1764535656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 msgr2=0x562cbe2c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:58.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.902+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.902+0000 7fe3c0c00700 1 -- 172.21.15.71:0/1764535656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cbe2d75f0 con 0x562cbe14de40 2024-05-27T09:49:58.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.902+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d1d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00092a0 tx=0x7fe3b000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28588ba0f90f801 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:58.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.903+0000 7fe3ad600700 1 -- 172.21.15.71:0/1764535656 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000ed70 con 0x562cbe14de40 2024-05-27T09:49:58.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.903+0000 7fe3ad600700 1 -- 172.21.15.71:0/1764535656 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b002d030 con 0x562cbe14de40 2024-05-27T09:49:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.903+0000 7fe3ad600700 1 -- 172.21.15.71:0/1764535656 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0004ad0 con 0x562cbe14de40 2024-05-27T09:49:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.904+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1764535656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 msgr2=0x562cbe2d1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.904+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d1d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00092a0 tx=0x7fe3b000ed00 comp rx=0 tx=0).stop 2024-05-27T09:49:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.904+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1764535656 shutdown_connections 2024-05-27T09:49:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.904+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2cc820 0x562cbe2d89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.904+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe14de40 0x562cbe2d1d90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.904+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/1764535656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2cc410 0x562cbe2c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.904+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1764535656 >> 172.21.15.71:0/1764535656 conn(0x562cbe1adfc0 msgr2=0x562cbe2d6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.905+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1764535656 shutdown_connections 2024-05-27T09:49:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.905+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/1764535656 wait complete. 2024-05-27T09:49:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.905+0000 7fe3d20c7b80 1 -- start start 2024-05-27T09:49:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.906+0000 7fe3d20c7b80 1 Processor -- start 2024-05-27T09:49:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.906+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc820 0x562cbe2f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2eb6c0 0x562cbe2ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3d20c7b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2ec010 0x562cbe3613d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc10dc20 con 0x562cbe2cc820 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc10f090 con 0x562cbe2ec010 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3d20c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc10e2f0 con 0x562cbe2eb6c0 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3d20c7b80 10 client.0 _ll_register_callbacks cb 0x562cbe194c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2eb6c0 0x562cbe2ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3bbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2eb6c0 0x562cbe2ebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42072/0 (socket says 172.21.15.71:42072) 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3bbe00700 1 -- 172.21.15.71:0/3408630061 learned_addr learned my addr 172.21.15.71:0/3408630061 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3bbe00700 1 -- 172.21.15.71:0/3408630061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2ec010 msgr2=0x562cbe3613d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.907+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2ec010 0x562cbe3613d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.908+0000 7fe3bbe00700 1 -- 172.21.15.71:0/3408630061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc820 msgr2=0x562cbe2f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.908+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc820 0x562cbe2f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.908+0000 7fe3bbe00700 1 -- 172.21.15.71:0/3408630061 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cbe361910 con 0x562cbe2eb6c0 2024-05-27T09:49:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.908+0000 7fe3bbe00700 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2eb6c0 0x562cbe2ebad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80a68a0 tx=0x7fe3a80aa3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374bca9cc497a467 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.908+0000 7fe3a2a00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.908+0000 7fe3a2a00700 1 -- 172.21.15.71:0/3408630061 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80c4060 con 0x562cbe2eb6c0 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.908+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b002d030 con 0x562cbe2eb6c0 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.909+0000 7fe3a2a00700 1 -- 172.21.15.71:0/3408630061 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fe3a80a6e10 con 0x562cbe2eb6c0 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.909+0000 7fe3a2a00700 1 -- 172.21.15.71:0/3408630061 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe3a80aa820 con 0x562cbe2eb6c0 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.909+0000 7fe3d20c7b80 10 client.25792 fetch_fsmap learned FSMap version 26 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.909+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cbe362b10 con 0x562cbe2eb6c0 2024-05-27T09:49:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.909+0000 7fe3a2a00700 1 -- 172.21.15.71:0/3408630061 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b002d030 con 0x562cbe2eb6c0 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3a2a00700 1 -- 172.21.15.71:0/3408630061 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fe3a80a9a80 con 0x562cbe2eb6c0 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3d20c7b80 10 client.25792 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3d20c7b80 10 client.25792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3d20c7b80 20 client.25792 populate_metadata read hostname 'smithi071' 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe363070 0x562cbe365490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3d20c7b80 4 client.25792 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cbe1f6570 con 0x562cbe363070 2024-05-27T09:49:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.910+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe363070 0x562cbe365490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.911+0000 7fe3c0c00700 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe363070 0x562cbe365490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a4778f10b8d9b74 server_cookie=12b3046b83029e68 in_seq=0 out_seq=0 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.911+0000 7fe3a2a00700 10 client.25792 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3a2a00700 1 -- 172.21.15.71:0/3408630061 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cbe1f6570 con 0x562cbe363070 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3a2a00700 10 client.25792 handle_command_reply: tid=0 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 client.25792 shutdown 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2eb6c0 msgr2=0x562cbe2ebad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2eb6c0 0x562cbe2ebad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80a68a0 tx=0x7fe3a80aa3e0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 shutdown_connections 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x562cbe363070 0x562cbe365490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3a2a00700 0 client.25792 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562cbe2ec010 0x562cbe3613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cbe2cc820 0x562cbe2f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 --2- 172.21.15.71:0/3408630061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562cbe2eb6c0 0x562cbe2ebad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.912+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 >> 172.21.15.71:0/3408630061 conn(0x562cbe1adfc0 msgr2=0x562cbe2d6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.913+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 shutdown_connections 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.913+0000 7fe3d20c7b80 1 -- 172.21.15.71:0/3408630061 wait complete. 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.913+0000 7fe3d20c7b80 20 client.25792 trim_cache size 0 max 16384 2024-05-27T09:49:58.915 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:49:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3a40b2a70 msgr2=0x7fe3a40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3a40b2a70 0x7fe3a40b4f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x562cbe2cccb0 tx=0x7fe3b4004ad0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc0764a0 msgr2=0x7fe3bc1a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:49:58.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc1a1860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80057c0 tx=0x7fe3a8005f10 comp rx=0 tx=0).stop 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 shutdown_connections 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3a40b2a70 0x7fe3a40b4f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3bc115170 0x7fe3bc1a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3bc075b50 0x7fe3bc1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 --2- 172.21.15.71:0/776613414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc0764a0 0x7fe3bc1a1860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.914+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 >> 172.21.15.71:0/776613414 conn(0x7fe3bc079d00 msgr2=0x7fe3bc102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.915+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 shutdown_connections 2024-05-27T09:49:58.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:49:58.915+0000 7fe3c2000700 1 -- 172.21.15.71:0/776613414 wait complete. 2024-05-27T09:49:58.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:49:58 smithi122 ceph-mon[36436]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-27T09:49:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:49:58 smithi072 ceph-mon[35951]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-27T09:49:59.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-27T09:50:00.382 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:00.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:00 smithi071 ceph-mon[31451]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-27T09:50:00.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:00 smithi071 ceph-mon[31451]: overall HEALTH_OK 2024-05-27T09:50:00.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:00 smithi122 ceph-mon[36436]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-27T09:50:00.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:00 smithi122 ceph-mon[36436]: overall HEALTH_OK 2024-05-27T09:50:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:00 smithi072 ceph-mon[35951]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-27T09:50:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:00 smithi072 ceph-mon[35951]: overall HEALTH_OK 2024-05-27T09:50:02.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.860+0000 7f4dd2600700 1 -- 172.21.15.71:0/2782411283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc109670 msgr2=0x7f4dcc110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.860+0000 7f4dd2600700 1 --2- 172.21.15.71:0/2782411283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc109670 0x7f4dcc110fd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400b0d0 tx=0x7f4dc400b3e0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.861+0000 7f4dd2600700 1 -- 172.21.15.71:0/2782411283 shutdown_connections 2024-05-27T09:50:02.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.861+0000 7f4dd2600700 1 --2- 172.21.15.71:0/2782411283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc109670 0x7f4dcc110fd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.861+0000 7f4dd2600700 1 --2- 172.21.15.71:0/2782411283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dcc1043f0 0x7f4dcc104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.861+0000 7f4dd2600700 1 --2- 172.21.15.71:0/2782411283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dcc108d20 0x7f4dcc109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.861+0000 7f4dd2600700 1 -- 172.21.15.71:0/2782411283 >> 172.21.15.71:0/2782411283 conn(0x7f4dcc079d00 msgr2=0x7f4dcc07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:02.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:02 smithi071 ceph-mon[31451]: pgmap v71: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-27T09:50:02.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.862+0000 7f4dd2600700 1 -- 172.21.15.71:0/2782411283 shutdown_connections 2024-05-27T09:50:02.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.862+0000 7f4dd2600700 1 -- 172.21.15.71:0/2782411283 wait complete. 2024-05-27T09:50:02.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.864+0000 7f4dd2600700 1 Processor -- start 2024-05-27T09:50:02.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.864+0000 7f4dd2600700 1 -- start start 2024-05-27T09:50:02.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.865+0000 7f4dd2600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dcc1043f0 0x7f4dcc10b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.865+0000 7f4dd2600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc108d20 0x7f4dcc10b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.865+0000 7f4dd2600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dcc109670 0x7f4dcc10bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.865+0000 7f4dd2600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1142f0 con 0x7f4dcc108d20 2024-05-27T09:50:02.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.865+0000 7f4dd2600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc114170 con 0x7f4dcc1043f0 2024-05-27T09:50:02.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.865+0000 7f4dd2600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc114470 con 0x7f4dcc109670 2024-05-27T09:50:02.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.865+0000 7f4dcbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc108d20 0x7f4dcc10b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dcc1043f0 0x7f4dcc10b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dcc1043f0 0x7f4dcc10b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51726/0 (socket says 172.21.15.71:51726) 2024-05-27T09:50:02.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1200700 1 -- 172.21.15.71:0/1462594266 learned_addr learned my addr 172.21.15.71:0/1462594266 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:02.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dcc109670 0x7f4dcc10bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dcbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc108d20 0x7f4dcc10b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55646/0 (socket says 172.21.15.71:55646) 2024-05-27T09:50:02.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1c00700 1 -- 172.21.15.71:0/1462594266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dcc1043f0 msgr2=0x7f4dcc10b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1c00700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dcc1043f0 0x7f4dcc10b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1c00700 1 -- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc108d20 msgr2=0x7f4dcc10b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1c00700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc108d20 0x7f4dcc10b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.866+0000 7f4dd1c00700 1 -- 172.21.15.71:0/1462594266 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc1ad540 con 0x7f4dcc109670 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.867+0000 7f4dd1c00700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dcc109670 0x7f4dcc10bad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400b770 tx=0x7f4dc4007a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.867+0000 7f4dc9600700 1 -- 172.21.15.71:0/1462594266 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc401f020 con 0x7f4dcc109670 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.867+0000 7f4dc9600700 1 -- 172.21.15.71:0/1462594266 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dc4004c50 con 0x7f4dcc109670 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.867+0000 7f4dc9600700 1 -- 172.21.15.71:0/1462594266 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc401b690 con 0x7f4dcc109670 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.867+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dcc1ad770 con 0x7f4dcc109670 2024-05-27T09:50:02.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.867+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dcc1adb10 con 0x7f4dcc109670 2024-05-27T09:50:02.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.872+0000 7f4dc9600700 1 -- 172.21.15.71:0/1462594266 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4dc4022020 con 0x7f4dcc109670 2024-05-27T09:50:02.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.874+0000 7f4de2799b80 1 Processor -- start 2024-05-27T09:50:02.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.874+0000 7f4de2799b80 1 -- start start 2024-05-27T09:50:02.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e515e40 0x56365e693ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4dc9600700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4db40b2aa0 0x7f4db40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e69ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4de2799b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56365e5c2e40 con 0x56365e515e40 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4de2799b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56365e5b29e0 con 0x56365e694410 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4de2799b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56365e5b6a20 con 0x56365e694820 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.875+0000 7f4dc9600700 1 -- 172.21.15.71:0/1462594266 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4dc400f020 con 0x7f4dcc109670 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.876+0000 7f4dd1c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.876+0000 7f4dd1c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42106/0 (socket says 172.21.15.71:42106) 2024-05-27T09:50:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.876+0000 7f4dd1c00700 1 -- 172.21.15.71:0/1843631085 learned_addr learned my addr 172.21.15.71:0/1843631085 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:02.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.876+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4db40b2aa0 0x7f4db40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.876+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e69ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.876+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e515e40 0x56365e693ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.877+0000 7f4dcbe00700 1 -- 172.21.15.71:0/1843631085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 msgr2=0x56365e6a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.877+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.877+0000 7f4dcbe00700 1 -- 172.21.15.71:0/1843631085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 msgr2=0x56365e69ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.877+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e69ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.877+0000 7f4dcbe00700 1 -- 172.21.15.71:0/1843631085 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56365e57b420 con 0x56365e515e40 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.877+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e515e40 0x56365e693ed0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009680 tx=0x7f4db8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0bbf95ca6fe233 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.877+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4db40b2aa0 0x7f4db40b4fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009cb0 tx=0x7f4dc0009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.878+0000 7f4dbe000700 1 -- 172.21.15.71:0/1843631085 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8004020 con 0x56365e515e40 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.878+0000 7f4dbe000700 1 -- 172.21.15.71:0/1843631085 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4db8004830 con 0x56365e515e40 2024-05-27T09:50:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.878+0000 7f4dbe000700 1 -- 172.21.15.71:0/1843631085 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8005380 con 0x56365e515e40 2024-05-27T09:50:02.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 -- 172.21.15.71:0/1843631085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e515e40 msgr2=0x56365e693ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e515e40 0x56365e693ed0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009680 tx=0x7f4db8009260 comp rx=0 tx=0).stop 2024-05-27T09:50:02.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 -- 172.21.15.71:0/1843631085 shutdown_connections 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e515e40 0x56365e693ed0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1843631085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e69ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 -- 172.21.15.71:0/1843631085 >> 172.21.15.71:0/1843631085 conn(0x56365e575fc0 msgr2=0x56365e68fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 -- 172.21.15.71:0/1843631085 shutdown_connections 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.879+0000 7f4de2799b80 1 -- 172.21.15.71:0/1843631085 wait complete. 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.880+0000 7f4de2799b80 1 -- start start 2024-05-27T09:50:02.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.880+0000 7f4de2799b80 1 Processor -- start 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694410 0x56365e69e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e69ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e69f110 0x56365e6aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4de2799b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56365e4b8fa0 con 0x56365e69f110 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4de2799b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56365e553760 con 0x56365e694820 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4de2799b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56365e6a1990 con 0x56365e694410 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4de2799b80 10 client.0 _ll_register_callbacks cb 0x56365e55cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4dcbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e69ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4dcbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e69ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51748/0 (socket says 172.21.15.71:51748) 2024-05-27T09:50:02.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4dcbe00700 1 -- 172.21.15.71:0/1505313958 learned_addr learned my addr 172.21.15.71:0/1505313958 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.881+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694410 0x56365e69e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1c00700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e69f110 0x56365e6aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1200700 1 -- 172.21.15.71:0/1505313958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 msgr2=0x56365e69ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e69ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1200700 1 -- 172.21.15.71:0/1505313958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e69f110 msgr2=0x56365e6aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e69f110 0x56365e6aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1200700 1 -- 172.21.15.71:0/1505313958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56365e5028d0 con 0x56365e694410 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1c00700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e69f110 0x56365e6aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694410 0x56365e69e690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00127b0 tx=0x7f4dc00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec157ee0be2752b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.882+0000 7f4db2a00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.883+0000 7f4db2a00700 1 -- 172.21.15.71:0/1505313958 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc001f830 con 0x56365e694410 2024-05-27T09:50:02.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.883+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db8004830 con 0x56365e694410 2024-05-27T09:50:02.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.883+0000 7f4db2a00700 1 -- 172.21.15.71:0/1505313958 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4dc001f9d0 con 0x56365e694410 2024-05-27T09:50:02.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.883+0000 7f4db2a00700 1 -- 172.21.15.71:0/1505313958 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4dc001fbd0 con 0x56365e694410 2024-05-27T09:50:02.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.883+0000 7f4de2799b80 10 client.25804 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:02.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.883+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56365e583060 con 0x56365e694410 2024-05-27T09:50:02.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4db2a00700 1 -- 172.21.15.71:0/1505313958 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4db8004830 con 0x56365e694410 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4db2a00700 1 -- 172.21.15.71:0/1505313958 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f4dc0027410 con 0x56365e694410 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4de2799b80 10 client.25804 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4de2799b80 10 client.25804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4de2799b80 20 client.25804 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e6aef10 0x56365e6b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4de2799b80 4 client.25804 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.884+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56365e5c4d90 con 0x56365e6aef10 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.885+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e6aef10 0x56365e6b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.885+0000 7f4db2a00700 10 client.25804 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.885+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e6aef10 0x56365e6b1330 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2893f1a36f6b30af server_cookie=bd9d107eaeda9166 in_seq=0 out_seq=0 2024-05-27T09:50:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.886+0000 7f4db2a00700 1 -- 172.21.15.71:0/1505313958 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56365e5c4d90 con 0x56365e6aef10 2024-05-27T09:50:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.886+0000 7f4db2a00700 10 client.25804 handle_command_reply: tid=0 2024-05-27T09:50:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 client.25804 shutdown 2024-05-27T09:50:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694410 msgr2=0x56365e69e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694410 0x56365e69e690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00127b0 tx=0x7f4dc00047c0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 shutdown_connections 2024-05-27T09:50:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e6aef10 0x56365e6b1330 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e69f110 0x56365e6aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694410 0x56365e69e690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1505313958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e69ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4db2a00700 0 client.25804 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.887+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 >> 172.21.15.71:0/1505313958 conn(0x56365e575fc0 msgr2=0x56365e68eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.888+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 shutdown_connections 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.888+0000 7f4de2799b80 1 -- 172.21.15.71:0/1505313958 wait complete. 2024-05-27T09:50:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.888+0000 7f4de2799b80 20 client.25804 trim_cache size 0 max 16384 2024-05-27T09:50:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.904+0000 7f4de2799b80 1 Processor -- start 2024-05-27T09:50:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.904+0000 7f4de2799b80 1 -- start start 2024-05-27T09:50:02.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e575fc0 0x56365e698830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e694410 0x56365e69eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e6b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4de2799b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1b7a50 con 0x56365e694410 2024-05-27T09:50:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4de2799b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1b52e0 con 0x56365e694820 2024-05-27T09:50:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4de2799b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1b3130 con 0x56365e575fc0 2024-05-27T09:50:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4dd1c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e6b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4dd1c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e6b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51760/0 (socket says 172.21.15.71:51760) 2024-05-27T09:50:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4dd1c00700 1 -- 172.21.15.71:0/1563497105 learned_addr learned my addr 172.21.15.71:0/1563497105 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.905+0000 7f4dd1200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e575fc0 0x56365e698830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e694410 0x56365e69eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dd1200700 1 -- 172.21.15.71:0/1563497105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 msgr2=0x56365e6b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e6b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dd1200700 1 -- 172.21.15.71:0/1563497105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e694410 msgr2=0x56365e69eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e694410 0x56365e69eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dd1200700 1 -- 172.21.15.71:0/1563497105 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56365e691350 con 0x56365e575fc0 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dd1200700 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e575fc0 0x56365e698830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00278b0 tx=0x7f4dc00046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93f057f5407e70c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.906+0000 7f4dbd600700 1 -- 172.21.15.71:0/1563497105 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc003e020 con 0x56365e575fc0 2024-05-27T09:50:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.907+0000 7f4dbd600700 1 -- 172.21.15.71:0/1563497105 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dc0027ca0 con 0x56365e575fc0 2024-05-27T09:50:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.907+0000 7f4dbd600700 1 -- 172.21.15.71:0/1563497105 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0036040 con 0x56365e575fc0 2024-05-27T09:50:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.908+0000 7f4de2799b80 1 -- 172.21.15.71:0/1563497105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e575fc0 msgr2=0x56365e698830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.908+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e575fc0 0x56365e698830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00278b0 tx=0x7f4dc00046d0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.908+0000 7f4de2799b80 1 -- 172.21.15.71:0/1563497105 shutdown_connections 2024-05-27T09:50:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.908+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694820 0x56365e6b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.908+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e575fc0 0x56365e698830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.908+0000 7f4de2799b80 1 --2- 172.21.15.71:0/1563497105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e694410 0x56365e69eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.908+0000 7f4de2799b80 1 -- 172.21.15.71:0/1563497105 >> 172.21.15.71:0/1563497105 conn(0x56365e688f60 msgr2=0x56365e68fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.909+0000 7f4de2799b80 1 -- 172.21.15.71:0/1563497105 shutdown_connections 2024-05-27T09:50:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.909+0000 7f4de2799b80 1 -- 172.21.15.71:0/1563497105 wait complete. 2024-05-27T09:50:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.909+0000 7f4de2799b80 1 -- start start 2024-05-27T09:50:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.909+0000 7f4de2799b80 1 Processor -- start 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.910+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e575fc0 0x56365e6a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.910+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e6a2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.910+0000 7f4de2799b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.910+0000 7f4de2799b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1b37a0 con 0x56365e575fc0 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.910+0000 7f4de2799b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1b4c10 con 0x56365e694410 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.910+0000 7f4de2799b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1b3e70 con 0x56365e694820 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.910+0000 7f4de2799b80 10 client.0 _ll_register_callbacks cb 0x56365e55cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e575fc0 0x56365e6a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e575fc0 0x56365e6a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55678/0 (socket says 172.21.15.71:55678) 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 -- 172.21.15.71:0/2091818292 learned_addr learned my addr 172.21.15.71:0/2091818292 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e6a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 -- 172.21.15.71:0/2091818292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 msgr2=0x56365e6a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 -- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 msgr2=0x56365e6a2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e6a2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.911+0000 7f4dd1200700 1 -- 172.21.15.71:0/2091818292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56365e6a30d0 con 0x56365e575fc0 2024-05-27T09:50:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.912+0000 7f4dd1200700 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e575fc0 0x56365e6a71f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000c00 tx=0x7f4dc0027b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5755c93e24ef40b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.912+0000 7f4db2a00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:02.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.913+0000 7f4db2a00700 1 -- 172.21.15.71:0/2091818292 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0047060 con 0x56365e575fc0 2024-05-27T09:50:02.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.913+0000 7f4db2a00700 1 -- 172.21.15.71:0/2091818292 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4dc001f830 con 0x56365e575fc0 2024-05-27T09:50:02.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.913+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc0027ca0 con 0x56365e575fc0 2024-05-27T09:50:02.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.913+0000 7f4db2a00700 1 -- 172.21.15.71:0/2091818292 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4dc0036070 con 0x56365e575fc0 2024-05-27T09:50:02.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.913+0000 7f4de2799b80 10 client.15660 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:02.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.913+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56365e7197b0 con 0x56365e575fc0 2024-05-27T09:50:02.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.914+0000 7f4db2a00700 1 -- 172.21.15.71:0/2091818292 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dc0027ca0 con 0x56365e575fc0 2024-05-27T09:50:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.915+0000 7f4db2a00700 1 -- 172.21.15.71:0/2091818292 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f4dc0004a20 con 0x56365e575fc0 2024-05-27T09:50:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.915+0000 7f4de2799b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.915+0000 7f4de2799b80 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.915+0000 7f4de2799b80 20 client.15660 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.915+0000 7f4de2799b80 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e69f110 0x56365e71bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.915+0000 7f4de2799b80 4 client.15660 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:50:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.915+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56365e5be570 con 0x56365e69f110 2024-05-27T09:50:02.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.917+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e69f110 0x56365e71bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:02.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.918+0000 7f4dcbe00700 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e69f110 0x56365e71bdf0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170309fa34fc6b2b server_cookie=fe25e600dbaad61e in_seq=0 out_seq=0 2024-05-27T09:50:02.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.918+0000 7f4db2a00700 10 client.15660 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:02.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.918+0000 7f4db2a00700 1 -- 172.21.15.71:0/2091818292 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56365e5be570 con 0x56365e69f110 2024-05-27T09:50:02.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.918+0000 7f4db2a00700 10 client.15660 handle_command_reply: tid=0 2024-05-27T09:50:02.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.918+0000 7f4de2799b80 1 client.15660 shutdown 2024-05-27T09:50:02.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.918+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e575fc0 msgr2=0x56365e6a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.918+0000 7f4de2799b80 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e575fc0 0x56365e6a71f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000c00 tx=0x7f4dc0027b80 comp rx=0 tx=0).stop 2024-05-27T09:50:02.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 shutdown_connections 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56365e69f110 0x56365e71bdf0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56365e694820 0x56365e6a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56365e575fc0 0x56365e6a71f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 --2- 172.21.15.71:0/2091818292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56365e694410 0x56365e6a2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 >> 172.21.15.71:0/2091818292 conn(0x56365e688f60 msgr2=0x56365e68f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4db2a00700 0 client.15660 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 shutdown_connections 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 1 -- 172.21.15.71:0/2091818292 wait complete. 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.919+0000 7f4de2799b80 20 client.15660 trim_cache size 0 max 16384 2024-05-27T09:50:02.921 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:50:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4db40b2aa0 msgr2=0x7f4db40b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4db40b2aa0 0x7f4db40b4fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009cb0 tx=0x7f4dc0009260 comp rx=0 tx=0).stop 2024-05-27T09:50:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dcc109670 msgr2=0x7f4dcc10bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:02.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dcc109670 0x7f4dcc10bad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400b770 tx=0x7f4dc4007a30 comp rx=0 tx=0).stop 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 shutdown_connections 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4db40b2aa0 0x7f4db40b4fb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dcc109670 0x7f4dcc10bad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dcc1043f0 0x7f4dcc10b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 --2- 172.21.15.71:0/1462594266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dcc108d20 0x7f4dcc10b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 >> 172.21.15.71:0/1462594266 conn(0x7f4dcc079d00 msgr2=0x7f4dcc10f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.920+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 shutdown_connections 2024-05-27T09:50:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:02.921+0000 7f4dd2600700 1 -- 172.21.15.71:0/1462594266 wait complete. 2024-05-27T09:50:02.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:02 smithi122 ceph-mon[36436]: pgmap v71: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-27T09:50:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:02 smithi072 ceph-mon[35951]: pgmap v71: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-27T09:50:04.859 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-27T09:50:04.860 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-27T09:50:04.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:04 smithi122 ceph-mon[36436]: pgmap v72: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-27T09:50:05.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:04 smithi071 ceph-mon[31451]: pgmap v72: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-27T09:50:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:04 smithi072 ceph-mon[35951]: pgmap v72: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-27T09:50:05.356 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.239+0000 7f1727e00640 1 -- 172.21.15.71:0/3005195755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 msgr2=0x7f17281127f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.239+0000 7f1727e00640 1 --2- 172.21.15.71:0/3005195755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281127f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ca0 tx=0x7f172002a8c0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.239+0000 7f1727e00640 1 -- 172.21.15.71:0/3005195755 shutdown_connections 2024-05-27T09:50:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.239+0000 7f1727e00640 1 --2- 172.21.15.71:0/3005195755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281127f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.239+0000 7f1727e00640 1 --2- 172.21.15.71:0/3005195755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172810c170 0x7f1728105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.239+0000 7f1727e00640 1 --2- 172.21.15.71:0/3005195755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f172810bcd0 0x7f1728105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.240+0000 7f1727e00640 1 -- 172.21.15.71:0/3005195755 >> 172.21.15.71:0/3005195755 conn(0x7f17281013d0 msgr2=0x7f1728103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.240+0000 7f1727e00640 1 -- 172.21.15.71:0/3005195755 shutdown_connections 2024-05-27T09:50:06.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.240+0000 7f1727e00640 1 -- 172.21.15.71:0/3005195755 wait complete. 2024-05-27T09:50:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.242+0000 7f1727e00640 1 Processor -- start 2024-05-27T09:50:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.242+0000 7f1727e00640 1 -- start start 2024-05-27T09:50:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.243+0000 7f1727e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281114e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.243+0000 7f1727e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f172810bcd0 0x7f1728111a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1727e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172810c170 0x7f1728111f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1726a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281114e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1726a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281114e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37354/0 (socket says 172.21.15.71:37354) 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1726a00640 1 -- 172.21.15.71:0/3898513476 learned_addr learned my addr 172.21.15.71:0/3898513476 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1728078240 con 0x7f172810bcd0 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f17280780c0 con 0x7f172810c170 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17280783c0 con 0x7f1728106420 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.244+0000 7f1727400640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172810c170 0x7f1728111f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.245+0000 7f1726a00640 1 -- 172.21.15.71:0/3898513476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172810c170 msgr2=0x7f1728111f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.245+0000 7f1726a00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172810c170 0x7f1728111f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.245+0000 7f1726a00640 1 -- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f172810bcd0 msgr2=0x7f1728111a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.245+0000 7f1726a00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f172810bcd0 0x7f1728111a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.245+0000 7f1726a00640 1 -- 172.21.15.71:0/3898513476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17281b55a0 con 0x7f1728106420 2024-05-27T09:50:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.245+0000 7f1726a00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281114e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1718005fd0 tx=0x7f171800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.246+0000 7f171f400640 1 -- 172.21.15.71:0/3898513476 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718017070 con 0x7f1728106420 2024-05-27T09:50:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.246+0000 7f171f400640 1 -- 172.21.15.71:0/3898513476 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1718009c30 con 0x7f1728106420 2024-05-27T09:50:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.246+0000 7f171f400640 1 -- 172.21.15.71:0/3898513476 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718003d30 con 0x7f1728106420 2024-05-27T09:50:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.246+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17281b5890 con 0x7f1728106420 2024-05-27T09:50:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.246+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17281b5d60 con 0x7f1728106420 2024-05-27T09:50:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.252+0000 7f1734c5c740 1 Processor -- start 2024-05-27T09:50:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.252+0000 7f1734c5c740 1 -- start start 2024-05-27T09:50:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629b61b0 0x55ae62d58a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae6298d2f0 0x55ae62d58fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1734c5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae62cc9b90 con 0x55ae629954d0 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1734c5c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ae62cb9730 con 0x55ae629b61b0 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1734c5c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ae62cbd770 con 0x55ae6298d2f0 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f171f400640 1 -- 172.21.15.71:0/3898513476 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f1718003ed0 con 0x7f1728106420 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1727400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629b61b0 0x55ae62d58a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1727400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629b61b0 0x55ae62d58a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36378/0 (socket says 172.21.15.71:36378) 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1727400640 1 -- 172.21.15.71:0/1709407615 learned_addr learned my addr 172.21.15.71:0/1709407615 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1727400640 1 -- 172.21.15.71:0/1709407615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae6298d2f0 msgr2=0x55ae62d58fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.253+0000 7f1727400640 1 --2- 172.21.15.71:0/1709407615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae6298d2f0 0x55ae62d58fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.254+0000 7f1727400640 1 -- 172.21.15.71:0/1709407615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 msgr2=0x55ae62d594e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.254+0000 7f1727400640 1 --2- 172.21.15.71:0/1709407615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d594e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.254+0000 7f1727400640 1 -- 172.21.15.71:0/1709407615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae62c528b0 con 0x55ae629b61b0 2024-05-27T09:50:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.254+0000 7f1727400640 1 --2- 172.21.15.71:0/1709407615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629b61b0 0x55ae62d58a60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ca0 tx=0x7f172002f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92d024d773074eee server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.256+0000 7f1713e00640 1 -- 172.21.15.71:0/1709407615 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172005a070 con 0x55ae629b61b0 2024-05-27T09:50:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.256+0000 7f1713e00640 1 -- 172.21.15.71:0/1709407615 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1720036070 con 0x55ae629b61b0 2024-05-27T09:50:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.256+0000 7f1713e00640 1 -- 172.21.15.71:0/1709407615 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17200042a0 con 0x55ae629b61b0 2024-05-27T09:50:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.256+0000 7f171f400640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f170c0b2a50 0x7f170c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.256+0000 7f171f400640 1 -- 172.21.15.71:0/3898513476 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f17180e2230 con 0x7f1728106420 2024-05-27T09:50:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.257+0000 7f1726a00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f170c0b2a50 0x7f170c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.257+0000 7f1734c5c740 1 -- 172.21.15.71:0/1709407615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629b61b0 msgr2=0x55ae62d58a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.257+0000 7f1734c5c740 1 --2- 172.21.15.71:0/1709407615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629b61b0 0x55ae62d58a60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ca0 tx=0x7f172002f310 comp rx=0 tx=0).stop 2024-05-27T09:50:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.257+0000 7f1734c5c740 1 -- 172.21.15.71:0/1709407615 shutdown_connections 2024-05-27T09:50:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.258+0000 7f1734c5c740 1 --2- 172.21.15.71:0/1709407615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.258+0000 7f1726a00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f170c0b2a50 0x7f170c0b4f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ae62d56550 tx=0x7f171800df10 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.258+0000 7f1734c5c740 1 --2- 172.21.15.71:0/1709407615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae6298d2f0 0x55ae62d58fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.258+0000 7f1734c5c740 1 --2- 172.21.15.71:0/1709407615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629b61b0 0x55ae62d58a60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.258+0000 7f1734c5c740 1 -- 172.21.15.71:0/1709407615 >> 172.21.15.71:0/1709407615 conn(0x55ae629aa300 msgr2=0x55ae62d55210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.258+0000 7f1734c5c740 1 -- 172.21.15.71:0/1709407615 shutdown_connections 2024-05-27T09:50:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.258+0000 7f1734c5c740 1 -- 172.21.15.71:0/1709407615 wait complete. 2024-05-27T09:50:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.259+0000 7f1734c5c740 1 -- start start 2024-05-27T09:50:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.259+0000 7f1734c5c740 1 Processor -- start 2024-05-27T09:50:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae6298d2f0 0x55ae62d62b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae629b61b0 0x55ae62d63620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1734c5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae6299f790 con 0x55ae629954d0 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1734c5c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ae62c61bc0 con 0x55ae6298d2f0 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1734c5c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ae62d65b30 con 0x55ae629b61b0 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1727400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae6298d2f0 0x55ae62d62b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1734c5c740 10 client.0 _ll_register_callbacks cb 0x55ae62c3f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1727400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae6298d2f0 0x55ae62d62b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36392/0 (socket says 172.21.15.71:36392) 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1727400640 1 -- 172.21.15.71:0/3066396951 learned_addr learned my addr 172.21.15.71:0/3066396951 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1726000640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.260+0000 7f1727400640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae629b61b0 0x55ae62d63620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1727400640 1 -- 172.21.15.71:0/3066396951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae629b61b0 msgr2=0x55ae62d63620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1727400640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae629b61b0 0x55ae62d63620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1727400640 1 -- 172.21.15.71:0/3066396951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 msgr2=0x55ae62d630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1727400640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1727400640 1 -- 172.21.15.71:0/3066396951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae629ce210 con 0x55ae6298d2f0 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1726000640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1727400640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae6298d2f0 0x55ae62d62b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1720009620 tx=0x7f1720003d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a346add4dd64b198 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1710c00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1710c00640 1 -- 172.21.15.71:0/3066396951 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172006a060 con 0x55ae6298d2f0 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.261+0000 7f1710c00640 1 -- 172.21.15.71:0/3066396951 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f172002f610 con 0x55ae6298d2f0 2024-05-27T09:50:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.262+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1720036070 con 0x55ae6298d2f0 2024-05-27T09:50:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.262+0000 7f1710c00640 1 -- 172.21.15.71:0/3066396951 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f172005a050 con 0x55ae6298d2f0 2024-05-27T09:50:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.262+0000 7f1734c5c740 10 client.25778 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.262+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ae62a9a620 con 0x55ae6298d2f0 2024-05-27T09:50:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.262+0000 7f1710c00640 1 -- 172.21.15.71:0/3066396951 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1720036070 con 0x55ae6298d2f0 2024-05-27T09:50:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.262+0000 7f1710c00640 1 -- 172.21.15.71:0/3066396951 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f17200309b0 con 0x55ae6298d2f0 2024-05-27T09:50:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1734c5c740 10 client.25778 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1734c5c740 10 client.25778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1734c5c740 20 client.25778 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae62974d80 0x55ae62d74c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1734c5c740 4 client.25778 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae62ccbae0 con 0x55ae62974d80 2024-05-27T09:50:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1726000640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae62974d80 0x55ae62d74c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1710c00640 10 client.25778 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.263+0000 7f1726000640 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae62974d80 0x55ae62d74c00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c9cd989c8d2cc7 server_cookie=c35af76304e6847e in_seq=0 out_seq=0 2024-05-27T09:50:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1710c00640 1 -- 172.21.15.71:0/3066396951 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ae62ccbae0 con 0x55ae62974d80 2024-05-27T09:50:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1710c00640 10 client.25778 handle_command_reply: tid=0 2024-05-27T09:50:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 client.25778 shutdown 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae6298d2f0 msgr2=0x55ae62d62b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae6298d2f0 0x55ae62d62b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1720009620 tx=0x7f1720003d70 comp rx=0 tx=0).stop 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 shutdown_connections 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae629b61b0 0x55ae62d63620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae62974d80 0x55ae62d74c00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae629954d0 0x55ae62d630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1710c00640 0 client.25778 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.265+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3066396951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae6298d2f0 0x55ae62d62b60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.266+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 >> 172.21.15.71:0/3066396951 conn(0x55ae629aa300 msgr2=0x55ae62d5a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.266+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 shutdown_connections 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.266+0000 7f1734c5c740 1 -- 172.21.15.71:0/3066396951 wait complete. 2024-05-27T09:50:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.266+0000 7f1734c5c740 20 client.25778 trim_cache size 0 max 16384 2024-05-27T09:50:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 Processor -- start 2024-05-27T09:50:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 -- start start 2024-05-27T09:50:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d5e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d64cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d63400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17281b8800 con 0x55ae6298d2f0 2024-05-27T09:50:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f17281b6120 con 0x55ae629954d0 2024-05-27T09:50:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.284+0000 7f1734c5c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f172806a230 con 0x55ae62974d80 2024-05-27T09:50:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.285+0000 7f1727400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d5e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.285+0000 7f1727400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d63400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.285+0000 7f1727400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d63400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36400/0 (socket says 172.21.15.71:36400) 2024-05-27T09:50:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.285+0000 7f1727400640 1 -- 172.21.15.71:0/3922516265 learned_addr learned my addr 172.21.15.71:0/3922516265 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.285+0000 7f1726000640 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d64cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.286+0000 7f1727400640 1 -- 172.21.15.71:0/3922516265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 msgr2=0x55ae62d5e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.286+0000 7f1727400640 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d5e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.286+0000 7f1727400640 1 -- 172.21.15.71:0/3922516265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 msgr2=0x55ae62d64cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.286+0000 7f1727400640 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d64cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.286+0000 7f1727400640 1 -- 172.21.15.71:0/3922516265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae62d53610 con 0x55ae629954d0 2024-05-27T09:50:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.286+0000 7f1727400640 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d63400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ae62cb9880 tx=0x7f1720003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d57068143b71e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.287+0000 7f1713400640 1 -- 172.21.15.71:0/3922516265 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172006a070 con 0x55ae629954d0 2024-05-27T09:50:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.287+0000 7f1713400640 1 -- 172.21.15.71:0/3922516265 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1720036040 con 0x55ae629954d0 2024-05-27T09:50:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.287+0000 7f1713400640 1 -- 172.21.15.71:0/3922516265 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172002fc50 con 0x55ae629954d0 2024-05-27T09:50:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.288+0000 7f1734c5c740 1 -- 172.21.15.71:0/3922516265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 msgr2=0x55ae62d63400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.288+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d63400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ae62cb9880 tx=0x7f1720003cd0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.288+0000 7f1734c5c740 1 -- 172.21.15.71:0/3922516265 shutdown_connections 2024-05-27T09:50:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.288+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d63400 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.288+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d64cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.288+0000 7f1734c5c740 1 --2- 172.21.15.71:0/3922516265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d5e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.288+0000 7f1734c5c740 1 -- 172.21.15.71:0/3922516265 >> 172.21.15.71:0/3922516265 conn(0x55ae629aa300 msgr2=0x55ae62d6e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.297+0000 7f1734c5c740 1 -- 172.21.15.71:0/3922516265 shutdown_connections 2024-05-27T09:50:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.298+0000 7f1734c5c740 1 -- 172.21.15.71:0/3922516265 wait complete. 2024-05-27T09:50:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.299+0000 7f1734c5c740 1 -- start start 2024-05-27T09:50:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.300+0000 7f1734c5c740 1 Processor -- start 2024-05-27T09:50:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.302+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d74b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.302+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d75090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.302+0000 7f1734c5c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.302+0000 7f1734c5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f172811bb50 con 0x55ae6298d2f0 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.302+0000 7f1734c5c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f172811cfc0 con 0x55ae629954d0 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.302+0000 7f1734c5c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f172811c220 con 0x55ae62974d80 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.302+0000 7f1734c5c740 10 client.0 _ll_register_callbacks cb 0x7f1720058070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.303+0000 7f1727400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.303+0000 7f1727400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d74b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.303+0000 7f1727400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d74b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37380/0 (socket says 172.21.15.71:37380) 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.303+0000 7f1727400640 1 -- 172.21.15.71:0/2021525329 learned_addr learned my addr 172.21.15.71:0/2021525329 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.303+0000 7f1726000640 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d75090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.304+0000 7f1726000640 1 -- 172.21.15.71:0/2021525329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 msgr2=0x55ae62d74b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.304+0000 7f1726000640 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d74b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.304+0000 7f1726000640 1 -- 172.21.15.71:0/2021525329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 msgr2=0x55ae62d755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.304+0000 7f1726000640 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d755d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.304+0000 7f1726000640 1 -- 172.21.15.71:0/2021525329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae62ddb170 con 0x55ae6298d2f0 2024-05-27T09:50:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.306+0000 7f1726000640 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d75090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55ae62cc9c70 tx=0x7f1714012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1860cf31160251d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.306+0000 7f1710c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.307+0000 7f1710c00640 1 -- 172.21.15.71:0/2021525329 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714005310 con 0x55ae6298d2f0 2024-05-27T09:50:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.309+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1720036040 con 0x55ae6298d2f0 2024-05-27T09:50:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.310+0000 7f1710c00640 1 -- 172.21.15.71:0/2021525329 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f17140054b0 con 0x55ae6298d2f0 2024-05-27T09:50:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.310+0000 7f1710c00640 1 -- 172.21.15.71:0/2021525329 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f17140056b0 con 0x55ae6298d2f0 2024-05-27T09:50:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.310+0000 7f1734c5c740 10 client.15669 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.310+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ae62ddc440 con 0x55ae6298d2f0 2024-05-27T09:50:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.311+0000 7f1710c00640 1 -- 172.21.15.71:0/2021525329 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1720036040 con 0x55ae6298d2f0 2024-05-27T09:50:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.311+0000 7f1710c00640 1 -- 172.21.15.71:0/2021525329 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f1714042030 con 0x55ae6298d2f0 2024-05-27T09:50:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.311+0000 7f1734c5c740 10 client.15669 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.311+0000 7f1734c5c740 10 client.15669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.311+0000 7f1734c5c740 20 client.15669 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.311+0000 7f1734c5c740 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae629b61b0 0x55ae62ddeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.312+0000 7f1734c5c740 4 client.15669 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:50:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.312+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae62cc52c0 con 0x55ae629b61b0 2024-05-27T09:50:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.312+0000 7f1727400640 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae629b61b0 0x55ae62ddeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.314+0000 7f1710c00640 10 client.15669 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.314+0000 7f1727400640 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae629b61b0 0x55ae62ddeb60 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21e361f3a6da90f2 server_cookie=e54a248b38256e82 in_seq=0 out_seq=0 2024-05-27T09:50:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.320+0000 7f1710c00640 1 -- 172.21.15.71:0/2021525329 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ae62cc52c0 con 0x55ae629b61b0 2024-05-27T09:50:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.321+0000 7f1710c00640 10 client.15669 handle_command_reply: tid=0 2024-05-27T09:50:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.321+0000 7f1734c5c740 1 client.15669 shutdown 2024-05-27T09:50:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.321+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 msgr2=0x55ae62d75090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.321+0000 7f1734c5c740 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d75090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55ae62cc9c70 tx=0x7f1714012820 comp rx=0 tx=0).stop 2024-05-27T09:50:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 shutdown_connections 2024-05-27T09:50:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ae629954d0 0x55ae62d755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ae629b61b0 0x55ae62ddeb60 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae6298d2f0 0x55ae62d75090 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 --2- 172.21.15.71:0/2021525329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae62974d80 0x55ae62d74b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 >> 172.21.15.71:0/2021525329 conn(0x55ae629aa300 msgr2=0x55ae62d5d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1710c00640 0 client.15669 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 shutdown_connections 2024-05-27T09:50:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.322+0000 7f1734c5c740 1 -- 172.21.15.71:0/2021525329 wait complete. 2024-05-27T09:50:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.323+0000 7f1734c5c740 20 client.15669 trim_cache size 0 max 16384 2024-05-27T09:50:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:50:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:50:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:50:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.324+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f170c0b2a50 msgr2=0x7f170c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.324+0000 7f1727e00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f170c0b2a50 0x7f170c0b4f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ae62d56550 tx=0x7f171800df10 comp rx=0 tx=0).stop 2024-05-27T09:50:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.324+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 msgr2=0x7f17281114e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.324+0000 7f1727e00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281114e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1718005fd0 tx=0x7f171800dde0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.326+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 shutdown_connections 2024-05-27T09:50:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.326+0000 7f1727e00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f170c0b2a50 0x7f170c0b4f60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.326+0000 7f1727e00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f172810c170 0x7f1728111f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.326+0000 7f1727e00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f172810bcd0 0x7f1728111a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.326+0000 7f1727e00640 1 --2- 172.21.15.71:0/3898513476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1728106420 0x7f17281114e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.326+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 >> 172.21.15.71:0/3898513476 conn(0x7f17281013d0 msgr2=0x7f172810abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.327+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 shutdown_connections 2024-05-27T09:50:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:06.327+0000 7f1727e00640 1 -- 172.21.15.71:0/3898513476 wait complete. 2024-05-27T09:50:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:06 smithi122 ceph-mon[36436]: pgmap v73: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-27T09:50:06.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:06 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:50:07.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:06 smithi071 ceph-mon[31451]: pgmap v73: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-27T09:50:07.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:06 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:50:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:06 smithi072 ceph-mon[35951]: pgmap v73: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-27T09:50:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:06 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.972+0000 7f9fcc800700 1 -- 172.21.15.71:0/1631169921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4109860 msgr2=0x7f9fc41111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.972+0000 7f9fcc800700 1 --2- 172.21.15.71:0/1631169921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4109860 0x7f9fc41111c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000b0d0 tx=0x7f9fc000b3e0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.972+0000 7f9fcc800700 1 -- 172.21.15.71:0/1631169921 shutdown_connections 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.972+0000 7f9fcc800700 1 --2- 172.21.15.71:0/1631169921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4109860 0x7f9fc41111c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.972+0000 7f9fcc800700 1 --2- 172.21.15.71:0/1631169921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc41045e0 0x7f9fc41049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.972+0000 7f9fcc800700 1 --2- 172.21.15.71:0/1631169921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4108f10 0x7f9fc4109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.972+0000 7f9fcc800700 1 -- 172.21.15.71:0/1631169921 >> 172.21.15.71:0/1631169921 conn(0x7f9fc4100030 msgr2=0x7f9fc4102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.973+0000 7f9fcc800700 1 -- 172.21.15.71:0/1631169921 shutdown_connections 2024-05-27T09:50:07.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:07 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:50:07.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:07 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:50:07.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:07 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:50:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.973+0000 7f9fcc800700 1 -- 172.21.15.71:0/1631169921 wait complete. 2024-05-27T09:50:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.974+0000 7f9fcc800700 1 Processor -- start 2024-05-27T09:50:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.974+0000 7f9fcc800700 1 -- start start 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.974+0000 7f9fcc800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc41045e0 0x7f9fc419ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fcc800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc4108f10 0x7f9fc419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fcc800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4109860 0x7f9fc419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fcc800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4114490 con 0x7f9fc4108f10 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fcc800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4114310 con 0x7f9fc41045e0 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fcc800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4114610 con 0x7f9fc4109860 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc4108f10 0x7f9fc419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc41045e0 0x7f9fc419ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc4108f10 0x7f9fc419b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57230/0 (socket says 172.21.15.71:57230) 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9400700 1 -- 172.21.15.71:0/2208105130 learned_addr learned my addr 172.21.15.71:0/2208105130 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9e00700 1 -- 172.21.15.71:0/2208105130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4109860 msgr2=0x7f9fc419f610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4109860 0x7f9fc419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9e00700 1 -- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc4108f10 msgr2=0x7f9fc419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc4108f10 0x7f9fc419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9e00700 1 -- 172.21.15.71:0/2208105130 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc419fcb0 con 0x7f9fc41045e0 2024-05-27T09:50:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.975+0000 7f9fc9400700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc4108f10 0x7f9fc419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.976+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc41045e0 0x7f9fc419ade0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800e9f0 tx=0x7f9fb800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.976+0000 7f9fbea00700 1 -- 172.21.15.71:0/2208105130 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb800cbd0 con 0x7f9fc41045e0 2024-05-27T09:50:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.976+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc419ffa0 con 0x7f9fc41045e0 2024-05-27T09:50:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.976+0000 7f9fbea00700 1 -- 172.21.15.71:0/2208105130 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fb800cd70 con 0x7f9fc41045e0 2024-05-27T09:50:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.976+0000 7f9fbea00700 1 -- 172.21.15.71:0/2208105130 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8018680 con 0x7f9fc41045e0 2024-05-27T09:50:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.976+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc41a78c0 con 0x7f9fc41045e0 2024-05-27T09:50:07.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.982+0000 7f9fbea00700 1 -- 172.21.15.71:0/2208105130 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f9fb8018820 con 0x7f9fc41045e0 2024-05-27T09:50:07.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.982+0000 7f9fdb370b80 1 Processor -- start 2024-05-27T09:50:07.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fdb370b80 1 -- start start 2024-05-27T09:50:07.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a6db0 0x55bca93a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a0e30 0x55bca93a1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bca92ceec0 con 0x55bca93a6db0 2024-05-27T09:50:07.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bca92bea60 con 0x55bca93a0e30 2024-05-27T09:50:07.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bca92c2aa0 con 0x55bca9221ec0 2024-05-27T09:50:07.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fbea00700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9fac0b2a70 0x7f9fac0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.983+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a6db0 0x55bca93a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a6db0 0x55bca93a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57234/0 (socket says 172.21.15.71:57234) 2024-05-27T09:50:07.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9e00700 1 -- 172.21.15.71:0/802089533 learned_addr learned my addr 172.21.15.71:0/802089533 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:07.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9400700 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a0e30 0x55bca93a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fca800700 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fbea00700 1 -- 172.21.15.71:0/2208105130 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9fb80e2800 con 0x7f9fc41045e0 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fca800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9fac0b2a70 0x7f9fac0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9e00700 1 -- 172.21.15.71:0/802089533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 msgr2=0x55bca93a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9e00700 1 -- 172.21.15.71:0/802089533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a0e30 msgr2=0x55bca93a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a0e30 0x55bca93a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.984+0000 7f9fc9e00700 1 -- 172.21.15.71:0/802089533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bca92874a0 con 0x55bca93a6db0 2024-05-27T09:50:07.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.985+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a6db0 0x55bca93a08f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80dfef0 tx=0x7f9fb80776e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4990cbd5dc2abfeb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:07.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.985+0000 7f9fca800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9fac0b2a70 0x7f9fac0b4f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55bca93a1bb0 tx=0x7f9fc0006000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:07.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.985+0000 7f9fb3400700 1 -- 172.21.15.71:0/802089533 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb805f070 con 0x55bca93a6db0 2024-05-27T09:50:07.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.985+0000 7f9fb3400700 1 -- 172.21.15.71:0/802089533 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fb80b22b0 con 0x55bca93a6db0 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.985+0000 7f9fb3400700 1 -- 172.21.15.71:0/802089533 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80701e0 con 0x55bca93a6db0 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 -- 172.21.15.71:0/802089533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a6db0 msgr2=0x55bca93a08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a6db0 0x55bca93a08f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80dfef0 tx=0x7f9fb80776e0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 -- 172.21.15.71:0/802089533 shutdown_connections 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a0e30 0x55bca93a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/802089533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a6db0 0x55bca93a08f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 -- 172.21.15.71:0/802089533 >> 172.21.15.71:0/802089533 conn(0x55bca9282040 msgr2=0x55bca939b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 -- 172.21.15.71:0/802089533 shutdown_connections 2024-05-27T09:50:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.986+0000 7f9fdb370b80 1 -- 172.21.15.71:0/802089533 wait complete. 2024-05-27T09:50:07.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.987+0000 7f9fdb370b80 1 -- start start 2024-05-27T09:50:07.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.987+0000 7f9fdb370b80 1 Processor -- start 2024-05-27T09:50:07.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.988+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.988+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93aab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.988+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.988+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bca91c5020 con 0x55bca93a0e30 2024-05-27T09:50:07.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.988+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bca925f7e0 con 0x55bca93a6db0 2024-05-27T09:50:07.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.988+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bca93ad880 con 0x55bca9221ec0 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.988+0000 7f9fdb370b80 10 client.0 _ll_register_callbacks cb 0x55bca9268cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fca800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93aab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57248/0 (socket says 172.21.15.71:57248) 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37412/0 (socket says 172.21.15.71:37412) 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fc9400700 1 -- 172.21.15.71:0/501871497 learned_addr learned my addr 172.21.15.71:0/501871497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fca800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36450/0 (socket says 172.21.15.71:36450) 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fca800700 1 -- 172.21.15.71:0/501871497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 msgr2=0x55bca93aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fca800700 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fca800700 1 -- 172.21.15.71:0/501871497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 msgr2=0x55bca93aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fca800700 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93aab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.989+0000 7f9fca800700 1 -- 172.21.15.71:0/501871497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bca920e950 con 0x55bca93a6db0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fca800700 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93ab0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009900 tx=0x7f9fc00099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d852839ec1517c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fa7e00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fa7e00700 1 -- 172.21.15.71:0/501871497 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0003e60 con 0x55bca93a6db0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bca92d0e10 con 0x55bca93a6db0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fa7e00700 1 -- 172.21.15.71:0/501871497 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9fc001cad0 con 0x55bca93a6db0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fa7e00700 1 -- 172.21.15.71:0/501871497 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9fc001ccd0 con 0x55bca93a6db0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fdb370b80 10 client.25796 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.990+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bca928f0e0 con 0x55bca93a6db0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fa7e00700 1 -- 172.21.15.71:0/501871497 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bca92d0e10 con 0x55bca93a6db0 2024-05-27T09:50:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fa7e00700 1 -- 172.21.15.71:0/501871497 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f9fc0011070 con 0x55bca93a6db0 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fdb370b80 10 client.25796 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fdb370b80 10 client.25796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fdb370b80 20 client.25796 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca93ba800 0x55bca93bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fdb370b80 4 client.25796 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bca92ca5f0 con 0x55bca93ba800 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.991+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca93ba800 0x55bca93bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.992+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca93ba800 0x55bca93bcc60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eefdc408f0af0ce2 server_cookie=acf635857c9187b2 in_seq=0 out_seq=0 2024-05-27T09:50:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.992+0000 7f9fa7e00700 10 client.25796 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fa7e00700 1 -- 172.21.15.71:0/501871497 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55bca92ca5f0 con 0x55bca93ba800 2024-05-27T09:50:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fa7e00700 10 client.25796 handle_command_reply: tid=0 2024-05-27T09:50:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 client.25796 shutdown 2024-05-27T09:50:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 msgr2=0x55bca93ab0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93ab0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009900 tx=0x7f9fc00099e0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 shutdown_connections 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca93ba800 0x55bca93bcc60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93ab0a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fa7e00700 0 client.25796 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca9221ec0 0x55bca93aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/501871497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.993+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 >> 172.21.15.71:0/501871497 conn(0x55bca9282040 msgr2=0x55bca939b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.994+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 shutdown_connections 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.994+0000 7f9fdb370b80 1 -- 172.21.15.71:0/501871497 wait complete. 2024-05-27T09:50:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:07.994+0000 7f9fdb370b80 20 client.25796 trim_cache size 0 max 16384 2024-05-27T09:50:08.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:07 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:50:08.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:07 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:50:08.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:07 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 Processor -- start 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 -- start start 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca9221ec0 0x55bca93acac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a0e30 0x55bca93b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41af420 con 0x55bca9221ec0 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41accb0 con 0x55bca93a6db0 2024-05-27T09:50:08.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41aab20 con 0x55bca93a0e30 2024-05-27T09:50:08.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fca800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:08.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.029+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca9221ec0 0x55bca93acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93a7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36460/0 (socket says 172.21.15.71:36460) 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca9221ec0 0x55bca93acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57264/0 (socket says 172.21.15.71:57264) 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 -- 172.21.15.71:0/3034742385 learned_addr learned my addr 172.21.15.71:0/3034742385 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a0e30 0x55bca93b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 -- 172.21.15.71:0/3034742385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a0e30 msgr2=0x55bca93b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 --2- 172.21.15.71:0/3034742385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a0e30 0x55bca93b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 -- 172.21.15.71:0/3034742385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca9221ec0 msgr2=0x55bca93acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 --2- 172.21.15.71:0/3034742385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca9221ec0 0x55bca93acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 -- 172.21.15.71:0/3034742385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bca93951b0 con 0x55bca93a6db0 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.030+0000 7f9fca800700 1 --2- 172.21.15.71:0/3034742385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93a7bc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000b770 tx=0x7f9fc000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b142ae695c892a03 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.031+0000 7f9fb2a00700 1 -- 172.21.15.71:0/3034742385 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc001cad0 con 0x55bca93a6db0 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.031+0000 7f9fb2a00700 1 -- 172.21.15.71:0/3034742385 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc0003e20 con 0x55bca93a6db0 2024-05-27T09:50:08.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.031+0000 7f9fb2a00700 1 -- 172.21.15.71:0/3034742385 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc003e450 con 0x55bca93a6db0 2024-05-27T09:50:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3034742385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 msgr2=0x55bca93a7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3034742385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93a7bc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000b770 tx=0x7f9fc000bf90 comp rx=0 tx=0).stop 2024-05-27T09:50:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3034742385 shutdown_connections 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3034742385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca93a6db0 0x55bca93a7bc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3034742385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca9221ec0 0x55bca93acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3034742385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a0e30 0x55bca93b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3034742385 >> 172.21.15.71:0/3034742385 conn(0x55bca9282040 msgr2=0x55bca93a74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3034742385 shutdown_connections 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3034742385 wait complete. 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.032+0000 7f9fdb370b80 1 -- start start 2024-05-27T09:50:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 1 Processor -- start 2024-05-27T09:50:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca9221ec0 0x55bca93b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a6db0 0x55bca941f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41ab170 con 0x55bca93a0e30 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41ac5e0 con 0x55bca9221ec0 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41ab840 con 0x55bca93a6db0 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.033+0000 7f9fdb370b80 10 client.0 _ll_register_callbacks cb 0x55bca9268cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca9221ec0 0x55bca93b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57268/0 (socket says 172.21.15.71:57268) 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca9221ec0 0x55bca93b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36468/0 (socket says 172.21.15.71:36468) 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9400700 1 -- 172.21.15.71:0/3284758151 learned_addr learned my addr 172.21.15.71:0/3284758151 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fca800700 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a6db0 0x55bca941f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 -- 172.21.15.71:0/3284758151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a6db0 msgr2=0x55bca941f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a6db0 0x55bca941f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 -- 172.21.15.71:0/3284758151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 msgr2=0x55bca93b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 -- 172.21.15.71:0/3284758151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bca941f860 con 0x55bca9221ec0 2024-05-27T09:50:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fc9e00700 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca9221ec0 0x55bca93b00a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80a9a50 tx=0x7f9fb801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe8506ff250c9b91 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.034+0000 7f9fa7e00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fa7e00700 1 -- 172.21.15.71:0/3284758151 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a9280 con 0x55bca9221ec0 2024-05-27T09:50:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fa7e00700 1 -- 172.21.15.71:0/3284758151 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9fb80a9f80 con 0x55bca9221ec0 2024-05-27T09:50:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc0003e20 con 0x55bca9221ec0 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fa7e00700 1 -- 172.21.15.71:0/3284758151 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9fb80a9620 con 0x55bca9221ec0 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 10 client.25802 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bca9426ba0 con 0x55bca9221ec0 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fa7e00700 1 -- 172.21.15.71:0/3284758151 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc0003e20 con 0x55bca9221ec0 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fa7e00700 1 -- 172.21.15.71:0/3284758151 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f9fb80b24e0 con 0x55bca9221ec0 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 10 client.25802 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 10 client.25802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 20 client.25802 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca9426e30 0x55bca9429250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:08.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 4 client.25802 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-27T09:50:08.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.035+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bca91412d0 con 0x55bca9426e30 2024-05-27T09:50:08.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.036+0000 7f9fc9400700 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca9426e30 0x55bca9429250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:08.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.036+0000 7f9fc9400700 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca9426e30 0x55bca9429250 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cdf0c58bbcce50f server_cookie=20a71d45744969bc in_seq=0 out_seq=0 2024-05-27T09:50:08.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.036+0000 7f9fa7e00700 10 client.25802 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.037+0000 7f9fa7e00700 1 -- 172.21.15.71:0/3284758151 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bca91412d0 con 0x55bca9426e30 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.037+0000 7f9fa7e00700 10 client.25802 handle_command_reply: tid=0 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.037+0000 7f9fdb370b80 1 client.25802 shutdown 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca9221ec0 msgr2=0x55bca93b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca9221ec0 0x55bca93b00a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80a9a50 tx=0x7f9fb801f000 comp rx=0 tx=0).stop 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 shutdown_connections 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bca9426e30 0x55bca9429250 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bca93a6db0 0x55bca941f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bca9221ec0 0x55bca93b00a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 --2- 172.21.15.71:0/3284758151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bca93a0e30 0x55bca93b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 >> 172.21.15.71:0/3284758151 conn(0x55bca9282040 msgr2=0x55bca93a7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fa7e00700 0 client.25802 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 shutdown_connections 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 1 -- 172.21.15.71:0/3284758151 wait complete. 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.038+0000 7f9fdb370b80 20 client.25802 trim_cache size 0 max 16384 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:50:08.040 INFO:teuthology.orchestra.run.smithi071.stdout: "return_code": 0, 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_tag": "558e45b5-a087-416e-a6bc-de85838de9be", 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": "asynchronous" 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9fac0b2a70 msgr2=0x7f9fac0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9fac0b2a70 0x7f9fac0b4f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55bca93a1bb0 tx=0x7f9fc0006000 comp rx=0 tx=0).stop 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc41045e0 msgr2=0x7f9fc419ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc41045e0 0x7f9fc419ade0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800e9f0 tx=0x7f9fb800ed00 comp rx=0 tx=0).stop 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 shutdown_connections 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9fac0b2a70 0x7f9fac0b4f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4109860 0x7f9fc419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc41045e0 0x7f9fc419ade0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 --2- 172.21.15.71:0/2208105130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fc4108f10 0x7f9fc419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 >> 172.21.15.71:0/2208105130 conn(0x7f9fc4100030 msgr2=0x7f9fc4108650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 shutdown_connections 2024-05-27T09:50:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:08.039+0000 7f9fcc800700 1 -- 172.21.15.71:0/2208105130 wait complete. 2024-05-27T09:50:08.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:07 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:50:08.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:07 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:50:08.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:07 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:50:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:08 smithi071 ceph-mon[31451]: pgmap v74: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-27T09:50:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:08 smithi071 ceph-mon[31451]: scrub queued for path: / 2024-05-27T09:50:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:08 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:08 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:50:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:08 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:09.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:08 smithi071 ceph-mon[31451]: scrub summary: idle 2024-05-27T09:50:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:08 smithi072 ceph-mon[35951]: pgmap v74: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-27T09:50:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:08 smithi072 ceph-mon[35951]: scrub queued for path: / 2024-05-27T09:50:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:08 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:08 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:50:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:08 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:08 smithi072 ceph-mon[35951]: scrub summary: idle 2024-05-27T09:50:09.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-27T09:50:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:08 smithi122 ceph-mon[36436]: pgmap v74: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-27T09:50:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:08 smithi122 ceph-mon[36436]: scrub queued for path: / 2024-05-27T09:50:09.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:08 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:09.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:08 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:50:09.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:08 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:09.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:08 smithi122 ceph-mon[36436]: scrub summary: idle 2024-05-27T09:50:09.639 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:11.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:10 smithi071 ceph-mon[31451]: pgmap v75: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:50:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:10 smithi072 ceph-mon[35951]: pgmap v75: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:50:11.032 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:10 smithi122 ceph-mon[36436]: pgmap v75: 97 pgs: 97 active+clean; 1.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-27T09:50:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.194+0000 7f261a600700 1 -- 172.21.15.71:0/1725402846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 msgr2=0x7f2614105690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.194+0000 7f261a600700 1 --2- 172.21.15.71:0/1725402846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f2614105690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2608009990 tx=0x7f2608009ca0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.194+0000 7f261a600700 1 -- 172.21.15.71:0/1725402846 shutdown_connections 2024-05-27T09:50:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.194+0000 7f261a600700 1 --2- 172.21.15.71:0/1725402846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f261410e6f0 0x7f2614110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.194+0000 7f261a600700 1 --2- 172.21.15.71:0/1725402846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f2614105690 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.194+0000 7f261a600700 1 --2- 172.21.15.71:0/1725402846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2614105bd0 0x7f261410e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.194+0000 7f261a600700 1 -- 172.21.15.71:0/1725402846 >> 172.21.15.71:0/1725402846 conn(0x7f2614078ab0 msgr2=0x7f2614078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.195+0000 7f261a600700 1 -- 172.21.15.71:0/1725402846 shutdown_connections 2024-05-27T09:50:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.195+0000 7f261a600700 1 -- 172.21.15.71:0/1725402846 wait complete. 2024-05-27T09:50:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.196+0000 7f261a600700 1 Processor -- start 2024-05-27T09:50:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.196+0000 7f261a600700 1 -- start start 2024-05-27T09:50:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.196+0000 7f261a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f26141a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f261a600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2614105bd0 0x7f26141a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f261a600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f261410e6f0 0x7f261419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f261a600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2614114240 con 0x7f2614105280 2024-05-27T09:50:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f261a600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f26141140c0 con 0x7f261410e6f0 2024-05-27T09:50:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f261a600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26141143c0 con 0x7f2614105bd0 2024-05-27T09:50:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f26141a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f26141a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57286/0 (socket says 172.21.15.71:57286) 2024-05-27T09:50:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 -- 172.21.15.71:0/121115413 learned_addr learned my addr 172.21.15.71:0/121115413 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2613e00700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2614105bd0 0x7f26141a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619c00700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f261410e6f0 0x7f261419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 -- 172.21.15.71:0/121115413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2614105bd0 msgr2=0x7f26141a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2614105bd0 0x7f26141a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 -- 172.21.15.71:0/121115413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f261410e6f0 msgr2=0x7f261419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f261410e6f0 0x7f261419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.197+0000 7f2619200700 1 -- 172.21.15.71:0/121115413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261419b0b0 con 0x7f2614105280 2024-05-27T09:50:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.198+0000 7f2619200700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f26141a07e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26080057c0 tx=0x7f26080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.198+0000 7f2611600700 1 -- 172.21.15.71:0/121115413 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608027070 con 0x7f2614105280 2024-05-27T09:50:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.198+0000 7f2611600700 1 -- 172.21.15.71:0/121115413 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2608022470 con 0x7f2614105280 2024-05-27T09:50:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.198+0000 7f2611600700 1 -- 172.21.15.71:0/121115413 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608017650 con 0x7f2614105280 2024-05-27T09:50:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.198+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261419b340 con 0x7f2614105280 2024-05-27T09:50:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.198+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261419b820 con 0x7f2614105280 2024-05-27T09:50:12.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.202+0000 7f2611600700 1 -- 172.21.15.71:0/121115413 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2608009d10 con 0x7f2614105280 2024-05-27T09:50:12.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.203+0000 7f262a74bb80 1 Processor -- start 2024-05-27T09:50:12.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.204+0000 7f262a74bb80 1 -- start start 2024-05-27T09:50:12.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.204+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b4a6e40 0x56111b624ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.204+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.204+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625820 0x56111b632020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.204+0000 7f262a74bb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56111b553e40 con 0x56111b625820 2024-05-27T09:50:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.204+0000 7f262a74bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56111b5439e0 con 0x56111b4a6e40 2024-05-27T09:50:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.204+0000 7f262a74bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56111b547a20 con 0x56111b625410 2024-05-27T09:50:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b4a6e40 0x56111b624ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2613e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625820 0x56111b632020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b4a6e40 0x56111b624ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:36504/0 (socket says 172.21.15.71:36504) 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 -- 172.21.15.71:0/4221991943 learned_addr learned my addr 172.21.15.71:0/4221991943 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619200700 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2611600700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25fc0b29f0 0x7f25fc0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 -- 172.21.15.71:0/4221991943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 msgr2=0x56111b62fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 -- 172.21.15.71:0/4221991943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625820 msgr2=0x56111b632020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625820 0x56111b632020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2619c00700 1 -- 172.21.15.71:0/4221991943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56111b50c420 con 0x56111b4a6e40 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.205+0000 7f2611600700 1 -- 172.21.15.71:0/121115413 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f26080e33e0 con 0x7f2614105280 2024-05-27T09:50:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.206+0000 7f2619c00700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25fc0b29f0 0x7f25fc0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.206+0000 7f2619c00700 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b4a6e40 0x56111b624ed0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f260c015a90 tx=0x7f260c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c0e6e57fea45276 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.206+0000 7f2606000700 1 -- 172.21.15.71:0/4221991943 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c026070 con 0x56111b4a6e40 2024-05-27T09:50:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.206+0000 7f2606000700 1 -- 172.21.15.71:0/4221991943 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f260c014b90 con 0x56111b4a6e40 2024-05-27T09:50:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.206+0000 7f2619c00700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25fc0b29f0 0x7f25fc0b4f00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f260c0094f0 tx=0x7f260c024000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.206+0000 7f2606000700 1 -- 172.21.15.71:0/4221991943 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c007760 con 0x56111b4a6e40 2024-05-27T09:50:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.207+0000 7f262a74bb80 1 -- 172.21.15.71:0/4221991943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b4a6e40 msgr2=0x56111b624ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.207+0000 7f262a74bb80 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b4a6e40 0x56111b624ed0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f260c015a90 tx=0x7f260c009920 comp rx=0 tx=0).stop 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.207+0000 7f262a74bb80 1 -- 172.21.15.71:0/4221991943 shutdown_connections 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.207+0000 7f262a74bb80 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625820 0x56111b632020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.207+0000 7f262a74bb80 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b4a6e40 0x56111b624ed0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.207+0000 7f262a74bb80 1 --2- 172.21.15.71:0/4221991943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.207+0000 7f262a74bb80 1 -- 172.21.15.71:0/4221991943 >> 172.21.15.71:0/4221991943 conn(0x56111b506fc0 msgr2=0x56111b620d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.208+0000 7f262a74bb80 1 -- 172.21.15.71:0/4221991943 shutdown_connections 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.208+0000 7f262a74bb80 1 -- 172.21.15.71:0/4221991943 wait complete. 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.208+0000 7f262a74bb80 1 -- start start 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.208+0000 7f262a74bb80 1 Processor -- start 2024-05-27T09:50:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b62f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b62ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f262a74bb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56111b449fa0 con 0x56111b4a6e40 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f262a74bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56111b4e4760 con 0x56111b625820 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f262a74bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56111b632990 con 0x56111b625410 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f262a74bb80 10 client.0 _ll_register_callbacks cb 0x56111b4edc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f2619200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b62f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f2619200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b62f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57300/0 (socket says 172.21.15.71:57300) 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.209+0000 7f2619200700 1 -- 172.21.15.71:0/179724664 learned_addr learned my addr 172.21.15.71:0/179724664 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:12.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2613e00700 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2619c00700 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b62ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2619200700 1 -- 172.21.15.71:0/179724664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 msgr2=0x56111b62fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2619200700 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2619200700 1 -- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 msgr2=0x56111b62ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2619200700 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b62ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2619200700 1 -- 172.21.15.71:0/179724664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56111b4938d0 con 0x56111b4a6e40 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f2619200700 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b62f550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f26080098e0 tx=0x7f2608022c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffee0522c7723dc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.210+0000 7f25faa00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f25faa00700 1 -- 172.21.15.71:0/179724664 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26080aa4f0 con 0x56111b4a6e40 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f25faa00700 1 -- 172.21.15.71:0/179724664 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f26080aa980 con 0x56111b4a6e40 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f260c014b90 con 0x56111b4a6e40 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f25faa00700 1 -- 172.21.15.71:0/179724664 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f26080a9e90 con 0x56111b4a6e40 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f262a74bb80 10 client.15699 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56111b514060 con 0x56111b4a6e40 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f25faa00700 1 -- 172.21.15.71:0/179724664 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f260c014b90 con 0x56111b4a6e40 2024-05-27T09:50:12.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.211+0000 7f25faa00700 1 -- 172.21.15.71:0/179724664 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f260802a020 con 0x56111b4a6e40 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.212+0000 7f262a74bb80 10 client.15699 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.212+0000 7f262a74bb80 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.212+0000 7f262a74bb80 20 client.15699 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.212+0000 7f262a74bb80 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b63f870 0x56111b641cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.212+0000 7f262a74bb80 4 client.15699 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.212+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56111b555d90 con 0x56111b63f870 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.212+0000 7f2613e00700 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b63f870 0x56111b641cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.213+0000 7f25faa00700 10 client.15699 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:12.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.213+0000 7f2613e00700 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b63f870 0x56111b641cf0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61cdfb142d077c59 server_cookie=4e955de0263819f4 in_seq=0 out_seq=0 2024-05-27T09:50:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f25faa00700 1 -- 172.21.15.71:0/179724664 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56111b555d90 con 0x56111b63f870 2024-05-27T09:50:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f25faa00700 10 client.15699 handle_command_reply: tid=0 2024-05-27T09:50:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 client.15699 shutdown 2024-05-27T09:50:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 msgr2=0x56111b62f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b62f550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f26080098e0 tx=0x7f2608022c00 comp rx=0 tx=0).stop 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 shutdown_connections 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b63f870 0x56111b641cf0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b62ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b62f550 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 --2- 172.21.15.71:0/179724664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625410 0x56111b62fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 >> 172.21.15.71:0/179724664 conn(0x56111b506fc0 msgr2=0x56111b61fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.214+0000 7f25faa00700 0 client.15699 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.215+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 shutdown_connections 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.215+0000 7f262a74bb80 1 -- 172.21.15.71:0/179724664 wait complete. 2024-05-27T09:50:12.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.215+0000 7f262a74bb80 20 client.15699 trim_cache size 0 max 16384 2024-05-27T09:50:12.222 INFO:tasks.workunit.client.0.smithi071.stderr:Updating files: 58% (7212/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 94% (11631/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-27T09:50:12.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.237+0000 7f262a74bb80 1 Processor -- start 2024-05-27T09:50:12.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.237+0000 7f262a74bb80 1 -- start start 2024-05-27T09:50:12.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.237+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b6297a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625410 0x56111b6319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625820 0x56111b63ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f262a74bb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f26141af200 con 0x56111b4a6e40 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f262a74bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f26141aca90 con 0x56111b625410 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f262a74bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26141aa900 con 0x56111b625820 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2619200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b6297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2619200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b6297a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57302/0 (socket says 172.21.15.71:57302) 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2619200700 1 -- 172.21.15.71:0/2393332207 learned_addr learned my addr 172.21.15.71:0/2393332207 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2613e00700 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625410 0x56111b6319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2619c00700 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625820 0x56111b63ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2613e00700 1 -- 172.21.15.71:0/2393332207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625820 msgr2=0x56111b63ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2613e00700 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625820 0x56111b63ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2613e00700 1 -- 172.21.15.71:0/2393332207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 msgr2=0x56111b6297a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2613e00700 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b6297a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2613e00700 1 -- 172.21.15.71:0/2393332207 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56111b62da80 con 0x56111b625410 2024-05-27T09:50:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2619c00700 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625820 0x56111b63ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.238+0000 7f2619200700 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b6297a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.239+0000 7f2613e00700 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625410 0x56111b6319f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x56111b642490 tx=0x7f2600009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feae9e4cf97f00a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.239+0000 7f2605600700 1 -- 172.21.15.71:0/2393332207 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600003c40 con 0x56111b625410 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.239+0000 7f2605600700 1 -- 172.21.15.71:0/2393332207 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2600003de0 con 0x56111b625410 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.239+0000 7f2605600700 1 -- 172.21.15.71:0/2393332207 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600010720 con 0x56111b625410 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 -- 172.21.15.71:0/2393332207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625410 msgr2=0x56111b6319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625410 0x56111b6319f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x56111b642490 tx=0x7f2600009260 comp rx=0 tx=0).stop 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 -- 172.21.15.71:0/2393332207 shutdown_connections 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b625820 0x56111b63ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b4a6e40 0x56111b6297a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 --2- 172.21.15.71:0/2393332207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625410 0x56111b6319f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 -- 172.21.15.71:0/2393332207 >> 172.21.15.71:0/2393332207 conn(0x56111b506fc0 msgr2=0x56111b62fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 -- 172.21.15.71:0/2393332207 shutdown_connections 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.240+0000 7f262a74bb80 1 -- 172.21.15.71:0/2393332207 wait complete. 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.241+0000 7f262a74bb80 1 -- start start 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.241+0000 7f262a74bb80 1 Processor -- start 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b4a6e40 0x56111b634100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625410 0x56111b634640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f262a74bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b6b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f262a74bb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f26141aaf50 con 0x56111b625410 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f262a74bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f26141ac3c0 con 0x56111b625820 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f262a74bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26141ab620 con 0x56111b4a6e40 2024-05-27T09:50:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f262a74bb80 10 client.0 _ll_register_callbacks cb 0x56111b4edc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:12.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f2613e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625410 0x56111b634640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f2613e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625410 0x56111b634640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57314/0 (socket says 172.21.15.71:57314) 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f2619c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b6b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f2613e00700 1 -- 172.21.15.71:0/1887153471 learned_addr learned my addr 172.21.15.71:0/1887153471 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.242+0000 7f2619200700 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b4a6e40 0x56111b634100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f2619c00700 1 -- 172.21.15.71:0/1887153471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b4a6e40 msgr2=0x56111b634100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f2619c00700 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b4a6e40 0x56111b634100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f2619c00700 1 -- 172.21.15.71:0/1887153471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625410 msgr2=0x56111b634640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f2619c00700 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625410 0x56111b634640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f2619c00700 1 -- 172.21.15.71:0/1887153471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56111b6b2110 con 0x56111b625820 2024-05-27T09:50:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f2619200700 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b4a6e40 0x56111b634100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f2619c00700 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b6b1bd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f260c015a30 tx=0x7f260c015360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3782f0780ce7a6ed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f25faa00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f25faa00700 1 -- 172.21.15.71:0/1887153471 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c026030 con 0x56111b625820 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2600003de0 con 0x56111b625820 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.243+0000 7f25faa00700 1 -- 172.21.15.71:0/1887153471 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f260c004a50 con 0x56111b625820 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f25faa00700 1 -- 172.21.15.71:0/1887153471 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f260c004c50 con 0x56111b625820 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 10 client.25820 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56111b6b3360 con 0x56111b625820 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f25faa00700 1 -- 172.21.15.71:0/1887153471 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2600003de0 con 0x56111b625820 2024-05-27T09:50:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f25faa00700 1 -- 172.21.15.71:0/1887153471 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f260c014bb0 con 0x56111b625820 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 10 client.25820 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 10 client.25820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 20 client.25820 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b6b3820 0x56111b6b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 4 client.25820 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.244+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56111b54f570 con 0x56111b6b3820 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.245+0000 7f2619200700 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b6b3820 0x56111b6b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.245+0000 7f2619200700 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b6b3820 0x56111b6b5c40 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7554a5983b60334 server_cookie=98161a76c5f0f2f2 in_seq=0 out_seq=0 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.245+0000 7f25faa00700 10 client.25820 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.245+0000 7f25faa00700 1 -- 172.21.15.71:0/1887153471 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56111b54f570 con 0x56111b6b3820 2024-05-27T09:50:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.245+0000 7f25faa00700 10 client.25820 handle_command_reply: tid=0 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.245+0000 7f262a74bb80 1 client.25820 shutdown 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 msgr2=0x56111b6b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b6b1bd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f260c015a30 tx=0x7f260c015360 comp rx=0 tx=0).stop 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 shutdown_connections 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56111b6b3820 0x56111b6b5c40 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56111b625820 0x56111b6b1bd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56111b4a6e40 0x56111b634100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f25faa00700 0 client.25820 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 --2- 172.21.15.71:0/1887153471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56111b625410 0x56111b634640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 >> 172.21.15.71:0/1887153471 conn(0x56111b506fc0 msgr2=0x56111b62fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 shutdown_connections 2024-05-27T09:50:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 1 -- 172.21.15.71:0/1887153471 wait complete. 2024-05-27T09:50:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.246+0000 7f262a74bb80 20 client.25820 trim_cache size 0 max 16384 2024-05-27T09:50:12.251 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:50:12.251 INFO:teuthology.orchestra.run.smithi071.stdout: "status": "no active scrubs running", 2024-05-27T09:50:12.251 INFO:teuthology.orchestra.run.smithi071.stdout: "scrubs": {} 2024-05-27T09:50:12.251 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:50:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25fc0b29f0 msgr2=0x7f25fc0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25fc0b29f0 0x7f25fc0b4f00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f260c0094f0 tx=0x7f260c024000 comp rx=0 tx=0).stop 2024-05-27T09:50:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 msgr2=0x7f26141a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f26141a07e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26080057c0 tx=0x7f26080057f0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 shutdown_connections 2024-05-27T09:50:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25fc0b29f0 0x7f25fc0b4f00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f261410e6f0 0x7f261419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2614105280 0x7f26141a07e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 --2- 172.21.15.71:0/121115413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2614105bd0 0x7f26141a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 >> 172.21.15.71:0/121115413 conn(0x7f2614078ab0 msgr2=0x7f26140ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.247+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 shutdown_connections 2024-05-27T09:50:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:12.248+0000 7f261a600700 1 -- 172.21.15.71:0/121115413 wait complete. 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to 'a6507388dd5057528934822c0163b0c347ef1d5d'. 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-05-27T09:50:12.954 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:12.954 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-05-27T09:50:12.954 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-27T09:50:12.954 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at a6507388dd5 Merge PR #53755 into wip-vshankar-testing-20240521.105740-debug 2024-05-27T09:50:12.968 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-27T09:50:13.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:12 smithi071 ceph-mon[31451]: pgmap v76: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-05-27T09:50:13.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:12 smithi072 ceph-mon[35951]: pgmap v76: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-05-27T09:50:13.071 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-27T09:50:13.079 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-27T09:50:13.079 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-27T09:50:13.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:12 smithi122 ceph-mon[36436]: pgmap v76: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-05-27T09:50:13.368 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-27T09:50:13.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:50:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:14.301 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-27T09:50:14.491 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-27T09:50:14.565 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-27T09:50:14.570 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-27T09:50:14.570 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-27T09:50:14.647 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-27T09:50:14.658 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T09:50:14.658 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-27T09:50:14.706 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-05-27T09:50:14.707 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-05-27T09:50:14.707 DEBUG:teuthology.orchestra.run.smithi071:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6507388dd5057528934822c0163b0c347ef1d5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-05-27T09:50:14.815 INFO:tasks.workunit.client.0.smithi071.stderr:+ set -e 2024-05-27T09:50:14.815 INFO:tasks.workunit.client.0.smithi071.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-05-27T09:50:14.821 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into 'xfstests-dev'... 2024-05-27T09:50:14.993 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:14 smithi071 ceph-mon[31451]: pgmap v77: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T09:50:15.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:14 smithi072 ceph-mon[35951]: pgmap v77: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T09:50:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:14 smithi122 ceph-mon[36436]: pgmap v77: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T09:50:16.344 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:16 smithi071 ceph-mon[31451]: pgmap v78: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 -- 172.21.15.71:0/1113527784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00115170 msgr2=0x7f4e00117590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 --2- 172.21.15.71:0/1113527784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00115170 0x7f4e00117590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009990 tx=0x7f4df8009ca0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 -- 172.21.15.71:0/1113527784 shutdown_connections 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 --2- 172.21.15.71:0/1113527784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00115170 0x7f4e00117590 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 --2- 172.21.15.71:0/1113527784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e00075b50 0x7f4e00075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 --2- 172.21.15.71:0/1113527784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e000764a0 0x7f4e00114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 -- 172.21.15.71:0/1113527784 >> 172.21.15.71:0/1113527784 conn(0x7f4e00079d00 msgr2=0x7f4e0007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 -- 172.21.15.71:0/1113527784 shutdown_connections 2024-05-27T09:50:16.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.344+0000 7f4dff200700 1 -- 172.21.15.71:0/1113527784 wait complete. 2024-05-27T09:50:16.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.346+0000 7f4dff200700 1 Processor -- start 2024-05-27T09:50:16.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.346+0000 7f4dff200700 1 -- start start 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dff200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00075b50 0x7f4e001a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dff200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e000764a0 0x7f4e001a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dff200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e00115170 0x7f4e001a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dff200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0011a8d0 con 0x7f4e000764a0 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dff200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0011a750 con 0x7f4e00075b50 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dff200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0011aa50 con 0x7f4e00115170 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dfde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00075b50 0x7f4e001a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dfde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00075b50 0x7f4e001a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34842/0 (socket says 172.21.15.71:34842) 2024-05-27T09:50:16.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dfde00700 1 -- 172.21.15.71:0/3057945546 learned_addr learned my addr 172.21.15.71:0/3057945546 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:16.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.347+0000 7f4dfe800700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e00115170 0x7f4e001a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:16.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4dfde00700 1 -- 172.21.15.71:0/3057945546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e00115170 msgr2=0x7f4e001a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:16.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4dfde00700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e00115170 0x7f4e001a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4dfde00700 1 -- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e000764a0 msgr2=0x7f4e001a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4dfde00700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e000764a0 0x7f4e001a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4dfde00700 1 -- 172.21.15.71:0/3057945546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e001a6170 con 0x7f4e00075b50 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4dfde00700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00075b50 0x7f4e001a12a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4df000ef10 tx=0x7f4df000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4df6a00700 1 -- 172.21.15.71:0/3057945546 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df000ca70 con 0x7f4e00075b50 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e001a6400 con 0x7f4e00075b50 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4df6a00700 1 -- 172.21.15.71:0/3057945546 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4df0019070 con 0x7f4e00075b50 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.348+0000 7f4df6a00700 1 -- 172.21.15.71:0/3057945546 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0014480 con 0x7f4e00075b50 2024-05-27T09:50:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.349+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e001add80 con 0x7f4e00075b50 2024-05-27T09:50:16.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.350+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e00077290 con 0x7f4e00075b50 2024-05-27T09:50:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.352+0000 7f4df6a00700 1 -- 172.21.15.71:0/3057945546 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4df0012050 con 0x7f4e00075b50 2024-05-27T09:50:16.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.354+0000 7f4df6a00700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4de40b2a70 0x7f4de40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:16.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.354+0000 7f4df6a00700 1 -- 172.21.15.71:0/3057945546 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4df00e2630 con 0x7f4e00075b50 2024-05-27T09:50:16.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.354+0000 7f4dfd400700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4de40b2a70 0x7f4de40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.355+0000 7f4dfd400700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4de40b2a70 0x7f4de40b4f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e00116d50 tx=0x7f4dec009620 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:16.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.358+0000 7f4df6a00700 1 -- 172.21.15.71:0/3057945546 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4df0010040 con 0x7f4e00075b50 2024-05-27T09:50:16.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:16 smithi072 ceph-mon[35951]: pgmap v78: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T09:50:16.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.660+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e0002e5e0 con 0x7f4e00075b50 2024-05-27T09:50:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.661+0000 7f4df6a00700 1 -- 172.21.15.71:0/3057945546 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11854 (secure 0 0 0) 0x7f4df00a9fe0 con 0x7f4e00075b50 2024-05-27T09:50:16.661 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:50:16.662 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:47:44.135191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.664+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4de40b2a70 msgr2=0x7f4de40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.664+0000 7f4dff200700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4de40b2a70 0x7f4de40b4f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e00116d50 tx=0x7f4dec009620 comp rx=0 tx=0).stop 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.664+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00075b50 msgr2=0x7f4e001a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.664+0000 7f4dff200700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00075b50 0x7f4e001a12a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4df000ef10 tx=0x7f4df000c3a0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 shutdown_connections 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4de40b2a70 0x7f4de40b4f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e00115170 0x7f4e001a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e00075b50 0x7f4e001a12a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 --2- 172.21.15.71:0/3057945546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e000764a0 0x7f4e001a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 >> 172.21.15.71:0/3057945546 conn(0x7f4e00079d00 msgr2=0x7f4e00102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 shutdown_connections 2024-05-27T09:50:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:16.665+0000 7f4dff200700 1 -- 172.21.15.71:0/3057945546 wait complete. 2024-05-27T09:50:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-05-27T09:50:16.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:16 smithi122 ceph-mon[36436]: pgmap v78: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T09:50:17.512 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:17 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3057945546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:50:17.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:17 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3057945546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:50:17.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:17 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3057945546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:50:17.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-27T09:50:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:18 smithi072 ceph-mon[35951]: pgmap v79: 97 pgs: 97 active+clean; 1.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-27T09:50:18.544 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:18 smithi071 ceph-mon[31451]: pgmap v79: 97 pgs: 97 active+clean; 1.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-27T09:50:18.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:18 smithi122 ceph-mon[36436]: pgmap v79: 97 pgs: 97 active+clean; 1.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-27T09:50:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 -- 172.21.15.71:0/2067561954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff844111f90 msgr2=0x7ff8441143b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 --2- 172.21.15.71:0/2067561954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff844111f90 0x7ff8441143b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff830009900 tx=0x7ff83002a410 comp rx=0 tx=0).stop 2024-05-27T09:50:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 -- 172.21.15.71:0/2067561954 shutdown_connections 2024-05-27T09:50:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 --2- 172.21.15.71:0/2067561954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8441148f0 0x7ff844116d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 --2- 172.21.15.71:0/2067561954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff844111f90 0x7ff8441143b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 --2- 172.21.15.71:0/2067561954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff844078720 0x7ff844078b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 -- 172.21.15.71:0/2067561954 >> 172.21.15.71:0/2067561954 conn(0x7ff844101300 msgr2=0x7ff844103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 -- 172.21.15.71:0/2067561954 shutdown_connections 2024-05-27T09:50:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.562+0000 7ff848a00640 1 -- 172.21.15.71:0/2067561954 wait complete. 2024-05-27T09:50:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.563+0000 7ff848a00640 1 Processor -- start 2024-05-27T09:50:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.563+0000 7ff848a00640 1 -- start start 2024-05-27T09:50:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff848a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff844078720 0x7ff8441a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff848a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff844111f90 0x7ff8441a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff848a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8441148f0 0x7ff8441a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff848a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff84411a260 con 0x7ff8441148f0 2024-05-27T09:50:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff848a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff84411a0e0 con 0x7ff844111f90 2024-05-27T09:50:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff848a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff84411a3e0 con 0x7ff844078720 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff843400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff844078720 0x7ff8441a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff843e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8441148f0 0x7ff8441a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff843400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff844078720 0x7ff8441a69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57596/0 (socket says 172.21.15.71:57596) 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff843400640 1 -- 172.21.15.71:0/2455747426 learned_addr learned my addr 172.21.15.71:0/2455747426 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.564+0000 7ff842a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff844111f90 0x7ff8441a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff843400640 1 -- 172.21.15.71:0/2455747426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff844111f90 msgr2=0x7ff8441a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff843400640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff844111f90 0x7ff8441a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff843400640 1 -- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8441148f0 msgr2=0x7ff8441a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff843400640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8441148f0 0x7ff8441a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff843400640 1 -- 172.21.15.71:0/2455747426 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8441a1270 con 0x7ff844078720 2024-05-27T09:50:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff843e00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8441148f0 0x7ff8441a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff842a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff844111f90 0x7ff8441a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff843400640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff844078720 0x7ff8441a69c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e9f0 tx=0x7ff83400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff83be00640 1 -- 172.21.15.71:0/2455747426 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83400cd80 con 0x7ff844078720 2024-05-27T09:50:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff83be00640 1 -- 172.21.15.71:0/2455747426 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8340108e0 con 0x7ff844078720 2024-05-27T09:50:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8441a1500 con 0x7ff844078720 2024-05-27T09:50:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.565+0000 7ff83be00640 1 -- 172.21.15.71:0/2455747426 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834018980 con 0x7ff844078720 2024-05-27T09:50:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.566+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8441ad760 con 0x7ff844078720 2024-05-27T09:50:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 Processor -- start 2024-05-27T09:50:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 -- start start 2024-05-27T09:50:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f73ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3712f0 0x56125f73cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff83be00640 1 -- 172.21.15.71:0/2455747426 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7ff834010430 con 0x7ff844078720 2024-05-27T09:50:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f73d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56125f6adb90 con 0x56125f3712f0 2024-05-27T09:50:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56125f69d730 con 0x56125f3794d0 2024-05-27T09:50:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.569+0000 7ff850fc8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56125f6a1770 con 0x56125f39a1b0 2024-05-27T09:50:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff843400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3712f0 0x56125f73cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff842a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f73d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff842a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f73d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34864/0 (socket says 172.21.15.71:34864) 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff842a00640 1 -- 172.21.15.71:0/768971109 learned_addr learned my addr 172.21.15.71:0/768971109 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff843e00640 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f73ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff843e00640 1 -- 172.21.15.71:0/768971109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 msgr2=0x56125f73d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff843e00640 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f73d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff843e00640 1 -- 172.21.15.71:0/768971109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3712f0 msgr2=0x56125f73cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff843e00640 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3712f0 0x56125f73cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.570+0000 7ff843e00640 1 -- 172.21.15.71:0/768971109 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125f6368b0 con 0x56125f39a1b0 2024-05-27T09:50:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.571+0000 7ff843e00640 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f73ca60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff83c005fd0 tx=0x7ff83c011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a7a3f5cf5c4adc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.571+0000 7ff82fe00640 1 -- 172.21.15.71:0/768971109 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c004d20 con 0x56125f39a1b0 2024-05-27T09:50:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.571+0000 7ff82fe00640 1 -- 172.21.15.71:0/768971109 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff83c00f9a0 con 0x56125f39a1b0 2024-05-27T09:50:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.571+0000 7ff82fe00640 1 -- 172.21.15.71:0/768971109 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c004450 con 0x56125f39a1b0 2024-05-27T09:50:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.571+0000 7ff83be00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff8280b2950 0x7ff8280b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff83be00640 1 -- 172.21.15.71:0/2455747426 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff8340e2970 con 0x7ff844078720 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 -- 172.21.15.71:0/768971109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 msgr2=0x56125f73ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f73ca60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff83c005fd0 tx=0x7ff83c011bf0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff843400640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff8280b2950 0x7ff8280b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 -- 172.21.15.71:0/768971109 shutdown_connections 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f73d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3712f0 0x56125f73cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 --2- 172.21.15.71:0/768971109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f73ca60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 -- 172.21.15.71:0/768971109 >> 172.21.15.71:0/768971109 conn(0x56125f38e300 msgr2=0x56125f739210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 -- 172.21.15.71:0/768971109 shutdown_connections 2024-05-27T09:50:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff850fc8740 1 -- 172.21.15.71:0/768971109 wait complete. 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.572+0000 7ff843400640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff8280b2950 0x7ff8280b4e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x56125f73a550 tx=0x7ff8340e8480 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 -- start start 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 Processor -- start 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f746bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3794d0 0x56125f747110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f752ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56125f383790 con 0x56125f3794d0 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56125f645bc0 con 0x56125f3712f0 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.573+0000 7ff850fc8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56125f749b90 con 0x56125f39a1b0 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff850fc8740 10 client.0 _ll_register_callbacks cb 0x56125f623400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3794d0 0x56125f747110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3794d0 0x56125f747110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60526/0 (socket says 172.21.15.71:60526) 2024-05-27T09:50:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 -- 172.21.15.71:0/3429095282 learned_addr learned my addr 172.21.15.71:0/3429095282 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff843e00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f746bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff843e00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f752ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 -- 172.21.15.71:0/3429095282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 msgr2=0x56125f752ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f752ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 -- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 msgr2=0x56125f746bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f746bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff842a00640 1 -- 172.21.15.71:0/3429095282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125f3b2210 con 0x56125f3794d0 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.574+0000 7ff843e00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f746bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff842a00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3794d0 0x56125f747110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff830006010 tx=0x7ff830031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320603738981d07f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff82cc00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff82cc00640 1 -- 172.21.15.71:0/3429095282 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830035040 con 0x56125f3794d0 2024-05-27T09:50:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff83c00f9a0 con 0x56125f3794d0 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff82cc00640 1 -- 172.21.15.71:0/3429095282 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff830004240 con 0x56125f3794d0 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff82cc00640 1 -- 172.21.15.71:0/3429095282 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff830004440 con 0x56125f3794d0 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff850fc8740 10 client.15720 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56125f47e620 con 0x56125f3794d0 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.575+0000 7ff82cc00640 1 -- 172.21.15.71:0/3429095282 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff83c00f9a0 con 0x56125f3794d0 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff82cc00640 1 -- 172.21.15.71:0/3429095282 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7ff830004c00 con 0x56125f3794d0 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff850fc8740 10 client.15720 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff850fc8740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff850fc8740 20 client.15720 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff850fc8740 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f358d80 0x56125f758df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff850fc8740 4 client.15720 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56125f6afae0 con 0x56125f358d80 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.576+0000 7ff843e00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f358d80 0x56125f758df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.577+0000 7ff82cc00640 10 client.15720 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.577+0000 7ff843e00640 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f358d80 0x56125f758df0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e03d1a54162bb31 server_cookie=550310aa246b2cf0 in_seq=0 out_seq=0 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff82cc00640 1 -- 172.21.15.71:0/3429095282 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56125f6afae0 con 0x56125f358d80 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff82cc00640 10 client.15720 handle_command_reply: tid=0 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 client.15720 shutdown 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3794d0 msgr2=0x56125f747110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3794d0 0x56125f747110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff830006010 tx=0x7ff830031740 comp rx=0 tx=0).stop 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 shutdown_connections 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f39a1b0 0x56125f752ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f358d80 0x56125f758df0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f3794d0 0x56125f747110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 --2- 172.21.15.71:0/3429095282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f746bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff82cc00640 0 client.15720 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 >> 172.21.15.71:0/3429095282 conn(0x56125f38e300 msgr2=0x56125f73c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 shutdown_connections 2024-05-27T09:50:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 1 -- 172.21.15.71:0/3429095282 wait complete. 2024-05-27T09:50:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.578+0000 7ff850fc8740 20 client.15720 trim_cache size 0 max 16384 2024-05-27T09:50:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.595+0000 7ff850fc8740 1 Processor -- start 2024-05-27T09:50:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.595+0000 7ff850fc8740 1 -- start start 2024-05-27T09:50:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3712f0 0x56125f749300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f752c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f753170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff850fc8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441b86f0 con 0x56125f39a1b0 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff850fc8740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441b5fc0 con 0x56125f3794d0 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff850fc8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441b3e10 con 0x56125f3712f0 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff843e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f753170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff843e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f753170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60538/0 (socket says 172.21.15.71:60538) 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff843e00640 1 -- 172.21.15.71:0/2322331306 learned_addr learned my addr 172.21.15.71:0/2322331306 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff843e00640 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3712f0 0x56125f749300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff842a00640 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f752c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff843e00640 1 -- 172.21.15.71:0/2322331306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3712f0 msgr2=0x56125f749300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.596+0000 7ff843e00640 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3712f0 0x56125f749300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.597+0000 7ff843e00640 1 -- 172.21.15.71:0/2322331306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 msgr2=0x56125f752c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.597+0000 7ff843e00640 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f752c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.597+0000 7ff843e00640 1 -- 172.21.15.71:0/2322331306 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125f737610 con 0x56125f39a1b0 2024-05-27T09:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.597+0000 7ff843e00640 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f753170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009fd0 tx=0x7ff83c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a8a0536ec9c9e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.597+0000 7ff82f400640 1 -- 172.21.15.71:0/2322331306 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c01e040 con 0x56125f39a1b0 2024-05-27T09:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.597+0000 7ff82f400640 1 -- 172.21.15.71:0/2322331306 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff83c004160 con 0x56125f39a1b0 2024-05-27T09:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.597+0000 7ff82f400640 1 -- 172.21.15.71:0/2322331306 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c027650 con 0x56125f39a1b0 2024-05-27T09:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 -- 172.21.15.71:0/2322331306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 msgr2=0x56125f753170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f753170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009fd0 tx=0x7ff83c009500 comp rx=0 tx=0).stop 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 -- 172.21.15.71:0/2322331306 shutdown_connections 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f753170 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3794d0 0x56125f752c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2322331306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3712f0 0x56125f749300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 -- 172.21.15.71:0/2322331306 >> 172.21.15.71:0/2322331306 conn(0x56125f38e300 msgr2=0x56125f746e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 -- 172.21.15.71:0/2322331306 shutdown_connections 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.598+0000 7ff850fc8740 1 -- 172.21.15.71:0/2322331306 wait complete. 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.599+0000 7ff850fc8740 1 -- start start 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.599+0000 7ff850fc8740 1 Processor -- start 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.599+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f7b9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.599+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3794d0 0x56125f7b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.599+0000 7ff850fc8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f74c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff850fc8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441b4480 con 0x56125f39a1b0 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff850fc8740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441b58f0 con 0x56125f3712f0 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff850fc8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441b4b50 con 0x56125f3794d0 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff850fc8740 10 client.0 _ll_register_callbacks cb 0x7ff830009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f74c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f74c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60552/0 (socket says 172.21.15.71:60552) 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 -- 172.21.15.71:0/2709923462 learned_addr learned my addr 172.21.15.71:0/2709923462 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff842a00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3794d0 0x56125f7b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f7b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 -- 172.21.15.71:0/2709923462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3794d0 msgr2=0x56125f7b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3794d0 0x56125f7b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 -- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 msgr2=0x56125f7b9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f7b9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff843e00640 1 -- 172.21.15.71:0/2709923462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125f74c990 con 0x56125f39a1b0 2024-05-27T09:50:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.600+0000 7ff842a00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3794d0 0x56125f7b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff843e00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f74c3a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x56125f74fbe0 tx=0x7ff83c011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a81dceadd96dc3e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff82cc00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff82cc00640 1 -- 172.21.15.71:0/2709923462 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c003b80 con 0x56125f39a1b0 2024-05-27T09:50:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff82cc00640 1 -- 172.21.15.71:0/2709923462 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff83c03c030 con 0x56125f39a1b0 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff83c004160 con 0x56125f39a1b0 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff82cc00640 1 -- 172.21.15.71:0/2709923462 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff83c003d20 con 0x56125f39a1b0 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff850fc8740 10 client.15726 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.601+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56125f7c0e90 con 0x56125f39a1b0 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff82cc00640 1 -- 172.21.15.71:0/2709923462 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff83c004160 con 0x56125f39a1b0 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff82cc00640 1 -- 172.21.15.71:0/2709923462 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7ff83c024040 con 0x56125f39a1b0 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff850fc8740 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff850fc8740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff850fc8740 20 client.15726 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f32e1c0 0x56125f7c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff850fc8740 4 client.15726 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:50:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56125f6a92c0 con 0x56125f32e1c0 2024-05-27T09:50:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.602+0000 7ff842a00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f32e1c0 0x56125f7c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.603+0000 7ff842a00640 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f32e1c0 0x56125f7c3320 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1515b22632ac924 server_cookie=4d314ee30ba04c65 in_seq=0 out_seq=0 2024-05-27T09:50:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.603+0000 7ff82cc00640 10 client.15726 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.832+0000 7ff82cc00640 1 -- 172.21.15.71:0/2709923462 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56125f6a92c0 con 0x56125f32e1c0 2024-05-27T09:50:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.832+0000 7ff82cc00640 10 client.15726 handle_command_reply: tid=0 2024-05-27T09:50:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.832+0000 7ff850fc8740 1 client.15726 shutdown 2024-05-27T09:50:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 msgr2=0x56125f74c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f74c3a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x56125f74fbe0 tx=0x7ff83c011500 comp rx=0 tx=0).stop 2024-05-27T09:50:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 shutdown_connections 2024-05-27T09:50:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56125f32e1c0 0x56125f7c3320 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56125f39a1b0 0x56125f74c3a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56125f3794d0 0x56125f7b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 --2- 172.21.15.71:0/2709923462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56125f3712f0 0x56125f7b9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 >> 172.21.15.71:0/2709923462 conn(0x56125f38e300 msgr2=0x56125f741370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff82cc00640 0 client.15726 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 shutdown_connections 2024-05-27T09:50:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 1 -- 172.21.15.71:0/2709923462 wait complete. 2024-05-27T09:50:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.833+0000 7ff850fc8740 20 client.15726 trim_cache size 0 max 16384 2024-05-27T09:50:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:50:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:50:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:50:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.834+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff8280b2950 msgr2=0x7ff8280b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.834+0000 7ff848a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff8280b2950 0x7ff8280b4e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x56125f73a550 tx=0x7ff8340e8480 comp rx=0 tx=0).stop 2024-05-27T09:50:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.834+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff844078720 msgr2=0x7ff8441a69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.834+0000 7ff848a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff844078720 0x7ff8441a69c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e9f0 tx=0x7ff83400eeb0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 shutdown_connections 2024-05-27T09:50:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff8280b2950 0x7ff8280b4e60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8441148f0 0x7ff8441a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff844111f90 0x7ff8441a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 --2- 172.21.15.71:0/2455747426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff844078720 0x7ff8441a69c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 >> 172.21.15.71:0/2455747426 conn(0x7ff844101300 msgr2=0x7ff844113310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 shutdown_connections 2024-05-27T09:50:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:19.835+0000 7ff848a00640 1 -- 172.21.15.71:0/2455747426 wait complete. 2024-05-27T09:50:20.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 -- 172.21.15.71:0/2200963646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 msgr2=0x7f7f48110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/2200963646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f48110bd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000b0a0 tx=0x7f7f4000b3b0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 -- 172.21.15.71:0/2200963646 shutdown_connections 2024-05-27T09:50:20.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/2200963646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f48110bd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/2200963646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f48105280 0x7f7f48105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/2200963646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f48105bd0 0x7f7f4810e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 -- 172.21.15.71:0/2200963646 >> 172.21.15.71:0/2200963646 conn(0x7f7f48078b40 msgr2=0x7f7f48078f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:20.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 -- 172.21.15.71:0/2200963646 shutdown_connections 2024-05-27T09:50:20.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.606+0000 7f7f4ee00700 1 -- 172.21.15.71:0/2200963646 wait complete. 2024-05-27T09:50:20.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 Processor -- start 2024-05-27T09:50:20.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 -- start start 2024-05-27T09:50:20.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f48105280 0x7f7f48102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f48105bd0 0x7f7f481034b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f481039f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481142a0 con 0x7f7f48105bd0 2024-05-27T09:50:20.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7f48114120 con 0x7f7f4810e6f0 2024-05-27T09:50:20.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.608+0000 7f7f4ee00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f48114420 con 0x7f7f48105280 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f481039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4d000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f48105bd0 0x7f7f481034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f481039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34922/0 (socket says 172.21.15.71:34922) 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4da00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f48105280 0x7f7f48102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 -- 172.21.15.71:0/3309927766 learned_addr learned my addr 172.21.15.71:0/3309927766 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 -- 172.21.15.71:0/3309927766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f48105280 msgr2=0x7f7f48102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f48105280 0x7f7f48102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 -- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f48105bd0 msgr2=0x7f7f481034b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f48105bd0 0x7f7f481034b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 -- 172.21.15.71:0/3309927766 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f481a8f30 con 0x7f7f4810e6f0 2024-05-27T09:50:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.609+0000 7f7f4e400700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f481039f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000b070 tx=0x7f7f40009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.610+0000 7f7f46000700 1 -- 172.21.15.71:0/3309927766 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40021070 con 0x7f7f4810e6f0 2024-05-27T09:50:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.610+0000 7f7f46000700 1 -- 172.21.15.71:0/3309927766 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f40004e40 con 0x7f7f4810e6f0 2024-05-27T09:50:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.610+0000 7f7f46000700 1 -- 172.21.15.71:0/3309927766 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40004630 con 0x7f7f4810e6f0 2024-05-27T09:50:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.610+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f481a91c0 con 0x7f7f4810e6f0 2024-05-27T09:50:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.610+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f481a96c0 con 0x7f7f4810e6f0 2024-05-27T09:50:20.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.614+0000 7f7f46000700 1 -- 172.21.15.71:0/3309927766 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f7f40007980 con 0x7f7f4810e6f0 2024-05-27T09:50:20.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.615+0000 7f7f5eef3b80 1 Processor -- start 2024-05-27T09:50:20.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.615+0000 7f7f46000700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7f300b2a70 0x7f7f300b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.615+0000 7f7f5eef3b80 1 -- start start 2024-05-27T09:50:20.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.615+0000 7f7f46000700 1 -- 172.21.15.71:0/3309927766 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f7f4000f020 con 0x7f7f4810e6f0 2024-05-27T09:50:20.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f4d000700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7f300b2a70 0x7f7f300b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ee6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49ee7100 0x561d49ee7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49efc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561d49e15e40 con 0x561d49efa2e0 2024-05-27T09:50:20.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561d49e059e0 con 0x561d49d68e40 2024-05-27T09:50:20.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561d49e09a20 con 0x561d49ee7100 2024-05-27T09:50:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f4da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ee6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f4da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ee6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34934/0 (socket says 172.21.15.71:34934) 2024-05-27T09:50:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.616+0000 7f7f4da00700 1 -- 172.21.15.71:0/2012613401 learned_addr learned my addr 172.21.15.71:0/2012613401 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4e400700 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49efc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4da00700 1 -- 172.21.15.71:0/2012613401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49ee7100 msgr2=0x561d49ee7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4da00700 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49ee7100 0x561d49ee7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4da00700 1 -- 172.21.15.71:0/2012613401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 msgr2=0x561d49efc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4da00700 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49efc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4da00700 1 -- 172.21.15.71:0/2012613401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d49dce420 con 0x561d49d68e40 2024-05-27T09:50:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4d000700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7f300b2a70 0x7f7f300b4f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f48102670 tx=0x7f7f34009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.617+0000 7f7f4da00700 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ee6bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009d80 tx=0x7f7f3c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6947c9602b3c91 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.622+0000 7f7f3aa00700 1 -- 172.21.15.71:0/2012613401 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c004230 con 0x561d49d68e40 2024-05-27T09:50:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.622+0000 7f7f3aa00700 1 -- 172.21.15.71:0/2012613401 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f3c0043d0 con 0x561d49d68e40 2024-05-27T09:50:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.622+0000 7f7f3aa00700 1 -- 172.21.15.71:0/2012613401 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c019800 con 0x561d49d68e40 2024-05-27T09:50:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2012613401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 msgr2=0x561d49ee6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ee6bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009d80 tx=0x7f7f3c011720 comp rx=0 tx=0).stop 2024-05-27T09:50:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2012613401 shutdown_connections 2024-05-27T09:50:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49efc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ee6bc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2012613401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49ee7100 0x561d49ee7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2012613401 >> 172.21.15.71:0/2012613401 conn(0x561d49dc8fc0 msgr2=0x561d49ee2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2012613401 shutdown_connections 2024-05-27T09:50:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.623+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2012613401 wait complete. 2024-05-27T09:50:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.624+0000 7f7f5eef3b80 1 -- start start 2024-05-27T09:50:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.624+0000 7f7f5eef3b80 1 Processor -- start 2024-05-27T09:50:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49ef7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49ee7100 0x561d49ef7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49ef7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561d49d0bfa0 con 0x561d49efa2e0 2024-05-27T09:50:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561d49da6760 con 0x561d49ee7100 2024-05-27T09:50:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561d49efd150 con 0x561d49d68e40 2024-05-27T09:50:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f5eef3b80 10 client.0 _ll_register_callbacks cb 0x561d49dafc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:20.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f4d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49ee7100 0x561d49ef7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f4d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49ee7100 0x561d49ef7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34948/0 (socket says 172.21.15.71:34948) 2024-05-27T09:50:20.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f4d000700 1 -- 172.21.15.71:0/58861147 learned_addr learned my addr 172.21.15.71:0/58861147 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:20.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f4e400700 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49ef7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.625+0000 7f7f4da00700 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49ef7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.626+0000 7f7f4d000700 1 -- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 msgr2=0x561d49ef7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.626+0000 7f7f4d000700 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49ef7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.626+0000 7f7f4d000700 1 -- 172.21.15.71:0/58861147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 msgr2=0x561d49ef7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.626+0000 7f7f4d000700 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49ef7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.626+0000 7f7f4d000700 1 -- 172.21.15.71:0/58861147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d49d558d0 con 0x561d49ee7100 2024-05-27T09:50:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.626+0000 7f7f4d000700 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49ee7100 0x561d49ef7850 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7f340042b0 tx=0x7f7f34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b24eced0de9f7f81 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.626+0000 7f7f2f400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.627+0000 7f7f2f400700 1 -- 172.21.15.71:0/58861147 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34003d10 con 0x561d49ee7100 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.627+0000 7f7f2f400700 1 -- 172.21.15.71:0/58861147 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f7f3401d420 con 0x561d49ee7100 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.627+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f3c0043d0 con 0x561d49ee7100 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.627+0000 7f7f2f400700 1 -- 172.21.15.71:0/58861147 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f3401d620 con 0x561d49ee7100 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.627+0000 7f7f5eef3b80 10 client.25856 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.627+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561d49dd6060 con 0x561d49ee7100 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.627+0000 7f7f2f400700 1 -- 172.21.15.71:0/58861147 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f3c0043d0 con 0x561d49ee7100 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f2f400700 1 -- 172.21.15.71:0/58861147 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f7f34026700 con 0x561d49ee7100 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f5eef3b80 10 client.25856 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f5eef3b80 10 client.25856 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f5eef3b80 20 client.25856 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f0a290 0x561d49f0c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f5eef3b80 4 client.25856 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d49e17d90 con 0x561d49f0a290 2024-05-27T09:50:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.628+0000 7f7f4da00700 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f0a290 0x561d49f0c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.629+0000 7f7f4da00700 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f0a290 0x561d49f0c700 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee8eb4b17bbad6a5 server_cookie=812fbf7ec6cd661f in_seq=0 out_seq=0 2024-05-27T09:50:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.629+0000 7f7f2f400700 10 client.25856 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:50:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f2f400700 1 -- 172.21.15.71:0/58861147 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x561d49e17d90 con 0x561d49f0a290 2024-05-27T09:50:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f2f400700 10 client.25856 handle_command_reply: tid=0 2024-05-27T09:50:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 client.25856 shutdown 2024-05-27T09:50:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49ee7100 msgr2=0x561d49ef7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49ee7100 0x561d49ef7850 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7f340042b0 tx=0x7f7f34004750 comp rx=0 tx=0).stop 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 shutdown_connections 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f0a290 0x561d49f0c700 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49efa2e0 0x561d49ef7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49ef7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f2f400700 0 client.25856 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/58861147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49ee7100 0x561d49ef7850 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 >> 172.21.15.71:0/58861147 conn(0x561d49dc8fc0 msgr2=0x561d49ee1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 shutdown_connections 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.630+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/58861147 wait complete. 2024-05-27T09:50:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.631+0000 7f7f5eef3b80 20 client.25856 trim_cache size 0 max 16384 2024-05-27T09:50:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.648+0000 7f7f5eef3b80 1 Processor -- start 2024-05-27T09:50:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.648+0000 7f7f5eef3b80 1 -- start start 2024-05-27T09:50:20.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ef6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49f06220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49efa2e0 0x561d49f11ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481af0e0 con 0x561d49ee7100 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481ac970 con 0x561d49d68e40 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4819ea40 con 0x561d49efa2e0 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f4da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ef6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f4da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ef6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34956/0 (socket says 172.21.15.71:34956) 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f4da00700 1 -- 172.21.15.71:0/2455124240 learned_addr learned my addr 172.21.15.71:0/2455124240 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f4d000700 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49f06220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.649+0000 7f7f4e400700 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49efa2e0 0x561d49f11ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f4da00700 1 -- 172.21.15.71:0/2455124240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49efa2e0 msgr2=0x561d49f11ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f4da00700 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49efa2e0 0x561d49f11ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f4da00700 1 -- 172.21.15.71:0/2455124240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 msgr2=0x561d49f06220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f4da00700 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49f06220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f4da00700 1 -- 172.21.15.71:0/2455124240 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d49ef83d0 con 0x561d49d68e40 2024-05-27T09:50:20.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f4da00700 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ef6630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000c00 tx=0x7f7f3c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99e702ebb34805a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:20.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f3a000700 1 -- 172.21.15.71:0/2455124240 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c02f070 con 0x561d49d68e40 2024-05-27T09:50:20.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f3a000700 1 -- 172.21.15.71:0/2455124240 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f3c003680 con 0x561d49d68e40 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.650+0000 7f7f3a000700 1 -- 172.21.15.71:0/2455124240 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c004850 con 0x561d49d68e40 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2455124240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 msgr2=0x561d49ef6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ef6630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000c00 tx=0x7f7f3c011720 comp rx=0 tx=0).stop 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2455124240 shutdown_connections 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49efa2e0 0x561d49f11ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49d68e40 0x561d49ef6630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/2455124240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49f06220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2455124240 >> 172.21.15.71:0/2455124240 conn(0x561d49dc8fc0 msgr2=0x561d49ef28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.651+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2455124240 shutdown_connections 2024-05-27T09:50:20.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.652+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/2455124240 wait complete. 2024-05-27T09:50:20.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.652+0000 7f7f5eef3b80 1 -- start start 2024-05-27T09:50:20.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.652+0000 7f7f5eef3b80 1 Processor -- start 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49efb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49efb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f5eef3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49efa2e0 0x561d49efbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481aae50 con 0x561d49ee7100 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481ac2a0 con 0x561d49efa2e0 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f5eef3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481ab500 con 0x561d49d68e40 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f5eef3b80 10 client.0 _ll_register_callbacks cb 0x561d49dafc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f4e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49efa2e0 0x561d49efbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f4d000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49efb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f4e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49efa2e0 0x561d49efbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34970/0 (socket says 172.21.15.71:34970) 2024-05-27T09:50:20.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f4e400700 1 -- 172.21.15.71:0/4043336853 learned_addr learned my addr 172.21.15.71:0/4043336853 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f4d000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49efb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60596/0 (socket says 172.21.15.71:60596) 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.653+0000 7f7f4da00700 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49efb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f4e400700 1 -- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 msgr2=0x561d49efb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f4e400700 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49efb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f4e400700 1 -- 172.21.15.71:0/4043336853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 msgr2=0x561d49efb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f4e400700 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49efb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f4e400700 1 -- 172.21.15.71:0/4043336853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d49f00810 con 0x561d49efa2e0 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f4d000700 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49efb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f4e400700 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49efa2e0 0x561d49efbcc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7f400e1000 tx=0x7f7f40003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a299f9224b011dce server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f2f400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:20.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.654+0000 7f7f2f400700 1 -- 172.21.15.71:0/4043336853 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400b3390 con 0x561d49efa2e0 2024-05-27T09:50:20.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f2f400700 1 -- 172.21.15.71:0/4043336853 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f7f40011e30 con 0x561d49efa2e0 2024-05-27T09:50:20.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f3c003680 con 0x561d49efa2e0 2024-05-27T09:50:20.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f2f400700 1 -- 172.21.15.71:0/4043336853 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f400aa790 con 0x561d49efa2e0 2024-05-27T09:50:20.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 10 client.25862 fetch_fsmap learned FSMap version 26 2024-05-27T09:50:20.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561d49f74ee0 con 0x561d49efa2e0 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f2f400700 1 -- 172.21.15.71:0/4043336853 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f3c003680 con 0x561d49efa2e0 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f2f400700 1 -- 172.21.15.71:0/4043336853 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f7f40011070 con 0x561d49efa2e0 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 10 client.25862 fetch_fsmap finished waiting for FSMap version 26 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 10 client.25862 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 20 client.25862 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f75410 0x561d49f77830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 4 client.25862 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.655+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d49e11570 con 0x561d49f75410 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.656+0000 7f7f4da00700 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f75410 0x561d49f77830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.656+0000 7f7f4da00700 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f75410 0x561d49f77830 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0076e62efa5f77e server_cookie=30dab93d0c04780b in_seq=0 out_seq=0 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.656+0000 7f7f2f400700 10 client.25862 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.656+0000 7f7f2f400700 1 -- 172.21.15.71:0/4043336853 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d49e11570 con 0x561d49f75410 2024-05-27T09:50:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.656+0000 7f7f2f400700 10 client.25862 handle_command_reply: tid=0 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.656+0000 7f7f5eef3b80 1 client.25862 shutdown 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49efa2e0 msgr2=0x561d49efbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49efa2e0 0x561d49efbcc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7f400e1000 tx=0x7f7f40003f50 comp rx=0 tx=0).stop 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 shutdown_connections 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x561d49f75410 0x561d49f77830 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561d49efa2e0 0x561d49efbcc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561d49d68e40 0x561d49efb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 --2- 172.21.15.71:0/4043336853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d49ee7100 0x561d49efb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f2f400700 0 client.25862 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 >> 172.21.15.71:0/4043336853 conn(0x561d49dc8fc0 msgr2=0x561d49ef28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 shutdown_connections 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 1 -- 172.21.15.71:0/4043336853 wait complete. 2024-05-27T09:50:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.657+0000 7f7f5eef3b80 20 client.25862 trim_cache size 0 max 16384 2024-05-27T09:50:20.660 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:50:20.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7f300b2a70 msgr2=0x7f7f300b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7f300b2a70 0x7f7f300b4f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f48102670 tx=0x7f7f34009260 comp rx=0 tx=0).stop 2024-05-27T09:50:20.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 msgr2=0x7f7f481039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:20.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f481039f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000b070 tx=0x7f7f40009c90 comp rx=0 tx=0).stop 2024-05-27T09:50:20.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 shutdown_connections 2024-05-27T09:50:20.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7f300b2a70 0x7f7f300b4f80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f4810e6f0 0x7f7f481039f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f48105280 0x7f7f48102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 --2- 172.21.15.71:0/3309927766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f48105bd0 0x7f7f481034b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:20.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 >> 172.21.15.71:0/3309927766 conn(0x7f7f48078b40 msgr2=0x7f7f480ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:20.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 shutdown_connections 2024-05-27T09:50:20.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:20.658+0000 7f7f4ee00700 1 -- 172.21.15.71:0/3309927766 wait complete. 2024-05-27T09:50:20.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:20 smithi071 ceph-mon[31451]: pgmap v80: 97 pgs: 97 active+clean; 1.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2024-05-27T09:50:20.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:20 smithi122 ceph-mon[36436]: pgmap v80: 97 pgs: 97 active+clean; 1.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2024-05-27T09:50:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:20 smithi072 ceph-mon[35951]: pgmap v80: 97 pgs: 97 active+clean; 1.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2024-05-27T09:50:21.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-27T09:50:22.182 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:22.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:22 smithi122 ceph-mon[36436]: pgmap v81: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2024-05-27T09:50:23.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:22 smithi071 ceph-mon[31451]: pgmap v81: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2024-05-27T09:50:23.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:22 smithi072 ceph-mon[35951]: pgmap v81: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2024-05-27T09:50:24.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 -- 172.21.15.71:0/1686430633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c105e40 msgr2=0x7f1f1c10e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 --2- 172.21.15.71:0/1686430633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c105e40 0x7f1f1c10e390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009990 tx=0x7f1f04009ca0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:24 smithi071 ceph-mon[31451]: pgmap v82: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.2 MiB/s wr, 119 op/s 2024-05-27T09:50:24.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:24 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 -- 172.21.15.71:0/1686430633 shutdown_connections 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 --2- 172.21.15.71:0/1686430633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c10e8d0 0x7f1f1c110db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 --2- 172.21.15.71:0/1686430633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c1054f0 0x7f1f1c105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 --2- 172.21.15.71:0/1686430633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c105e40 0x7f1f1c10e390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 -- 172.21.15.71:0/1686430633 >> 172.21.15.71:0/1686430633 conn(0x7f1f1c0fedb0 msgr2=0x7f1f1c1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 -- 172.21.15.71:0/1686430633 shutdown_connections 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.697+0000 7f1f21000700 1 -- 172.21.15.71:0/1686430633 wait complete. 2024-05-27T09:50:24.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.699+0000 7f1f21000700 1 Processor -- start 2024-05-27T09:50:24.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.699+0000 7f1f21000700 1 -- start start 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.699+0000 7f1f21000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c1054f0 0x7f1f1c19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.699+0000 7f1f21000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c105e40 0x7f1f1c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.699+0000 7f1f21000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c10e8d0 0x7f1f1c19f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.699+0000 7f1f21000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c114480 con 0x7f1f1c1054f0 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f21000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c114300 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f21000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c114600 con 0x7f1f1c105e40 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c10e8d0 0x7f1f1c19f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f11400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c105e40 0x7f1f1c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f19e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c1054f0 0x7f1f1c19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c10e8d0 0x7f1f1c19f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53936/0 (socket says 172.21.15.71:53936) 2024-05-27T09:50:24.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f11400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c105e40 0x7f1f1c19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54674/0 (socket says 172.21.15.71:54674) 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 -- 172.21.15.71:0/3376973000 learned_addr learned my addr 172.21.15.71:0/3376973000 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 -- 172.21.15.71:0/3376973000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c105e40 msgr2=0x7f1f1c19b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c105e40 0x7f1f1c19b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 -- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c1054f0 msgr2=0x7f1f1c19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c1054f0 0x7f1f1c19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f1a800700 1 -- 172.21.15.71:0/3376973000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c19fc80 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.700+0000 7f1f11400700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c105e40 0x7f1f1c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.701+0000 7f1f1a800700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c10e8d0 0x7f1f1c19f5e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400ef30 tx=0x7f1f1400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.701+0000 7f1f13400700 1 -- 172.21.15.71:0/3376973000 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140092e0 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.701+0000 7f1f13400700 1 -- 172.21.15.71:0/3376973000 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f14004bb0 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.701+0000 7f1f13400700 1 -- 172.21.15.71:0/3376973000 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14004020 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.701+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c19ff10 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.701+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1a7890 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.704+0000 7f1f13400700 1 -- 172.21.15.71:0/3376973000 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f1f1401b030 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 Processor -- start 2024-05-27T09:50:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 -- start start 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f13400700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f000b2a70 0x7f1f000b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5629c86ffe40 con 0x5629c87d7d30 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5629c86ef9e0 con 0x5629c8652e40 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.706+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5629c86f3a20 con 0x5629c87d1db0 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f13400700 1 -- 172.21.15.71:0/3376973000 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1f140e1ff0 con 0x7f1f1c10e8d0 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54686/0 (socket says 172.21.15.71:54686) 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 -- 172.21.15.71:0/4043100182 learned_addr learned my addr 172.21.15.71:0/4043100182 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f11400700 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f11400700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f000b2a70 0x7f1f000b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f19e00700 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 -- 172.21.15.71:0/4043100182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 msgr2=0x5629c87d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 -- 172.21.15.71:0/4043100182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 msgr2=0x5629c87d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.707+0000 7f1f1a800700 1 -- 172.21.15.71:0/4043100182 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c86b8420 con 0x5629c87d1db0 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.708+0000 7f1f1a800700 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d21c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400d010 tx=0x7f1f140a8dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6378de7b9acc372 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.708+0000 7f1f19e00700 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.708+0000 7f1f0b400700 1 -- 172.21.15.71:0/4043100182 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140a9370 con 0x5629c87d1db0 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.708+0000 7f1f0b400700 1 -- 172.21.15.71:0/4043100182 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140ad720 con 0x5629c87d1db0 2024-05-27T09:50:24.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.708+0000 7f1f0b400700 1 -- 172.21.15.71:0/4043100182 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140b1cb0 con 0x5629c87d1db0 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/4043100182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 msgr2=0x5629c87d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f11400700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f000b2a70 0x7f1f000b4f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005f50 tx=0x7f1f04005fd0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d21c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400d010 tx=0x7f1f140a8dd0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/4043100182 shutdown_connections 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d21c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/4043100182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/4043100182 >> 172.21.15.71:0/4043100182 conn(0x5629c86b2fc0 msgr2=0x5629c87cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/4043100182 shutdown_connections 2024-05-27T09:50:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.709+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/4043100182 wait complete. 2024-05-27T09:50:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.710+0000 7f1f2fa5eb80 1 -- start start 2024-05-27T09:50:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.710+0000 7f1f2fa5eb80 1 Processor -- start 2024-05-27T09:50:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c8652e40 0x5629c87db4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d1db0 0x5629c87dba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87dbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5629c85f5fa0 con 0x5629c87d7d30 2024-05-27T09:50:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5629c8690760 con 0x5629c87d1db0 2024-05-27T09:50:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5629c87de800 con 0x5629c8652e40 2024-05-27T09:50:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f2fa5eb80 10 client.0 _ll_register_callbacks cb 0x5629c8699c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f11400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d1db0 0x5629c87dba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f11400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d1db0 0x5629c87dba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53952/0 (socket says 172.21.15.71:53952) 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f11400700 1 -- 172.21.15.71:0/805840969 learned_addr learned my addr 172.21.15.71:0/805840969 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.711+0000 7f1f19e00700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c8652e40 0x5629c87db4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f11400700 1 -- 172.21.15.71:0/805840969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c8652e40 msgr2=0x5629c87db4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f11400700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c8652e40 0x5629c87db4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f1a800700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87dbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f11400700 1 -- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 msgr2=0x5629c87dbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f11400700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87dbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f11400700 1 -- 172.21.15.71:0/805840969 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c863f8d0 con 0x5629c87d1db0 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f19e00700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c8652e40 0x5629c87db4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f1a800700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87dbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:50:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f11400700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d1db0 0x5629c87dba10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f04015000 tx=0x7f1f04009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2b632cf64c7cb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1effe00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1effe00700 1 -- 172.21.15.71:0/805840969 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400f8f0 con 0x5629c87d1db0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1effe00700 1 -- 172.21.15.71:0/805840969 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1f0400fa90 con 0x5629c87d1db0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.712+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f140ad720 con 0x5629c87d1db0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1effe00700 1 -- 172.21.15.71:0/805840969 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f0400fc90 con 0x5629c87d1db0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 10 client.25871 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629c86c0060 con 0x5629c87d1db0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1effe00700 1 -- 172.21.15.71:0/805840969 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140ad720 con 0x5629c87d1db0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1effe00700 1 -- 172.21.15.71:0/805840969 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1f0402f070 con 0x5629c87d1db0 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 10 client.25871 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 10 client.25871 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 20 client.25871 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:24.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c87eb5d0 0x5629c87eda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 4 client.25871 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:24.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.713+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629c8701d90 con 0x5629c87eb5d0 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.714+0000 7f1f19e00700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c87eb5d0 0x5629c87eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.714+0000 7f1f19e00700 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c87eb5d0 0x5629c87eda40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d60ad8796bf3183 server_cookie=980c6808ccd5151c in_seq=0 out_seq=0 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.714+0000 7f1effe00700 10 client.25871 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.715+0000 7f1effe00700 1 -- 172.21.15.71:0/805840969 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5629c8701d90 con 0x5629c87eb5d0 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.715+0000 7f1effe00700 10 client.25871 handle_command_reply: tid=0 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.715+0000 7f1f2fa5eb80 1 client.25871 shutdown 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d1db0 msgr2=0x5629c87dba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d1db0 0x5629c87dba10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f04015000 tx=0x7f1f04009ca0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 shutdown_connections 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c87eb5d0 0x5629c87eda40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1effe00700 0 client.25871 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87dbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c8652e40 0x5629c87db4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/805840969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d1db0 0x5629c87dba10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 >> 172.21.15.71:0/805840969 conn(0x5629c86b2fc0 msgr2=0x5629c87cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 shutdown_connections 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/805840969 wait complete. 2024-05-27T09:50:24.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.716+0000 7f1f2fa5eb80 20 client.25871 trim_cache size 0 max 16384 2024-05-27T09:50:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 Processor -- start 2024-05-27T09:50:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 -- start start 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1b1650 con 0x5629c87d7d30 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1aeee0 con 0x5629c8652e40 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.736+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1acd30 con 0x5629c87d1db0 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f1a800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f11400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53966/0 (socket says 172.21.15.71:53966) 2024-05-27T09:50:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 -- 172.21.15.71:0/3618773989 learned_addr learned my addr 172.21.15.71:0/3618773989 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 -- 172.21.15.71:0/3618773989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 msgr2=0x5629c87d5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 --2- 172.21.15.71:0/3618773989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 -- 172.21.15.71:0/3618773989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 msgr2=0x5629c87d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 --2- 172.21.15.71:0/3618773989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 -- 172.21.15.71:0/3618773989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c87ce320 con 0x5629c8652e40 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.737+0000 7f1f19e00700 1 --2- 172.21.15.71:0/3618773989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d1870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5629c87ee1f0 tx=0x7f1f0c014750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20eea1072161c61a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.738+0000 7f1f0aa00700 1 -- 172.21.15.71:0/3618773989 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c024070 con 0x5629c8652e40 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.738+0000 7f1f0aa00700 1 -- 172.21.15.71:0/3618773989 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f0c004500 con 0x5629c8652e40 2024-05-27T09:50:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.738+0000 7f1f0aa00700 1 -- 172.21.15.71:0/3618773989 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c01e690 con 0x5629c8652e40 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3618773989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 msgr2=0x5629c87d1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3618773989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d1870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5629c87ee1f0 tx=0x7f1f0c014750 comp rx=0 tx=0).stop 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3618773989 shutdown_connections 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3618773989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c87d7d30 0x5629c87d6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3618773989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c8652e40 0x5629c87d1870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3618773989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87d5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3618773989 >> 172.21.15.71:0/3618773989 conn(0x5629c86b2fc0 msgr2=0x5629c87db2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3618773989 shutdown_connections 2024-05-27T09:50:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.739+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3618773989 wait complete. 2024-05-27T09:50:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.740+0000 7f1f2fa5eb80 1 -- start start 2024-05-27T09:50:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.740+0000 7f1f2fa5eb80 1 Processor -- start 2024-05-27T09:50:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c8652e40 0x5629c87f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f2fa5eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d7d30 0x5629c87f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1ad3a0 con 0x5629c8652e40 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1ae810 con 0x5629c87d7d30 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f2fa5eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1ada70 con 0x5629c87d1db0 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f2fa5eb80 10 client.0 _ll_register_callbacks cb 0x5629c8699c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d7d30 0x5629c87f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d7d30 0x5629c87f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53972/0 (socket says 172.21.15.71:53972) 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 -- 172.21.15.71:0/3431017625 learned_addr learned my addr 172.21.15.71:0/3431017625 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f11400700 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 -- 172.21.15.71:0/3431017625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 msgr2=0x5629c87f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 -- 172.21.15.71:0/3431017625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c8652e40 msgr2=0x5629c87f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c8652e40 0x5629c87f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.741+0000 7f1f1a800700 1 -- 172.21.15.71:0/3431017625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c8855120 con 0x5629c87d7d30 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1f1a800700 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d7d30 0x5629c87f3710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f140910b0 tx=0x7f1f14009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b08ded11a965cea server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1effe00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1effe00700 1 -- 172.21.15.71:0/3431017625 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140c3060 con 0x5629c87d7d30 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1effe00700 1 -- 172.21.15.71:0/3431017625 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1f140b1ec0 con 0x5629c87d7d30 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f0c004500 con 0x5629c87d7d30 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1effe00700 1 -- 172.21.15.71:0/3431017625 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f140ca050 con 0x5629c87d7d30 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1f2fa5eb80 10 client.25877 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629c8856200 con 0x5629c87d7d30 2024-05-27T09:50:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.742+0000 7f1effe00700 1 -- 172.21.15.71:0/3431017625 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f0c004500 con 0x5629c87d7d30 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1effe00700 1 -- 172.21.15.71:0/3431017625 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1f140a4ce0 con 0x5629c87d7d30 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1f2fa5eb80 10 client.25877 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1f2fa5eb80 10 client.25877 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1f2fa5eb80 20 client.25877 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c88564e0 0x5629c8858900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1f2fa5eb80 4 client.25877 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629c86fb570 con 0x5629c88564e0 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.743+0000 7f1f19e00700 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c88564e0 0x5629c8858900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1effe00700 10 client.25877 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f19e00700 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c88564e0 0x5629c8858900 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4121a2950a298fd server_cookie=3c3f95b073fb579e in_seq=0 out_seq=0 2024-05-27T09:50:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1effe00700 1 -- 172.21.15.71:0/3431017625 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629c86fb570 con 0x5629c88564e0 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1effe00700 10 client.25877 handle_command_reply: tid=0 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 client.25877 shutdown 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d7d30 msgr2=0x5629c87f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d7d30 0x5629c87f3710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f140910b0 tx=0x7f1f14009ed0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 shutdown_connections 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x5629c88564e0 0x5629c8858900 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5629c87d7d30 0x5629c87f3710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5629c8652e40 0x5629c87f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 --2- 172.21.15.71:0/3431017625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629c87d1db0 0x5629c87f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 >> 172.21.15.71:0/3431017625 conn(0x5629c86b2fc0 msgr2=0x5629c87d59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1effe00700 0 client.25877 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 shutdown_connections 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.744+0000 7f1f2fa5eb80 1 -- 172.21.15.71:0/3431017625 wait complete. 2024-05-27T09:50:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.745+0000 7f1f2fa5eb80 20 client.25877 trim_cache size 0 max 16384 2024-05-27T09:50:24.748 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:50:24.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.745+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f000b2a70 msgr2=0x7f1f000b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f000b2a70 0x7f1f000b4f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005f50 tx=0x7f1f04005fd0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c10e8d0 msgr2=0x7f1f1c19f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c10e8d0 0x7f1f1c19f5e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400ef30 tx=0x7f1f1400c3a0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 shutdown_connections 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f1f000b2a70 0x7f1f000b4f80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f1c10e8d0 0x7f1f1c19f5e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c1054f0 0x7f1f1c19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 --2- 172.21.15.71:0/3376973000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c105e40 0x7f1f1c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 >> 172.21.15.71:0/3376973000 conn(0x7f1f1c0fedb0 msgr2=0x7f1f1c0ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 shutdown_connections 2024-05-27T09:50:24.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:24.746+0000 7f1f21000700 1 -- 172.21.15.71:0/3376973000 wait complete. 2024-05-27T09:50:24.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:24 smithi122 ceph-mon[36436]: pgmap v82: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.2 MiB/s wr, 119 op/s 2024-05-27T09:50:24.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:24 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:50:25.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:24 smithi072 ceph-mon[35951]: pgmap v82: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.2 MiB/s wr, 119 op/s 2024-05-27T09:50:25.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:24 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:50:25.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-27T09:50:26.215 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:26.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:26 smithi122 ceph-mon[36436]: pgmap v83: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.2 MiB/s wr, 119 op/s 2024-05-27T09:50:27.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:26 smithi071 ceph-mon[31451]: pgmap v83: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.2 MiB/s wr, 119 op/s 2024-05-27T09:50:27.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:26 smithi072 ceph-mon[35951]: pgmap v83: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.2 MiB/s wr, 119 op/s 2024-05-27T09:50:28.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 -- 172.21.15.71:0/2341467643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 msgr2=0x7f2dc4117800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 --2- 172.21.15.71:0/2341467643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc4117800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009990 tx=0x7f2dbc009ca0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 -- 172.21.15.71:0/2341467643 shutdown_connections 2024-05-27T09:50:28.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 --2- 172.21.15.71:0/2341467643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc4117800 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 --2- 172.21.15.71:0/2341467643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4110960 0x7f2dc4110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 --2- 172.21.15.71:0/2341467643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dc410a980 0x7f2dc410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 -- 172.21.15.71:0/2341467643 >> 172.21.15.71:0/2341467643 conn(0x7f2dc4077c70 msgr2=0x7f2dc40780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 -- 172.21.15.71:0/2341467643 shutdown_connections 2024-05-27T09:50:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.426+0000 7f2dcc000700 1 -- 172.21.15.71:0/2341467643 wait complete. 2024-05-27T09:50:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.427+0000 7f2dcc000700 1 Processor -- start 2024-05-27T09:50:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.427+0000 7f2dcc000700 1 -- start start 2024-05-27T09:50:28.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dcc000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dc410a980 0x7f2dc41a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dcc000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc41a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dcc000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4110960 0x7f2dc41a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dcc000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc411aad0 con 0x7f2dc410a980 2024-05-27T09:50:28.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dcc000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc411a950 con 0x7f2dc410b2d0 2024-05-27T09:50:28.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dcc000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc411ac50 con 0x7f2dc4110960 2024-05-27T09:50:28.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dc8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc41a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dc9600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dc410a980 0x7f2dc41a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dc8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc41a19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53980/0 (socket says 172.21.15.71:53980) 2024-05-27T09:50:28.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dc8c00700 1 -- 172.21.15.71:0/996819398 learned_addr learned my addr 172.21.15.71:0/996819398 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:28.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.428+0000 7f2dca000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4110960 0x7f2dc41a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc8c00700 1 -- 172.21.15.71:0/996819398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4110960 msgr2=0x7f2dc41a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4110960 0x7f2dc41a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc8c00700 1 -- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dc410a980 msgr2=0x7f2dc41a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dc410a980 0x7f2dc41a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc8c00700 1 -- 172.21.15.71:0/996819398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc41a62d0 con 0x7f2dc410b2d0 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dca000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4110960 0x7f2dc41a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc41a19a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2db000e970 tx=0x7f2db000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:28.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc2000700 1 -- 172.21.15.71:0/996819398 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db000cbd0 con 0x7f2dc410b2d0 2024-05-27T09:50:28.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc2000700 1 -- 172.21.15.71:0/996819398 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db000cd70 con 0x7f2dc410b2d0 2024-05-27T09:50:28.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc41a65c0 con 0x7f2dc410b2d0 2024-05-27T09:50:28.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.429+0000 7f2dc2000700 1 -- 172.21.15.71:0/996819398 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0005680 con 0x7f2dc410b2d0 2024-05-27T09:50:28.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.430+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc41adee0 con 0x7f2dc410b2d0 2024-05-27T09:50:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.433+0000 7f2dc2000700 1 -- 172.21.15.71:0/996819398 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2db0021440 con 0x7f2dc410b2d0 2024-05-27T09:50:28.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.435+0000 7f2ddab40b80 1 Processor -- start 2024-05-27T09:50:28.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.435+0000 7f2ddab40b80 1 -- start start 2024-05-27T09:50:28.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.435+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf6f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf7c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e89ce9de40 con 0x55e89cf6fe70 2024-05-27T09:50:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e89ce8d9e0 con 0x55e89cedc9f0 2024-05-27T09:50:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e89ce91a20 con 0x55e89cdf0e40 2024-05-27T09:50:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dc2000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2dac0b2a70 0x7f2dac0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dca000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dca000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53994/0 (socket says 172.21.15.71:53994) 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dca000700 1 -- 172.21.15.71:0/3058259456 learned_addr learned my addr 172.21.15.71:0/3058259456 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dc2000700 1 -- 172.21.15.71:0/996819398 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2db00e2780 con 0x7f2dc410b2d0 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf7c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dc9600700 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf6f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.436+0000 7f2dca000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2dac0b2a70 0x7f2dac0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.437+0000 7f2dca000700 1 -- 172.21.15.71:0/3058259456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 msgr2=0x55e89cf6f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.437+0000 7f2dca000700 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf6f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.437+0000 7f2dca000700 1 -- 172.21.15.71:0/3058259456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 msgr2=0x55e89cf7c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.437+0000 7f2dca000700 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf7c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.437+0000 7f2dca000700 1 -- 172.21.15.71:0/3058259456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89ce56420 con 0x55e89cedc9f0 2024-05-27T09:50:28.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.437+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:28.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.437+0000 7f2dca000700 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00b6c0 tx=0x7f2dbc005570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f80a538cfbd45a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.438+0000 7f2db6a00700 1 -- 172.21.15.71:0/3058259456 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc021070 con 0x55e89cedc9f0 2024-05-27T09:50:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.438+0000 7f2db6a00700 1 -- 172.21.15.71:0/3058259456 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dbc022040 con 0x55e89cedc9f0 2024-05-27T09:50:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.438+0000 7f2db6a00700 1 -- 172.21.15.71:0/3058259456 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00fb30 con 0x55e89cedc9f0 2024-05-27T09:50:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.438+0000 7f2dca000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2dac0b2a70 0x7f2dac0b4f80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc02b000 tx=0x7f2dbc028000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3058259456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 msgr2=0x55e89cf6f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00b6c0 tx=0x7f2dbc005570 comp rx=0 tx=0).stop 2024-05-27T09:50:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3058259456 shutdown_connections 2024-05-27T09:50:28.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3058259456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf6f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3058259456 >> 172.21.15.71:0/3058259456 conn(0x55e89ce8a390 msgr2=0x55e89cf6b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:28.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3058259456 shutdown_connections 2024-05-27T09:50:28.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.439+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3058259456 wait complete. 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.440+0000 7f2ddab40b80 1 -- start start 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.440+0000 7f2ddab40b80 1 Processor -- start 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf79550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf79a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf79fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e89cd93fa0 con 0x55e89cf6fe70 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e89ce2e760 con 0x55e89cedc9f0 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e89cf7cb80 con 0x55e89cdf0e40 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2ddab40b80 10 client.0 _ll_register_callbacks cb 0x55e89ce37c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2dc8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf79a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2dc8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf79a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54008/0 (socket says 172.21.15.71:54008) 2024-05-27T09:50:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2dc8c00700 1 -- 172.21.15.71:0/585849037 learned_addr learned my addr 172.21.15.71:0/585849037 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2dc9600700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf79550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.441+0000 7f2dca000700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf79fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dc9600700 1 -- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 msgr2=0x55e89cf79a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dc9600700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf79a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dc9600700 1 -- 172.21.15.71:0/585849037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 msgr2=0x55e89cf79fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dc9600700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf79fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dc9600700 1 -- 172.21.15.71:0/585849037 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89cddd8d0 con 0x55e89cdf0e40 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf79a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dc9600700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf79550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55e89cf6ca20 tx=0x7f2db8004090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f3e4ad1484c2cf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dab400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.442+0000 7f2dab400700 1 -- 172.21.15.71:0/585849037 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db801a070 con 0x55e89cdf0e40 2024-05-27T09:50:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.443+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dbc022040 con 0x55e89cdf0e40 2024-05-27T09:50:28.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.443+0000 7f2dab400700 1 -- 172.21.15.71:0/585849037 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2db8004db0 con 0x55e89cdf0e40 2024-05-27T09:50:28.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.443+0000 7f2dab400700 1 -- 172.21.15.71:0/585849037 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2db8023050 con 0x55e89cdf0e40 2024-05-27T09:50:28.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.443+0000 7f2ddab40b80 10 client.25924 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:28.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.443+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e89ce5e060 con 0x55e89cdf0e40 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.443+0000 7f2dab400700 1 -- 172.21.15.71:0/585849037 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dbc022040 con 0x55e89cdf0e40 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2dab400700 1 -- 172.21.15.71:0/585849037 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2db8016530 con 0x55e89cdf0e40 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2ddab40b80 10 client.25924 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2ddab40b80 10 client.25924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2ddab40b80 20 client.25924 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cf89b10 0x55e89cf8bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2ddab40b80 4 client.25924 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e89ce9fd90 con 0x55e89cf89b10 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.444+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cf89b10 0x55e89cf8bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.445+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cf89b10 0x55e89cf8bfb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c60d28fbfbcec63 server_cookie=8fd47c004ee278b9 in_seq=0 out_seq=0 2024-05-27T09:50:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.445+0000 7f2dab400700 10 client.25924 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:28.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2dab400700 1 -- 172.21.15.71:0/585849037 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55e89ce9fd90 con 0x55e89cf89b10 2024-05-27T09:50:28.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2dab400700 10 client.25924 handle_command_reply: tid=0 2024-05-27T09:50:28.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 client.25924 shutdown 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 msgr2=0x55e89cf79550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf79550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55e89cf6ca20 tx=0x7f2db8004090 comp rx=0 tx=0).stop 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 shutdown_connections 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cf89b10 0x55e89cf8bfb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cf6fe70 0x55e89cf79fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf79550 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2dab400700 0 client.25924 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/585849037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cedc9f0 0x55e89cf79a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 >> 172.21.15.71:0/585849037 conn(0x55e89ce8a390 msgr2=0x55e89cf6f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 shutdown_connections 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.446+0000 7f2ddab40b80 1 -- 172.21.15.71:0/585849037 wait complete. 2024-05-27T09:50:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.447+0000 7f2ddab40b80 20 client.25924 trim_cache size 0 max 16384 2024-05-27T09:50:28.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.464+0000 7f2ddab40b80 1 Processor -- start 2024-05-27T09:50:28.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.464+0000 7f2ddab40b80 1 -- start start 2024-05-27T09:50:28.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cdf0e40 0x55e89cf74d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf85cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2da400fdd0 con 0x55e89cdf0e40 2024-05-27T09:50:28.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2da400d660 con 0x55e89cf6fe70 2024-05-27T09:50:28.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2da400b4b0 con 0x55e89cedc9f0 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf85cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dc9600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cdf0e40 0x55e89cf74d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf85cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54022/0 (socket says 172.21.15.71:54022) 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 -- 172.21.15.71:0/3825871895 learned_addr learned my addr 172.21.15.71:0/3825871895 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 -- 172.21.15.71:0/3825871895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cedc9f0 msgr2=0x55e89cf6f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 -- 172.21.15.71:0/3825871895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cdf0e40 msgr2=0x55e89cf74d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cdf0e40 0x55e89cf74d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.465+0000 7f2dca000700 1 -- 172.21.15.71:0/3825871895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89cf7a340 con 0x55e89cf6fe70 2024-05-27T09:50:28.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.466+0000 7f2dca000700 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf85cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55e89cf71ff0 tx=0x7f2dbc01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a957a2d0cbcb1b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.466+0000 7f2db6000700 1 -- 172.21.15.71:0/3825871895 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc021040 con 0x55e89cf6fe70 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.466+0000 7f2db6000700 1 -- 172.21.15.71:0/3825871895 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dbc030460 con 0x55e89cf6fe70 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.466+0000 7f2db6000700 1 -- 172.21.15.71:0/3825871895 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00f6c0 con 0x55e89cf6fe70 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3825871895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 msgr2=0x55e89cf85cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf85cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55e89cf71ff0 tx=0x7f2dbc01a000 comp rx=0 tx=0).stop 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3825871895 shutdown_connections 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf85cb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cdf0e40 0x55e89cf74d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/3825871895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cedc9f0 0x55e89cf6f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3825871895 >> 172.21.15.71:0/3825871895 conn(0x55e89ce8a390 msgr2=0x55e89cf6f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:28.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3825871895 shutdown_connections 2024-05-27T09:50:28.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.467+0000 7f2ddab40b80 1 -- 172.21.15.71:0/3825871895 wait complete. 2024-05-27T09:50:28.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.468+0000 7f2ddab40b80 1 -- start start 2024-05-27T09:50:28.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.468+0000 7f2ddab40b80 1 Processor -- start 2024-05-27T09:50:28.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cedc9f0 0x55e89cf73b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2ddab40b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf80ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2da400bb20 con 0x55e89cedc9f0 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2da400cf90 con 0x55e89cf6fe70 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2ddab40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2da400c1f0 con 0x55e89cdf0e40 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2ddab40b80 10 client.0 _ll_register_callbacks cb 0x55e89ce37c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc8c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cedc9f0 0x55e89cf73b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54772/0 (socket says 172.21.15.71:54772) 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 -- 172.21.15.71:0/2978960734 learned_addr learned my addr 172.21.15.71:0/2978960734 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dca000700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf80ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 -- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 msgr2=0x55e89cf80ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf80ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 -- 172.21.15.71:0/2978960734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cedc9f0 msgr2=0x55e89cf73b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cedc9f0 0x55e89cf73b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc9600700 1 -- 172.21.15.71:0/2978960734 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89cf74410 con 0x55e89cdf0e40 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dca000700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf80ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.469+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cedc9f0 0x55e89cf73b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.470+0000 7f2dc9600700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf735f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009a30 tx=0x7f2db8016660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a151a3d76940be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.470+0000 7f2dab400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.470+0000 7f2dab400700 1 -- 172.21.15.71:0/2978960734 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db801a040 con 0x55e89cdf0e40 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.470+0000 7f2dab400700 1 -- 172.21.15.71:0/2978960734 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2db8016da0 con 0x55e89cdf0e40 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.470+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dbc030460 con 0x55e89cdf0e40 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.470+0000 7f2dab400700 1 -- 172.21.15.71:0/2978960734 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2db8009310 con 0x55e89cdf0e40 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 10 client.25930 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:28.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e89cf82430 con 0x55e89cdf0e40 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2dab400700 1 -- 172.21.15.71:0/2978960734 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dbc030460 con 0x55e89cdf0e40 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2dab400700 1 -- 172.21.15.71:0/2978960734 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2db8007b00 con 0x55e89cdf0e40 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 10 client.25930 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 10 client.25930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 20 client.25930 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cff4640 0x55e89cff6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 4 client.25930 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.471+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e89ce99570 con 0x55e89cff4640 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.472+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cff4640 0x55e89cff6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:28.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.472+0000 7f2dc8c00700 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cff4640 0x55e89cff6a60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed4a0d3f7c6d0cf server_cookie=1f9906a470a4051 in_seq=0 out_seq=0 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.472+0000 7f2dab400700 10 client.25930 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2dab400700 1 -- 172.21.15.71:0/2978960734 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e89ce99570 con 0x55e89cff4640 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2dab400700 10 client.25930 handle_command_reply: tid=0 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 client.25930 shutdown 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 msgr2=0x55e89cf735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf735f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009a30 tx=0x7f2db8016660 comp rx=0 tx=0).stop 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 shutdown_connections 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e89cff4640 0x55e89cff6a60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e89cf6fe70 0x55e89cf80ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e89cdf0e40 0x55e89cf735f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 --2- 172.21.15.71:0/2978960734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e89cedc9f0 0x55e89cf73b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2dab400700 0 client.25930 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 >> 172.21.15.71:0/2978960734 conn(0x55e89ce8a390 msgr2=0x55e89cf77a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:28.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 shutdown_connections 2024-05-27T09:50:28.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.473+0000 7f2ddab40b80 1 -- 172.21.15.71:0/2978960734 wait complete. 2024-05-27T09:50:28.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2ddab40b80 20 client.25930 trim_cache size 0 max 16384 2024-05-27T09:50:28.476 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:50:28.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2dac0b2a70 msgr2=0x7f2dac0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2dac0b2a70 0x7f2dac0b4f80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc02b000 tx=0x7f2dbc028000 comp rx=0 tx=0).stop 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 msgr2=0x7f2dc41a19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc41a19a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2db000e970 tx=0x7f2db000ec80 comp rx=0 tx=0).stop 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 shutdown_connections 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2dac0b2a70 0x7f2dac0b4f80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4110960 0x7f2dc41a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2dc410a980 0x7f2dc41a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 --2- 172.21.15.71:0/996819398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc410b2d0 0x7f2dc41a19a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.474+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 >> 172.21.15.71:0/996819398 conn(0x7f2dc4077c70 msgr2=0x7f2dc407b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.475+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 shutdown_connections 2024-05-27T09:50:28.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:28.475+0000 7f2dcc000700 1 -- 172.21.15.71:0/996819398 wait complete. 2024-05-27T09:50:28.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:28 smithi071 ceph-mon[31451]: pgmap v84: 97 pgs: 97 active+clean; 20 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2024-05-27T09:50:28.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:28 smithi122 ceph-mon[36436]: pgmap v84: 97 pgs: 97 active+clean; 20 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2024-05-27T09:50:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:28 smithi072 ceph-mon[35951]: pgmap v84: 97 pgs: 97 active+clean; 20 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2024-05-27T09:50:30.429 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-27T09:50:30.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-27T09:50:30.884 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:30 smithi122 ceph-mon[36436]: pgmap v85: 97 pgs: 97 active+clean; 20 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2024-05-27T09:50:31.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:30 smithi071 ceph-mon[31451]: pgmap v85: 97 pgs: 97 active+clean; 20 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2024-05-27T09:50:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:30 smithi072 ceph-mon[35951]: pgmap v85: 97 pgs: 97 active+clean; 20 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2024-05-27T09:50:32.849 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:32 smithi071 ceph-mon[31451]: pgmap v86: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-27T09:50:32.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:32 smithi122 ceph-mon[36436]: pgmap v86: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-27T09:50:33.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:32 smithi072 ceph-mon[35951]: pgmap v86: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-27T09:50:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 -- 172.21.15.71:0/1041539584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00104250 msgr2=0x7f6d001105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 --2- 172.21.15.71:0/1041539584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00104250 0x7f6d001105d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009ca0 tx=0x7f6cf802a8c0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 -- 172.21.15.71:0/1041539584 shutdown_connections 2024-05-27T09:50:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 --2- 172.21.15.71:0/1041539584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00104250 0x7f6d001105d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 --2- 172.21.15.71:0/1041539584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d00109f50 0x7f6d00103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.062 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 --2- 172.21.15.71:0/1041539584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 0x7f6d001036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.062 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 -- 172.21.15.71:0/1041539584 >> 172.21.15.71:0/1041539584 conn(0x7f6d00079240 msgr2=0x7f6d00079680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.062 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 -- 172.21.15.71:0/1041539584 shutdown_connections 2024-05-27T09:50:33.062 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.060+0000 7f6cffe00640 1 -- 172.21.15.71:0/1041539584 wait complete. 2024-05-27T09:50:33.062 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.061+0000 7f6cffe00640 1 Processor -- start 2024-05-27T09:50:33.062 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.061+0000 7f6cffe00640 1 -- start start 2024-05-27T09:50:33.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d00104250 0x7f6d00074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 0x7f6d00075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00109f50 0x7f6d00075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cffe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00113ca0 con 0x7f6d00109f50 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cffe00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00113b20 con 0x7f6d00109ab0 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cffe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00113e20 con 0x7f6d00104250 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cff400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00109f50 0x7f6d00075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cf6000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 0x7f6d00075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cf6000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 0x7f6d00075500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54060/0 (socket says 172.21.15.71:54060) 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cf6000640 1 -- 172.21.15.71:0/2510782614 learned_addr learned my addr 172.21.15.71:0/2510782614 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.062+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d00104250 0x7f6d00074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf6000640 1 -- 172.21.15.71:0/2510782614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d00104250 msgr2=0x7f6d00074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d00104250 0x7f6d00074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf6000640 1 -- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00109f50 msgr2=0x7f6d00075a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00109f50 0x7f6d00075a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf6000640 1 -- 172.21.15.71:0/2510782614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d001a89c0 con 0x7f6d00109ab0 2024-05-27T09:50:33.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 0x7f6d00075500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800e9f0 tx=0x7f6ce800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf7e00640 1 -- 172.21.15.71:0/2510782614 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce800ccc0 con 0x7f6d00109ab0 2024-05-27T09:50:33.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf7e00640 1 -- 172.21.15.71:0/2510782614 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce80035f0 con 0x7f6d00109ab0 2024-05-27T09:50:33.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cf7e00640 1 -- 172.21.15.71:0/2510782614 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce800ce60 con 0x7f6d00109ab0 2024-05-27T09:50:33.066 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.063+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d001a8cb0 con 0x7f6d00109ab0 2024-05-27T09:50:33.066 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.064+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d001a91b0 con 0x7f6d00109ab0 2024-05-27T09:50:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 Processor -- start 2024-05-27T09:50:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 -- start start 2024-05-27T09:50:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6cf7e00640 1 -- 172.21.15.71:0/2510782614 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f6ce8003aa0 con 0x7f6d00109ab0 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c57a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c57fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cb79bc8b90 con 0x55cb798b51b0 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55cb79bb8730 con 0x55cb7988c2f0 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.067+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cb79bbc770 con 0x55cb798944d0 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c57fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cf6000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cff400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c57a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c57fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54068/0 (socket says 172.21.15.71:54068) 2024-05-27T09:50:33.069 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 -- 172.21.15.71:0/2342331922 learned_addr learned my addr 172.21.15.71:0/2342331922 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 -- 172.21.15.71:0/2342331922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 msgr2=0x55cb79c584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2342331922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 -- 172.21.15.71:0/2342331922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 msgr2=0x55cb79c57a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2342331922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c57a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.068+0000 7f6cfea00640 1 -- 172.21.15.71:0/2342331922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb79b518b0 con 0x55cb7988c2f0 2024-05-27T09:50:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.069+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2342331922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c57fa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009c90 tx=0x7f6cf0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70543b0f92ce345 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.069+0000 7f6cefe00640 1 -- 172.21.15.71:0/2342331922 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf001e070 con 0x55cb7988c2f0 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.069+0000 7f6cefe00640 1 -- 172.21.15.71:0/2342331922 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf0019ae0 con 0x55cb7988c2f0 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.069+0000 7f6cefe00640 1 -- 172.21.15.71:0/2342331922 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000e960 con 0x55cb7988c2f0 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.069+0000 7f6cf7e00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ce40b2950 0x7f6ce40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6cf7e00640 1 -- 172.21.15.71:0/2510782614 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f6ce80e28e0 con 0x7f6d00109ab0 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6cff400640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ce40b2950 0x7f6ce40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2342331922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 msgr2=0x55cb79c57fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2342331922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c57fa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009c90 tx=0x7f6cf0011810 comp rx=0 tx=0).stop 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2342331922 shutdown_connections 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2342331922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2342331922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c57fa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2342331922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c57a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2342331922 >> 172.21.15.71:0/2342331922 conn(0x55cb798a9300 msgr2=0x55cb79c54210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2342331922 shutdown_connections 2024-05-27T09:50:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.070+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2342331922 wait complete. 2024-05-27T09:50:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.071+0000 7f6cff400640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ce40b2950 0x7f6ce40b4e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80094e0 tx=0x7f6cf802f310 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.071+0000 7f6d0cbdc740 1 -- start start 2024-05-27T09:50:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.071+0000 7f6d0cbdc740 1 Processor -- start 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c61bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798944d0 0x55cb79c62110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798b51b0 0x55cb79c6def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cb7989e790 con 0x55cb798944d0 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55cb79b60bc0 con 0x55cb798b51b0 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cb79c64b90 con 0x55cb7988c2f0 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6d0cbdc740 10 client.0 _ll_register_callbacks cb 0x55cb79b3e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6cf6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798944d0 0x55cb79c62110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6cf6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798944d0 0x55cb79c62110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42710/0 (socket says 172.21.15.71:42710) 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6cf6000640 1 -- 172.21.15.71:0/2885585537 learned_addr learned my addr 172.21.15.71:0/2885585537 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c61bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.072+0000 7f6cff400640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798b51b0 0x55cb79c6def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cf6000640 1 -- 172.21.15.71:0/2885585537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 msgr2=0x55cb79c61bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c61bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cf6000640 1 -- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798b51b0 msgr2=0x55cb79c6def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798b51b0 0x55cb79c6def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cf6000640 1 -- 172.21.15.71:0/2885585537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb798cd210 con 0x55cb798944d0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c61bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798944d0 0x55cb79c62110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80a5c10 tx=0x7f6ce80e0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54eb4b47f38af884 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cecc00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cecc00640 1 -- 172.21.15.71:0/2885585537 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80a94e0 con 0x55cb798944d0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6cecc00640 1 -- 172.21.15.71:0/2885585537 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f6ce80b2770 con 0x55cb798944d0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.073+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf0019ae0 con 0x55cb798944d0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6cecc00640 1 -- 172.21.15.71:0/2885585537 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ce80a9300 con 0x55cb798944d0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 10 client.15786 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb79999620 con 0x55cb798944d0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6cecc00640 1 -- 172.21.15.71:0/2885585537 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf0019ae0 con 0x55cb798944d0 2024-05-27T09:50:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6cecc00640 1 -- 172.21.15.71:0/2885585537 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6ce80a5500 con 0x55cb798944d0 2024-05-27T09:50:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 10 client.15786 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 20 client.15786 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb79873d80 0x55cb79c73e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 4 client.15786 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.074+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb79bcaae0 con 0x55cb79873d80 2024-05-27T09:50:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.075+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb79873d80 0x55cb79c73e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.075+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb79873d80 0x55cb79c73e50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ffd2356c8442bcd server_cookie=7327a0ce90c37cb in_seq=0 out_seq=0 2024-05-27T09:50:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.075+0000 7f6cecc00640 10 client.15786 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6cecc00640 1 -- 172.21.15.71:0/2885585537 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55cb79bcaae0 con 0x55cb79873d80 2024-05-27T09:50:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6cecc00640 10 client.15786 handle_command_reply: tid=0 2024-05-27T09:50:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 client.15786 shutdown 2024-05-27T09:50:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798944d0 msgr2=0x55cb79c62110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798944d0 0x55cb79c62110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80a5c10 tx=0x7f6ce80e0570 comp rx=0 tx=0).stop 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 shutdown_connections 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798b51b0 0x55cb79c6def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb79873d80 0x55cb79c73e50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798944d0 0x55cb79c62110 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2885585537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c61bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6cecc00640 0 client.15786 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.076+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 >> 172.21.15.71:0/2885585537 conn(0x55cb798a9300 msgr2=0x55cb79c59780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.077+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 shutdown_connections 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.077+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2885585537 wait complete. 2024-05-27T09:50:33.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.077+0000 7f6d0cbdc740 20 client.15786 trim_cache size 0 max 16384 2024-05-27T09:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.093+0000 7f6d0cbdc740 1 Processor -- start 2024-05-27T09:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6d0cbdc740 1 -- start start 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c63dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c6dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c6e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001b4300 con 0x55cb798b51b0 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001b1bd0 con 0x55cb7988c2f0 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001afa20 con 0x55cb798944d0 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c63dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c63dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54090/0 (socket says 172.21.15.71:54090) 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6cff400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c6e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.094+0000 7f6cfea00640 1 -- 172.21.15.71:0/203054105 learned_addr learned my addr 172.21.15.71:0/203054105 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cf6000640 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c6dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cfea00640 1 -- 172.21.15.71:0/203054105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 msgr2=0x55cb79c6dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cfea00640 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c6dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cfea00640 1 -- 172.21.15.71:0/203054105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 msgr2=0x55cb79c6e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cfea00640 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c6e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cfea00640 1 -- 172.21.15.71:0/203054105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb79c60120 con 0x55cb7988c2f0 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cff400640 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c6e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cfea00640 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c63dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009be0 tx=0x7f6cf0009a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b05a0bfd0e42be0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cef400640 1 -- 172.21.15.71:0/203054105 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf001e040 con 0x55cb7988c2f0 2024-05-27T09:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.095+0000 7f6cef400640 1 -- 172.21.15.71:0/203054105 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf002b040 con 0x55cb7988c2f0 2024-05-27T09:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.096+0000 7f6cef400640 1 -- 172.21.15.71:0/203054105 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0003aa0 con 0x55cb7988c2f0 2024-05-27T09:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.096+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/203054105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 msgr2=0x55cb79c63dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.096+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c63dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009be0 tx=0x7f6cf0009a00 comp rx=0 tx=0).stop 2024-05-27T09:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/203054105 shutdown_connections 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79c6e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb798944d0 0x55cb79c6dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/203054105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb7988c2f0 0x55cb79c63dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/203054105 >> 172.21.15.71:0/203054105 conn(0x55cb798a9300 msgr2=0x55cb79c58220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/203054105 shutdown_connections 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/203054105 wait complete. 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 -- start start 2024-05-27T09:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.097+0000 7f6d0cbdc740 1 Processor -- start 2024-05-27T09:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c65200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798944d0 0x55cb79c65740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6d0cbdc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79ce2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001b0090 con 0x55cb798b51b0 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001b1500 con 0x55cb798944d0 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6d0cbdc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001b0760 con 0x55cb7988c2f0 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6d0cbdc740 10 client.0 _ll_register_callbacks cb 0x7f6ce80a5a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6cf6000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798944d0 0x55cb79c65740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6cff400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79ce2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c65200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6cf6000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798944d0 0x55cb79c65740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54104/0 (socket says 172.21.15.71:54104) 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.098+0000 7f6cf6000640 1 -- 172.21.15.71:0/2377928431 learned_addr learned my addr 172.21.15.71:0/2377928431 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cf6000640 1 -- 172.21.15.71:0/2377928431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 msgr2=0x55cb79c65200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c65200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cf6000640 1 -- 172.21.15.71:0/2377928431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 msgr2=0x55cb79ce2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79ce2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cf6000640 1 -- 172.21.15.71:0/2377928431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb79ce3260 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cf6000640 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798944d0 0x55cb79c65740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80a9890 tx=0x7f6ce80a5b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e355b468921b5b08 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cecc00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cecc00640 1 -- 172.21.15.71:0/2377928431 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80a94e0 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cecc00640 1 -- 172.21.15.71:0/2377928431 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f6ce80a9000 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf002b040 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6cecc00640 1 -- 172.21.15.71:0/2377928431 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ce80c4280 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6d0cbdc740 10 client.25913 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.099+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb79ce43c0 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6cecc00640 1 -- 172.21.15.71:0/2377928431 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf002b040 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6cecc00640 1 -- 172.21.15.71:0/2377928431 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6ce8086030 con 0x55cb798944d0 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6d0cbdc740 10 client.25913 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6d0cbdc740 10 client.25913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6d0cbdc740 20 client.25913 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb798491c0 0x55cb79ce6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6d0cbdc740 4 client.25913 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:50:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb79bc42c0 con 0x55cb798491c0 2024-05-27T09:50:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.100+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb798491c0 0x55cb79ce6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.101+0000 7f6cecc00640 10 client.25913 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.101+0000 7f6cfea00640 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb798491c0 0x55cb79ce6a70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb45c1e554654a20 server_cookie=58e136db702d8fb7 in_seq=0 out_seq=0 2024-05-27T09:50:33.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 -- 172.21.15.71:0/3412018378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 msgr2=0x7fcda810ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3412018378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 0x7fcda810ad90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcd940098f0 tx=0x7fcd94009c00 comp rx=0 tx=0).stop 2024-05-27T09:50:33.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 -- 172.21.15.71:0/3412018378 shutdown_connections 2024-05-27T09:50:33.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3412018378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcda810b2d0 0x7fcda8117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3412018378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 0x7fcda8110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3412018378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 0x7fcda810ad90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 -- 172.21.15.71:0/3412018378 >> 172.21.15.71:0/3412018378 conn(0x7fcda8077c70 msgr2=0x7fcda80780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 -- 172.21.15.71:0/3412018378 shutdown_connections 2024-05-27T09:50:33.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.190+0000 7fcdaea00700 1 -- 172.21.15.71:0/3412018378 wait complete. 2024-05-27T09:50:33.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.191+0000 7fcdaea00700 1 Processor -- start 2024-05-27T09:50:33.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.192+0000 7fcdaea00700 1 -- start start 2024-05-27T09:50:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.192+0000 7fcdaea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 0x7fcda81a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.192+0000 7fcdaea00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcda810b2d0 0x7fcda81a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.192+0000 7fcdaea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 0x7fcda81a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.192+0000 7fcdaea00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcda811aad0 con 0x7fcda810a980 2024-05-27T09:50:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.192+0000 7fcdaea00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcda811a950 con 0x7fcda8110960 2024-05-27T09:50:33.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.192+0000 7fcdaea00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcda811ac50 con 0x7fcda810b2d0 2024-05-27T09:50:33.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 0x7fcda81a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 0x7fcda81a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54128/0 (socket says 172.21.15.71:54128) 2024-05-27T09:50:33.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 -- 172.21.15.71:0/3863800030 learned_addr learned my addr 172.21.15.71:0/3863800030 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcda7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 0x7fcda81a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcda7400700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcda810b2d0 0x7fcda81a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 -- 172.21.15.71:0/3863800030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcda810b2d0 msgr2=0x7fcda81a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcda810b2d0 0x7fcda81a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 -- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 msgr2=0x7fcda81a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 0x7fcda81a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.193+0000 7fcdaca00700 1 -- 172.21.15.71:0/3863800030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda81a63b0 con 0x7fcda8110960 2024-05-27T09:50:33.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.194+0000 7fcdaca00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 0x7fcda81a5d10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcda000ef30 tx=0x7fcda000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.194+0000 7fcda4c00700 1 -- 172.21.15.71:0/3863800030 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda00092e0 con 0x7fcda8110960 2024-05-27T09:50:33.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.194+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda81a6640 con 0x7fcda8110960 2024-05-27T09:50:33.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.194+0000 7fcda4c00700 1 -- 172.21.15.71:0/3863800030 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcda0004bb0 con 0x7fcda8110960 2024-05-27T09:50:33.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.194+0000 7fcda4c00700 1 -- 172.21.15.71:0/3863800030 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0004280 con 0x7fcda8110960 2024-05-27T09:50:33.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.194+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda81a6b00 con 0x7fcda8110960 2024-05-27T09:50:33.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.198+0000 7fcda4c00700 1 -- 172.21.15.71:0/3863800030 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fcda001b030 con 0x7fcda8110960 2024-05-27T09:50:33.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.199+0000 7fcdbd491b80 1 Processor -- start 2024-05-27T09:50:33.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.199+0000 7fcdbd491b80 1 -- start start 2024-05-27T09:50:33.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2e88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561de216ec0 con 0x5561de169ec0 2024-05-27T09:50:33.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5561de206a60 con 0x5561de2e8ef0 2024-05-27T09:50:33.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5561de20aaa0 con 0x5561de255a70 2024-05-27T09:50:33.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcda7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcda4c00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fcd8c0b29f0 0x7fcd8c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcda7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54144/0 (socket says 172.21.15.71:54144) 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcda7400700 1 -- 172.21.15.71:0/3264234118 learned_addr learned my addr 172.21.15.71:0/3264234118 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcda7e00700 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2e88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.200+0000 7fcda7400700 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcda4c00700 1 -- 172.21.15.71:0/3863800030 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fcda00e2050 con 0x7fcda8110960 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcda7400700 1 -- 172.21.15.71:0/3264234118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 msgr2=0x5561de2e83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcda7400700 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2e83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcda7400700 1 -- 172.21.15.71:0/3264234118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 msgr2=0x5561de2e88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcda7400700 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2e88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcda7400700 1 -- 172.21.15.71:0/3264234118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561de1cf4a0 con 0x5561de2e8ef0 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcdaca00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fcd8c0b29f0 0x7fcd8c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.201+0000 7fcda7400700 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f5190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009680 tx=0x7fcd94019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150ac09a95ada3f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.202+0000 7fcd9d600700 1 -- 172.21.15.71:0/3264234118 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9402b070 con 0x5561de2e8ef0 2024-05-27T09:50:33.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.202+0000 7fcd9d600700 1 -- 172.21.15.71:0/3264234118 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd940054f0 con 0x5561de2e8ef0 2024-05-27T09:50:33.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.202+0000 7fcd9d600700 1 -- 172.21.15.71:0/3264234118 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd940048f0 con 0x5561de2e8ef0 2024-05-27T09:50:33.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3264234118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 msgr2=0x5561de2f5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdaca00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fcd8c0b29f0 0x7fcd8c0b4f00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009f40 tx=0x7fcda0009480 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f5190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009680 tx=0x7fcd94019040 comp rx=0 tx=0).stop 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3264234118 shutdown_connections 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f5190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2e83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3264234118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2e88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3264234118 >> 172.21.15.71:0/3264234118 conn(0x5561de203410 msgr2=0x5561de2e4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3264234118 shutdown_connections 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.203+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3264234118 wait complete. 2024-05-27T09:50:33.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.204+0000 7fcdbd491b80 1 -- start start 2024-05-27T09:50:33.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.204+0000 7fcdbd491b80 1 Processor -- start 2024-05-27T09:50:33.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2f2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561de10d020 con 0x5561de169ec0 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5561de1a77e0 con 0x5561de2e8ef0 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5561de2f5a20 con 0x5561de255a70 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcdbd491b80 10 client.0 _ll_register_callbacks cb 0x5561de1b0cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcda7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcda7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42760/0 (socket says 172.21.15.71:42760) 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcda7400700 1 -- 172.21.15.71:0/1874614931 learned_addr learned my addr 172.21.15.71:0/1874614931 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcda7e00700 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.205+0000 7fcda7400700 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.206+0000 7fcda7400700 1 -- 172.21.15.71:0/1874614931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 msgr2=0x5561de2f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.206+0000 7fcda7400700 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.206+0000 7fcda7400700 1 -- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 msgr2=0x5561de2f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.206+0000 7fcda7400700 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.206+0000 7fcda7400700 1 -- 172.21.15.71:0/1874614931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561de156950 con 0x5561de169ec0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.206+0000 7fcda7400700 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2f2640 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400a010 tx=0x7fcd94010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f08cbdad8df219 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.206+0000 7fcd92000700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcd92000700 1 -- 172.21.15.71:0/1874614931 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9403a060 con 0x5561de169ec0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcd92000700 1 -- 172.21.15.71:0/1874614931 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fcd9400b760 con 0x5561de169ec0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd940054f0 con 0x5561de169ec0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcd92000700 1 -- 172.21.15.71:0/1874614931 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcd9402b070 con 0x5561de169ec0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcdbd491b80 10 client.15804 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5561de1d70e0 con 0x5561de169ec0 2024-05-27T09:50:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcd92000700 1 -- 172.21.15.71:0/1874614931 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd940054f0 con 0x5561de169ec0 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcd92000700 1 -- 172.21.15.71:0/1874614931 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcd940357e0 con 0x5561de169ec0 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.207+0000 7fcdbd491b80 10 client.15804 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcdbd491b80 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcdbd491b80 20 client.15804 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de302800 0x5561de304c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcdbd491b80 4 client.15804 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561de218e10 con 0x5561de302800 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcda7e00700 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de302800 0x5561de304c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcda7e00700 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de302800 0x5561de304c20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b38a7885c1db1b8 server_cookie=2655ddc3054d8dfd in_seq=0 out_seq=0 2024-05-27T09:50:33.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.208+0000 7fcd92000700 10 client.15804 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcd92000700 1 -- 172.21.15.71:0/1874614931 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5561de218e10 con 0x5561de302800 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcd92000700 10 client.15804 handle_command_reply: tid=0 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 client.15804 shutdown 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 msgr2=0x5561de2f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2f2640 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400a010 tx=0x7fcd94010f40 comp rx=0 tx=0).stop 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 shutdown_connections 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de302800 0x5561de304c20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de2e8ef0 0x5561de2f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de169ec0 0x5561de2f2640 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/1874614931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de255a70 0x5561de2f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 >> 172.21.15.71:0/1874614931 conn(0x5561de203410 msgr2=0x5561de2e8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcd92000700 0 client.15804 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 shutdown_connections 2024-05-27T09:50:33.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.210+0000 7fcdbd491b80 1 -- 172.21.15.71:0/1874614931 wait complete. 2024-05-27T09:50:33.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.211+0000 7fcdbd491b80 20 client.15804 trim_cache size 0 max 16384 2024-05-27T09:50:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 Processor -- start 2024-05-27T09:50:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 -- start start 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de169ec0 0x5561de2feb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de255a70 0x5561de2f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de2e8ef0 0x5561de2f3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8800fdd0 con 0x5561de255a70 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8800d660 con 0x5561de169ec0 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.235+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8800b4b0 con 0x5561de2e8ef0 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de169ec0 0x5561de2feb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de169ec0 0x5561de2feb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54168/0 (socket says 172.21.15.71:54168) 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 -- 172.21.15.71:0/850925477 learned_addr learned my addr 172.21.15.71:0/850925477 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7e00700 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de255a70 0x5561de2f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de2e8ef0 0x5561de2f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 -- 172.21.15.71:0/850925477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de2e8ef0 msgr2=0x5561de2f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de2e8ef0 0x5561de2f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 -- 172.21.15.71:0/850925477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de255a70 msgr2=0x5561de2f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de255a70 0x5561de2f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.236+0000 7fcda7400700 1 -- 172.21.15.71:0/850925477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561de2e5080 con 0x5561de169ec0 2024-05-27T09:50:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.237+0000 7fcda7400700 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de169ec0 0x5561de2feb50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400f6e0 tx=0x7fcd94010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea30d9c0b1903580 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.237+0000 7fcd9cc00700 1 -- 172.21.15.71:0/850925477 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9403a070 con 0x5561de169ec0 2024-05-27T09:50:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.237+0000 7fcd9cc00700 1 -- 172.21.15.71:0/850925477 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9402c040 con 0x5561de169ec0 2024-05-27T09:50:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.237+0000 7fcd9cc00700 1 -- 172.21.15.71:0/850925477 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94017c30 con 0x5561de169ec0 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 -- 172.21.15.71:0/850925477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de169ec0 msgr2=0x5561de2feb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de169ec0 0x5561de2feb50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400f6e0 tx=0x7fcd94010bd0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 -- 172.21.15.71:0/850925477 shutdown_connections 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de2e8ef0 0x5561de2f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de169ec0 0x5561de2feb50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/850925477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de255a70 0x5561de2f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 -- 172.21.15.71:0/850925477 >> 172.21.15.71:0/850925477 conn(0x5561de203410 msgr2=0x5561de2f2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 -- 172.21.15.71:0/850925477 shutdown_connections 2024-05-27T09:50:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.238+0000 7fcdbd491b80 1 -- 172.21.15.71:0/850925477 wait complete. 2024-05-27T09:50:33.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 -- start start 2024-05-27T09:50:33.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 Processor -- start 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de169ec0 0x5561de366480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de255a70 0x5561de3669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de2e8ef0 0x5561de2f7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8800bb20 con 0x5561de2e8ef0 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8800cf90 con 0x5561de255a70 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.239+0000 7fcdbd491b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8800c1f0 con 0x5561de169ec0 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcdbd491b80 10 client.0 _ll_register_callbacks cb 0x5561de1b0cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de255a70 0x5561de3669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de255a70 0x5561de3669c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:54178/0 (socket says 172.21.15.71:54178) 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 -- 172.21.15.71:0/3557294025 learned_addr learned my addr 172.21.15.71:0/3557294025 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de169ec0 0x5561de366480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7400700 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de2e8ef0 0x5561de2f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 -- 172.21.15.71:0/3557294025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de169ec0 msgr2=0x5561de366480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de169ec0 0x5561de366480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 -- 172.21.15.71:0/3557294025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de2e8ef0 msgr2=0x5561de2f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de2e8ef0 0x5561de2f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.240+0000 7fcda7e00700 1 -- 172.21.15.71:0/3557294025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561de2f7910 con 0x5561de255a70 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcda7e00700 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de255a70 0x5561de3669c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5561de2e5aa0 tx=0x7fcd98004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41eb8512932e3910 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcd92000700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcd92000700 1 -- 172.21.15.71:0/3557294025 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98004830 con 0x5561de255a70 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcd92000700 1 -- 172.21.15.71:0/3557294025 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fcd980049d0 con 0x5561de255a70 2024-05-27T09:50:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd9402c040 con 0x5561de255a70 2024-05-27T09:50:33.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcd92000700 1 -- 172.21.15.71:0/3557294025 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcd9802f050 con 0x5561de255a70 2024-05-27T09:50:33.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcdbd491b80 10 client.25931 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:33.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.241+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5561de36dbe0 con 0x5561de255a70 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcd92000700 1 -- 172.21.15.71:0/3557294025 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9402c040 con 0x5561de255a70 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcd92000700 1 -- 172.21.15.71:0/3557294025 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcd98010660 con 0x5561de255a70 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcdbd491b80 10 client.25931 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcdbd491b80 10 client.25931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcdbd491b80 20 client.25931 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de36e330 0x5561de370750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcdbd491b80 4 client.25931 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5561de2125f0 con 0x5561de36e330 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.242+0000 7fcda7400700 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de36e330 0x5561de370750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.243+0000 7fcd92000700 10 client.25931 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.243+0000 7fcda7400700 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de36e330 0x5561de370750 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ccc1a59447bc990 server_cookie=d3dc13f7dbd9177e in_seq=0 out_seq=0 2024-05-27T09:50:33.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.371+0000 7fcd92000700 1 -- 172.21.15.71:0/3557294025 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5561de2125f0 con 0x5561de36e330 2024-05-27T09:50:33.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.371+0000 7fcd92000700 10 client.25931 handle_command_reply: tid=0 2024-05-27T09:50:33.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.371+0000 7fcdbd491b80 1 client.25931 shutdown 2024-05-27T09:50:33.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de255a70 msgr2=0x5561de3669c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de255a70 0x5561de3669c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5561de2e5aa0 tx=0x7fcd98004580 comp rx=0 tx=0).stop 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 shutdown_connections 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5561de36e330 0x5561de370750 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561de2e8ef0 0x5561de2f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5561de169ec0 0x5561de366480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 --2- 172.21.15.71:0/3557294025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5561de255a70 0x5561de3669c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.373+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 >> 172.21.15.71:0/3557294025 conn(0x5561de203410 msgr2=0x5561de2f4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.374+0000 7fcd92000700 0 client.25931 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.374+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 shutdown_connections 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.374+0000 7fcdbd491b80 1 -- 172.21.15.71:0/3557294025 wait complete. 2024-05-27T09:50:33.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.374+0000 7fcdbd491b80 20 client.25931 trim_cache size 0 max 16384 2024-05-27T09:50:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:50:33.376 INFO:teuthology.orchestra.run.smithi071.stdout: "return_code": 0, 2024-05-27T09:50:33.376 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_tag": "ec9070d3-2227-4f86-b459-3cd64c6af36c", 2024-05-27T09:50:33.376 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": "asynchronous" 2024-05-27T09:50:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:50:33.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fcd8c0b29f0 msgr2=0x7fcd8c0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fcd8c0b29f0 0x7fcd8c0b4f00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009f40 tx=0x7fcda0009480 comp rx=0 tx=0).stop 2024-05-27T09:50:33.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 msgr2=0x7fcda81a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 0x7fcda81a5d10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcda000ef30 tx=0x7fcda000c3a0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 shutdown_connections 2024-05-27T09:50:33.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fcd8c0b29f0 0x7fcd8c0b4f00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda8110960 0x7fcda81a5d10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcda810a980 0x7fcda81a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 --2- 172.21.15.71:0/3863800030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcda810b2d0 0x7fcda81a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.376+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 >> 172.21.15.71:0/3863800030 conn(0x7fcda8077c70 msgr2=0x7fcda807b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.377+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 shutdown_connections 2024-05-27T09:50:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:33.381+0000 7fcdaea00700 1 -- 172.21.15.71:0/3863800030 wait complete. 2024-05-27T09:50:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.731+0000 7f6cecc00640 1 -- 172.21.15.71:0/2377928431 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55cb79bc42c0 con 0x55cb798491c0 2024-05-27T09:50:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.731+0000 7f6cecc00640 10 client.25913 handle_command_reply: tid=0 2024-05-27T09:50:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 client.25913 shutdown 2024-05-27T09:50:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798944d0 msgr2=0x55cb79c65740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798944d0 0x55cb79c65740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80a9890 tx=0x7f6ce80a5b00 comp rx=0 tx=0).stop 2024-05-27T09:50:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 shutdown_connections 2024-05-27T09:50:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55cb798491c0 0x55cb79ce6a70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb798b51b0 0x55cb79ce2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55cb798944d0 0x55cb79c65740 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6cecc00640 0 client.25913 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 --2- 172.21.15.71:0/2377928431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cb7988c2f0 0x55cb79c65200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 >> 172.21.15.71:0/2377928431 conn(0x55cb798a9300 msgr2=0x55cb79c61340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 shutdown_connections 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 1 -- 172.21.15.71:0/2377928431 wait complete. 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.732+0000 7f6d0cbdc740 20 client.25913 trim_cache size 0 max 16384 2024-05-27T09:50:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:50:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:50:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:50:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ce40b2950 msgr2=0x7f6ce40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ce40b2950 0x7f6ce40b4e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80094e0 tx=0x7f6cf802f310 comp rx=0 tx=0).stop 2024-05-27T09:50:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 msgr2=0x7f6d00075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 0x7f6d00075500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800e9f0 tx=0x7f6ce800eeb0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 shutdown_connections 2024-05-27T09:50:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ce40b2950 0x7f6ce40b4e60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00109f50 0x7f6d00075a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d00109ab0 0x7f6d00075500 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 --2- 172.21.15.71:0/2510782614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d00104250 0x7f6d00074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 >> 172.21.15.71:0/2510782614 conn(0x7f6d00079240 msgr2=0x7f6d00100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 shutdown_connections 2024-05-27T09:50:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:33.733+0000 7f6cffe00640 1 -- 172.21.15.71:0/2510782614 wait complete. 2024-05-27T09:50:33.980 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.547+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b5 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/str_to_bytes.c auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87990580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b5:[<0x100000002aa/str_to_bytes.c v22>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b5:[<0x100000002aa/str_to_bytes.c v22>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.980 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.547+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b6 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/string_to_tokens.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87920c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b6:[<0x100000002aa/string_to_tokens.c v24>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b6:[<0x100000002aa/string_to_tokens.c v24>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.980 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.548+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ac [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/dataascii.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87990000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ac:[<0x100000002aa/dataascii.c v4>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002ac:[<0x100000002aa/dataascii.c v4>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.980 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.548+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b8 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/write_log.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87990b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b8:[<0x100000002aa/write_log.c v28>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b8:[<0x100000002aa/write_log.c v28>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.980 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.549+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ad [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/databin.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87921180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ad:[<0x100000002aa/databin.c v6>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002ad:[<0x100000002aa/databin.c v6>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.549+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b7 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/tlibio.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87991080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b7:[<0x100000002aa/tlibio.c v26>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b7:[<0x100000002aa/tlibio.c v26>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.549+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ae [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/datapid.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87992100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ae:[<0x100000002aa/datapid.c v8>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002ae:[<0x100000002aa/datapid.c v8>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.549+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002af [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/file_lock.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87991600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002af:[<0x100000002aa/file_lock.c v10>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002af:[<0x100000002aa/file_lock.c v10>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.549+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ab [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87992680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ab:[<0x100000002aa/Makefile v2>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002ab:[<0x100000002aa/Makefile v2>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.550+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b2 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/pattern.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87993180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b2:[<0x100000002aa/pattern.c v16>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b2:[<0x100000002aa/pattern.c v16>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.551+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b3 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87993700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b3:[<0x100000002aa/random.c v18>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b3:[<0x100000002aa/random.c v18>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.635+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b0 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/forker.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87921700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b0:[<0x100000002aa/forker.c v12>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b0:[<0x100000002aa/forker.c v12>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.645+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b4 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random_range.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87991b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b4:[<0x100000002aa/random_range.c v20>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b4:[<0x100000002aa/random_range.c v20>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:33.981 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 09:50:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T09:50:33.645+0000 7fcdb6acc700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b1 [4,head] /volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/open_flags.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={14955=0-4194304@3} caps={14955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=14955 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x558c87992c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b1:[<0x100000002aa/open_flags.c v14>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v74>,<0x10000000005/tmp v8>,<0x100000001fb/client.0 v12>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/qa v42>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x100000002b1:[<0x100000002aa/open_flags.c v14>,<0x10000000007/lib v388>,<0x10000000006/xfstests-dev v106>,<0x10000000005/tmp v31>,<0x100000001fb/client.0 v33>,<0x100000001fa/616bd330-493f-4a98-a838-adf26d894d14 v47>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v50>,<0x1/volumes v41>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-27T09:50:34.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-27T09:50:34.883 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: scrub queued for path: / 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b5 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/databin.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002ae (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002af (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/Makefile) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: pgmap v87: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 525 KiB/s wr, 27 op/s 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/forker.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:34.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:34 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: scrub queued for path: / 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b5 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/databin.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002ae (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002af (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/Makefile) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: pgmap v87: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 525 KiB/s wr, 27 op/s 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/forker.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:34 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: scrub queued for path: / 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b5 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/databin.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002ae (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002af (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/Makefile) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: pgmap v87: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 525 KiB/s wr, 27 op/s 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/forker.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.i log and `damage ls` output for details 2024-05-27T09:50:35.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:34 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:35 smithi071 ceph-mon[31451]: scrub summary: active paths [/] 2024-05-27T09:50:35.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:35 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:35 smithi071 ceph-mon[31451]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:35 smithi122 ceph-mon[36436]: scrub summary: active paths [/] 2024-05-27T09:50:35.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:35 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:35.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:35 smithi122 ceph-mon[36436]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:36.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:35 smithi072 ceph-mon[35951]: scrub summary: active paths [/] 2024-05-27T09:50:36.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:35 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:36.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:35 smithi072 ceph-mon[35951]: scrub summary: idle+waiting paths [/] 2024-05-27T09:50:36.112 INFO:tasks.workunit.client.0.smithi071.stderr:Updating files: 11% (491/4296) Updating files: 12% (516/4296) Updating files: 13% (559/4296) Updating files: 14% (602/4296) Updating files: 15% (645/4296) Updating files: 16% (688/4296) Updating files: 17% (731/4296) Updating files: 18% (774/4296) Updating files: 19% (817/4296) Updating files: 20% (860/4296) Updating files: 21% (903/4296) Updating files: 22% (946/4296) Updating files: 23% (989/4296) Updating files: 24% (1032/4296) Updating files: 25% (1074/4296) Updating files: 25% (1102/4296) Updating files: 26% (1117/4296) Updating files: 27% (1160/4296) Updating files: 28% (1203/4296) Updating files: 29% (1246/4296) Updating files: 29% (1288/4296) Updating files: 30% (1289/4296) Updating files: 31% (1332/4296) Updating files: 31% (1353/4296) Updating files: 32% (1375/4296) Updating files: 33% (1418/4296) Updating files: 34% (1461/4296) Updating files: 35% (1504/4296) Updating files: 36% (1547/4296) Updating files: 37% (1590/4296) Updating files: 38% (1633/4296) Updating files: 39% (1676/4296) Updating files: 40% (1719/4296) Updating files: 41% (1762/4296) Updating files: 42% (1805/4296) Updating files: 43% (1848/4296) Updating files: 44% (1891/4296) Updating files: 45% (1934/4296) Updating files: 45% (1943/4296) Updating files: 46% (1977/4296) Updating files: 47% (2020/4296) Updating files: 48% (2063/4296) Updating files: 49% (2106/4296) Updating files: 50% (2148/4296) Updating files: 51% (2191/4296) Updating files: 52% (2234/4296) Updating files: 53% (2277/4296) Updating files: 54% (2320/4296) Updating files: 54% (2351/4296) Updating files: 55% (2363/4296) Updating files: 56% (2406/4296) Updating files: 57% (2449/4296) Updating files: 58% (2492/4296) Updating files: 59% (2535/4296) Updating files: 60% (2578/4296) Updating files: 61% (2621/4296) Updating files: 62% (2664/4296) Updating files: 63% (2707/4296) Updating files: 64% (2750/4296) Updating files: 65% (2793/4296) Updating files: 65% (2794/4296) Updating files: 66% (2836/4296) Updating files: 67% (2879/4296) Updating files: 68% (2922/4296) Updating files: 69% (2965/4296) Updating files: 70% (3008/4296) Updating files: 70% (3025/4296) Updating files: 71% (3051/4296) Updating files: 72% (3094/4296) Updating files: 72% (3116/4296) Updating files: 73% (3137/4296) Updating files: 74% (3180/4296) Updating files: 75% (3222/4296) Updating files: 76% (3265/4296) Updating files: 77% (3308/4296) Updating files: 78% (3351/4296) Updating files: 79% (3394/4296) Updating files: 80% (3437/4296) Updating files: 81% (3480/4296) Updating files: 82% (3523/4296) Updating files: 83% (3566/4296) Updating files: 84% (3609/4296) Updating files: 85% (3652/4296) Updating files: 85% (3688/4296) Updating files: 86% (3695/4296) Updating files: 87% (3738/4296) Updating files: 88% (3781/4296) Updating files: 89% (3824/4296) Updating files: 90% (3867/4296) Updating files: 91% (3910/4296) Updating files: 92% (3953/4296) Updating files: 93% (3996/4296) Updating files: 94% (4039/4296) Updating files: 95% (4082/4296) Updating files: 95% (4124/4296) Updating files: 96% (4125/4296) Updating files: 97% (4168/4296) Updating files: 98% (4211/4296) Updating files: 99% (4254/4296) Updating files: 100% (4296/4296) Updating files: 100% (4296/4296), done. 2024-05-27T09:50:36.135 INFO:tasks.workunit.client.0.smithi071.stderr:+ cd xfstests-dev 2024-05-27T09:50:36.135 INFO:tasks.workunit.client.0.smithi071.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-05-27T09:50:36.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:36 smithi071 ceph-mon[31451]: pgmap v88: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 525 KiB/s wr, 27 op/s 2024-05-27T09:50:36.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:36 smithi122 ceph-mon[36436]: pgmap v88: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 525 KiB/s wr, 27 op/s 2024-05-27T09:50:37.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:36 smithi072 ceph-mon[35951]: pgmap v88: 97 pgs: 97 active+clean; 21 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 525 KiB/s wr, 27 op/s 2024-05-27T09:50:37.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.162+0000 7f229e400700 1 -- 172.21.15.71:0/1148333490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2298108d20 msgr2=0x7f2298109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.162+0000 7f229e400700 1 --2- 172.21.15.71:0/1148333490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2298108d20 0x7f2298109130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2284009920 tx=0x7f2284009c30 comp rx=0 tx=0).stop 2024-05-27T09:50:37.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.163+0000 7f229e400700 1 -- 172.21.15.71:0/1148333490 shutdown_connections 2024-05-27T09:50:37.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.163+0000 7f229e400700 1 --2- 172.21.15.71:0/1148333490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298109670 0x7f2298110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.163+0000 7f229e400700 1 --2- 172.21.15.71:0/1148333490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22981043f0 0x7f2298104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.163+0000 7f229e400700 1 --2- 172.21.15.71:0/1148333490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2298108d20 0x7f2298109130 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.163+0000 7f229e400700 1 -- 172.21.15.71:0/1148333490 >> 172.21.15.71:0/1148333490 conn(0x7f2298079d00 msgr2=0x7f229807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:37.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.163+0000 7f229e400700 1 -- 172.21.15.71:0/1148333490 shutdown_connections 2024-05-27T09:50:37.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.163+0000 7f229e400700 1 -- 172.21.15.71:0/1148333490 wait complete. 2024-05-27T09:50:37.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.164+0000 7f229e400700 1 Processor -- start 2024-05-27T09:50:37.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.164+0000 7f229e400700 1 -- start start 2024-05-27T09:50:37.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229e400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22981043f0 0x7f2298075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298108d20 0x7f2298075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229e400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298109670 0x7f2298076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229e400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2298114280 con 0x7f2298109670 2024-05-27T09:50:37.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2298114100 con 0x7f2298108d20 2024-05-27T09:50:37.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229e400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2298114400 con 0x7f22981043f0 2024-05-27T09:50:37.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f2297e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298108d20 0x7f2298075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f2297e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298108d20 0x7f2298075ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37518/0 (socket says 172.21.15.71:37518) 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f2297e00700 1 -- 172.21.15.71:0/4028524233 learned_addr learned my addr 172.21.15.71:0/4028524233 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229da00700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298109670 0x7f2298076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.165+0000 7f229d000700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22981043f0 0x7f2298075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f229d000700 1 -- 172.21.15.71:0/4028524233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298108d20 msgr2=0x7f2298075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f229d000700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298108d20 0x7f2298075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f229d000700 1 -- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298109670 msgr2=0x7f2298076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f229d000700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298109670 0x7f2298076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f229d000700 1 -- 172.21.15.71:0/4028524233 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22981a9170 con 0x7f22981043f0 2024-05-27T09:50:37.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f2297e00700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298108d20 0x7f2298075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:37.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f229d000700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22981043f0 0x7f2298075ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e9f0 tx=0x7f228c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:37.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.166+0000 7f2295600700 1 -- 172.21.15.71:0/4028524233 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c00cb70 con 0x7f22981043f0 2024-05-27T09:50:37.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.167+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22981a9460 con 0x7f22981043f0 2024-05-27T09:50:37.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.167+0000 7f2295600700 1 -- 172.21.15.71:0/4028524233 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c00ee90 con 0x7f22981043f0 2024-05-27T09:50:37.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.167+0000 7f2295600700 1 -- 172.21.15.71:0/4028524233 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c003d40 con 0x7f22981043f0 2024-05-27T09:50:37.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.167+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22981a99f0 con 0x7f22981043f0 2024-05-27T09:50:37.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.172+0000 7f2295600700 1 -- 172.21.15.71:0/4028524233 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f228c018430 con 0x7f22981043f0 2024-05-27T09:50:37.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.172+0000 7f22ae451b80 1 Processor -- start 2024-05-27T09:50:37.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f22ae451b80 1 -- start start 2024-05-27T09:50:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901504ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901512020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f22ae451b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558901433e40 con 0x558901505820 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f22ae451b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5589014239e0 con 0x558901505410 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f22ae451b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558901427a20 con 0x558901386e40 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f2297e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901512020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f229d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f2297e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901512020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57548/0 (socket says 172.21.15.71:57548) 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.173+0000 7f2297e00700 1 -- 172.21.15.71:0/2540566476 learned_addr learned my addr 172.21.15.71:0/2540566476 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229da00700 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901504ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229d000700 1 -- 172.21.15.71:0/2540566476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 msgr2=0x558901504ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229d000700 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901504ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229d000700 1 -- 172.21.15.71:0/2540566476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 msgr2=0x558901512020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229d000700 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901512020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229d000700 1 -- 172.21.15.71:0/2540566476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589013ec420 con 0x558901505410 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229da00700 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901504ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f2295600700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f22800b29f0 0x7f22800b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f2295600700 1 -- 172.21.15.71:0/4028524233 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f228c0e2780 con 0x7f22981043f0 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229d000700 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f228c0dfea0 tx=0x7f228c0e8d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efd9051b62715bd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.174+0000 7f229da00700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f22800b29f0 0x7f22800b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.175+0000 7f228a000700 1 -- 172.21.15.71:0/2540566476 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0a58f0 con 0x558901505410 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.175+0000 7f228a000700 1 -- 172.21.15.71:0/2540566476 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0a51b0 con 0x558901505410 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.175+0000 7f228a000700 1 -- 172.21.15.71:0/2540566476 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0a91a0 con 0x558901505410 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 -- 172.21.15.71:0/2540566476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 msgr2=0x55890150fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f228c0dfea0 tx=0x7f228c0e8d40 comp rx=0 tx=0).stop 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f229da00700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f22800b29f0 0x7f22800b4f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x558901501690 tx=0x7f229000b040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 -- 172.21.15.71:0/2540566476 shutdown_connections 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901512020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901504ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 --2- 172.21.15.71:0/2540566476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fad0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 -- 172.21.15.71:0/2540566476 >> 172.21.15.71:0/2540566476 conn(0x5589013e6fc0 msgr2=0x558901500d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:37.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 -- 172.21.15.71:0/2540566476 shutdown_connections 2024-05-27T09:50:37.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 -- 172.21.15.71:0/2540566476 wait complete. 2024-05-27T09:50:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.176+0000 7f22ae451b80 1 -- start start 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 1 Processor -- start 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901386e40 0x55890150f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505820 0x55890150ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558901329fa0 con 0x558901386e40 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5589013c4760 con 0x558901505410 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558901512990 con 0x558901505820 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.177+0000 7f22ae451b80 10 client.0 _ll_register_callbacks cb 0x5589013cdc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37524/0 (socket says 172.21.15.71:37524) 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 -- 172.21.15.71:0/1187167072 learned_addr learned my addr 172.21.15.71:0/1187167072 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f229d000700 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901386e40 0x55890150f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f229da00700 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505820 0x55890150ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 -- 172.21.15.71:0/1187167072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505820 msgr2=0x55890150ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505820 0x55890150ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 -- 172.21.15.71:0/1187167072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901386e40 msgr2=0x55890150f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901386e40 0x55890150f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 -- 172.21.15.71:0/1187167072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589013738d0 con 0x558901505410 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f2297e00700 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fa20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2284009230 tx=0x7f2284009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f2d9ca1da7b7be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.178+0000 7f227ea00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f227ea00700 1 -- 172.21.15.71:0/1187167072 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284027070 con 0x558901505410 2024-05-27T09:50:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f227ea00700 1 -- 172.21.15.71:0/1187167072 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2284005590 con 0x558901505410 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228c0a51b0 con 0x558901505410 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f227ea00700 1 -- 172.21.15.71:0/1187167072 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2284033050 con 0x558901505410 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f22ae451b80 10 client.25943 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5589013f4060 con 0x558901505410 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f227ea00700 1 -- 172.21.15.71:0/1187167072 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0a51b0 con 0x558901505410 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.179+0000 7f227ea00700 1 -- 172.21.15.71:0/1187167072 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f228400b810 con 0x558901505410 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f22ae451b80 10 client.25943 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f22ae451b80 10 client.25943 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f22ae451b80 20 client.25943 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f22ae451b80 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55890151f800 0x558901521c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f22ae451b80 4 client.25943 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:37.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558901435d90 con 0x55890151f800 2024-05-27T09:50:37.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f229d000700 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55890151f800 0x558901521c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f229d000700 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55890151f800 0x558901521c40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89c4d76d0d25655e server_cookie=fceaff27dc830f21 in_seq=0 out_seq=0 2024-05-27T09:50:37.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.180+0000 7f227ea00700 10 client.25943 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:37.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.181+0000 7f227ea00700 1 -- 172.21.15.71:0/1187167072 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x558901435d90 con 0x55890151f800 2024-05-27T09:50:37.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.181+0000 7f227ea00700 10 client.25943 handle_command_reply: tid=0 2024-05-27T09:50:37.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 client.25943 shutdown 2024-05-27T09:50:37.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 msgr2=0x55890150fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fa20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2284009230 tx=0x7f2284009520 comp rx=0 tx=0).stop 2024-05-27T09:50:37.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 shutdown_connections 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55890151f800 0x558901521c40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505820 0x55890150ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901386e40 0x55890150f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 --2- 172.21.15.71:0/1187167072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x55890150fa20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f227ea00700 0 client.25943 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 >> 172.21.15.71:0/1187167072 conn(0x5589013e6fc0 msgr2=0x5589014ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 shutdown_connections 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.182+0000 7f22ae451b80 1 -- 172.21.15.71:0/1187167072 wait complete. 2024-05-27T09:50:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.183+0000 7f22ae451b80 20 client.25943 trim_cache size 0 max 16384 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.206+0000 7f22ae451b80 1 Processor -- start 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.206+0000 7f22ae451b80 1 -- start start 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901386e40 0x558901500e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505410 0x55890150fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x55890151ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f22ae451b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22981b36f0 con 0x558901505820 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f22ae451b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f22981b0f80 con 0x558901386e40 2024-05-27T09:50:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f22ae451b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22981aedf0 con 0x558901505410 2024-05-27T09:50:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901386e40 0x558901500e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901386e40 0x558901500e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37530/0 (socket says 172.21.15.71:37530) 2024-05-27T09:50:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 -- 172.21.15.71:0/3492314508 learned_addr learned my addr 172.21.15.71:0/3492314508 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229da00700 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x55890151ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f2297e00700 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505410 0x55890150fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 -- 172.21.15.71:0/3492314508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505410 msgr2=0x55890150fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505410 0x55890150fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 -- 172.21.15.71:0/3492314508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 msgr2=0x55890151ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x55890151ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.207+0000 7f229d000700 1 -- 172.21.15.71:0/3492314508 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890150e4a0 con 0x558901386e40 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.208+0000 7f229da00700 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x55890151ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.208+0000 7f2297e00700 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505410 0x55890150fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.208+0000 7f229d000700 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901386e40 0x558901500e30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c5b0 tx=0x7f228c005c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d09fbc840bb235e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.208+0000 7f2289600700 1 -- 172.21.15.71:0/3492314508 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0a9380 con 0x558901386e40 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.208+0000 7f2289600700 1 -- 172.21.15.71:0/3492314508 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0a51b0 con 0x558901386e40 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.208+0000 7f2289600700 1 -- 172.21.15.71:0/3492314508 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0a9800 con 0x558901386e40 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 -- 172.21.15.71:0/3492314508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901386e40 msgr2=0x558901500e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901386e40 0x558901500e30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c5b0 tx=0x7f228c005c40 comp rx=0 tx=0).stop 2024-05-27T09:50:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 -- 172.21.15.71:0/3492314508 shutdown_connections 2024-05-27T09:50:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x55890151ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901386e40 0x558901500e30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3492314508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901505410 0x55890150fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 -- 172.21.15.71:0/3492314508 >> 172.21.15.71:0/3492314508 conn(0x5589013e6fc0 msgr2=0x558901508860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 -- 172.21.15.71:0/3492314508 shutdown_connections 2024-05-27T09:50:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.209+0000 7f22ae451b80 1 -- 172.21.15.71:0/3492314508 wait complete. 2024-05-27T09:50:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 -- start start 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 Processor -- start 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901513d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x5589015142a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901591b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22981af440 con 0x558901505820 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f22981b08b0 con 0x558901505410 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22981afb10 con 0x558901386e40 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.210+0000 7f22ae451b80 10 client.0 _ll_register_callbacks cb 0x5589013cdc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f2297e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x5589015142a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901591b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229d000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901513d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901591b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57578/0 (socket says 172.21.15.71:57578) 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229d000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901513d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53748/0 (socket says 172.21.15.71:53748) 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 -- 172.21.15.71:0/3676643204 learned_addr learned my addr 172.21.15.71:0/3676643204 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f2297e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x5589015142a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37536/0 (socket says 172.21.15.71:37536) 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 -- 172.21.15.71:0/3676643204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 msgr2=0x558901513d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901513d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 -- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 msgr2=0x5589015142a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x5589015142a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f229da00700 1 -- 172.21.15.71:0/3676643204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558901514b80 con 0x558901505820 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.211+0000 7f2297e00700 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x5589015142a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f229da00700 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901591b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2290016e30 tx=0x7f2290004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7f4fd380a818a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f227ea00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f227ea00700 1 -- 172.21.15.71:0/3676643204 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290016e60 con 0x558901505820 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f227ea00700 1 -- 172.21.15.71:0/3676643204 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2290025d70 con 0x558901505820 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228c0a51b0 con 0x558901505820 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f227ea00700 1 -- 172.21.15.71:0/3676643204 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2290003a00 con 0x558901505820 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f22ae451b80 10 client.15828 fetch_fsmap learned FSMap version 27 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.212+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558901593050 con 0x558901505820 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f227ea00700 1 -- 172.21.15.71:0/3676643204 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0a51b0 con 0x558901505820 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f227ea00700 1 -- 172.21.15.71:0/3676643204 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f229002c070 con 0x558901505820 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f22ae451b80 10 client.15828 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f22ae451b80 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f22ae451b80 20 client.15828 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558901593810 0x558901595c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f22ae451b80 4 client.15828 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-27T09:50:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55890142f570 con 0x558901593810 2024-05-27T09:50:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.213+0000 7f229d000700 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558901593810 0x558901595c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.214+0000 7f227ea00700 10 client.15828 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.214+0000 7f229d000700 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558901593810 0x558901595c30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff715531555eccf7 server_cookie=bf468c70e4453d0e in_seq=0 out_seq=0 2024-05-27T09:50:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f227ea00700 1 -- 172.21.15.71:0/3676643204 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55890142f570 con 0x558901593810 2024-05-27T09:50:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f227ea00700 10 client.15828 handle_command_reply: tid=0 2024-05-27T09:50:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 client.15828 shutdown 2024-05-27T09:50:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 msgr2=0x558901591b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901591b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2290016e30 tx=0x7f2290004b40 comp rx=0 tx=0).stop 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 shutdown_connections 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558901593810 0x558901595c30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558901505820 0x558901591b20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558901386e40 0x558901513d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 --2- 172.21.15.71:0/3676643204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558901505410 0x5589015142a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 >> 172.21.15.71:0/3676643204 conn(0x5589013e6fc0 msgr2=0x55890150fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.215+0000 7f227ea00700 0 client.15828 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 shutdown_connections 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f22ae451b80 1 -- 172.21.15.71:0/3676643204 wait complete. 2024-05-27T09:50:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f22ae451b80 20 client.15828 trim_cache size 0 max 16384 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: "scrubs": { 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ec9070d3-2227-4f86-b459-3cd64c6af36c": { 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: "tag": "ec9070d3-2227-4f86-b459-3cd64c6af36c", 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: "options": "recursive,force" 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:50:37.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:50:37.222 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:50:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f22800b29f0 msgr2=0x7f22800b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f22800b29f0 0x7f22800b4f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x558901501690 tx=0x7f229000b040 comp rx=0 tx=0).stop 2024-05-27T09:50:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22981043f0 msgr2=0x7f2298075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22981043f0 0x7f2298075ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e9f0 tx=0x7f228c00ed00 comp rx=0 tx=0).stop 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 shutdown_connections 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f22800b29f0 0x7f22800b4f00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2298109670 0x7f2298076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22981043f0 0x7f2298075ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 --2- 172.21.15.71:0/4028524233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298108d20 0x7f2298075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.216+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 >> 172.21.15.71:0/4028524233 conn(0x7f2298079d00 msgr2=0x7f2298101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.217+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 shutdown_connections 2024-05-27T09:50:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:37.217+0000 7f229e400700 1 -- 172.21.15.71:0/4028524233 wait complete. 2024-05-27T09:50:37.597 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-05-27T09:50:37.597 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:37.597 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-27T09:50:37.597 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-27T09:50:37.597 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-05-27T09:50:37.598 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:37.599 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-27T09:50:37.599 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-05-27T09:50:37.599 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-05-27T09:50:37.602 INFO:tasks.workunit.client.0.smithi071.stderr:+ make -j4 2024-05-27T09:50:37.628 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize -cfi 2024-05-27T09:50:38.542 INFO:tasks.cephfs.filesystem:scrub status for tag:ec9070d3-2227-4f86-b459-3cd64c6af36c - {'path': '/', 'tag': 'ec9070d3-2227-4f86-b459-3cd64c6af36c', 'options': 'recursive,force'} 2024-05-27T09:50:38.953 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-27T09:50:38.953 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file './config.guess' 2024-05-27T09:50:38.970 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file './config.sub' 2024-05-27T09:50:38.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:38 smithi122 ceph-mon[36436]: pgmap v89: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 925 KiB/s wr, 759 op/s 2024-05-27T09:50:38.986 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file './install-sh' 2024-05-27T09:50:39.002 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file './ltmain.sh' 2024-05-27T09:50:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:38 smithi071 ceph-mon[31451]: pgmap v89: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 925 KiB/s wr, 759 op/s 2024-05-27T09:50:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:38 smithi072 ceph-mon[35951]: pgmap v89: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 925 KiB/s wr, 759 op/s 2024-05-27T09:50:39.092 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-27T09:50:39.092 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-27T09:50:39.111 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-27T09:50:39.130 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-27T09:50:39.149 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-27T09:50:39.169 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-27T09:50:39.193 INFO:tasks.workunit.client.0.smithi071.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-27T09:50:39.197 INFO:tasks.workunit.client.0.smithi071.stdout:cp include/install-sh . 2024-05-27T09:50:39.214 INFO:tasks.workunit.client.0.smithi071.stdout:aclocal -I m4 2024-05-27T09:50:40.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:40 smithi122 ceph-mon[36436]: pgmap v90: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 463 KiB/s wr, 737 op/s 2024-05-27T09:50:41.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31447]: 2024-05-27T09:50:40.681+0000 7f2cfbc00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-27T09:50:41.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:40 smithi071 ceph-mon[31451]: pgmap v90: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 463 KiB/s wr, 737 op/s 2024-05-27T09:50:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:40 smithi072 ceph-mon[35951]: pgmap v90: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 463 KiB/s wr, 737 op/s 2024-05-27T09:50:41.518 INFO:tasks.workunit.client.0.smithi071.stdout:autoheader 2024-05-27T09:50:41.973 INFO:tasks.workunit.client.0.smithi071.stdout:autoconf 2024-05-27T09:50:41.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:41 smithi122 ceph-mon[36436]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-27T09:50:41.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:41 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:active 2024-05-27T09:50:41.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:41 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:50:42.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:41 smithi071 ceph-mon[31451]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-27T09:50:42.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:41 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:active 2024-05-27T09:50:42.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:41 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:50:42.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:41 smithi072 ceph-mon[35951]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-27T09:50:42.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:41 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] up:active 2024-05-27T09:50:42.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:41 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:50:42.291 INFO:tasks.workunit.client.0.smithi071.stdout:./configure \ 2024-05-27T09:50:42.291 INFO:tasks.workunit.client.0.smithi071.stdout: --libexecdir=/usr/lib \ 2024-05-27T09:50:42.291 INFO:tasks.workunit.client.0.smithi071.stdout: --exec_prefix=/var/lib 2024-05-27T09:50:42.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:42 smithi122 ceph-mon[36436]: pgmap v91: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1.3 MiB/s wr, 843 op/s 2024-05-27T09:50:43.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:42 smithi071 ceph-mon[31451]: pgmap v91: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1.3 MiB/s wr, 843 op/s 2024-05-27T09:50:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:42 smithi072 ceph-mon[35951]: pgmap v91: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1.3 MiB/s wr, 843 op/s 2024-05-27T09:50:43.613 INFO:tasks.workunit.client.0.smithi071.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-27T09:50:43.613 INFO:tasks.workunit.client.0.smithi071.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-27T09:50:43.618 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to print strings... printf 2024-05-27T09:50:43.619 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gcc... gcc 2024-05-27T09:50:43.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:43 smithi122 ceph-mon[36436]: scrub summary: idle 2024-05-27T09:50:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:43 smithi122 ceph-mon[36436]: scrub summary: idle 2024-05-27T09:50:43.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:43 smithi122 ceph-mon[36436]: scrub summary: idle 2024-05-27T09:50:44.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:43 smithi071 ceph-mon[31451]: scrub summary: idle 2024-05-27T09:50:44.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:43 smithi071 ceph-mon[31451]: scrub summary: idle 2024-05-27T09:50:44.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:43 smithi071 ceph-mon[31451]: scrub summary: idle 2024-05-27T09:50:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:43 smithi072 ceph-mon[35951]: scrub summary: idle 2024-05-27T09:50:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:43 smithi072 ceph-mon[35951]: scrub summary: idle 2024-05-27T09:50:44.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:43 smithi072 ceph-mon[35951]: scrub summary: idle 2024-05-27T09:50:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether the C compiler works... yes 2024-05-27T09:50:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:checking for C compiler default output file name... a.out 2024-05-27T09:50:44.272 INFO:tasks.workunit.client.0.smithi071.stdout:checking for suffix of executables... 2024-05-27T09:50:44.353 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether we are cross compiling... no 2024-05-27T09:50:44.433 INFO:tasks.workunit.client.0.smithi071.stdout:checking for suffix of object files... o 2024-05-27T09:50:44.500 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether we are using the GNU C compiler... yes 2024-05-27T09:50:44.637 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether gcc accepts -g... yes 2024-05-27T09:50:44.781 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-27T09:50:44.796 INFO:tasks.workunit.client.0.smithi071.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-05-27T09:50:44.808 INFO:tasks.workunit.client.0.smithi071.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-27T09:50:44.815 INFO:tasks.workunit.client.0.smithi071.stdout:checking for egrep... /usr/bin/grep -E 2024-05-27T09:50:44.820 INFO:tasks.workunit.client.0.smithi071.stdout:checking for fgrep... /usr/bin/grep -F 2024-05-27T09:50:44.834 INFO:tasks.workunit.client.0.smithi071.stdout:checking for ld used by gcc... /usr/bin/ld 2024-05-27T09:50:44.841 INFO:tasks.workunit.client.0.smithi071.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-05-27T09:50:44.854 INFO:tasks.workunit.client.0.smithi071.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-05-27T09:50:44.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:44 smithi122 ceph-mon[36436]: pgmap v92: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 1.2 MiB/s wr, 836 op/s 2024-05-27T09:50:45.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:44 smithi071 ceph-mon[31451]: pgmap v92: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 1.2 MiB/s wr, 836 op/s 2024-05-27T09:50:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:44 smithi072 ceph-mon[35951]: pgmap v92: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 1.2 MiB/s wr, 836 op/s 2024-05-27T09:50:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.960+0000 7f763e800640 1 -- 172.21.15.71:0/2312741799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 msgr2=0x7f7638103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.960+0000 7f763e800640 1 --2- 172.21.15.71:0/2312741799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f7638103b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7624009900 tx=0x7f762402a400 comp rx=0 tx=0).stop 2024-05-27T09:50:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.960+0000 7f763e800640 1 -- 172.21.15.71:0/2312741799 shutdown_connections 2024-05-27T09:50:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.960+0000 7f763e800640 1 --2- 172.21.15.71:0/2312741799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104200 0x7f76381105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.960+0000 7f763e800640 1 --2- 172.21.15.71:0/2312741799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f7638103b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.960+0000 7f763e800640 1 --2- 172.21.15.71:0/2312741799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7638109ab0 0x7f7638103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.960+0000 7f763e800640 1 -- 172.21.15.71:0/2312741799 >> 172.21.15.71:0/2312741799 conn(0x7f7638079140 msgr2=0x7f7638079580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.961+0000 7f763e800640 1 -- 172.21.15.71:0/2312741799 shutdown_connections 2024-05-27T09:50:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.961+0000 7f763e800640 1 -- 172.21.15.71:0/2312741799 wait complete. 2024-05-27T09:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 Processor -- start 2024-05-27T09:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 -- start start 2024-05-27T09:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104200 0x7f763819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7638109ab0 0x7f763819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f763819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7638113cf0 con 0x7f7638104200 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7638113b70 con 0x7f7638109f50 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.962+0000 7f763e800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7638113e70 con 0x7f7638109ab0 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f763819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104200 0x7f763819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f763819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45316/0 (socket says 172.21.15.71:45316) 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 -- 172.21.15.71:0/2945294634 learned_addr learned my addr 172.21.15.71:0/2945294634 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763ca00640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7638109ab0 0x7f763819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 -- 172.21.15.71:0/2945294634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7638109ab0 msgr2=0x7f763819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7638109ab0 0x7f763819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 -- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104200 msgr2=0x7f763819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104200 0x7f763819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 -- 172.21.15.71:0/2945294634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763819f4d0 con 0x7f7638109f50 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763d400640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104200 0x7f763819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.963+0000 7f763de00640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f763819ee90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f763000eb10 tx=0x7f763000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.964+0000 7f7636000640 1 -- 172.21.15.71:0/2945294634 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630004b20 con 0x7f7638109f50 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.964+0000 7f7636000640 1 -- 172.21.15.71:0/2945294634 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7630004cc0 con 0x7f7638109f50 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.964+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763819f7c0 con 0x7f7638109f50 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.964+0000 7f7636000640 1 -- 172.21.15.71:0/2945294634 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630010670 con 0x7f7638109f50 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.964+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76381a7140 con 0x7f7638109f50 2024-05-27T09:50:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.967+0000 7f7646da7740 1 Processor -- start 2024-05-27T09:50:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.967+0000 7f7636000640 1 -- 172.21.15.71:0/2945294634 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f7630005020 con 0x7f7638109f50 2024-05-27T09:50:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f7646da7740 1 -- start start 2024-05-27T09:50:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f7646da7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f7646da7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d0963b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f7646da7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f7646da7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55668d002b90 con 0x55668ccc62f0 2024-05-27T09:50:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f7646da7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55668cff2730 con 0x55668ccce4d0 2024-05-27T09:50:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f7646da7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55668cff6770 con 0x55668ccef1b0 2024-05-27T09:50:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f763ca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f763ca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45322/0 (socket says 172.21.15.71:45322) 2024-05-27T09:50:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f763ca00640 1 -- 172.21.15.71:0/852159598 learned_addr learned my addr 172.21.15.71:0/852159598 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f763d400640 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d0963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.968+0000 7f763ca00640 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763d400640 1 -- 172.21.15.71:0/852159598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 msgr2=0x55668d095e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763d400640 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763d400640 1 -- 172.21.15.71:0/852159598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 msgr2=0x55668d0968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763d400640 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763d400640 1 -- 172.21.15.71:0/852159598 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668cf8b8b0 con 0x55668ccc62f0 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763ca00640 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763d400640 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d0963b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f762c009f20 tx=0x7f762c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88af4dac376dcf77 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f7636000640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f76200b29d0 0x7f76200b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f762a600640 1 -- 172.21.15.71:0/852159598 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c004020 con 0x55668ccc62f0 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f7636000640 1 -- 172.21.15.71:0/2945294634 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f76300e2b50 con 0x7f7638109f50 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f762a600640 1 -- 172.21.15.71:0/852159598 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f762c0054d0 con 0x55668ccc62f0 2024-05-27T09:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f762a600640 1 -- 172.21.15.71:0/852159598 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c004ba0 con 0x55668ccc62f0 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.969+0000 7f763ca00640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f76200b29d0 0x7f76200b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 -- 172.21.15.71:0/852159598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 msgr2=0x55668d0963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f763ca00640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f76200b29d0 0x7f76200b4ee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7624005f70 tx=0x7f7624005780 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d0963b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f762c009f20 tx=0x7f762c0118d0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 -- 172.21.15.71:0/852159598 shutdown_connections 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d0963b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 --2- 172.21.15.71:0/852159598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 -- 172.21.15.71:0/852159598 >> 172.21.15.71:0/852159598 conn(0x55668cce3300 msgr2=0x55668d092620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 -- 172.21.15.71:0/852159598 shutdown_connections 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.970+0000 7f7646da7740 1 -- 172.21.15.71:0/852159598 wait complete. 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.971+0000 7f7646da7740 1 -- start start 2024-05-27T09:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.971+0000 7f7646da7740 1 Processor -- start 2024-05-27T09:50:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f7646da7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccc62f0 0x55668d0a0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f7646da7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccce4d0 0x55668d0a0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f7646da7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccef1b0 0x55668d0ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f7646da7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55668ccd8790 con 0x55668ccce4d0 2024-05-27T09:50:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f7646da7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55668cf9abc0 con 0x55668ccef1b0 2024-05-27T09:50:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f7646da7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55668d0a2fa0 con 0x55668ccc62f0 2024-05-27T09:50:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f7646da7740 10 client.0 _ll_register_callbacks cb 0x55668cf78400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccce4d0 0x55668d0a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccce4d0 0x55668d0a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41866/0 (socket says 172.21.15.71:41866) 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccef1b0 0x55668d0ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763ca00640 1 -- 172.21.15.71:0/160520245 learned_addr learned my addr 172.21.15.71:0/160520245 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763d400640 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccc62f0 0x55668d0a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763de00640 1 -- 172.21.15.71:0/160520245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccc62f0 msgr2=0x55668d0a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763de00640 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccc62f0 0x55668d0a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763de00640 1 -- 172.21.15.71:0/160520245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccce4d0 msgr2=0x55668d0a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763de00640 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccce4d0 0x55668d0a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763de00640 1 -- 172.21.15.71:0/160520245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668cd07210 con 0x55668ccef1b0 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.972+0000 7f763ca00640 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccce4d0 0x55668d0a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f763de00640 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccef1b0 0x55668d0ac300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f76300e0270 tx=0x7f76300a9750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c780cf00152c3321 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f761ea00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f761ea00640 1 -- 172.21.15.71:0/160520245 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300aa500 con 0x55668ccef1b0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f762c0054d0 con 0x55668ccef1b0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f761ea00640 1 -- 172.21.15.71:0/160520245 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f76300aa270 con 0x55668ccef1b0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f761ea00640 1 -- 172.21.15.71:0/160520245 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76300a9e00 con 0x55668ccef1b0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 10 client.25961 fetch_fsmap learned FSMap version 28 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55668cdd3620 con 0x55668ccef1b0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f761ea00640 1 -- 172.21.15.71:0/160520245 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f762c0054d0 con 0x55668ccef1b0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f761ea00640 1 -- 172.21.15.71:0/160520245 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f76300c1030 con 0x55668ccef1b0 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 10 client.25961 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 10 client.25961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 20 client.25961 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668ccadd80 0x55668d0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 4 client.25961 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.973+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55668d004ae0 con 0x55668ccadd80 2024-05-27T09:50:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.974+0000 7f763d400640 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668ccadd80 0x55668d0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.974+0000 7f763d400640 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668ccadd80 0x55668d0b2330 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32a13b35a3e83532 server_cookie=a1560da8abdfdee3 in_seq=0 out_seq=0 2024-05-27T09:50:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.974+0000 7f761ea00640 10 client.25961 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f761ea00640 1 -- 172.21.15.71:0/160520245 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55668d004ae0 con 0x55668ccadd80 2024-05-27T09:50:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f761ea00640 10 client.25961 handle_command_reply: tid=0 2024-05-27T09:50:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 client.25961 shutdown 2024-05-27T09:50:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccef1b0 msgr2=0x55668d0ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccef1b0 0x55668d0ac300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f76300e0270 tx=0x7f76300a9750 comp rx=0 tx=0).stop 2024-05-27T09:50:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 shutdown_connections 2024-05-27T09:50:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccef1b0 0x55668d0ac300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668ccadd80 0x55668d0b2330 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccce4d0 0x55668d0a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 --2- 172.21.15.71:0/160520245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccc62f0 0x55668d0a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 >> 172.21.15.71:0/160520245 conn(0x55668cce3300 msgr2=0x55668d095ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.976+0000 7f761ea00640 0 client.25961 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.977+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 shutdown_connections 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.977+0000 7f7646da7740 1 -- 172.21.15.71:0/160520245 wait complete. 2024-05-27T09:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.977+0000 7f7646da7740 20 client.25961 trim_cache size 0 max 16384 2024-05-27T09:50:46.981 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:46 smithi122 ceph-mon[36436]: pgmap v93: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 1.2 MiB/s wr, 836 op/s 2024-05-27T09:50:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.993+0000 7f7646da7740 1 Processor -- start 2024-05-27T09:50:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f7646da7740 1 -- start start 2024-05-27T09:50:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f7646da7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d09b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f7646da7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0a0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f7646da7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f7646da7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76381aff00 con 0x55668ccc62f0 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f7646da7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f76381ad7d0 con 0x55668ccce4d0 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f7646da7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f76381ab640 con 0x55668ccef1b0 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d09b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d09b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41872/0 (socket says 172.21.15.71:41872) 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 -- 172.21.15.71:0/1902665037 learned_addr learned my addr 172.21.15.71:0/1902665037 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763ca00640 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763de00640 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 -- 172.21.15.71:0/1902665037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 msgr2=0x55668d095e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 -- 172.21.15.71:0/1902665037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 msgr2=0x55668d0a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.994+0000 7f763d400640 1 -- 172.21.15.71:0/1902665037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668d08d950 con 0x55668ccc62f0 2024-05-27T09:50:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.995+0000 7f763d400640 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d09b850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f762c011dd0 tx=0x7f762c0051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebfa69ab5aa4aa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.995+0000 7f7629c00640 1 -- 172.21.15.71:0/1902665037 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c01d040 con 0x55668ccc62f0 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.995+0000 7f7629c00640 1 -- 172.21.15.71:0/1902665037 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f762c005340 con 0x55668ccc62f0 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.995+0000 7f7629c00640 1 -- 172.21.15.71:0/1902665037 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c00fe50 con 0x55668ccc62f0 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 -- 172.21.15.71:0/1902665037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 msgr2=0x55668d09b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d09b850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f762c011dd0 tx=0x7f762c0051d0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 -- 172.21.15.71:0/1902665037 shutdown_connections 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccef1b0 0x55668d095e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccce4d0 0x55668d0a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 --2- 172.21.15.71:0/1902665037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccc62f0 0x55668d09b850 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 -- 172.21.15.71:0/1902665037 >> 172.21.15.71:0/1902665037 conn(0x55668cce3300 msgr2=0x55668d08d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 -- 172.21.15.71:0/1902665037 shutdown_connections 2024-05-27T09:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 -- 172.21.15.71:0/1902665037 wait complete. 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.996+0000 7f7646da7740 1 -- start start 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 1 Processor -- start 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccc62f0 0x55668d0a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccce4d0 0x55668d0a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccef1b0 0x55668d0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76381abc90 con 0x55668ccef1b0 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f76381ad100 con 0x55668ccc62f0 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f76381ac360 con 0x55668ccce4d0 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f7646da7740 10 client.0 _ll_register_callbacks cb 0x7f76300a9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f763d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccc62f0 0x55668d0a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f763d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccc62f0 0x55668d0a4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45350/0 (socket says 172.21.15.71:45350) 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f763d400640 1 -- 172.21.15.71:0/96194066 learned_addr learned my addr 172.21.15.71:0/96194066 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f763de00640 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccef1b0 0x55668d0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.997+0000 7f763ca00640 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccce4d0 0x55668d0a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f763d400640 1 -- 172.21.15.71:0/96194066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccce4d0 msgr2=0x55668d0a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f763d400640 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccce4d0 0x55668d0a4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f763d400640 1 -- 172.21.15.71:0/96194066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccef1b0 msgr2=0x55668d0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f763d400640 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccef1b0 0x55668d0a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f763d400640 1 -- 172.21.15.71:0/96194066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668d1199c0 con 0x55668ccc62f0 2024-05-27T09:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f763d400640 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccc62f0 0x55668d0a4050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f762c00fcb0 tx=0x7f762c0093a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af1bb5a9cbfb41f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f761ea00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f761ea00640 1 -- 172.21.15.71:0/96194066 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c033020 con 0x55668ccc62f0 2024-05-27T09:50:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f762c005340 con 0x55668ccc62f0 2024-05-27T09:50:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.998+0000 7f761ea00640 1 -- 172.21.15.71:0/96194066 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f762c00f640 con 0x55668ccc62f0 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f761ea00640 1 -- 172.21.15.71:0/96194066 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f762c01d050 con 0x55668ccc62f0 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 10 client.25967 fetch_fsmap learned FSMap version 28 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55668d11ac00 con 0x55668ccc62f0 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f761ea00640 1 -- 172.21.15.71:0/96194066 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f762c005340 con 0x55668ccc62f0 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f761ea00640 1 -- 172.21.15.71:0/96194066 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f762c02d040 con 0x55668ccc62f0 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 10 client.25967 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 10 client.25967 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 20 client.25967 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668cc831c0 0x55668d11d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 4 client.25967 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55668cffe2c0 con 0x55668cc831c0 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:46.999+0000 7f763ca00640 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668cc831c0 0x55668d11d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:47.000+0000 7f763ca00640 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668cc831c0 0x55668d11d1f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99d3c603d58df43 server_cookie=c3590a59080be198 in_seq=0 out_seq=0 2024-05-27T09:50:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:47.000+0000 7f761ea00640 10 client.25967 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:47.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:46 smithi071 ceph-mon[31451]: pgmap v93: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 1.2 MiB/s wr, 836 op/s 2024-05-27T09:50:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:46 smithi072 ceph-mon[35951]: pgmap v93: 97 pgs: 97 active+clean; 29 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 1.2 MiB/s wr, 836 op/s 2024-05-27T09:50:48.087 INFO:tasks.workunit.client.0.smithi071.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-05-27T09:50:48.087 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether ln -s works... yes 2024-05-27T09:50:48.115 INFO:tasks.workunit.client.0.smithi071.stdout:checking the maximum length of command line arguments... 1572864 2024-05-27T09:50:48.125 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-27T09:50:48.126 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-27T09:50:48.126 INFO:tasks.workunit.client.0.smithi071.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-05-27T09:50:48.126 INFO:tasks.workunit.client.0.smithi071.stdout:checking for objdump... objdump 2024-05-27T09:50:48.127 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to recognize dependent libraries... pass_all 2024-05-27T09:50:48.128 INFO:tasks.workunit.client.0.smithi071.stdout:checking for dlltool... no 2024-05-27T09:50:48.128 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-27T09:50:48.129 INFO:tasks.workunit.client.0.smithi071.stdout:checking for ar... ar 2024-05-27T09:50:48.290 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-27T09:50:48.291 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:50:48.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:48 smithi071 ceph-mon[31451]: pgmap v94: 97 pgs: 97 active+clean; 39 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 1.17k op/s 2024-05-27T09:50:48.852 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.989+0000 7f761ea00640 1 -- 172.21.15.71:0/96194066 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55668cffe2c0 con 0x55668cc831c0 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.989+0000 7f761ea00640 10 client.25967 handle_command_reply: tid=0 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.989+0000 7f7646da7740 1 client.25967 shutdown 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.989+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccc62f0 msgr2=0x55668d0a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.989+0000 7f7646da7740 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccc62f0 0x55668d0a4050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f762c00fcb0 tx=0x7f762c0093a0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 shutdown_connections 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55668cc831c0 0x55668d11d1f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668ccef1b0 0x55668d0a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55668ccce4d0 0x55668d0a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 --2- 172.21.15.71:0/96194066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55668ccc62f0 0x55668d0a4050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f761ea00640 0 client.25967 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 >> 172.21.15.71:0/96194066 conn(0x55668cce3300 msgr2=0x55668d08cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 shutdown_connections 2024-05-27T09:50:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 1 -- 172.21.15.71:0/96194066 wait complete. 2024-05-27T09:50:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.990+0000 7f7646da7740 20 client.25967 trim_cache size 0 max 16384 2024-05-27T09:50:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:50:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:50:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:50:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f76200b29d0 msgr2=0x7f76200b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f76200b29d0 0x7f76200b4ee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7624005f70 tx=0x7f7624005780 comp rx=0 tx=0).stop 2024-05-27T09:50:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 msgr2=0x7f763819ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f763819ee90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f763000eb10 tx=0x7f763000c2d0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 shutdown_connections 2024-05-27T09:50:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f76200b29d0 0x7f76200b4ee0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7638109f50 0x7f763819ee90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7638109ab0 0x7f763819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 --2- 172.21.15.71:0/2945294634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104200 0x7f763819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 >> 172.21.15.71:0/2945294634 conn(0x7f7638079140 msgr2=0x7f7638102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 shutdown_connections 2024-05-27T09:50:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:50:48.991+0000 7f763e800640 1 -- 172.21.15.71:0/2945294634 wait complete. 2024-05-27T09:50:48.996 INFO:tasks.workunit.client.0.smithi071.stdout:checking for archiver @FILE support... @ 2024-05-27T09:50:48.997 INFO:tasks.workunit.client.0.smithi071.stdout:checking for strip... strip 2024-05-27T09:50:48.997 INFO:tasks.workunit.client.0.smithi071.stdout:checking for ranlib... ranlib 2024-05-27T09:50:48.998 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gawk... gawk 2024-05-27T09:50:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:48 smithi072 ceph-mon[35951]: pgmap v94: 97 pgs: 97 active+clean; 39 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 1.17k op/s 2024-05-27T09:50:49.193 INFO:tasks.workunit.client.0.smithi071.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-05-27T09:50:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sysroot... no 2024-05-27T09:50:49.216 INFO:tasks.workunit.client.0.smithi071.stdout:checking for a working dd... /usr/bin/dd 2024-05-27T09:50:49.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:48 smithi122 ceph-mon[36436]: pgmap v94: 97 pgs: 97 active+clean; 39 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 1.17k op/s 2024-05-27T09:50:49.232 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-05-27T09:50:49.295 INFO:tasks.workunit.client.0.smithi071.stdout:checking for mt... no 2024-05-27T09:50:49.322 INFO:tasks.workunit.client.0.smithi071.stdout:checking if : is a manifest tool... no 2024-05-27T09:50:49.520 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to run the C preprocessor... gcc -E 2024-05-27T09:50:49.882 INFO:tasks.workunit.client.0.smithi071.stdout:checking for ANSI C header files... yes 2024-05-27T09:50:49.960 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/types.h... yes 2024-05-27T09:50:50.055 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/stat.h... yes 2024-05-27T09:50:50.151 INFO:tasks.workunit.client.0.smithi071.stdout:checking for stdlib.h... yes 2024-05-27T09:50:50.256 INFO:tasks.workunit.client.0.smithi071.stdout:checking for string.h... yes 2024-05-27T09:50:50.354 INFO:tasks.workunit.client.0.smithi071.stdout:checking for memory.h... yes 2024-05-27T09:50:50.446 INFO:tasks.workunit.client.0.smithi071.stdout:checking for strings.h... yes 2024-05-27T09:50:50.534 INFO:tasks.workunit.client.0.smithi071.stdout:checking for inttypes.h... yes 2024-05-27T09:50:50.612 INFO:tasks.workunit.client.0.smithi071.stdout:checking for stdint.h... yes 2024-05-27T09:50:50.705 INFO:tasks.workunit.client.0.smithi071.stdout:checking for unistd.h... yes 2024-05-27T09:50:50.801 INFO:tasks.workunit.client.0.smithi071.stdout:checking for dlfcn.h... yes 2024-05-27T09:50:50.814 INFO:tasks.workunit.client.0.smithi071.stdout:checking for objdir... .libs 2024-05-27T09:50:51.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:50 smithi071 ceph-mon[31451]: pgmap v95: 97 pgs: 97 active+clean; 39 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 1.9 MiB/s wr, 436 op/s 2024-05-27T09:50:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:50 smithi072 ceph-mon[35951]: pgmap v95: 97 pgs: 97 active+clean; 39 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 1.9 MiB/s wr, 436 op/s 2024-05-27T09:50:51.048 INFO:tasks.workunit.client.0.smithi071.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-27T09:50:51.049 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-27T09:50:51.151 INFO:tasks.workunit.client.0.smithi071.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-27T09:50:51.229 INFO:tasks.workunit.client.0.smithi071.stdout:checking if gcc static flag -static works... no 2024-05-27T09:50:51.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:50 smithi122 ceph-mon[36436]: pgmap v95: 97 pgs: 97 active+clean; 39 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 1.9 MiB/s wr, 436 op/s 2024-05-27T09:50:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 -- 172.21.15.71:0/2177681723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0390105e20 msgr2=0x7f039010e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 --2- 172.21.15.71:0/2177681723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0390105e20 0x7f039010e370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0378009990 tx=0x7f0378009ca0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 -- 172.21.15.71:0/2177681723 shutdown_connections 2024-05-27T09:50:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 --2- 172.21.15.71:0/2177681723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039010e900 0x7f0390110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 --2- 172.21.15.71:0/2177681723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03901054d0 0x7f03901058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 --2- 172.21.15.71:0/2177681723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0390105e20 0x7f039010e370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 -- 172.21.15.71:0/2177681723 >> 172.21.15.71:0/2177681723 conn(0x7f03900fede0 msgr2=0x7f0390101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:51.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 -- 172.21.15.71:0/2177681723 shutdown_connections 2024-05-27T09:50:51.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.250+0000 7f0395c00700 1 -- 172.21.15.71:0/2177681723 wait complete. 2024-05-27T09:50:51.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 Processor -- start 2024-05-27T09:50:51.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 -- start start 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03901054d0 0x7f03901031c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0390105e20 0x7f0390103700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f039010e900 0x7f0390103c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03901144a0 con 0x7f03901054d0 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0390114320 con 0x7f039010e900 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.252+0000 7f0395c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0390114620 con 0x7f0390105e20 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038ea00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03901054d0 0x7f03901031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f039010e900 0x7f0390103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f039010e900 0x7f0390103c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45360/0 (socket says 172.21.15.71:45360) 2024-05-27T09:50:51.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 -- 172.21.15.71:0/3032285939 learned_addr learned my addr 172.21.15.71:0/3032285939 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f0387e00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0390105e20 0x7f0390103700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 -- 172.21.15.71:0/3032285939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0390105e20 msgr2=0x7f0390103700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0390105e20 0x7f0390103700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 -- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03901054d0 msgr2=0x7f03901031c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03901054d0 0x7f03901031c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.253+0000 7f038f400700 1 -- 172.21.15.71:0/3032285939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03901a91f0 con 0x7f039010e900 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.254+0000 7f038f400700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f039010e900 0x7f0390103c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f038800ef30 tx=0x7f038800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.254+0000 7f0387400700 1 -- 172.21.15.71:0/3032285939 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880092e0 con 0x7f039010e900 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.254+0000 7f0387400700 1 -- 172.21.15.71:0/3032285939 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0388004bb0 con 0x7f039010e900 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.254+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03901a9480 con 0x7f039010e900 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.254+0000 7f0387400700 1 -- 172.21.15.71:0/3032285939 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0388004020 con 0x7f039010e900 2024-05-27T09:50:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.254+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03901a99c0 con 0x7f039010e900 2024-05-27T09:50:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.255+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03900512b0 con 0x7f039010e900 2024-05-27T09:50:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.258+0000 7f0387400700 1 -- 172.21.15.71:0/3032285939 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f038801b030 con 0x7f039010e900 2024-05-27T09:50:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.259+0000 7f0387400700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03740b2a70 0x7f03740b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.260+0000 7f0387400700 1 -- 172.21.15.71:0/3032285939 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f03880e2180 con 0x7f039010e900 2024-05-27T09:50:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.260+0000 7f038ea00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03740b2a70 0x7f03740b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.260+0000 7f038ea00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03740b2a70 0x7f03740b4f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f039006d140 tx=0x7f0380009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.261+0000 7f0387400700 1 -- 172.21.15.71:0/3032285939 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0388022020 con 0x7f039010e900 2024-05-27T09:50:51.343 INFO:tasks.workunit.client.0.smithi071.stdout:checking if gcc supports -c -o file.o... yes 2024-05-27T09:50:51.343 INFO:tasks.workunit.client.0.smithi071.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-27T09:50:51.364 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-27T09:50:51.452 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether -lc should be explicitly linked in... no 2024-05-27T09:50:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.566+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f039002e7a0 con 0x7f039010e900 2024-05-27T09:50:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.568+0000 7f0387400700 1 -- 172.21.15.71:0/3032285939 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11858 (secure 0 0 0) 0x7f0388010040 con 0x7f039010e900 2024-05-27T09:50:51.569 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:50:51.569 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:50:40.326047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:50:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03740b2a70 msgr2=0x7f03740b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03740b2a70 0x7f03740b4f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f039006d140 tx=0x7f0380009260 comp rx=0 tx=0).stop 2024-05-27T09:50:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f039010e900 msgr2=0x7f0390103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f039010e900 0x7f0390103c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f038800ef30 tx=0x7f038800c3a0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 shutdown_connections 2024-05-27T09:50:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03740b2a70 0x7f03740b4f80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f039010e900 0x7f0390103c40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03901054d0 0x7f03901031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 --2- 172.21.15.71:0/3032285939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0390105e20 0x7f0390103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 >> 172.21.15.71:0/3032285939 conn(0x7f03900fede0 msgr2=0x7f03900ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 shutdown_connections 2024-05-27T09:50:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:51.571+0000 7f0395c00700 1 -- 172.21.15.71:0/3032285939 wait complete. 2024-05-27T09:50:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 28 2024-05-27T09:50:51.594 INFO:tasks.workunit.client.0.smithi071.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-27T09:50:51.595 INFO:tasks.workunit.client.0.smithi071.stdout:checking how to hardcode library paths into programs... immediate 2024-05-27T09:50:51.599 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether stripping libraries is possible... yes 2024-05-27T09:50:51.599 INFO:tasks.workunit.client.0.smithi071.stdout:checking if libtool supports shared libraries... yes 2024-05-27T09:50:51.599 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether to build shared libraries... yes 2024-05-27T09:50:51.599 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether to build static libraries... yes 2024-05-27T09:50:51.617 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gcc... (cached) gcc 2024-05-27T09:50:51.680 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-27T09:50:51.680 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-27T09:50:51.680 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-27T09:50:51.680 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gmake... /usr/bin/gmake 2024-05-27T09:50:51.681 INFO:tasks.workunit.client.0.smithi071.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-05-27T09:50:51.681 INFO:tasks.workunit.client.0.smithi071.stdout:checking for tar... /bin/tar 2024-05-27T09:50:51.681 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gzip... /bin/gzip 2024-05-27T09:50:51.734 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether gcc -MM is supported... yes 2024-05-27T09:50:51.736 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sort... /bin/sort 2024-05-27T09:50:51.736 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether ln -s works... yes 2024-05-27T09:50:51.739 INFO:tasks.workunit.client.0.smithi071.stdout:checking for rpm... /bin/rpm 2024-05-27T09:50:51.751 INFO:tasks.workunit.client.0.smithi071.stdout:checking for rpmbuild... no 2024-05-27T09:50:51.870 INFO:tasks.workunit.client.0.smithi071.stdout:checking assert.h usability... yes 2024-05-27T09:50:51.910 INFO:tasks.workunit.client.0.smithi071.stdout:checking assert.h presence... yes 2024-05-27T09:50:51.910 INFO:tasks.workunit.client.0.smithi071.stdout:checking for assert.h... yes 2024-05-27T09:50:51.985 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:51 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3032285939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:50:52.010 INFO:tasks.workunit.client.0.smithi071.stdout:checking bstring.h usability... no 2024-05-27T09:50:52.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:51 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3032285939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:50:52.058 INFO:tasks.workunit.client.0.smithi071.stdout:checking bstring.h presence... no 2024-05-27T09:50:52.058 INFO:tasks.workunit.client.0.smithi071.stdout:checking for bstring.h... no 2024-05-27T09:50:52.138 INFO:tasks.workunit.client.0.smithi071.stdout:checking libgen.h usability... yes 2024-05-27T09:50:52.175 INFO:tasks.workunit.client.0.smithi071.stdout:checking libgen.h presence... yes 2024-05-27T09:50:52.175 INFO:tasks.workunit.client.0.smithi071.stdout:checking for libgen.h... yes 2024-05-27T09:50:52.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:51 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3032285939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:50:52.310 INFO:tasks.workunit.client.0.smithi071.stdout:checking dirent.h usability... yes 2024-05-27T09:50:52.347 INFO:tasks.workunit.client.0.smithi071.stdout:checking dirent.h presence... yes 2024-05-27T09:50:52.349 INFO:tasks.workunit.client.0.smithi071.stdout:checking for dirent.h... yes 2024-05-27T09:50:52.448 INFO:tasks.workunit.client.0.smithi071.stdout:checking errno.h usability... yes 2024-05-27T09:50:52.474 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-05-27T09:50:52.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-05-27T09:50:52.485 INFO:tasks.workunit.client.0.smithi071.stdout:checking errno.h presence... yes 2024-05-27T09:50:52.485 INFO:tasks.workunit.client.0.smithi071.stdout:checking for errno.h... yes 2024-05-27T09:50:52.578 INFO:tasks.workunit.client.0.smithi071.stdout:checking malloc.h usability... yes 2024-05-27T09:50:52.616 INFO:tasks.workunit.client.0.smithi071.stdout:checking malloc.h presence... yes 2024-05-27T09:50:52.616 INFO:tasks.workunit.client.0.smithi071.stdout:checking for malloc.h... yes 2024-05-27T09:50:52.717 INFO:tasks.workunit.client.0.smithi071.stdout:checking uuid.h usability... no 2024-05-27T09:50:52.774 INFO:tasks.workunit.client.0.smithi071.stdout:checking uuid.h presence... no 2024-05-27T09:50:52.774 INFO:tasks.workunit.client.0.smithi071.stdout:checking for uuid.h... no 2024-05-27T09:50:52.860 INFO:tasks.workunit.client.0.smithi071.stdout:checking uuid/uuid.h usability... yes 2024-05-27T09:50:52.893 INFO:tasks.workunit.client.0.smithi071.stdout:checking uuid/uuid.h presence... yes 2024-05-27T09:50:52.894 INFO:tasks.workunit.client.0.smithi071.stdout:checking for uuid/uuid.h... yes 2024-05-27T09:50:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:50:52.998 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/uuid.h usability... no 2024-05-27T09:50:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:52 smithi071 ceph-mon[31451]: pgmap v96: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 786 op/s 2024-05-27T09:50:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:52 smithi072 ceph-mon[35951]: pgmap v96: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 786 op/s 2024-05-27T09:50:53.047 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/uuid.h presence... no 2024-05-27T09:50:53.048 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/uuid.h... no 2024-05-27T09:50:53.150 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/file.h usability... yes 2024-05-27T09:50:53.188 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/file.h presence... yes 2024-05-27T09:50:53.188 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/file.h... yes 2024-05-27T09:50:53.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:52 smithi122 ceph-mon[36436]: pgmap v96: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 786 op/s 2024-05-27T09:50:53.302 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/fcntl.h usability... yes 2024-05-27T09:50:53.342 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/fcntl.h presence... yes 2024-05-27T09:50:53.342 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/fcntl.h... yes 2024-05-27T09:50:53.446 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/syssgi.h usability... no 2024-05-27T09:50:53.498 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/syssgi.h presence... no 2024-05-27T09:50:53.499 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/syssgi.h... no 2024-05-27T09:50:53.763 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/param.h usability... yes 2024-05-27T09:50:53.809 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/param.h presence... yes 2024-05-27T09:50:53.809 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/param.h... yes 2024-05-27T09:50:53.838 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/stat.h... (cached) yes 2024-05-27T09:50:53.925 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/statvfs.h usability... yes 2024-05-27T09:50:53.961 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/statvfs.h presence... yes 2024-05-27T09:50:53.961 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/statvfs.h... yes 2024-05-27T09:50:54.061 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/time.h usability... yes 2024-05-27T09:50:54.099 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/time.h presence... yes 2024-05-27T09:50:54.099 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/time.h... yes 2024-05-27T09:50:54.238 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/ioctl.h usability... yes 2024-05-27T09:50:54.278 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/ioctl.h presence... yes 2024-05-27T09:50:54.279 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/ioctl.h... yes 2024-05-27T09:50:54.402 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/wait.h usability... yes 2024-05-27T09:50:54.446 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/wait.h presence... yes 2024-05-27T09:50:54.446 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/wait.h... yes 2024-05-27T09:50:54.476 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/types.h... (cached) yes 2024-05-27T09:50:54.490 INFO:tasks.workunit.client.0.smithi071.stdout:checking for strings.h... (cached) yes 2024-05-27T09:50:54.583 INFO:tasks.workunit.client.0.smithi071.stdout:checking err.h usability... yes 2024-05-27T09:50:54.617 INFO:tasks.workunit.client.0.smithi071.stdout:checking err.h presence... yes 2024-05-27T09:50:54.617 INFO:tasks.workunit.client.0.smithi071.stdout:checking for err.h... yes 2024-05-27T09:50:54.699 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/falloc.h usability... yes 2024-05-27T09:50:54.734 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/falloc.h presence... yes 2024-05-27T09:50:54.734 INFO:tasks.workunit.client.0.smithi071.stdout:checking for linux/falloc.h... yes 2024-05-27T09:50:54.832 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-27T09:50:54.889 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-27T09:50:54.889 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-27T09:50:54.983 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-27T09:50:55.000 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:54 smithi071 ceph-mon[31451]: pgmap v97: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.8 MiB/s wr, 680 op/s 2024-05-27T09:50:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:54 smithi072 ceph-mon[35951]: pgmap v97: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.8 MiB/s wr, 680 op/s 2024-05-27T09:50:55.039 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-27T09:50:55.039 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-27T09:50:55.125 INFO:tasks.workunit.client.0.smithi071.stdout:checking xfs/platform_defs.h usability... no 2024-05-27T09:50:55.185 INFO:tasks.workunit.client.0.smithi071.stdout:checking xfs/platform_defs.h presence... no 2024-05-27T09:50:55.185 INFO:tasks.workunit.client.0.smithi071.stdout:checking for xfs/platform_defs.h... no 2024-05-27T09:50:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:54 smithi122 ceph-mon[36436]: pgmap v97: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.8 MiB/s wr, 680 op/s 2024-05-27T09:50:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 -- 172.21.15.71:0/675800698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 msgr2=0x7f0734110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 --2- 172.21.15.71:0/675800698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 0x7f0734110090 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f072c009f90 tx=0x7f072c00b330 comp rx=0 tx=0).stop 2024-05-27T09:50:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 -- 172.21.15.71:0/675800698 shutdown_connections 2024-05-27T09:50:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 --2- 172.21.15.71:0/675800698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 0x7f0734110090 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 --2- 172.21.15.71:0/675800698 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07341034b0 0x7f07341038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 --2- 172.21.15.71:0/675800698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 0x7f07341081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 -- 172.21.15.71:0/675800698 >> 172.21.15.71:0/675800698 conn(0x7f07340fedb0 msgr2=0x7f07341011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 -- 172.21.15.71:0/675800698 shutdown_connections 2024-05-27T09:50:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.255+0000 7f073c400700 1 -- 172.21.15.71:0/675800698 wait complete. 2024-05-27T09:50:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.256+0000 7f073c400700 1 Processor -- start 2024-05-27T09:50:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073c400700 1 -- start start 2024-05-27T09:50:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073c400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07341034b0 0x7f073419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073c400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 0x7f073419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073c400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 0x7f07341a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073c400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07341133b0 con 0x7f0734107de0 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073c400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0734113230 con 0x7f0734108730 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073c400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0734113530 con 0x7f07341034b0 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f0739000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 0x7f073419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f073a400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 0x7f07341a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f0739000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 0x7f073419d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35734/0 (socket says 172.21.15.71:35734) 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f0739000700 1 -- 172.21.15.71:0/802926396 learned_addr learned my addr 172.21.15.71:0/802926396 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.257+0000 7f0739a00700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07341034b0 0x7f073419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f073a400700 1 -- 172.21.15.71:0/802926396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07341034b0 msgr2=0x7f073419d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f073a400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07341034b0 0x7f073419d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f073a400700 1 -- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 msgr2=0x7f073419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f073a400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 0x7f073419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f073a400700 1 -- 172.21.15.71:0/802926396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07341a1f10 con 0x7f0734108730 2024-05-27T09:50:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f0739000700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 0x7f073419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f073a400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 0x7f07341a1870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f072c00b6c0 tx=0x7f072c00cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.258+0000 7f0732000700 1 -- 172.21.15.71:0/802926396 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c021070 con 0x7f0734108730 2024-05-27T09:50:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.259+0000 7f0732000700 1 -- 172.21.15.71:0/802926396 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072c007d60 con 0x7f0734108730 2024-05-27T09:50:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.259+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07341a21a0 con 0x7f0734108730 2024-05-27T09:50:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.259+0000 7f0732000700 1 -- 172.21.15.71:0/802926396 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c005040 con 0x7f0734108730 2024-05-27T09:50:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.259+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07341a9b20 con 0x7f0734108730 2024-05-27T09:50:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.262+0000 7f0732000700 1 -- 172.21.15.71:0/802926396 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f072c024070 con 0x7f0734108730 2024-05-27T09:50:55.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.264+0000 7f0732000700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f071c0b2a70 0x7f071c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.264+0000 7f0732000700 1 -- 172.21.15.71:0/802926396 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f072c00f020 con 0x7f0734108730 2024-05-27T09:50:55.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.264+0000 7f0739a00700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f071c0b2a70 0x7f071c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.265+0000 7f074afe6b80 1 Processor -- start 2024-05-27T09:50:55.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.265+0000 7f074afe6b80 1 -- start start 2024-05-27T09:50:55.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.265+0000 7f0739a00700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f071c0b2a70 0x7f071c0b4f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0728009c60 tx=0x7f0728009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.265+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c171bb80 0x5631c17b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.265+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.265+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c17af670 0x5631c17afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f074afe6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5631c16dcfd0 con 0x5631c17af670 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f074afe6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5631c16ccb70 con 0x5631c171bb80 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f074afe6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631c16d0bb0 con 0x5631c162ffd0 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c171bb80 0x5631c17b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c171bb80 0x5631c17b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49824/0 (socket says 172.21.15.71:49824) 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 -- 172.21.15.71:0/3522822053 learned_addr learned my addr 172.21.15.71:0/3522822053 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739000700 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f073a400700 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c17af670 0x5631c17afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 -- 172.21.15.71:0/3522822053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 msgr2=0x5631c17b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 -- 172.21.15.71:0/3522822053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c17af670 msgr2=0x5631c17afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c17af670 0x5631c17afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f0739a00700 1 -- 172.21.15.71:0/3522822053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c16955b0 con 0x5631c171bb80 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.266+0000 7f073a400700 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c17af670 0x5631c17afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.267+0000 7f0739a00700 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c171bb80 0x5631c17b55c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f072800e4e0 tx=0x7f0728014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa4cec77b764b77 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.267+0000 7f0726a00700 1 -- 172.21.15.71:0/3522822053 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072800ee00 con 0x5631c171bb80 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.267+0000 7f0726a00700 1 -- 172.21.15.71:0/3522822053 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072801c8c0 con 0x5631c171bb80 2024-05-27T09:50:55.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.267+0000 7f0726a00700 1 -- 172.21.15.71:0/3522822053 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072801da20 con 0x5631c171bb80 2024-05-27T09:50:55.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 -- 172.21.15.71:0/3522822053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c171bb80 msgr2=0x5631c17b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:55.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c171bb80 0x5631c17b55c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f072800e4e0 tx=0x7f0728014000 comp rx=0 tx=0).stop 2024-05-27T09:50:55.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 -- 172.21.15.71:0/3522822053 shutdown_connections 2024-05-27T09:50:55.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c17af670 0x5631c17afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c171bb80 0x5631c17b55c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 --2- 172.21.15.71:0/3522822053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 -- 172.21.15.71:0/3522822053 >> 172.21.15.71:0/3522822053 conn(0x5631c16c9520 msgr2=0x5631c17aa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 -- 172.21.15.71:0/3522822053 shutdown_connections 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.268+0000 7f074afe6b80 1 -- 172.21.15.71:0/3522822053 wait complete. 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 -- start start 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 Processor -- start 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5631c15d3130 con 0x5631c171bb80 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5631c166d8f0 con 0x5631c17af670 2024-05-27T09:50:55.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.269+0000 7f074afe6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631c17b0460 con 0x5631c162ffd0 2024-05-27T09:50:55.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f074afe6b80 10 client.0 _ll_register_callbacks cb 0x5631c1676e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:55.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:51734/0 (socket says 172.21.15.71:51734) 2024-05-27T09:50:55.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 -- 172.21.15.71:0/651005944 learned_addr learned my addr 172.21.15.71:0/651005944 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f073a400700 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 -- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 msgr2=0x5631c17b9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17b9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 -- 172.21.15.71:0/651005944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 msgr2=0x5631c17b9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f0739a00700 1 -- 172.21.15.71:0/651005944 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c161ca60 con 0x5631c162ffd0 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.270+0000 7f073a400700 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17b9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f0739a00700 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b9420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0728009e90 tx=0x7f072800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac1b4a53b720729 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f071b400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f071b400700 1 -- 172.21.15.71:0/651005944 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728033060 con 0x5631c162ffd0 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f072801c8c0 con 0x5631c162ffd0 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f071b400700 1 -- 172.21.15.71:0/651005944 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f072801c6a0 con 0x5631c162ffd0 2024-05-27T09:50:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f071b400700 1 -- 172.21.15.71:0/651005944 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f072801ca70 con 0x5631c162ffd0 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f074afe6b80 10 client.26017 fetch_fsmap learned FSMap version 28 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631c169d1f0 con 0x5631c162ffd0 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.271+0000 7f071b400700 1 -- 172.21.15.71:0/651005944 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072801c8c0 con 0x5631c162ffd0 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f071b400700 1 -- 172.21.15.71:0/651005944 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f0728003830 con 0x5631c162ffd0 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f074afe6b80 10 client.26017 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f074afe6b80 10 client.26017 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f074afe6b80 20 client.26017 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f074afe6b80 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c17c9050 0x5631c17cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f074afe6b80 4 client.26017 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631c16def20 con 0x5631c17c9050 2024-05-27T09:50:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.272+0000 7f0739000700 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c17c9050 0x5631c17cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.276 INFO:tasks.workunit.client.0.smithi071.stdout:checking btrfs/ioctl.h usability... no 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.273+0000 7f0739000700 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c17c9050 0x5631c17cb470 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc3fa4acbbad936b server_cookie=f5b1a35cebf59e0a in_seq=0 out_seq=0 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.273+0000 7f071b400700 10 client.26017 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.273+0000 7f071b400700 1 -- 172.21.15.71:0/651005944 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5631c16def20 con 0x5631c17c9050 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.273+0000 7f071b400700 10 client.26017 handle_command_reply: tid=0 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 client.26017 shutdown 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 msgr2=0x5631c17b9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b9420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0728009e90 tx=0x7f072800ee70 comp rx=0 tx=0).stop 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 shutdown_connections 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c17c9050 0x5631c17cb470 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17b9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17b9420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f071b400700 0 client.26017 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 --2- 172.21.15.71:0/651005944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 >> 172.21.15.71:0/651005944 conn(0x5631c16c9520 msgr2=0x5631c17ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 shutdown_connections 2024-05-27T09:50:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 1 -- 172.21.15.71:0/651005944 wait complete. 2024-05-27T09:50:55.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.274+0000 7f074afe6b80 20 client.26017 trim_cache size 0 max 16384 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.296+0000 7f074afe6b80 1 Processor -- start 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f074afe6b80 1 -- start start 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c162ffd0 0x5631c17b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c17af670 0x5631c17c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f074afe6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07341b37e0 con 0x5631c171bb80 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f074afe6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f07341b1070 con 0x5631c162ffd0 2024-05-27T09:50:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f074afe6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f07341aeee0 con 0x5631c17af670 2024-05-27T09:50:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f0739a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c162ffd0 0x5631c17b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f0739a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c162ffd0 0x5631c17b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49840/0 (socket says 172.21.15.71:49840) 2024-05-27T09:50:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.297+0000 7f0739a00700 1 -- 172.21.15.71:0/1718385907 learned_addr learned my addr 172.21.15.71:0/1718385907 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0739000700 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f073a400700 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c17af670 0x5631c17c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0739a00700 1 -- 172.21.15.71:0/1718385907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c17af670 msgr2=0x5631c17c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0739a00700 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c17af670 0x5631c17c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0739a00700 1 -- 172.21.15.71:0/1718385907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 msgr2=0x5631c17b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0739a00700 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0739a00700 1 -- 172.21.15.71:0/1718385907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c17bc1d0 con 0x5631c162ffd0 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f073a400700 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c17af670 0x5631c17c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0739a00700 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c162ffd0 0x5631c17b3a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0728003df0 tx=0x7f072800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b8f23f5b6c8aba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.298+0000 7f0726000700 1 -- 172.21.15.71:0/1718385907 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728033070 con 0x5631c162ffd0 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.299+0000 7f0726000700 1 -- 172.21.15.71:0/1718385907 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072801cc10 con 0x5631c162ffd0 2024-05-27T09:50:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.299+0000 7f0726000700 1 -- 172.21.15.71:0/1718385907 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07280053c0 con 0x5631c162ffd0 2024-05-27T09:50:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.299+0000 7f074afe6b80 1 -- 172.21.15.71:0/1718385907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c162ffd0 msgr2=0x5631c17b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:50:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.299+0000 7f074afe6b80 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c162ffd0 0x5631c17b3a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0728003df0 tx=0x7f072800ed40 comp rx=0 tx=0).stop 2024-05-27T09:50:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 -- 172.21.15.71:0/1718385907 shutdown_connections 2024-05-27T09:50:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c17af670 0x5631c17c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c162ffd0 0x5631c17b3a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 --2- 172.21.15.71:0/1718385907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 -- 172.21.15.71:0/1718385907 >> 172.21.15.71:0/1718385907 conn(0x5631c16c9520 msgr2=0x5631c17b9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:50:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 -- 172.21.15.71:0/1718385907 shutdown_connections 2024-05-27T09:50:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 -- 172.21.15.71:0/1718385907 wait complete. 2024-05-27T09:50:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.300+0000 7f074afe6b80 1 -- start start 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.301+0000 7f074afe6b80 1 Processor -- start 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.301+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.301+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.301+0000 7f074afe6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17be460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.301+0000 7f074afe6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07341af530 con 0x5631c171bb80 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f074afe6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f07341b09a0 con 0x5631c17af670 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f074afe6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f07341afc00 con 0x5631c162ffd0 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f074afe6b80 10 client.0 _ll_register_callbacks cb 0x5631c1676e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f0739a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f0739000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17be460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49844/0 (socket says 172.21.15.71:49844) 2024-05-27T09:50:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 -- 172.21.15.71:0/2439783656 learned_addr learned my addr 172.21.15.71:0/2439783656 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 -- 172.21.15.71:0/2439783656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 msgr2=0x5631c17c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 -- 172.21.15.71:0/2439783656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 msgr2=0x5631c17c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.302+0000 7f073a400700 1 -- 172.21.15.71:0/2439783656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c17c1fc0 con 0x5631c17af670 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f073a400700 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17be460 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f072c009840 tx=0x7f072c007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e76402080ff66dcc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f071b400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f071b400700 1 -- 172.21.15.71:0/2439783656 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c0aa8f0 con 0x5631c17af670 2024-05-27T09:50:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f071b400700 1 -- 172.21.15.71:0/2439783656 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f072c007ac0 con 0x5631c17af670 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f072801cc10 con 0x5631c17af670 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f071b400700 1 -- 172.21.15.71:0/2439783656 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f072c0ab4e0 con 0x5631c17af670 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f074afe6b80 10 client.25991 fetch_fsmap learned FSMap version 28 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631c1833d80 con 0x5631c17af670 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f071b400700 1 -- 172.21.15.71:0/2439783656 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072801cc10 con 0x5631c17af670 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.303+0000 7f071b400700 1 -- 172.21.15.71:0/2439783656 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f072c0c4030 con 0x5631c17af670 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f074afe6b80 10 client.25991 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f074afe6b80 10 client.25991 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f074afe6b80 20 client.25991 populate_metadata read hostname 'smithi071' 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f074afe6b80 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c1834560 0x5631c1836980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f074afe6b80 4 client.25991 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5631c17a28a0 con 0x5631c1834560 2024-05-27T09:50:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f0739a00700 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c1834560 0x5631c1836980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:50:55.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f0739a00700 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c1834560 0x5631c1836980 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db49697074307d71 server_cookie=d268f6c208a00265 in_seq=0 out_seq=0 2024-05-27T09:50:55.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:50:55.304+0000 7f071b400700 10 client.25991 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:50:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:56 smithi072 ceph-mon[35951]: pgmap v98: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.8 MiB/s wr, 680 op/s 2024-05-27T09:50:57.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:56 smithi122 ceph-mon[36436]: pgmap v98: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.8 MiB/s wr, 680 op/s 2024-05-27T09:50:57.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:56 smithi071 ceph-mon[31451]: pgmap v98: 97 pgs: 97 active+clean; 32 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.8 MiB/s wr, 680 op/s 2024-05-27T09:50:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:50:58 smithi072 ceph-mon[35951]: pgmap v99: 97 pgs: 97 active+clean; 34 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 2.0 MiB/s wr, 690 op/s 2024-05-27T09:50:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:50:58 smithi122 ceph-mon[36436]: pgmap v99: 97 pgs: 97 active+clean; 34 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 2.0 MiB/s wr, 690 op/s 2024-05-27T09:50:59.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:50:58 smithi071 ceph-mon[31451]: pgmap v99: 97 pgs: 97 active+clean; 34 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 2.0 MiB/s wr, 690 op/s 2024-05-27T09:51:00.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f071b400700 1 -- 172.21.15.71:0/2439783656 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5631c17a28a0 con 0x5631c1834560 2024-05-27T09:51:00.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f071b400700 10 client.25991 handle_command_reply: tid=0 2024-05-27T09:51:00.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 client.25991 shutdown 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 msgr2=0x5631c17be460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17be460 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f072c009840 tx=0x7f072c007f10 comp rx=0 tx=0).stop 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 shutdown_connections 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631c1834560 0x5631c1836980 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631c17af670 0x5631c17be460 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631c162ffd0 0x5631c17c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 --2- 172.21.15.71:0/2439783656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631c171bb80 0x5631c17c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 >> 172.21.15.71:0/2439783656 conn(0x5631c16c9520 msgr2=0x5631c17b9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.457+0000 7f071b400700 0 client.25991 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.458+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 shutdown_connections 2024-05-27T09:51:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.458+0000 7f074afe6b80 1 -- 172.21.15.71:0/2439783656 wait complete. 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.458+0000 7f074afe6b80 20 client.25991 trim_cache size 0 max 16384 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 28, 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 6, 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stdout: "78c79bd9": { 2024-05-27T09:51:00.460 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 6, 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 130.0, 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:51:00.461 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:51:00.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:00.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:00.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:00.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:00.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:00.462 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.459+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f071c0b2a70 msgr2=0x7f071c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f071c0b2a70 0x7f071c0b4f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0728009c60 tx=0x7f0728009260 comp rx=0 tx=0).stop 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 msgr2=0x7f07341a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 0x7f07341a1870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f072c00b6c0 tx=0x7f072c00cc30 comp rx=0 tx=0).stop 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 shutdown_connections 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f071c0b2a70 0x7f071c0b4f80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0734108730 0x7f07341a1870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07341034b0 0x7f073419d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 --2- 172.21.15.71:0/802926396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0734107de0 0x7f073419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 >> 172.21.15.71:0/802926396 conn(0x7f07340fedb0 msgr2=0x7f073406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 shutdown_connections 2024-05-27T09:51:00.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:00.460+0000 7f073c400700 1 -- 172.21.15.71:0/802926396 wait complete. 2024-05-27T09:51:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:00 smithi072 ceph-mon[35951]: pgmap v100: 97 pgs: 97 active+clean; 34 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 904 KiB/s wr, 359 op/s 2024-05-27T09:51:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:00 smithi122 ceph-mon[36436]: pgmap v100: 97 pgs: 97 active+clean; 34 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 904 KiB/s wr, 359 op/s 2024-05-27T09:51:01.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:00 smithi071 ceph-mon[31451]: pgmap v100: 97 pgs: 97 active+clean; 34 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 904 KiB/s wr, 359 op/s 2024-05-27T09:51:01.358 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '78c79bd9', quiesce took 13.1 seconds. Will release after: -3.0999999999999996 2024-05-27T09:51:01.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:51:01.842 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 -- 172.21.15.71:0/3215615828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 msgr2=0x7f4c20117920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 --2- 172.21.15.71:0/3215615828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c20117920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009ca0 tx=0x7f4c1802a950 comp rx=0 tx=0).stop 2024-05-27T09:51:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 -- 172.21.15.71:0/3215615828 shutdown_connections 2024-05-27T09:51:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 --2- 172.21.15.71:0/3215615828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c20117920 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 --2- 172.21.15.71:0/3215615828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c2010af10 0x7f4c2010b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 --2- 172.21.15.71:0/3215615828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c20110ba0 0x7f4c2010a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 -- 172.21.15.71:0/3215615828 >> 172.21.15.71:0/3215615828 conn(0x7f4c2006eda0 msgr2=0x7f4c2006f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 -- 172.21.15.71:0/3215615828 shutdown_connections 2024-05-27T09:51:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.218+0000 7f4c26600640 1 -- 172.21.15.71:0/3215615828 wait complete. 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.219+0000 7f4c26600640 1 Processor -- start 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.219+0000 7f4c26600640 1 -- start start 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c26600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c2010af10 0x7f4c201a3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c26600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c20110ba0 0x7f4c201a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c26600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c201a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c26600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2011c6a0 con 0x7f4c20115500 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c26600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2011c520 con 0x7f4c2010af10 2024-05-27T09:51:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c26600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2011c820 con 0x7f4c20110ba0 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c201a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c2010af10 0x7f4c201a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c201a7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35784/0 (socket says 172.21.15.71:35784) 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c1fe00640 1 -- 172.21.15.71:0/3292166409 learned_addr learned my addr 172.21.15.71:0/3292166409 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.220+0000 7f4c1ea00640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c20110ba0 0x7f4c201a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c1fe00640 1 -- 172.21.15.71:0/3292166409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c20110ba0 msgr2=0x7f4c201a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c20110ba0 0x7f4c201a35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c1fe00640 1 -- 172.21.15.71:0/3292166409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c2010af10 msgr2=0x7f4c201a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c2010af10 0x7f4c201a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c1fe00640 1 -- 172.21.15.71:0/3292166409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c201a7ec0 con 0x7f4c20115500 2024-05-27T09:51:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c1f400640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c2010af10 0x7f4c201a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c201a7880 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009dc0 tx=0x7f4c18003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c17e00640 1 -- 172.21.15.71:0/3292166409 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18034040 con 0x7f4c20115500 2024-05-27T09:51:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c17e00640 1 -- 172.21.15.71:0/3292166409 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c18003e50 con 0x7f4c20115500 2024-05-27T09:51:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.221+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c201a8150 con 0x7f4c20115500 2024-05-27T09:51:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.222+0000 7f4c17e00640 1 -- 172.21.15.71:0/3292166409 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18004600 con 0x7f4c20115500 2024-05-27T09:51:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.222+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201a8640 con 0x7f4c20115500 2024-05-27T09:51:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.225+0000 7f4c2d620740 1 Processor -- start 2024-05-27T09:51:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.225+0000 7f4c17e00640 1 -- 172.21.15.71:0/3292166409 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4c18037020 con 0x7f4c20115500 2024-05-27T09:51:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.225+0000 7f4c2d620740 1 -- start start 2024-05-27T09:51:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafeca6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafeca6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafeca7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c2d620740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bafec17b90 con 0x55bafe8e34d0 2024-05-27T09:51:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c2d620740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bafec07730 con 0x55bafe8db2f0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c2d620740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bafec0b770 con 0x55bafe9041b0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafeca6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafeca6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49882/0 (socket says 172.21.15.71:49882) 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c1f400640 1 -- 172.21.15.71:0/3400272209 learned_addr learned my addr 172.21.15.71:0/3400272209 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c1ea00640 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafeca7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.226+0000 7f4c1ea00640 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafeca6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c1f400640 1 -- 172.21.15.71:0/3400272209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 msgr2=0x55bafeca6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c1f400640 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafeca6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c1f400640 1 -- 172.21.15.71:0/3400272209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 msgr2=0x55bafeca7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c1f400640 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafeca7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c1f400640 1 -- 172.21.15.71:0/3400272209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bafeba08b0 con 0x55bafe8db2f0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c1f400640 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafeca6c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4c100114f0 tx=0x7f4c100119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d002ae4b8015da9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c14c00640 1 -- 172.21.15.71:0/3400272209 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1001e070 con 0x55bafe8db2f0 2024-05-27T09:51:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c14c00640 1 -- 172.21.15.71:0/3400272209 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c10011250 con 0x55bafe8db2f0 2024-05-27T09:51:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c14c00640 1 -- 172.21.15.71:0/3400272209 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10019930 con 0x55bafe8db2f0 2024-05-27T09:51:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.227+0000 7f4c17e00640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4c040b2950 0x7f4c040b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c17e00640 1 -- 172.21.15.71:0/3292166409 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4c18103190 con 0x7f4c20115500 2024-05-27T09:51:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c1ea00640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4c040b2950 0x7f4c040b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c2d620740 1 -- 172.21.15.71:0/3400272209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 msgr2=0x55bafeca6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c2d620740 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafeca6c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4c100114f0 tx=0x7f4c100119b0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c2d620740 1 -- 172.21.15.71:0/3400272209 shutdown_connections 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c2d620740 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafeca7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c2d620740 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafeca6c50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c2d620740 1 --2- 172.21.15.71:0/3400272209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafeca6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.228+0000 7f4c2d620740 1 -- 172.21.15.71:0/3400272209 >> 172.21.15.71:0/3400272209 conn(0x55bafe8f8300 msgr2=0x55bafeca3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.229+0000 7f4c2d620740 1 -- 172.21.15.71:0/3400272209 shutdown_connections 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.229+0000 7f4c1ea00640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4c040b2950 0x7f4c040b4e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c20116d90 tx=0x7f4c0c004730 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.229+0000 7f4c2d620740 1 -- 172.21.15.71:0/3400272209 wait complete. 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.229+0000 7f4c2d620740 1 -- start start 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.229+0000 7f4c2d620740 1 Processor -- start 2024-05-27T09:51:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8e34d0 0x55bafecb5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafecc10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c2d620740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bafe8ed790 con 0x55bafe9041b0 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c2d620740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bafebafbc0 con 0x55bafe8db2f0 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c2d620740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bafecb7da0 con 0x55bafe8e34d0 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c2d620740 10 client.0 _ll_register_callbacks cb 0x55bafeb8d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafecc10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8e34d0 0x55bafecb5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafecc10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35816/0 (socket says 172.21.15.71:35816) 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c1fe00640 1 -- 172.21.15.71:0/4267951499 learned_addr learned my addr 172.21.15.71:0/4267951499 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.230+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8e34d0 0x55bafecb5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:51804/0 (socket says 172.21.15.71:51804) 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c1fe00640 1 -- 172.21.15.71:0/4267951499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8e34d0 msgr2=0x55bafecb5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8e34d0 0x55bafecb5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c1fe00640 1 -- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 msgr2=0x55bafecb4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c1fe00640 1 -- 172.21.15.71:0/4267951499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bafe91c210 con 0x55bafe9041b0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c1f400640 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafecc10d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c180ca540 tx=0x7f4c18031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90df8c4b456b9079 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c09600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c09600640 1 -- 172.21.15.71:0/4267951499 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1802c040 con 0x55bafe9041b0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c09600640 1 -- 172.21.15.71:0/4267951499 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4c180c6840 con 0x55bafe9041b0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.231+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c10011250 con 0x55bafe9041b0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c09600640 1 -- 172.21.15.71:0/4267951499 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c180ca0c0 con 0x55bafe9041b0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 10 client.15882 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bafe9e8620 con 0x55bafe9041b0 2024-05-27T09:51:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c09600640 1 -- 172.21.15.71:0/4267951499 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c10011250 con 0x55bafe9041b0 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c09600640 1 -- 172.21.15.71:0/4267951499 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f4c1804d030 con 0x55bafe9041b0 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 10 client.15882 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 20 client.15882 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8c2d80 0x55bafecc70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 4 client.15882 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.232+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bafec19ae0 con 0x55bafe8c2d80 2024-05-27T09:51:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.233+0000 7f4c1f400640 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8c2d80 0x55bafecc70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.233+0000 7f4c1f400640 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8c2d80 0x55bafecc70b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7662e4c4d58c15 server_cookie=c80489f1a3e9d1f7 in_seq=0 out_seq=0 2024-05-27T09:51:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.233+0000 7f4c09600640 10 client.15882 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.234+0000 7f4c09600640 1 -- 172.21.15.71:0/4267951499 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55bafec19ae0 con 0x55bafe8c2d80 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.234+0000 7f4c09600640 10 client.15882 handle_command_reply: tid=0 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.234+0000 7f4c2d620740 1 client.15882 shutdown 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 msgr2=0x55bafecc10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafecc10d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c180ca540 tx=0x7f4c18031b00 comp rx=0 tx=0).stop 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 shutdown_connections 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8c2d80 0x55bafecc70b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafecc10d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8e34d0 0x55bafecb5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c09600640 0 client.15882 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 --2- 172.21.15.71:0/4267951499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 >> 172.21.15.71:0/4267951499 conn(0x55bafe8f8300 msgr2=0x55bafeca8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 shutdown_connections 2024-05-27T09:51:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 1 -- 172.21.15.71:0/4267951499 wait complete. 2024-05-27T09:51:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.235+0000 7f4c2d620740 20 client.15882 trim_cache size 0 max 16384 2024-05-27T09:51:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 Processor -- start 2024-05-27T09:51:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 -- start start 2024-05-27T09:51:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafecaeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafecaefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b8990 con 0x55bafe8e34d0 2024-05-27T09:51:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b6260 con 0x55bafe8db2f0 2024-05-27T09:51:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c2d620740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b40b0 con 0x55bafe9041b0 2024-05-27T09:51:02.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafecaeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafecaeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35832/0 (socket says 172.21.15.71:35832) 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c1ea00640 1 -- 172.21.15.71:0/912648075 learned_addr learned my addr 172.21.15.71:0/912648075 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c1f400640 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.252+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafecaefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c1f400640 1 -- 172.21.15.71:0/912648075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 msgr2=0x55bafecaefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c1f400640 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafecaefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c1f400640 1 -- 172.21.15.71:0/912648075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 msgr2=0x55bafecaeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c1f400640 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafecaeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c1f400640 1 -- 172.21.15.71:0/912648075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bafecb73e0 con 0x55bafe8db2f0 2024-05-27T09:51:02.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c1f400640 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb6530 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c1001c040 tx=0x7f4c10019570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32bea11e378e276 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c0be00640 1 -- 172.21.15.71:0/912648075 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1001e040 con 0x55bafe8db2f0 2024-05-27T09:51:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c0be00640 1 -- 172.21.15.71:0/912648075 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1002b070 con 0x55bafe8db2f0 2024-05-27T09:51:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.253+0000 7f4c0be00640 1 -- 172.21.15.71:0/912648075 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10019860 con 0x55bafe8db2f0 2024-05-27T09:51:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 -- 172.21.15.71:0/912648075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 msgr2=0x55bafecb6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb6530 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c1001c040 tx=0x7f4c10019570 comp rx=0 tx=0).stop 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 -- 172.21.15.71:0/912648075 shutdown_connections 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe9041b0 0x55bafecaefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe8e34d0 0x55bafecaeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 --2- 172.21.15.71:0/912648075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8db2f0 0x55bafecb6530 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 -- 172.21.15.71:0/912648075 >> 172.21.15.71:0/912648075 conn(0x55bafe8f8300 msgr2=0x55bafeca7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 -- 172.21.15.71:0/912648075 shutdown_connections 2024-05-27T09:51:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.254+0000 7f4c2d620740 1 -- 172.21.15.71:0/912648075 wait complete. 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.255+0000 7f4c2d620740 1 -- start start 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.255+0000 7f4c2d620740 1 Processor -- start 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8db2f0 0x55bafecb8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8e34d0 0x55bafecb85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c2d620740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafed2d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c2d620740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b4720 con 0x55bafe9041b0 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c2d620740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b5b90 con 0x55bafe8e34d0 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c2d620740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b4df0 con 0x55bafe8db2f0 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c2d620740 10 client.0 _ll_register_callbacks cb 0x7f4c18009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8db2f0 0x55bafecb8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafed2d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8db2f0 0x55bafecb8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:51816/0 (socket says 172.21.15.71:51816) 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1f400640 1 -- 172.21.15.71:0/2963999753 learned_addr learned my addr 172.21.15.71:0/2963999753 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1ea00640 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8e34d0 0x55bafecb85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1fe00640 1 -- 172.21.15.71:0/2963999753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8db2f0 msgr2=0x55bafecb8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8db2f0 0x55bafecb8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1fe00640 1 -- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8e34d0 msgr2=0x55bafecb85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8e34d0 0x55bafecb85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.256+0000 7f4c1fe00640 1 -- 172.21.15.71:0/2963999753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bafecb8db0 con 0x55bafe9041b0 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c1fe00640 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafed2d770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c7820 tx=0x7f4c180040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10aaa9d4a63d27ac server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c09600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c09600640 1 -- 172.21.15.71:0/2963999753 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1802c040 con 0x55bafe9041b0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c09600640 1 -- 172.21.15.71:0/2963999753 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4c180c60e0 con 0x55bafe9041b0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1002b070 con 0x55bafe9041b0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c09600640 1 -- 172.21.15.71:0/2963999753 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c180ca380 con 0x55bafe9041b0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c2d620740 10 client.15888 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.257+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bafed2ec50 con 0x55bafe9041b0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c09600640 1 -- 172.21.15.71:0/2963999753 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1002b070 con 0x55bafe9041b0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c09600640 1 -- 172.21.15.71:0/2963999753 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f4c1804d070 con 0x55bafe9041b0 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c2d620740 10 client.15888 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c2d620740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c2d620740 20 client.15888 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c2d620740 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8981c0 0x55bafed312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c2d620740 4 client.15888 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:51:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bafec132c0 con 0x55bafe8981c0 2024-05-27T09:51:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.258+0000 7f4c1f400640 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8981c0 0x55bafed312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.259+0000 7f4c1f400640 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8981c0 0x55bafed312b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210e0def3f31f94a server_cookie=fee27bfb12ed60c9 in_seq=0 out_seq=0 2024-05-27T09:51:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.259+0000 7f4c09600640 10 client.15888 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.326+0000 7f4c09600640 1 -- 172.21.15.71:0/2963999753 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bafec132c0 con 0x55bafe8981c0 2024-05-27T09:51:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.326+0000 7f4c09600640 10 client.15888 handle_command_reply: tid=0 2024-05-27T09:51:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.326+0000 7f4c2d620740 1 client.15888 shutdown 2024-05-27T09:51:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.326+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 msgr2=0x55bafed2d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.326+0000 7f4c2d620740 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafed2d770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c7820 tx=0x7f4c180040d0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 shutdown_connections 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c2d620740 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bafe8981c0 0x55bafed312b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c2d620740 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bafe9041b0 0x55bafed2d770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c2d620740 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bafe8e34d0 0x55bafecb85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c2d620740 1 --2- 172.21.15.71:0/2963999753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bafe8db2f0 0x55bafecb8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c09600640 0 client.15888 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 >> 172.21.15.71:0/2963999753 conn(0x55bafe8f8300 msgr2=0x55bafeca6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.327+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 shutdown_connections 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.328+0000 7f4c2d620740 1 -- 172.21.15.71:0/2963999753 wait complete. 2024-05-27T09:51:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.328+0000 7f4c2d620740 20 client.15888 trim_cache size 0 max 16384 2024-05-27T09:51:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:51:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:51:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:51:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4c040b2950 msgr2=0x7f4c040b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4c040b2950 0x7f4c040b4e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c20116d90 tx=0x7f4c0c004730 comp rx=0 tx=0).stop 2024-05-27T09:51:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 msgr2=0x7f4c201a7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c201a7880 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009dc0 tx=0x7f4c18003ce0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 shutdown_connections 2024-05-27T09:51:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4c040b2950 0x7f4c040b4e60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c20115500 0x7f4c201a7880 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c20110ba0 0x7f4c201a35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 --2- 172.21.15.71:0/3292166409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c2010af10 0x7f4c201a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 >> 172.21.15.71:0/3292166409 conn(0x7f4c2006eda0 msgr2=0x7f4c2010e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 shutdown_connections 2024-05-27T09:51:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:02.329+0000 7f4c26600640 1 -- 172.21.15.71:0/3292166409 wait complete. 2024-05-27T09:51:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:02 smithi072 ceph-mon[35951]: pgmap v101: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 943 KiB/s wr, 382 op/s 2024-05-27T09:51:03.113 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:02 smithi071 ceph-mon[31451]: pgmap v101: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 943 KiB/s wr, 382 op/s 2024-05-27T09:51:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:02 smithi122 ceph-mon[36436]: pgmap v101: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 943 KiB/s wr, 382 op/s 2024-05-27T09:51:03.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 -- 172.21.15.71:0/592629471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 msgr2=0x7f157010abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:03.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 --2- 172.21.15.71:0/592629471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f157010abc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f155c009990 tx=0x7f155c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:51:03.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 -- 172.21.15.71:0/592629471 shutdown_connections 2024-05-27T09:51:03.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 --2- 172.21.15.71:0/592629471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f157010b100 0x7f1570117610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:03.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 --2- 172.21.15.71:0/592629471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157010f6b0 0x7f157010fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:03.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 --2- 172.21.15.71:0/592629471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f157010abc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:03.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 -- 172.21.15.71:0/592629471 >> 172.21.15.71:0/592629471 conn(0x7f1570076af0 msgr2=0x7f1570076f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:03.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 -- 172.21.15.71:0/592629471 shutdown_connections 2024-05-27T09:51:03.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.981+0000 7f1576600700 1 -- 172.21.15.71:0/592629471 wait complete. 2024-05-27T09:51:03.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.982+0000 7f1576600700 1 Processor -- start 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.983+0000 7f1576600700 1 -- start start 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.983+0000 7f1576600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f15701a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.983+0000 7f1576600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157010b100 0x7f15701a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.983+0000 7f1576600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f157010f6b0 0x7f15701a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.983+0000 7f1576600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f157011a8f0 con 0x7f157010f6b0 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.983+0000 7f1576600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f157011a770 con 0x7f157010b100 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.983+0000 7f1576600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f157011aa70 con 0x7f157010a7b0 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f15701a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:03.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f15701a1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50668/0 (socket says 172.21.15.71:50668) 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 -- 172.21.15.71:0/3959090488 learned_addr learned my addr 172.21.15.71:0/3959090488 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575c00700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f157010f6b0 0x7f15701a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f156fe00700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157010b100 0x7f15701a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 -- 172.21.15.71:0/3959090488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157010b100 msgr2=0x7f15701a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157010b100 0x7f15701a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 -- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f157010f6b0 msgr2=0x7f15701a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f157010f6b0 0x7f15701a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f1575200700 1 -- 172.21.15.71:0/3959090488 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15701a6180 con 0x7f157010a7b0 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.984+0000 7f156fe00700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157010b100 0x7f15701a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:03.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.985+0000 7f1575200700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f15701a1300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f156400e9a0 tx=0x7f156400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:03.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.985+0000 7f156d600700 1 -- 172.21.15.71:0/3959090488 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156400ca10 con 0x7f157010a7b0 2024-05-27T09:51:03.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.985+0000 7f156d600700 1 -- 172.21.15.71:0/3959090488 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f156400cbb0 con 0x7f157010a7b0 2024-05-27T09:51:03.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.985+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15701a6470 con 0x7f157010a7b0 2024-05-27T09:51:03.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.985+0000 7f156d600700 1 -- 172.21.15.71:0/3959090488 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564018680 con 0x7f157010a7b0 2024-05-27T09:51:03.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.985+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15701add90 con 0x7f157010a7b0 2024-05-27T09:51:03.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.986+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15700512b0 con 0x7f157010a7b0 2024-05-27T09:51:03.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.989+0000 7f156d600700 1 -- 172.21.15.71:0/3959090488 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f1564010430 con 0x7f157010a7b0 2024-05-27T09:51:03.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.990+0000 7f156d600700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f15580b29f0 0x7f15580b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:03.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.991+0000 7f156d600700 1 -- 172.21.15.71:0/3959090488 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f15640e2ac0 con 0x7f157010a7b0 2024-05-27T09:51:03.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.991+0000 7f156fe00700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f15580b29f0 0x7f15580b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:03.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.992+0000 7f156fe00700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f15580b29f0 0x7f15580b4f00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1570077ff0 tx=0x7f155c005fd0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:03.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:03.993+0000 7f156d600700 1 -- 172.21.15.71:0/3959090488 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f15640aa470 con 0x7f157010a7b0 2024-05-27T09:51:04.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.275+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15701a2610 con 0x7f157010a7b0 2024-05-27T09:51:04.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.276+0000 7f156d600700 1 -- 172.21.15.71:0/3959090488 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11858 (secure 0 0 0) 0x7f15640a9d70 con 0x7f157010a7b0 2024-05-27T09:51:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:51:04.277 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:50:40.326047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f15580b29f0 msgr2=0x7f15580b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f15580b29f0 0x7f15580b4f00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1570077ff0 tx=0x7f155c005fd0 comp rx=0 tx=0).stop 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 msgr2=0x7f15701a1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f15701a1300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f156400e9a0 tx=0x7f156400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 shutdown_connections 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f15580b29f0 0x7f15580b4f00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f157010f6b0 0x7f15701a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f157010a7b0 0x7f15701a1300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:04.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.279+0000 7f1576600700 1 --2- 172.21.15.71:0/3959090488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157010b100 0x7f15701a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:04.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.280+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 >> 172.21.15.71:0/3959090488 conn(0x7f1570076af0 msgr2=0x7f1570108970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:04.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.280+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 shutdown_connections 2024-05-27T09:51:04.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:04.280+0000 7f1576600700 1 -- 172.21.15.71:0/3959090488 wait complete. 2024-05-27T09:51:04.281 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 28 2024-05-27T09:51:04.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:04 smithi071 ceph-mon[31451]: pgmap v102: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 236 KiB/s wr, 32 op/s 2024-05-27T09:51:04.994 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:04 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3959090488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:05.149 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id 78c79bd9 --release --await' 2024-05-27T09:51:05.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id 78c79bd9 --release --await 2024-05-27T09:51:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:04 smithi122 ceph-mon[36436]: pgmap v102: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 236 KiB/s wr, 32 op/s 2024-05-27T09:51:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:04 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3959090488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:04 smithi072 ceph-mon[35951]: pgmap v102: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 236 KiB/s wr, 32 op/s 2024-05-27T09:51:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:04 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3959090488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:05.602 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:07.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:06 smithi071 ceph-mon[31451]: pgmap v103: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 236 KiB/s wr, 32 op/s 2024-05-27T09:51:07.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:06 smithi122 ceph-mon[36436]: pgmap v103: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 236 KiB/s wr, 32 op/s 2024-05-27T09:51:07.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:06 smithi072 ceph-mon[35951]: pgmap v103: 97 pgs: 97 active+clean; 34 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 236 KiB/s wr, 32 op/s 2024-05-27T09:51:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.991+0000 7f54e6200700 1 -- 172.21.15.71:0/2899159100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 msgr2=0x7f54e0104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.991+0000 7f54e6200700 1 --2- 172.21.15.71:0/2899159100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e0104810 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f54d40099c0 tx=0x7f54d4009cd0 comp rx=0 tx=0).stop 2024-05-27T09:51:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.991+0000 7f54e6200700 1 -- 172.21.15.71:0/2899159100 shutdown_connections 2024-05-27T09:51:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.991+0000 7f54e6200700 1 --2- 172.21.15.71:0/2899159100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e0109680 0x7f54e0110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.991+0000 7f54e6200700 1 --2- 172.21.15.71:0/2899159100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e0104810 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.991+0000 7f54e6200700 1 --2- 172.21.15.71:0/2899159100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e0108d30 0x7f54e0109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.991+0000 7f54e6200700 1 -- 172.21.15.71:0/2899159100 >> 172.21.15.71:0/2899159100 conn(0x7f54e0079d40 msgr2=0x7f54e007a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:07.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:07 smithi071 ceph-mon[31451]: pgmap v104: 97 pgs: 97 active+clean; 26 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 258 KiB/s wr, 78 op/s 2024-05-27T09:51:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.992+0000 7f54e6200700 1 -- 172.21.15.71:0/2899159100 shutdown_connections 2024-05-27T09:51:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.992+0000 7f54e6200700 1 -- 172.21.15.71:0/2899159100 wait complete. 2024-05-27T09:51:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.993+0000 7f54e6200700 1 Processor -- start 2024-05-27T09:51:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.994+0000 7f54e6200700 1 -- start start 2024-05-27T09:51:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.994+0000 7f54e6200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.994+0000 7f54e6200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e0108d30 0x7f54e019d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.994+0000 7f54e6200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e0109680 0x7f54e01a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.994+0000 7f54e6200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54e0114300 con 0x7f54e0109680 2024-05-27T09:51:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.994+0000 7f54e6200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f54e0114180 con 0x7f54e0108d30 2024-05-27T09:51:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.994+0000 7f54e6200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f54e0114480 con 0x7f54e0104400 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54dfe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e0108d30 0x7f54e019d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50686/0 (socket says 172.21.15.71:50686) 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54e4e00700 1 -- 172.21.15.71:0/143042862 learned_addr learned my addr 172.21.15.71:0/143042862 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54e5800700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e0109680 0x7f54e01a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54dfe00700 1 -- 172.21.15.71:0/143042862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 msgr2=0x7f54e019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54dfe00700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54dfe00700 1 -- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e0109680 msgr2=0x7f54e01a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54dfe00700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e0109680 0x7f54e01a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:07.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54dfe00700 1 -- 172.21.15.71:0/143042862 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e01a1d40 con 0x7f54e0108d30 2024-05-27T09:51:07.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.995+0000 7f54e4e00700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:07.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.996+0000 7f54dfe00700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e0108d30 0x7f54e019d410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00e9c0 tx=0x7f54cc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:07.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.996+0000 7f54dd600700 1 -- 172.21.15.71:0/143042862 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00c9c0 con 0x7f54e0108d30 2024-05-27T09:51:07.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.996+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e01a2030 con 0x7f54e0108d30 2024-05-27T09:51:07.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.996+0000 7f54dd600700 1 -- 172.21.15.71:0/143042862 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54cc00cb60 con 0x7f54e0108d30 2024-05-27T09:51:07.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.996+0000 7f54dd600700 1 -- 172.21.15.71:0/143042862 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc018680 con 0x7f54e0108d30 2024-05-27T09:51:07.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:07.996+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e01a9950 con 0x7f54e0108d30 2024-05-27T09:51:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.000+0000 7f54dd600700 1 -- 172.21.15.71:0/143042862 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f54cc018820 con 0x7f54e0108d30 2024-05-27T09:51:08.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.001+0000 7f54f6349b80 1 Processor -- start 2024-05-27T09:51:08.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.002+0000 7f54f6349b80 1 -- start start 2024-05-27T09:51:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.002+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.002+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16913050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.002+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 0x560a169155a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.002+0000 7f54f6349b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560a16836f40 con 0x560a169099f0 2024-05-27T09:51:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.002+0000 7f54f6349b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560a16826ae0 con 0x560a16789f40 2024-05-27T09:51:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.002+0000 7f54f6349b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560a1682ab20 con 0x560a16909e00 2024-05-27T09:51:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.003+0000 7f54dd600700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54c80b2a70 0x7f54c80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.003+0000 7f54e5800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.003+0000 7f54e5800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37610/0 (socket says 172.21.15.71:37610) 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.003+0000 7f54e5800700 1 -- 172.21.15.71:0/17258526 learned_addr learned my addr 172.21.15.71:0/17258526 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.003+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16913050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.003+0000 7f54e5800700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54c80b2a70 0x7f54c80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54e5800700 1 -- 172.21.15.71:0/17258526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 msgr2=0x560a169155a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54e5800700 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 0x560a169155a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54dd600700 1 -- 172.21.15.71:0/143042862 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f54cc0e27a0 con 0x7f54e0108d30 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54e5800700 1 -- 172.21.15.71:0/17258526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 msgr2=0x560a16913050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54e5800700 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16913050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54e5800700 1 -- 172.21.15.71:0/17258526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a167ef520 con 0x560a16789f40 2024-05-27T09:51:08.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54e4e00700 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16913050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.004+0000 7f54e5800700 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169094b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54d8008ad0 tx=0x7f54d8008de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2d9100bc5f78c1d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.005+0000 7f54d2000700 1 -- 172.21.15.71:0/17258526 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8008510 con 0x560a16789f40 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.005+0000 7f54d2000700 1 -- 172.21.15.71:0/17258526 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d801a8f0 con 0x560a16789f40 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.005+0000 7f54d2000700 1 -- 172.21.15.71:0/17258526 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8022840 con 0x560a16789f40 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54e5800700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54c80b2a70 0x7f54c80b4f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f54d8022000 tx=0x7f54d8020000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 -- 172.21.15.71:0/17258526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 msgr2=0x560a169094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169094b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54d8008ad0 tx=0x7f54d8008de0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 -- 172.21.15.71:0/17258526 shutdown_connections 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 0x560a169155a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169094b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 --2- 172.21.15.71:0/17258526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16913050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 -- 172.21.15.71:0/17258526 >> 172.21.15.71:0/17258526 conn(0x560a167ea0c0 msgr2=0x560a169042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:08.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.006+0000 7f54f6349b80 1 -- 172.21.15.71:0/17258526 shutdown_connections 2024-05-27T09:51:08.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.007+0000 7f54f6349b80 1 -- 172.21.15.71:0/17258526 wait complete. 2024-05-27T09:51:08.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.007+0000 7f54f6349b80 1 -- start start 2024-05-27T09:51:08.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 1 Processor -- start 2024-05-27T09:51:08.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16912ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a169099f0 0x560a169130e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a16909e00 0x560a16913620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560a1672d0a0 con 0x560a16909e00 2024-05-27T09:51:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560a167c7860 con 0x560a169099f0 2024-05-27T09:51:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560a16915f60 con 0x560a16789f40 2024-05-27T09:51:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.008+0000 7f54f6349b80 10 client.0 _ll_register_callbacks cb 0x560a167d0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16912ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16912ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50694/0 (socket says 172.21.15.71:50694) 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 -- 172.21.15.71:0/3620783832 learned_addr learned my addr 172.21.15.71:0/3620783832 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e5800700 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a16909e00 0x560a16913620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 -- 172.21.15.71:0/3620783832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a169099f0 msgr2=0x560a169130e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a169099f0 0x560a169130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 -- 172.21.15.71:0/3620783832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a16909e00 msgr2=0x560a16913620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a16909e00 0x560a16913620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e4e00700 1 -- 172.21.15.71:0/3620783832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a167769d0 con 0x560a16789f40 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.009+0000 7f54e5800700 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a16909e00 0x560a16913620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.010+0000 7f54e4e00700 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16912ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54d4003760 tx=0x7f54d4005390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed9060158cea8c88 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.010+0000 7f54c6a00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.010+0000 7f54c6a00700 1 -- 172.21.15.71:0/3620783832 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40039c0 con 0x560a16789f40 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.010+0000 7f54c6a00700 1 -- 172.21.15.71:0/3620783832 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f54d4003b60 con 0x560a16789f40 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.010+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d801a8f0 con 0x560a16789f40 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.010+0000 7f54c6a00700 1 -- 172.21.15.71:0/3620783832 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54d4032050 con 0x560a16789f40 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.010+0000 7f54f6349b80 10 client.26056 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560a167f7160 con 0x560a16789f40 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54c6a00700 1 -- 172.21.15.71:0/3620783832 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d801a8f0 con 0x560a16789f40 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54c6a00700 1 -- 172.21.15.71:0/3620783832 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f54d400f460 con 0x560a16789f40 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54f6349b80 10 client.26056 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54f6349b80 10 client.26056 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54f6349b80 20 client.26056 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a16923040 0x560a16925480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54f6349b80 4 client.26056 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.011+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a16838e90 con 0x560a16923040 2024-05-27T09:51:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.012+0000 7f54dfe00700 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a16923040 0x560a16925480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.012+0000 7f54dfe00700 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a16923040 0x560a16925480 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79cf872a682996fa server_cookie=be9a65d31abf7a57 in_seq=0 out_seq=0 2024-05-27T09:51:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.012+0000 7f54c6a00700 10 client.26056 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54c6a00700 1 -- 172.21.15.71:0/3620783832 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x560a16838e90 con 0x560a16923040 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54c6a00700 10 client.26056 handle_command_reply: tid=0 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 client.26056 shutdown 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 msgr2=0x560a16912ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16912ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54d4003760 tx=0x7f54d4005390 comp rx=0 tx=0).stop 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 shutdown_connections 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a16923040 0x560a16925480 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a16909e00 0x560a16913620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16912ba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3620783832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a169099f0 0x560a169130e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 >> 172.21.15.71:0/3620783832 conn(0x560a167ea0c0 msgr2=0x560a16907e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:08.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.013+0000 7f54c6a00700 0 client.26056 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:08.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.014+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 shutdown_connections 2024-05-27T09:51:08.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.014+0000 7f54f6349b80 1 -- 172.21.15.71:0/3620783832 wait complete. 2024-05-27T09:51:08.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.014+0000 7f54f6349b80 20 client.26056 trim_cache size 0 max 16384 2024-05-27T09:51:08.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 Processor -- start 2024-05-27T09:51:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 -- start start 2024-05-27T09:51:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16915040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a1690ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16909e00 0x560a1690e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01b3680 con 0x560a169099f0 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01b0f10 con 0x560a16909e00 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54f6349b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01aed80 con 0x560a16789f40 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16915040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16915040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50704/0 (socket says 172.21.15.71:50704) 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.039+0000 7f54e4e00700 1 -- 172.21.15.71:0/3624286260 learned_addr learned my addr 172.21.15.71:0/3624286260 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54dfe00700 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a1690ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54e5800700 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16909e00 0x560a1690e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54e4e00700 1 -- 172.21.15.71:0/3624286260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16909e00 msgr2=0x560a1690e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54e4e00700 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16909e00 0x560a1690e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54e4e00700 1 -- 172.21.15.71:0/3624286260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 msgr2=0x560a1690ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54e4e00700 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a1690ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54e4e00700 1 -- 172.21.15.71:0/3624286260 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a16915df0 con 0x560a16789f40 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.040+0000 7f54e4e00700 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16915040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f54d400f830 tx=0x7f54d4009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34860e85c86c864 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.041+0000 7f54d1600700 1 -- 172.21.15.71:0/3624286260 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d400faa0 con 0x560a16789f40 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.041+0000 7f54d1600700 1 -- 172.21.15.71:0/3624286260 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d4029070 con 0x560a16789f40 2024-05-27T09:51:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.041+0000 7f54d1600700 1 -- 172.21.15.71:0/3624286260 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40247f0 con 0x560a16789f40 2024-05-27T09:51:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 -- 172.21.15.71:0/3624286260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 msgr2=0x560a16915040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16915040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f54d400f830 tx=0x7f54d4009cd0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 -- 172.21.15.71:0/3624286260 shutdown_connections 2024-05-27T09:51:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16909e00 0x560a1690e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16789f40 0x560a16915040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 --2- 172.21.15.71:0/3624286260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a1690ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 -- 172.21.15.71:0/3624286260 >> 172.21.15.71:0/3624286260 conn(0x560a167ea0c0 msgr2=0x560a16903600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 -- 172.21.15.71:0/3624286260 shutdown_connections 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 -- 172.21.15.71:0/3624286260 wait complete. 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.042+0000 7f54f6349b80 1 -- start start 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 1 Processor -- start 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169171d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16917710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 0x560a16917c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01af3d0 con 0x560a169099f0 2024-05-27T09:51:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01b0840 con 0x560a16789f40 2024-05-27T09:51:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01afaa0 con 0x560a16909e00 2024-05-27T09:51:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.043+0000 7f54f6349b80 10 client.0 _ll_register_callbacks cb 0x560a167d0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169171d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54dfe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16917710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169171d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37634/0 (socket says 172.21.15.71:37634) 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 -- 172.21.15.71:0/412125046 learned_addr learned my addr 172.21.15.71:0/412125046 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e5800700 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 0x560a16917c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 -- 172.21.15.71:0/412125046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 msgr2=0x560a16917c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 0x560a16917c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 -- 172.21.15.71:0/412125046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 msgr2=0x560a16917710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16917710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 -- 172.21.15.71:0/412125046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a1698cd40 con 0x560a16789f40 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54e4e00700 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169171d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f54d4000c00 tx=0x7f54d400f460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb467db8b4b9d65c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.044+0000 7f54c6a00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:51:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.045+0000 7f54c6a00700 1 -- 172.21.15.71:0/412125046 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4054060 con 0x560a16789f40 2024-05-27T09:51:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.045+0000 7f54c6a00700 1 -- 172.21.15.71:0/412125046 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f54d40037c0 con 0x560a16789f40 2024-05-27T09:51:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.045+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d4029070 con 0x560a16789f40 2024-05-27T09:51:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.045+0000 7f54c6a00700 1 -- 172.21.15.71:0/412125046 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54d4003a00 con 0x560a16789f40 2024-05-27T09:51:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.045+0000 7f54f6349b80 10 client.26030 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.045+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560a1698dfc0 con 0x560a16789f40 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54c6a00700 1 -- 172.21.15.71:0/412125046 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d4029070 con 0x560a16789f40 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54c6a00700 1 -- 172.21.15.71:0/412125046 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f54d4024470 con 0x560a16789f40 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54f6349b80 10 client.26030 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54f6349b80 10 client.26030 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54f6349b80 20 client.26030 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54f6349b80 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a1698e5e0 0x560a16990a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54f6349b80 4 client.26030 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "78c79bd9", "release": true, "await": true}] 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "78c79bd9", "release": true, "await": true}) -- 0x560a16832670 con 0x560a1698e5e0 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.046+0000 7f54dfe00700 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a1698e5e0 0x560a16990a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.047+0000 7f54c6a00700 10 client.26030 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:08.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.047+0000 7f54dfe00700 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a1698e5e0 0x560a16990a00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b977f8cc010c62f server_cookie=ba5eec28f24c0b36 in_seq=0 out_seq=0 2024-05-27T09:51:08.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:07 smithi122 ceph-mon[36436]: pgmap v104: 97 pgs: 97 active+clean; 26 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 258 KiB/s wr, 78 op/s 2024-05-27T09:51:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.253+0000 7f54c6a00700 1 -- 172.21.15.71:0/412125046 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560a16832670 con 0x560a1698e5e0 2024-05-27T09:51:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.253+0000 7f54c6a00700 10 client.26030 handle_command_reply: tid=0 2024-05-27T09:51:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.253+0000 7f54f6349b80 1 client.26030 shutdown 2024-05-27T09:51:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.253+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 msgr2=0x560a169171d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.253+0000 7f54f6349b80 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169171d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f54d4000c00 tx=0x7f54d400f460 comp rx=0 tx=0).stop 2024-05-27T09:51:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 shutdown_connections 2024-05-27T09:51:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560a1698e5e0 0x560a16990a00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a16909e00 0x560a16917c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a16789f40 0x560a169171d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 --2- 172.21.15.71:0/412125046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a169099f0 0x560a16917710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 >> 172.21.15.71:0/412125046 conn(0x560a167ea0c0 msgr2=0x560a16904030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54c6a00700 0 client.26030 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 shutdown_connections 2024-05-27T09:51:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 1 -- 172.21.15.71:0/412125046 wait complete. 2024-05-27T09:51:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.254+0000 7f54f6349b80 20 client.26030 trim_cache size 0 max 16384 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 28, 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 8, 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "78c79bd9": { 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 8, 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:08.256 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 130.0, 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:51:08.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54c80b2a70 msgr2=0x7f54c80b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:08.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54c80b2a70 0x7f54c80b4f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f54d8022000 tx=0x7f54d8020000 comp rx=0 tx=0).stop 2024-05-27T09:51:08.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e0108d30 msgr2=0x7f54e019d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:08.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e0108d30 0x7f54e019d410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00e9c0 tx=0x7f54cc00ecd0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 shutdown_connections 2024-05-27T09:51:08.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f54c80b2a70 0x7f54c80b4f80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e0109680 0x7f54e01a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e0104400 0x7f54e019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 --2- 172.21.15.71:0/143042862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e0108d30 0x7f54e019d410 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:08.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 >> 172.21.15.71:0/143042862 conn(0x7f54e0079d40 msgr2=0x7f54e01025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:08.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 shutdown_connections 2024-05-27T09:51:08.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:08.256+0000 7f54e6200700 1 -- 172.21.15.71:0/143042862 wait complete. 2024-05-27T09:51:08.268 INFO:tasks.workunit.client.0.smithi071.stdout:checking btrfs/ioctl.h presence... no 2024-05-27T09:51:08.269 INFO:tasks.workunit.client.0.smithi071.stdout:checking for btrfs/ioctl.h... no 2024-05-27T09:51:08.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:07 smithi072 ceph-mon[35951]: pgmap v104: 97 pgs: 97 active+clean; 26 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 258 KiB/s wr, 78 op/s 2024-05-27T09:51:08.370 INFO:tasks.workunit.client.0.smithi071.stdout:checking cifs/ioctl.h usability... no 2024-05-27T09:51:08.421 INFO:tasks.workunit.client.0.smithi071.stdout:checking cifs/ioctl.h presence... no 2024-05-27T09:51:08.422 INFO:tasks.workunit.client.0.smithi071.stdout:checking for cifs/ioctl.h... no 2024-05-27T09:51:08.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-27T09:51:08.575 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/mman.h usability... yes 2024-05-27T09:51:08.612 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/mman.h presence... yes 2024-05-27T09:51:08.613 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/mman.h... yes 2024-05-27T09:51:08.711 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/ext4.h usability... no 2024-05-27T09:51:08.789 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/ext4.h presence... no 2024-05-27T09:51:08.789 INFO:tasks.workunit.client.0.smithi071.stdout:checking for linux/ext4.h... no 2024-05-27T09:51:08.846 INFO:tasks.workunit.client.0.smithi071.stdout:checking for xfs/xfs_log_format.h... no 2024-05-27T09:51:08.948 INFO:tasks.workunit.client.0.smithi071.stdout:checking for uuid_compare... no 2024-05-27T09:51:09.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:08 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:51:09.026 INFO:tasks.workunit.client.0.smithi071.stdout:checking for uuid_compare in -luuid... yes 2024-05-27T09:51:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:08 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:51:09.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:08 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:51:09.456 INFO:tasks.workunit.client.0.smithi071.stdout:checking for xfs/xfs.h... yes 2024-05-27T09:51:09.485 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '78c79bd9', total seconds elapsed: 21.2 2024-05-27T09:51:09.526 INFO:tasks.workunit.client.0.smithi071.stdout:checking for xfs/libxfs.h... no 2024-05-27T09:51:09.608 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:09.658 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-27T09:51:09.729 INFO:tasks.workunit.client.0.smithi071.stdout:checking for xfs/xqm.h... yes 2024-05-27T09:51:09.841 INFO:tasks.workunit.client.0.smithi071.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-27T09:51:09.917 INFO:tasks.workunit.client.0.smithi071.stdout:checking xfs/handle.h usability... yes 2024-05-27T09:51:09.952 INFO:tasks.workunit.client.0.smithi071.stdout:checking xfs/handle.h presence... yes 2024-05-27T09:51:09.953 INFO:tasks.workunit.client.0.smithi071.stdout:checking for xfs/handle.h... yes 2024-05-27T09:51:10.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:09 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:51:10.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:09 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:51:10.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:09 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:51:10.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:09 smithi071 ceph-mon[31451]: pgmap v105: 97 pgs: 97 active+clean; 26 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 61 KiB/s wr, 69 op/s 2024-05-27T09:51:10.052 INFO:tasks.workunit.client.0.smithi071.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-27T09:51:10.156 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/acl.h usability... yes 2024-05-27T09:51:10.193 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/acl.h presence... yes 2024-05-27T09:51:10.193 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/acl.h... yes 2024-05-27T09:51:10.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:09 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:51:10.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:09 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:51:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:09 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:51:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:09 smithi122 ceph-mon[36436]: pgmap v105: 97 pgs: 97 active+clean; 26 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 61 KiB/s wr, 69 op/s 2024-05-27T09:51:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:09 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:51:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:09 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:51:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:09 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:51:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:09 smithi072 ceph-mon[35951]: pgmap v105: 97 pgs: 97 active+clean; 26 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 61 KiB/s wr, 69 op/s 2024-05-27T09:51:10.303 INFO:tasks.workunit.client.0.smithi071.stdout:checking acl/libacl.h usability... yes 2024-05-27T09:51:10.350 INFO:tasks.workunit.client.0.smithi071.stdout:checking acl/libacl.h presence... yes 2024-05-27T09:51:10.351 INFO:tasks.workunit.client.0.smithi071.stdout:checking for acl/libacl.h... yes 2024-05-27T09:51:10.454 INFO:tasks.workunit.client.0.smithi071.stdout:checking for acl_init in -lacl... yes 2024-05-27T09:51:10.591 INFO:tasks.workunit.client.0.smithi071.stdout:checking gdbm-ndbm.h usability... no 2024-05-27T09:51:10.652 INFO:tasks.workunit.client.0.smithi071.stdout:checking gdbm-ndbm.h presence... no 2024-05-27T09:51:10.652 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gdbm-ndbm.h... no 2024-05-27T09:51:10.937 INFO:tasks.workunit.client.0.smithi071.stdout:checking gdbm/ndbm.h usability... no 2024-05-27T09:51:11.000 INFO:tasks.workunit.client.0.smithi071.stdout:checking gdbm/ndbm.h presence... no 2024-05-27T09:51:11.001 INFO:tasks.workunit.client.0.smithi071.stdout:checking for gdbm/ndbm.h... no 2024-05-27T09:51:11.098 INFO:tasks.workunit.client.0.smithi071.stdout:checking ndbm.h usability... no 2024-05-27T09:51:11.191 INFO:tasks.workunit.client.0.smithi071.stdout:checking ndbm.h presence... no 2024-05-27T09:51:11.191 INFO:tasks.workunit.client.0.smithi071.stdout:checking for ndbm.h... no 2024-05-27T09:51:11.266 INFO:tasks.workunit.client.0.smithi071.stdout:checking libaio.h usability... yes 2024-05-27T09:51:11.309 INFO:tasks.workunit.client.0.smithi071.stdout:checking libaio.h presence... yes 2024-05-27T09:51:11.309 INFO:tasks.workunit.client.0.smithi071.stdout:checking for libaio.h... yes 2024-05-27T09:51:11.403 INFO:tasks.workunit.client.0.smithi071.stdout:checking liburing.h usability... no 2024-05-27T09:51:11.469 INFO:tasks.workunit.client.0.smithi071.stdout:checking liburing.h presence... no 2024-05-27T09:51:11.470 INFO:tasks.workunit.client.0.smithi071.stdout:checking for liburing.h... no 2024-05-27T09:51:11.586 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/capability.h usability... no 2024-05-27T09:51:11.801 INFO:tasks.workunit.client.0.smithi071.stdout:checking sys/capability.h presence... no 2024-05-27T09:51:11.801 INFO:tasks.workunit.client.0.smithi071.stdout:checking for sys/capability.h... no 2024-05-27T09:51:11.916 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/fiemap.h usability... yes 2024-05-27T09:51:11.950 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/fiemap.h presence... yes 2024-05-27T09:51:11.950 INFO:tasks.workunit.client.0.smithi071.stdout:checking for linux/fiemap.h... yes 2024-05-27T09:51:12.035 INFO:tasks.workunit.client.0.smithi071.stdout:checking for fallocate... yes 2024-05-27T09:51:12.141 INFO:tasks.workunit.client.0.smithi071.stdout:checking for open_by_handle_at... yes 2024-05-27T09:51:12.209 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/fs.h usability... yes 2024-05-27T09:51:12.244 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/fs.h presence... yes 2024-05-27T09:51:12.244 INFO:tasks.workunit.client.0.smithi071.stdout:checking for linux/fs.h... yes 2024-05-27T09:51:12.414 INFO:tasks.workunit.client.0.smithi071.stdout:checking btrfsutil.h usability... no 2024-05-27T09:51:12.467 INFO:tasks.workunit.client.0.smithi071.stdout:checking btrfsutil.h presence... no 2024-05-27T09:51:12.467 INFO:tasks.workunit.client.0.smithi071.stdout:checking for btrfsutil.h... no 2024-05-27T09:51:12.580 INFO:tasks.workunit.client.0.smithi071.stdout:checking for copy_file_range... yes 2024-05-27T09:51:12.675 INFO:tasks.workunit.client.0.smithi071.stdout:checking for SEEK_DATA... yes 2024-05-27T09:51:12.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 -- 172.21.15.71:0/535348704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc075b50 msgr2=0x7fe3fc075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 --2- 172.21.15.71:0/535348704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc075b50 0x7fe3fc075f60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009990 tx=0x7fe3ec009ca0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 -- 172.21.15.71:0/535348704 shutdown_connections 2024-05-27T09:51:12.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 --2- 172.21.15.71:0/535348704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc115360 0x7fe3fc117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 --2- 172.21.15.71:0/535348704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc075b50 0x7fe3fc075f60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 --2- 172.21.15.71:0/535348704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3fc0764a0 0x7fe3fc114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 -- 172.21.15.71:0/535348704 >> 172.21.15.71:0/535348704 conn(0x7fe3fc100030 msgr2=0x7fe3fc102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:12.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 -- 172.21.15.71:0/535348704 shutdown_connections 2024-05-27T09:51:12.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.764+0000 7fe401200700 1 -- 172.21.15.71:0/535348704 wait complete. 2024-05-27T09:51:12.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.765+0000 7fe401200700 1 Processor -- start 2024-05-27T09:51:12.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.765+0000 7fe401200700 1 -- start start 2024-05-27T09:51:12.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe401200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc075b50 0x7fe3fc1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe401200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc0764a0 0x7fe3fc1a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe401200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3fc115360 0x7fe3fc1a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe401200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc11aab0 con 0x7fe3fc075b50 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe401200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc11a930 con 0x7fe3fc0764a0 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe401200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc11ac30 con 0x7fe3fc115360 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc0764a0 0x7fe3fc1a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc075b50 0x7fe3fc1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc0764a0 0x7fe3fc1a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37658/0 (socket says 172.21.15.71:37658) 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc075b50 0x7fe3fc1a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57972/0 (socket says 172.21.15.71:57972) 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 -- 172.21.15.71:0/35928762 learned_addr learned my addr 172.21.15.71:0/35928762 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 -- 172.21.15.71:0/35928762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3fc115360 msgr2=0x7fe3fc1a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3fc115360 0x7fe3fc1a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 -- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc075b50 msgr2=0x7fe3fc1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc075b50 0x7fe3fc1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.766+0000 7fe3f3e00700 1 -- 172.21.15.71:0/35928762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc1a6330 con 0x7fe3fc0764a0 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.767+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc0764a0 0x7fe3fc1a1a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400e920 tx=0x7fe3e400ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.767+0000 7fe3f2a00700 1 -- 172.21.15.71:0/35928762 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400cbd0 con 0x7fe3fc0764a0 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.767+0000 7fe3f2a00700 1 -- 172.21.15.71:0/35928762 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e400ee70 con 0x7fe3fc0764a0 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.767+0000 7fe3f2a00700 1 -- 172.21.15.71:0/35928762 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4018680 con 0x7fe3fc0764a0 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.767+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc1a6620 con 0x7fe3fc0764a0 2024-05-27T09:51:12.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.767+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc1adf40 con 0x7fe3fc0764a0 2024-05-27T09:51:12.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.772+0000 7fe3f2a00700 1 -- 172.21.15.71:0/35928762 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fe3e4018820 con 0x7fe3fc0764a0 2024-05-27T09:51:12.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.772+0000 7fe40fce6b80 1 Processor -- start 2024-05-27T09:51:12.772 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:12 smithi071 ceph-mon[31451]: pgmap v106: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 149 KiB/s wr, 75 op/s 2024-05-27T09:51:12.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.772+0000 7fe40fce6b80 1 -- start start 2024-05-27T09:51:12.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d88199a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88199ae70 0x55d8819a7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d8818c8e40 con 0x55d88181be40 2024-05-27T09:51:12.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d8818b89e0 con 0x55d88199ae70 2024-05-27T09:51:12.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d8818bca20 con 0x55d8819079f0 2024-05-27T09:51:12.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe3fa800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d88199a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe3f2a00700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3e00b2a70 0x7fe3e00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe3fa800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d88199a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:50740/0 (socket says 172.21.15.71:50740) 2024-05-27T09:51:12.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57988/0 (socket says 172.21.15.71:57988) 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.773+0000 7fe3fa800700 1 -- 172.21.15.71:0/2678955720 learned_addr learned my addr 172.21.15.71:0/2678955720 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3f2a00700 1 -- 172.21.15.71:0/35928762 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fe3e40e2830 con 0x7fe3fc0764a0 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3f9e00700 1 -- 172.21.15.71:0/2678955720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 msgr2=0x55d88199a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d88199a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3f9e00700 1 -- 172.21.15.71:0/2678955720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88199ae70 msgr2=0x55d8819a7110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88199ae70 0x55d8819a7110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3f9e00700 1 -- 172.21.15.71:0/2678955720 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d881881420 con 0x55d88181be40 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3fa800700 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d88199a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.774+0000 7fe3fa800700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3e00b2a70 0x7fe3e00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.775+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199a870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57826503059b03a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.775+0000 7fe3eb400700 1 -- 172.21.15.71:0/2678955720 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec027070 con 0x55d88181be40 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.775+0000 7fe3eb400700 1 -- 172.21.15.71:0/2678955720 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3ec0056b0 con 0x55d88181be40 2024-05-27T09:51:12.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.775+0000 7fe3eb400700 1 -- 172.21.15.71:0/2678955720 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec003b00 con 0x55d88181be40 2024-05-27T09:51:12.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2678955720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 msgr2=0x55d88199a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe3fa800700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3e00b2a70 0x7fe3e00b4f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009da0 tx=0x7fe3f4009040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:12.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199a870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec0096a0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2678955720 shutdown_connections 2024-05-27T09:51:12.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88199ae70 0x55d8819a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d88199a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2678955720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199a870 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2678955720 >> 172.21.15.71:0/2678955720 conn(0x55d8818b5390 msgr2=0x55d8819964c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:12.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2678955720 shutdown_connections 2024-05-27T09:51:12.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.777+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2678955720 wait complete. 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.778+0000 7fe40fce6b80 1 -- start start 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.778+0000 7fe40fce6b80 1 Processor -- start 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819a4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d8819a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88199ae70 0x55d8819a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d8817befa0 con 0x55d88199ae70 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d881859760 con 0x55d88181be40 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d8819a7b20 con 0x55d8819079f0 2024-05-27T09:51:12.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe40fce6b80 10 client.0 _ll_register_callbacks cb 0x55d881862c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:12.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37682/0 (socket says 172.21.15.71:37682) 2024-05-27T09:51:12.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe3f9e00700 1 -- 172.21.15.71:0/3581122189 learned_addr learned my addr 172.21.15.71:0/3581122189 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:12.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe3fa800700 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88199ae70 0x55d8819a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.779+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d8819a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3f9e00700 1 -- 172.21.15.71:0/3581122189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 msgr2=0x55d8819a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d8819a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3f9e00700 1 -- 172.21.15.71:0/3581122189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88199ae70 msgr2=0x55d8819a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88199ae70 0x55d8819a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3f9e00700 1 -- 172.21.15.71:0/3581122189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8818088d0 con 0x55d88181be40 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819a4630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00b950 tx=0x7fe3ec00b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54178ae85ae74fc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3dfe00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3dfe00700 1 -- 172.21.15.71:0/3581122189 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec031060 con 0x55d88181be40 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe3dfe00700 1 -- 172.21.15.71:0/3581122189 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fe3ec003680 con 0x55d88181be40 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.780+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3ec0056b0 con 0x55d88181be40 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe3dfe00700 1 -- 172.21.15.71:0/3581122189 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3ec027040 con 0x55d88181be40 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe40fce6b80 10 client.26039 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d881889060 con 0x55d88181be40 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe3dfe00700 1 -- 172.21.15.71:0/3581122189 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3ec0056b0 con 0x55d88181be40 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe3dfe00700 1 -- 172.21.15.71:0/3581122189 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fe3ec022770 con 0x55d88181be40 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe40fce6b80 10 client.26039 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe40fce6b80 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.781+0000 7fe40fce6b80 20 client.26039 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.782+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d8819b49a0 0x55d8819b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.782+0000 7fe40fce6b80 4 client.26039 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.782+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8818cad90 con 0x55d8819b49a0 2024-05-27T09:51:12.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.782+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d8819b49a0 0x55d8819b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.782+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d8819b49a0 0x55d8819b6dc0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af8850b1feb52ab2 server_cookie=2220ea88b58ba0c in_seq=0 out_seq=0 2024-05-27T09:51:12.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.782+0000 7fe3dfe00700 10 client.26039 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:12.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.783+0000 7fe3dfe00700 1 -- 172.21.15.71:0/3581122189 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d8818cad90 con 0x55d8819b49a0 2024-05-27T09:51:12.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.783+0000 7fe3dfe00700 10 client.26039 handle_command_reply: tid=0 2024-05-27T09:51:12.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.783+0000 7fe40fce6b80 1 client.26039 shutdown 2024-05-27T09:51:12.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 msgr2=0x55d8819a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819a4630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00b950 tx=0x7fe3ec00b980 comp rx=0 tx=0).stop 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 shutdown_connections 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d8819b49a0 0x55d8819b6dc0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88199ae70 0x55d8819a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819a4630 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe3dfe00700 0 client.26039 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/3581122189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8819079f0 0x55d8819a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 >> 172.21.15.71:0/3581122189 conn(0x55d8818b5390 msgr2=0x55d88199a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 shutdown_connections 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 1 -- 172.21.15.71:0/3581122189 wait complete. 2024-05-27T09:51:12.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.784+0000 7fe40fce6b80 20 client.26039 trim_cache size 0 max 16384 2024-05-27T09:51:12.794 INFO:tasks.workunit.client.0.smithi071.stdout:checking for BMV_OF_SHARED... yes 2024-05-27T09:51:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 Processor -- start 2024-05-27T09:51:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 -- start start 2024-05-27T09:51:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8819079f0 0x55d8819a3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 0x55d8819b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1b7c90 con 0x55d88181be40 2024-05-27T09:51:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1b5520 con 0x55d8819079f0 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.808+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1b3370 con 0x55d88199ae70 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8819079f0 0x55d8819a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8819079f0 0x55d8819a3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37688/0 (socket says 172.21.15.71:37688) 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 -- 172.21.15.71:0/2421221530 learned_addr learned my addr 172.21.15.71:0/2421221530 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f9e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58000/0 (socket says 172.21.15.71:58000) 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 -- 172.21.15.71:0/2421221530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 msgr2=0x55d8819b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/2421221530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 0x55d8819b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 -- 172.21.15.71:0/2421221530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 msgr2=0x55d88199fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/2421221530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 -- 172.21.15.71:0/2421221530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88199a780 con 0x55d8819079f0 2024-05-27T09:51:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.809+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/2421221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8819079f0 0x55d8819a3590 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40a9bc0 tx=0x7fe3e401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420e286156c29964 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.810+0000 7fe3eaa00700 1 -- 172.21.15.71:0/2421221530 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40a9740 con 0x55d8819079f0 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.810+0000 7fe3eaa00700 1 -- 172.21.15.71:0/2421221530 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e40b2940 con 0x55d8819079f0 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.810+0000 7fe3eaa00700 1 -- 172.21.15.71:0/2421221530 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40cc330 con 0x55d8819079f0 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2421221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8819079f0 msgr2=0x55d8819a3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2421221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8819079f0 0x55d8819a3590 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40a9bc0 tx=0x7fe3e401f000 comp rx=0 tx=0).stop 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2421221530 shutdown_connections 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2421221530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 0x55d8819b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2421221530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d88181be40 0x55d88199fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/2421221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8819079f0 0x55d8819a3590 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2421221530 >> 172.21.15.71:0/2421221530 conn(0x55d8818b5390 msgr2=0x55d8819a5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2421221530 shutdown_connections 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.811+0000 7fe40fce6b80 1 -- 172.21.15.71:0/2421221530 wait complete. 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 -- start start 2024-05-27T09:51:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 Processor -- start 2024-05-27T09:51:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819ba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8819079f0 0x55d8819b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 0x55d8819b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1b39e0 con 0x55d8819079f0 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1b4e50 con 0x55d88181be40 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.812+0000 7fe40fce6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1b40b0 con 0x55d88199ae70 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe40fce6b80 10 client.0 _ll_register_callbacks cb 0x55d881862c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8819079f0 0x55d8819b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8819079f0 0x55d8819b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58010/0 (socket says 172.21.15.71:58010) 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 -- 172.21.15.71:0/507576520 learned_addr learned my addr 172.21.15.71:0/507576520 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3fa800700 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 0x55d8819b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 -- 172.21.15.71:0/507576520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 msgr2=0x55d8819b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 0x55d8819b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 -- 172.21.15.71:0/507576520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 msgr2=0x55d8819ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.813+0000 7fe3f3e00700 1 -- 172.21.15.71:0/507576520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8819b6390 con 0x55d8819079f0 2024-05-27T09:51:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe3f3e00700 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8819079f0 0x55d8819b57b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400ceb0 tx=0x7fe3e40e0490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3c7dbb71d5146e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe3dfe00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe3dfe00700 1 -- 172.21.15.71:0/507576520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40c2070 con 0x55d8819079f0 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe3dfe00700 1 -- 172.21.15.71:0/507576520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fe3e40a8e90 con 0x55d8819079f0 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e40b2940 con 0x55d8819079f0 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe3dfe00700 1 -- 172.21.15.71:0/507576520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3e40a9090 con 0x55d8819079f0 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe40fce6b80 10 client.15930 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d881a1f020 con 0x55d8819079f0 2024-05-27T09:51:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.814+0000 7fe3dfe00700 1 -- 172.21.15.71:0/507576520 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e40b2940 con 0x55d8819079f0 2024-05-27T09:51:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe3dfe00700 1 -- 172.21.15.71:0/507576520 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e408e070 con 0x55d8819079f0 2024-05-27T09:51:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe40fce6b80 10 client.15930 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe40fce6b80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe40fce6b80 20 client.15930 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d881a1f680 0x55d881a21aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe40fce6b80 4 client.15930 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8818c4570 con 0x55d881a1f680 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.815+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d881a1f680 0x55d881a21aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe3f9e00700 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d881a1f680 0x55d881a21aa0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=552be9291702bed0 server_cookie=d2393d180ed3e30 in_seq=0 out_seq=0 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe3dfe00700 10 client.15930 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe3dfe00700 1 -- 172.21.15.71:0/507576520 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d8818c4570 con 0x55d881a1f680 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe3dfe00700 10 client.15930 handle_command_reply: tid=0 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 client.15930 shutdown 2024-05-27T09:51:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8819079f0 msgr2=0x55d8819b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8819079f0 0x55d8819b57b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400ceb0 tx=0x7fe3e40e0490 comp rx=0 tx=0).stop 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 shutdown_connections 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d881a1f680 0x55d881a21aa0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d88199ae70 0x55d8819b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d88181be40 0x55d8819ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 --2- 172.21.15.71:0/507576520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8819079f0 0x55d8819b57b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe3dfe00700 0 client.15930 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.816+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 >> 172.21.15.71:0/507576520 conn(0x55d8818b5390 msgr2=0x55d8819a4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.817+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 shutdown_connections 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.817+0000 7fe40fce6b80 1 -- 172.21.15.71:0/507576520 wait complete. 2024-05-27T09:51:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.817+0000 7fe40fce6b80 20 client.15930 trim_cache size 0 max 16384 2024-05-27T09:51:12.820 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:51:12.820 INFO:teuthology.orchestra.run.smithi071.stdout: "status": "no active scrubs running", 2024-05-27T09:51:12.820 INFO:teuthology.orchestra.run.smithi071.stdout: "scrubs": {} 2024-05-27T09:51:12.820 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:51:12.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3e00b2a70 msgr2=0x7fe3e00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3e00b2a70 0x7fe3e00b4f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009da0 tx=0x7fe3f4009040 comp rx=0 tx=0).stop 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc0764a0 msgr2=0x7fe3fc1a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc0764a0 0x7fe3fc1a1a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400e920 tx=0x7fe3e400ec30 comp rx=0 tx=0).stop 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 shutdown_connections 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe3e00b2a70 0x7fe3e00b4f80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3fc115360 0x7fe3fc1a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc075b50 0x7fe3fc1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 --2- 172.21.15.71:0/35928762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3fc0764a0 0x7fe3fc1a1a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.818+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 >> 172.21.15.71:0/35928762 conn(0x7fe3fc100030 msgr2=0x7fe3fc100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.819+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 shutdown_connections 2024-05-27T09:51:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:12.819+0000 7fe401200700 1 -- 172.21.15.71:0/35928762 wait complete. 2024-05-27T09:51:12.886 INFO:tasks.workunit.client.0.smithi071.stdout:checking for nftw... yes 2024-05-27T09:51:12.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:12 smithi122 ceph-mon[36436]: pgmap v106: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 149 KiB/s wr, 75 op/s 2024-05-27T09:51:13.013 INFO:tasks.workunit.client.0.smithi071.stdout:checking for RLIMIT_NOFILE... yes 2024-05-27T09:51:13.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:12 smithi072 ceph-mon[35951]: pgmap v106: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 149 KiB/s wr, 75 op/s 2024-05-27T09:51:13.101 INFO:tasks.workunit.client.0.smithi071.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-27T09:51:13.225 INFO:tasks.workunit.client.0.smithi071.stdout:checking for FICLONE... yes 2024-05-27T09:51:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:checking for renameat2... yes 2024-05-27T09:51:13.419 INFO:tasks.workunit.client.0.smithi071.stdout:checking for reallocarray... yes 2024-05-27T09:51:13.565 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct mount_attr... yes 2024-05-27T09:51:13.733 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-27T09:51:13.823 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-27T09:51:13.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:51:13.868 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-27T09:51:14.000 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-27T09:51:14.123 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-27T09:51:14.235 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-27T09:51:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-27T09:51:14.493 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-27T09:51:14.584 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/btrfs.h usability... yes 2024-05-27T09:51:14.623 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/btrfs.h presence... yes 2024-05-27T09:51:14.623 INFO:tasks.workunit.client.0.smithi071.stdout:checking for linux/btrfs.h... yes 2024-05-27T09:51:14.734 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/btrfs_tree.h usability... yes 2024-05-27T09:51:14.772 INFO:tasks.workunit.client.0.smithi071.stdout:checking linux/btrfs_tree.h presence... yes 2024-05-27T09:51:14.772 INFO:tasks.workunit.client.0.smithi071.stdout:checking for linux/btrfs_tree.h... yes 2024-05-27T09:51:14.853 INFO:tasks.workunit.client.0.smithi071.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-05-27T09:51:14.932 INFO:tasks.workunit.client.0.smithi071.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-05-27T09:51:14.935 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:14 smithi071 ceph-mon[31451]: pgmap v107: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 111 KiB/s wr, 52 op/s 2024-05-27T09:51:14.966 INFO:tasks.workunit.client.0.smithi071.stdout:configure: creating ./config.status 2024-05-27T09:51:14.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:14 smithi122 ceph-mon[36436]: pgmap v107: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 111 KiB/s wr, 52 op/s 2024-05-27T09:51:15.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:14 smithi072 ceph-mon[35951]: pgmap v107: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 111 KiB/s wr, 52 op/s 2024-05-27T09:51:15.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 -- 172.21.15.71:0/4018256198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010bcf0 msgr2=0x7f27a0105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 --2- 172.21.15.71:0/4018256198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010bcf0 0x7f27a0105890 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2790009900 tx=0x7f279002a3f0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 -- 172.21.15.71:0/4018256198 shutdown_connections 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 --2- 172.21.15.71:0/4018256198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 0x7f27a0112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 --2- 172.21.15.71:0/4018256198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a010c190 0x7f27a0105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 --2- 172.21.15.71:0/4018256198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010bcf0 0x7f27a0105890 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 -- 172.21.15.71:0/4018256198 >> 172.21.15.71:0/4018256198 conn(0x7f27a007d510 msgr2=0x7f27a007d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 -- 172.21.15.71:0/4018256198 shutdown_connections 2024-05-27T09:51:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.557+0000 7f279f200640 1 -- 172.21.15.71:0/4018256198 wait complete. 2024-05-27T09:51:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.558+0000 7f279f200640 1 Processor -- start 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.558+0000 7f279f200640 1 -- start start 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279f200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 0x7f27a01a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279f200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a010bcf0 0x7f27a01a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010c190 0x7f27a019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27a0115ec0 con 0x7f27a010c190 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279f200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27a0115d40 con 0x7f27a0106440 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279f200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27a0116040 con 0x7f27a010bcf0 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 0x7f27a01a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 0x7f27a01a2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53744/0 (socket says 172.21.15.71:53744) 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279de00640 1 -- 172.21.15.71:0/1852724297 learned_addr learned my addr 172.21.15.71:0/1852724297 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279e800640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010c190 0x7f27a019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.559+0000 7f279d400640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a010bcf0 0x7f27a01a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.560+0000 7f279de00640 1 -- 172.21.15.71:0/1852724297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a010bcf0 msgr2=0x7f27a01a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.560+0000 7f279de00640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a010bcf0 0x7f27a01a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.560+0000 7f279de00640 1 -- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010c190 msgr2=0x7f27a019c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.560+0000 7f279de00640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010c190 0x7f27a019c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.560+0000 7f279de00640 1 -- 172.21.15.71:0/1852724297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a019ceb0 con 0x7f27a0106440 2024-05-27T09:51:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.560+0000 7f279de00640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 0x7f27a01a2600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2790006010 tx=0x7f2790004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.561+0000 7f2796a00640 1 -- 172.21.15.71:0/1852724297 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279003f030 con 0x7f27a0106440 2024-05-27T09:51:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.561+0000 7f2796a00640 1 -- 172.21.15.71:0/1852724297 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2790003aa0 con 0x7f27a0106440 2024-05-27T09:51:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.561+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a019d0e0 con 0x7f27a0106440 2024-05-27T09:51:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.561+0000 7f2796a00640 1 -- 172.21.15.71:0/1852724297 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790035070 con 0x7f27a0106440 2024-05-27T09:51:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.561+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a01a93a0 con 0x7f27a0106440 2024-05-27T09:51:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.564+0000 7f27ac1df740 1 Processor -- start 2024-05-27T09:51:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.564+0000 7f27ac1df740 1 -- start start 2024-05-27T09:51:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.564+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a1631b0 0x55d17a505a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a13a2f0 0x55d17a505fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a5064e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f27ac1df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d17a476b90 con 0x55d17a1631b0 2024-05-27T09:51:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f27ac1df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d17a466730 con 0x55d17a1424d0 2024-05-27T09:51:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f27ac1df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d17a46a770 con 0x55d17a13a2f0 2024-05-27T09:51:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f2796a00640 1 -- 172.21.15.71:0/1852724297 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2790042030 con 0x7f27a0106440 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f279d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a5064e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f279d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a5064e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53760/0 (socket says 172.21.15.71:53760) 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f279d400640 1 -- 172.21.15.71:0/924393061 learned_addr learned my addr 172.21.15.71:0/924393061 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f279e800640 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a1631b0 0x55d17a505a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.565+0000 7f279de00640 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a13a2f0 0x55d17a505fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f279d400640 1 -- 172.21.15.71:0/924393061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a13a2f0 msgr2=0x55d17a505fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f279d400640 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a13a2f0 0x55d17a505fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f279d400640 1 -- 172.21.15.71:0/924393061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a1631b0 msgr2=0x55d17a505a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f279d400640 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a1631b0 0x55d17a505a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f279d400640 1 -- 172.21.15.71:0/924393061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17a3ff8b0 con 0x55d17a1424d0 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f279d400640 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a5064e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f278c009c20 tx=0x7f278c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d736b0ac323ac49c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f278b400640 1 -- 172.21.15.71:0/924393061 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c009dd0 con 0x55d17a1424d0 2024-05-27T09:51:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f278b400640 1 -- 172.21.15.71:0/924393061 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f278c005020 con 0x55d17a1424d0 2024-05-27T09:51:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.566+0000 7f278b400640 1 -- 172.21.15.71:0/924393061 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c0049e0 con 0x55d17a1424d0 2024-05-27T09:51:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.567+0000 7f2796a00640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f27840b29d0 0x7f27840b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.567+0000 7f2796a00640 1 -- 172.21.15.71:0/1852724297 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f27901029e0 con 0x7f27a0106440 2024-05-27T09:51:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.567+0000 7f279e800640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f27840b29d0 0x7f27840b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 -- 172.21.15.71:0/924393061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 msgr2=0x55d17a5064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a5064e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f278c009c20 tx=0x7f278c011810 comp rx=0 tx=0).stop 2024-05-27T09:51:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 -- 172.21.15.71:0/924393061 shutdown_connections 2024-05-27T09:51:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a5064e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a13a2f0 0x55d17a505fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 --2- 172.21.15.71:0/924393061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a1631b0 0x55d17a505a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 -- 172.21.15.71:0/924393061 >> 172.21.15.71:0/924393061 conn(0x55d17a157300 msgr2=0x55d17a502210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 -- 172.21.15.71:0/924393061 shutdown_connections 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f279e800640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f27840b29d0 0x7f27840b4ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55d17a502bd0 tx=0x7f27980096a0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.568+0000 7f27ac1df740 1 -- 172.21.15.71:0/924393061 wait complete. 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 -- start start 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 Processor -- start 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a50fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a5100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a51bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d17a14c790 con 0x55d17a13a2f0 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d17a40ebc0 con 0x55d17a1631b0 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d17a512b90 con 0x55d17a1424d0 2024-05-27T09:51:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.569+0000 7f27ac1df740 10 client.0 _ll_register_callbacks cb 0x55d17a3ec400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a5100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a50fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a51bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a5100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53784/0 (socket says 172.21.15.71:53784) 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279d400640 1 -- 172.21.15.71:0/2285516284 learned_addr learned my addr 172.21.15.71:0/2285516284 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279de00640 1 -- 172.21.15.71:0/2285516284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 msgr2=0x55d17a5100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279de00640 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a5100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279de00640 1 -- 172.21.15.71:0/2285516284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 msgr2=0x55d17a51bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279de00640 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a51bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.570+0000 7f279de00640 1 -- 172.21.15.71:0/2285516284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d17a17b210 con 0x55d17a13a2f0 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f279de00640 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a50fb90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2790100100 tx=0x7f2790003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7d61f5855fa266 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f277fe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f277fe00640 1 -- 172.21.15.71:0/2285516284 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790049040 con 0x55d17a13a2f0 2024-05-27T09:51:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f277fe00640 1 -- 172.21.15.71:0/2285516284 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f27900d2660 con 0x55d17a13a2f0 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f278c005020 con 0x55d17a13a2f0 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f277fe00640 1 -- 172.21.15.71:0/2285516284 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2790100590 con 0x55d17a13a2f0 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f27ac1df740 10 client.15942 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d17a247620 con 0x55d17a13a2f0 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.571+0000 7f277fe00640 1 -- 172.21.15.71:0/2285516284 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f278c005020 con 0x55d17a13a2f0 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f277fe00640 1 -- 172.21.15.71:0/2285516284 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f279003bb40 con 0x55d17a13a2f0 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f27ac1df740 10 client.15942 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f27ac1df740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f27ac1df740 20 client.15942 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f27ac1df740 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a121d80 0x55d17a521eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f27ac1df740 4 client.15942 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d17a478ae0 con 0x55d17a121d80 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.572+0000 7f279d400640 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a121d80 0x55d17a521eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.573+0000 7f279d400640 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a121d80 0x55d17a521eb0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3279aebb5b972bc6 server_cookie=bf84ee756275e01b in_seq=0 out_seq=0 2024-05-27T09:51:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.573+0000 7f277fe00640 10 client.15942 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f277fe00640 1 -- 172.21.15.71:0/2285516284 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d17a478ae0 con 0x55d17a121d80 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f277fe00640 10 client.15942 handle_command_reply: tid=0 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 client.15942 shutdown 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 msgr2=0x55d17a50fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a50fb90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2790100100 tx=0x7f2790003f50 comp rx=0 tx=0).stop 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 shutdown_connections 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a51bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a5100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a121d80 0x55d17a521eb0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 --2- 172.21.15.71:0/2285516284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a50fb90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 >> 172.21.15.71:0/2285516284 conn(0x55d17a157300 msgr2=0x55d17a507780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f277fe00640 0 client.15942 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 shutdown_connections 2024-05-27T09:51:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.574+0000 7f27ac1df740 1 -- 172.21.15.71:0/2285516284 wait complete. 2024-05-27T09:51:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.575+0000 7f27ac1df740 20 client.15942 trim_cache size 0 max 16384 2024-05-27T09:51:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.592+0000 7f27ac1df740 1 Processor -- start 2024-05-27T09:51:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.592+0000 7f27ac1df740 1 -- start start 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a511ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a506800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a50fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f27ac1df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27a01b43a0 con 0x55d17a13a2f0 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f27ac1df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27a01b1c70 con 0x55d17a1631b0 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f27ac1df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27a01afac0 con 0x55d17a1424d0 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a511ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a506800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a511ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59104/0 (socket says 172.21.15.71:59104) 2024-05-27T09:51:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 -- 172.21.15.71:0/3922952622 learned_addr learned my addr 172.21.15.71:0/3922952622 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279e800640 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a50fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 -- 172.21.15.71:0/3922952622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 msgr2=0x55d17a506800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a506800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 -- 172.21.15.71:0/3922952622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 msgr2=0x55d17a50fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a50fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.593+0000 7f279de00640 1 -- 172.21.15.71:0/3922952622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17a50e0e0 con 0x55d17a13a2f0 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.594+0000 7f279d400640 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a506800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.594+0000 7f279de00640 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a511ce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f279003beb0 tx=0x7f27900c9d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e540ecc67e608b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.594+0000 7f278aa00640 1 -- 172.21.15.71:0/3922952622 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790049070 con 0x55d17a13a2f0 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.594+0000 7f278aa00640 1 -- 172.21.15.71:0/3922952622 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27900e1070 con 0x55d17a13a2f0 2024-05-27T09:51:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.594+0000 7f278aa00640 1 -- 172.21.15.71:0/3922952622 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900d2660 con 0x55d17a13a2f0 2024-05-27T09:51:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 -- 172.21.15.71:0/3922952622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 msgr2=0x55d17a511ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a511ce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f279003beb0 tx=0x7f27900c9d40 comp rx=0 tx=0).stop 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 -- 172.21.15.71:0/3922952622 shutdown_connections 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1631b0 0x55d17a50fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1424d0 0x55d17a506800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 --2- 172.21.15.71:0/3922952622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a511ce0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 -- 172.21.15.71:0/3922952622 >> 172.21.15.71:0/3922952622 conn(0x55d17a157300 msgr2=0x55d17a50f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 -- 172.21.15.71:0/3922952622 shutdown_connections 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.595+0000 7f27ac1df740 1 -- 172.21.15.71:0/3922952622 wait complete. 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.596+0000 7f27ac1df740 1 -- start start 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.596+0000 7f27ac1df740 1 Processor -- start 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a509bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a50a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f27ac1df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1631b0 0x55d17a516e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f27ac1df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27a01b0130 con 0x55d17a13a2f0 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f27ac1df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27a01b15a0 con 0x55d17a1424d0 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f27ac1df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27a01b0800 con 0x55d17a1631b0 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f27ac1df740 10 client.0 _ll_register_callbacks cb 0x7f2790005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a509bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a50a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a509bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59118/0 (socket says 172.21.15.71:59118) 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a50a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53782/0 (socket says 172.21.15.71:53782) 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279de00640 1 -- 172.21.15.71:0/1219943721 learned_addr learned my addr 172.21.15.71:0/1219943721 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279e800640 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1631b0 0x55d17a516e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279d400640 1 -- 172.21.15.71:0/1219943721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1631b0 msgr2=0x55d17a516e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279d400640 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1631b0 0x55d17a516e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279d400640 1 -- 172.21.15.71:0/1219943721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 msgr2=0x55d17a509bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279d400640 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a509bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.597+0000 7f279d400640 1 -- 172.21.15.71:0/1219943721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d17a50a8f0 con 0x55d17a1424d0 2024-05-27T09:51:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f279de00640 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a509bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f279d400640 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a50a110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f278c009bf0 tx=0x7f278c02be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=640e29e3ab893523 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f277fe00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:51:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f277fe00640 1 -- 172.21.15.71:0/1219943721 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c031060 con 0x55d17a1424d0 2024-05-27T09:51:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27900e1070 con 0x55d17a1424d0 2024-05-27T09:51:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f277fe00640 1 -- 172.21.15.71:0/1219943721 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f278c0050c0 con 0x55d17a1424d0 2024-05-27T09:51:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f277fe00640 1 -- 172.21.15.71:0/1219943721 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f278c0054f0 con 0x55d17a1424d0 2024-05-27T09:51:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f27ac1df740 10 client.26060 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.598+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d17a518350 con 0x55d17a1424d0 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f277fe00640 1 -- 172.21.15.71:0/1219943721 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27900e1070 con 0x55d17a1424d0 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f277fe00640 1 -- 172.21.15.71:0/1219943721 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f278c02b3f0 con 0x55d17a1424d0 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f27ac1df740 10 client.26060 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f27ac1df740 10 client.26060 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f27ac1df740 20 client.26060 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f27ac1df740 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a0f71c0 0x55d17a58c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f27ac1df740 4 client.26060 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.599+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d17a4722c0 con 0x55d17a0f71c0 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.600+0000 7f279de00640 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a0f71c0 0x55d17a58c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.600+0000 7f277fe00640 10 client.26060 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.600+0000 7f279de00640 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a0f71c0 0x55d17a58c550 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1921cae38ea5c9 server_cookie=99447655565a5df9 in_seq=0 out_seq=0 2024-05-27T09:51:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.651+0000 7f277fe00640 1 -- 172.21.15.71:0/1219943721 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d17a4722c0 con 0x55d17a0f71c0 2024-05-27T09:51:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.651+0000 7f277fe00640 10 client.26060 handle_command_reply: tid=0 2024-05-27T09:51:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.651+0000 7f27ac1df740 1 client.26060 shutdown 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 msgr2=0x55d17a50a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a50a110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f278c009bf0 tx=0x7f278c02be70 comp rx=0 tx=0).stop 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 shutdown_connections 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a1631b0 0x55d17a516e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d17a1424d0 0x55d17a50a110 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d17a0f71c0 0x55d17a58c550 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 --2- 172.21.15.71:0/1219943721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d17a13a2f0 0x55d17a509bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f277fe00640 0 client.26060 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 >> 172.21.15.71:0/1219943721 conn(0x55d17a157300 msgr2=0x55d17a50fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 shutdown_connections 2024-05-27T09:51:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 1 -- 172.21.15.71:0/1219943721 wait complete. 2024-05-27T09:51:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.652+0000 7f27ac1df740 20 client.26060 trim_cache size 0 max 16384 2024-05-27T09:51:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:51:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:51:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f27840b29d0 msgr2=0x7f27840b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f27840b29d0 0x7f27840b4ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55d17a502bd0 tx=0x7f27980096a0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 msgr2=0x7f27a01a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 0x7f27a01a2600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2790006010 tx=0x7f2790004060 comp rx=0 tx=0).stop 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 shutdown_connections 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f27840b29d0 0x7f27840b4ee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a010c190 0x7f27a019c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a010bcf0 0x7f27a01a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 --2- 172.21.15.71:0/1852724297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a0106440 0x7f27a01a2600 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 >> 172.21.15.71:0/1852724297 conn(0x7f27a007d510 msgr2=0x7f27a0107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 shutdown_connections 2024-05-27T09:51:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:15.653+0000 7f279f200640 1 -- 172.21.15.71:0/1852724297 wait complete. 2024-05-27T09:51:16.005 INFO:tasks.workunit.client.0.smithi071.stdout:config.status: creating include/builddefs 2024-05-27T09:51:16.056 INFO:tasks.workunit.client.0.smithi071.stdout:config.status: creating include/config.h 2024-05-27T09:51:16.092 INFO:tasks.workunit.client.0.smithi071.stdout:config.status: executing libtool commands 2024-05-27T09:51:16.255 INFO:tasks.workunit.client.0.smithi071.stdout:Building include 2024-05-27T09:51:16.255 INFO:tasks.workunit.client.0.smithi071.stdout:Building lib 2024-05-27T09:51:16.257 INFO:tasks.workunit.client.0.smithi071.stdout:Building tests 2024-05-27T09:51:16.267 INFO:tasks.workunit.client.0.smithi071.stdout: [LTDEP] 2024-05-27T09:51:16.274 INFO:tasks.workunit.client.0.smithi071.stdout:Building btrfs 2024-05-27T09:51:16.274 INFO:tasks.workunit.client.0.smithi071.stdout:Building ceph 2024-05-27T09:51:16.276 INFO:tasks.workunit.client.0.smithi071.stdout:Building cifs 2024-05-27T09:51:16.296 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-05-27T09:51:16.296 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-05-27T09:51:16.321 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-05-27T09:51:16.366 INFO:tasks.workunit.client.0.smithi071.stdout:Building ext4 2024-05-27T09:51:16.371 INFO:tasks.workunit.client.0.smithi071.stdout:Building f2fs 2024-05-27T09:51:16.392 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-05-27T09:51:16.400 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-05-27T09:51:16.460 INFO:tasks.workunit.client.0.smithi071.stdout:Building generic 2024-05-27T09:51:16.591 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-05-27T09:51:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.642+0000 7f644e400700 1 -- 172.21.15.71:0/69753660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 msgr2=0x7f6448114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.642+0000 7f644e400700 1 --2- 172.21.15.71:0/69753660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f6448114c30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f64340098f0 tx=0x7f6434009c00 comp rx=0 tx=0).stop 2024-05-27T09:51:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.642+0000 7f644e400700 1 -- 172.21.15.71:0/69753660 shutdown_connections 2024-05-27T09:51:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.642+0000 7f644e400700 1 --2- 172.21.15.71:0/69753660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448115170 0x7f6448117590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.642+0000 7f644e400700 1 --2- 172.21.15.71:0/69753660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6448075b50 0x7f6448075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.642+0000 7f644e400700 1 --2- 172.21.15.71:0/69753660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f6448114c30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.642+0000 7f644e400700 1 -- 172.21.15.71:0/69753660 >> 172.21.15.71:0/69753660 conn(0x7f6448079d00 msgr2=0x7f644807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.643+0000 7f644e400700 1 -- 172.21.15.71:0/69753660 shutdown_connections 2024-05-27T09:51:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.643+0000 7f644e400700 1 -- 172.21.15.71:0/69753660 wait complete. 2024-05-27T09:51:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.645+0000 7f644e400700 1 Processor -- start 2024-05-27T09:51:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.645+0000 7f644e400700 1 -- start start 2024-05-27T09:51:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644e400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448075b50 0x7f64481a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f64481a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644e400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6448115170 0x7f64481a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644e400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f644811a8d0 con 0x7f6448115170 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f644811a750 con 0x7f64480764a0 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644e400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f644811aa50 con 0x7f6448075b50 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644d000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448075b50 0x7f64481a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f6447e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f64481a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644d000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448075b50 0x7f64481a12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53824/0 (socket says 172.21.15.71:53824) 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f644d000700 1 -- 172.21.15.71:0/440128652 learned_addr learned my addr 172.21.15.71:0/440128652 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.646+0000 7f6447e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f64481a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53806/0 (socket says 172.21.15.71:53806) 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f644da00700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6448115170 0x7f64481a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f644d000700 1 -- 172.21.15.71:0/440128652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 msgr2=0x7f64481a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f644d000700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f64481a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f644d000700 1 -- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6448115170 msgr2=0x7f64481a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f644d000700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6448115170 0x7f64481a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f644d000700 1 -- 172.21.15.71:0/440128652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64481a61b0 con 0x7f6448075b50 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f6447e00700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f64481a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.647+0000 7f644da00700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6448115170 0x7f64481a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:51:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.648+0000 7f644d000700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448075b50 0x7f64481a12e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f644000e9a0 tx=0x7f644000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.648+0000 7f6445600700 1 -- 172.21.15.71:0/440128652 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644000cbd0 con 0x7f6448075b50 2024-05-27T09:51:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.649+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64481a64a0 con 0x7f6448075b50 2024-05-27T09:51:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.649+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644806d1d0 con 0x7f6448075b50 2024-05-27T09:51:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.649+0000 7f6445600700 1 -- 172.21.15.71:0/440128652 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f644000cd70 con 0x7f6448075b50 2024-05-27T09:51:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.649+0000 7f6445600700 1 -- 172.21.15.71:0/440128652 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644000cbd0 con 0x7f6448075b50 2024-05-27T09:51:16.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.650+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6428005330 con 0x7f6448075b50 2024-05-27T09:51:16.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.654+0000 7f6445600700 1 -- 172.21.15.71:0/440128652 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f6440010430 con 0x7f6448075b50 2024-05-27T09:51:16.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.656+0000 7f6445600700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f642c0b2c70 0x7f642c0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:16.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.656+0000 7f6445600700 1 -- 172.21.15.71:0/440128652 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f64400e2320 con 0x7f6448075b50 2024-05-27T09:51:16.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.657+0000 7f6447e00700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f642c0b2c70 0x7f642c0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:16.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.658+0000 7f6447e00700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f642c0b2c70 0x7f642c0b5180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f64340098c0 tx=0x7f6434019040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:16.663+0000 7f6445600700 1 -- 172.21.15.71:0/440128652 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f64400a9d30 con 0x7f6448075b50 2024-05-27T09:51:16.668 INFO:tasks.workunit.client.0.smithi071.stdout:Building nfs 2024-05-27T09:51:16.683 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-05-27T09:51:16.737 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] dataascii.lo 2024-05-27T09:51:16.741 INFO:tasks.workunit.client.0.smithi071.stdout:Building ocfs2 2024-05-27T09:51:16.758 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-05-27T09:51:16.807 INFO:tasks.workunit.client.0.smithi071.stdout:Building overlay 2024-05-27T09:51:16.836 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-05-27T09:51:16.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:16 smithi122 ceph-mon[36436]: pgmap v108: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 111 KiB/s wr, 52 op/s 2024-05-27T09:51:17.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:16 smithi071 ceph-mon[31451]: pgmap v108: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 111 KiB/s wr, 52 op/s 2024-05-27T09:51:17.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:16 smithi072 ceph-mon[35951]: pgmap v108: 97 pgs: 97 active+clean; 27 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 111 KiB/s wr, 52 op/s 2024-05-27T09:51:17.046 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] databin.lo 2024-05-27T09:51:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.052+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64280058f0 con 0x7f6448075b50 2024-05-27T09:51:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.053+0000 7f6445600700 1 -- 172.21.15.71:0/440128652 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11858 (secure 0 0 0) 0x7f64400a9630 con 0x7f6448075b50 2024-05-27T09:51:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:51:17.053 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:50:40.326047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:51:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.056+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f642c0b2c70 msgr2=0x7f642c0b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.056+0000 7f644e400700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f642c0b2c70 0x7f642c0b5180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f64340098c0 tx=0x7f6434019040 comp rx=0 tx=0).stop 2024-05-27T09:51:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.056+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448075b50 msgr2=0x7f64481a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.056+0000 7f644e400700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448075b50 0x7f64481a12e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f644000e9a0 tx=0x7f644000ecb0 comp rx=0 tx=0).stop 2024-05-27T09:51:17.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 shutdown_connections 2024-05-27T09:51:17.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f642c0b2c70 0x7f642c0b5180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:17.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6448115170 0x7f64481a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:17.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6448075b50 0x7f64481a12e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:17.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 --2- 172.21.15.71:0/440128652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64480764a0 0x7f64481a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 >> 172.21.15.71:0/440128652 conn(0x7f6448079d00 msgr2=0x7f6448100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 shutdown_connections 2024-05-27T09:51:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:17.057+0000 7f644e400700 1 -- 172.21.15.71:0/440128652 wait complete. 2024-05-27T09:51:17.059 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 28 2024-05-27T09:51:17.093 INFO:tasks.workunit.client.0.smithi071.stdout:Building perf 2024-05-27T09:51:17.112 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-05-27T09:51:17.158 INFO:tasks.workunit.client.0.smithi071.stdout:Building selftest 2024-05-27T09:51:17.161 INFO:tasks.workunit.client.0.smithi071.stdout:Building shared 2024-05-27T09:51:17.173 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-05-27T09:51:17.178 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-05-27T09:51:17.222 INFO:tasks.workunit.client.0.smithi071.stdout:Building tmpfs 2024-05-27T09:51:17.236 INFO:tasks.workunit.client.0.smithi071.stdout:Building udf 2024-05-27T09:51:17.236 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-05-27T09:51:17.251 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-05-27T09:51:17.287 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] datapid.lo 2024-05-27T09:51:17.296 INFO:tasks.workunit.client.0.smithi071.stdout:Building xfs 2024-05-27T09:51:17.565 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] file_lock.lo 2024-05-27T09:51:17.607 INFO:tasks.workunit.client.0.smithi071.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-05-27T09:51:17.709 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] forker.lo 2024-05-27T09:51:17.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:17 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/440128652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:17.912 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] pattern.lo 2024-05-27T09:51:17.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:17 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/440128652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:18.019 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] open_flags.lo 2024-05-27T09:51:18.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:17 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/440128652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:18.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-27T09:51:18.181 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] random_range.lo 2024-05-27T09:51:18.239 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] string_to_tokens.lo 2024-05-27T09:51:18.326 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] str_to_bytes.lo 2024-05-27T09:51:18.488 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] tlibio.lo 2024-05-27T09:51:18.607 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:18.650 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] random.lo 2024-05-27T09:51:18.650 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] write_log.lo 2024-05-27T09:51:18.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:18 smithi071 ceph-mon[31451]: pgmap v109: 97 pgs: 97 active+clean; 30 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 420 KiB/s wr, 172 op/s 2024-05-27T09:51:18.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:18 smithi122 ceph-mon[36436]: pgmap v109: 97 pgs: 97 active+clean; 30 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 420 KiB/s wr, 172 op/s 2024-05-27T09:51:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:18 smithi072 ceph-mon[35951]: pgmap v109: 97 pgs: 97 active+clean; 30 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 420 KiB/s wr, 172 op/s 2024-05-27T09:51:19.090 INFO:tasks.workunit.client.0.smithi071.stdout: [LD] 2024-05-27T09:51:19.343 INFO:tasks.workunit.client.0.smithi071.stdout:Building ltp 2024-05-27T09:51:19.344 INFO:tasks.workunit.client.0.smithi071.stdout:Building src 2024-05-27T09:51:19.344 INFO:tasks.workunit.client.0.smithi071.stdout:Building m4 2024-05-27T09:51:19.345 INFO:tasks.workunit.client.0.smithi071.stdout:Building common 2024-05-27T09:51:19.361 INFO:tasks.workunit.client.0.smithi071.stdout: [DEP] 2024-05-27T09:51:19.389 INFO:tasks.workunit.client.0.smithi071.stdout: [DEP] 2024-05-27T09:51:19.839 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fsstress 2024-05-27T09:51:19.840 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] doio 2024-05-27T09:51:19.840 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fsx 2024-05-27T09:51:20.808 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] growfiles 2024-05-27T09:51:20.864 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] iogen 2024-05-27T09:51:20.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:20 smithi071 ceph-mon[31451]: pgmap v110: 97 pgs: 97 active+clean; 30 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 398 KiB/s wr, 125 op/s 2024-05-27T09:51:20.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:20 smithi122 ceph-mon[36436]: pgmap v110: 97 pgs: 97 active+clean; 30 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 398 KiB/s wr, 125 op/s 2024-05-27T09:51:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:20 smithi072 ceph-mon[35951]: pgmap v110: 97 pgs: 97 active+clean; 30 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 398 KiB/s wr, 125 op/s 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.029+0000 7f3735400700 1 -- 172.21.15.71:0/2774647331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 msgr2=0x7f37301049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.029+0000 7f3735400700 1 --2- 172.21.15.71:0/2774647331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f37301049f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3720009990 tx=0x7f3720009ca0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.029+0000 7f3735400700 1 -- 172.21.15.71:0/2774647331 shutdown_connections 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.029+0000 7f3735400700 1 --2- 172.21.15.71:0/2774647331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3730109860 0x7f37301111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.030+0000 7f3735400700 1 --2- 172.21.15.71:0/2774647331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f37301049f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.030+0000 7f3735400700 1 --2- 172.21.15.71:0/2774647331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3730108f10 0x7f3730109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.030+0000 7f3735400700 1 -- 172.21.15.71:0/2774647331 >> 172.21.15.71:0/2774647331 conn(0x7f3730100030 msgr2=0x7f3730102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:21.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.030+0000 7f3735400700 1 -- 172.21.15.71:0/2774647331 shutdown_connections 2024-05-27T09:51:21.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.031+0000 7f3735400700 1 -- 172.21.15.71:0/2774647331 wait complete. 2024-05-27T09:51:21.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.032+0000 7f3735400700 1 Processor -- start 2024-05-27T09:51:21.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.032+0000 7f3735400700 1 -- start start 2024-05-27T09:51:21.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f3735400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f373019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f3735400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3730108f10 0x7f373019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f3735400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3730109860 0x7f37301a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f3735400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3730114560 con 0x7f3730109860 2024-05-27T09:51:21.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f3735400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f37301143e0 con 0x7f37301045e0 2024-05-27T09:51:21.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f3735400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37301146e0 con 0x7f3730108f10 2024-05-27T09:51:21.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f372e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f373019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f372e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f373019d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53818/0 (socket says 172.21.15.71:53818) 2024-05-27T09:51:21.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.033+0000 7f372e800700 1 -- 172.21.15.71:0/2542114216 learned_addr learned my addr 172.21.15.71:0/2542114216 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:21.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.034+0000 7f372f200700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3730109860 0x7f37301a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.034+0000 7f372de00700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3730108f10 0x7f373019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.035+0000 7f372e800700 1 -- 172.21.15.71:0/2542114216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3730108f10 msgr2=0x7f373019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.035+0000 7f372e800700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3730108f10 0x7f373019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.035+0000 7f372e800700 1 -- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3730109860 msgr2=0x7f37301a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.035+0000 7f372e800700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3730109860 0x7f37301a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.035+0000 7f372e800700 1 -- 172.21.15.71:0/2542114216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37301a2020 con 0x7f37301045e0 2024-05-27T09:51:21.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.035+0000 7f372f200700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3730109860 0x7f37301a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:21.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.035+0000 7f372e800700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f373019d150 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3720005910 tx=0x7f37200047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:21.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.036+0000 7f3727400700 1 -- 172.21.15.71:0/2542114216 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720027070 con 0x7f37301045e0 2024-05-27T09:51:21.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.036+0000 7f3727400700 1 -- 172.21.15.71:0/2542114216 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f372000b610 con 0x7f37301045e0 2024-05-27T09:51:21.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.036+0000 7f3727400700 1 -- 172.21.15.71:0/2542114216 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37200173f0 con 0x7f37301045e0 2024-05-27T09:51:21.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.037+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37301a22b0 con 0x7f37301045e0 2024-05-27T09:51:21.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.038+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37301a2710 con 0x7f37301045e0 2024-05-27T09:51:21.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.042+0000 7f3743ecdb80 1 Processor -- start 2024-05-27T09:51:21.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.043+0000 7f3743ecdb80 1 -- start start 2024-05-27T09:51:21.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.043+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c7967f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.043+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c796d30 0x56159c790870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.043+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c790db0 0x56159c7911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.043+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56159c6bee40 con 0x56159c611e40 2024-05-27T09:51:21.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.043+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56159c6ae9e0 con 0x56159c796d30 2024-05-27T09:51:21.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.043+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56159c6b2a20 con 0x56159c790db0 2024-05-27T09:51:21.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.044+0000 7f372de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c790db0 0x56159c7911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.044+0000 7f372de00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c790db0 0x56159c7911c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53850/0 (socket says 172.21.15.71:53850) 2024-05-27T09:51:21.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.044+0000 7f372de00700 1 -- 172.21.15.71:0/2843303048 learned_addr learned my addr 172.21.15.71:0/2843303048 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:21.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.044+0000 7f3727400700 1 -- 172.21.15.71:0/2542114216 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f3720009d10 con 0x7f37301045e0 2024-05-27T09:51:21.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.045+0000 7f372de00700 1 -- 172.21.15.71:0/2843303048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c796d30 msgr2=0x56159c790870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T09:51:21.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.045+0000 7f372de00700 1 --2- 172.21.15.71:0/2843303048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c796d30 0x56159c790870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.045+0000 7f372de00700 1 -- 172.21.15.71:0/2843303048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 msgr2=0x56159c7967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:21.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.045+0000 7f372de00700 1 --2- 172.21.15.71:0/2843303048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c7967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.045+0000 7f372de00700 1 -- 172.21.15.71:0/2843303048 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159c677420 con 0x56159c790db0 2024-05-27T09:51:21.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.046+0000 7f372de00700 1 --2- 172.21.15.71:0/2843303048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c790db0 0x56159c7911c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f371c009cf0 tx=0x7f371c011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff2558e7dd778c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:21.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.046+0000 7f371be00700 1 -- 172.21.15.71:0/2843303048 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c011e30 con 0x56159c790db0 2024-05-27T09:51:21.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.046+0000 7f371be00700 1 -- 172.21.15.71:0/2843303048 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371c004500 con 0x56159c790db0 2024-05-27T09:51:21.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.046+0000 7f371be00700 1 -- 172.21.15.71:0/2843303048 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c005340 con 0x56159c790db0 2024-05-27T09:51:21.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.047+0000 7f3727400700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37140b2af0 0x7f37140b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.047+0000 7f3727400700 1 -- 172.21.15.71:0/2542114216 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f37200e3090 con 0x7f37301045e0 2024-05-27T09:51:21.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.048+0000 7f372f200700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37140b2af0 0x7f37140b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.048+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2843303048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c790db0 msgr2=0x56159c7911c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.048+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2843303048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c790db0 0x56159c7911c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f371c009cf0 tx=0x7f371c011440 comp rx=0 tx=0).stop 2024-05-27T09:51:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.049+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2843303048 shutdown_connections 2024-05-27T09:51:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.049+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2843303048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c790db0 0x56159c7911c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.049+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2843303048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c7967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.049+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2843303048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c796d30 0x56159c790870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.049+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2843303048 >> 172.21.15.71:0/2843303048 conn(0x56159c671fc0 msgr2=0x56159c78b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.049+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2843303048 shutdown_connections 2024-05-27T09:51:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.049+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2843303048 wait complete. 2024-05-27T09:51:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.050+0000 7f372f200700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37140b2af0 0x7f37140b5000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x56159c791b30 tx=0x7f372800d040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.050+0000 7f3743ecdb80 1 -- start start 2024-05-27T09:51:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.050+0000 7f3743ecdb80 1 Processor -- start 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.051+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c79a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.051+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c79ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.051+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c796d30 0x56159c79b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.051+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56159c5b4fa0 con 0x56159c611e40 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.051+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56159c64f760 con 0x56159c790db0 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.051+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56159c79d800 con 0x56159c796d30 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.051+0000 7f3743ecdb80 10 client.0 _ll_register_callbacks cb 0x56159c658c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.052+0000 7f372de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c79ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.052+0000 7f372de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c79ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53824/0 (socket says 172.21.15.71:53824) 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.052+0000 7f372de00700 1 -- 172.21.15.71:0/2418295956 learned_addr learned my addr 172.21.15.71:0/2418295956 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:21.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.052+0000 7f372e800700 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c79a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.052+0000 7f372f200700 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c796d30 0x56159c79b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.053+0000 7f372e800700 1 -- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c796d30 msgr2=0x56159c79b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:21.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.053+0000 7f372e800700 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c796d30 0x56159c79b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.053+0000 7f372e800700 1 -- 172.21.15.71:0/2418295956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 msgr2=0x56159c79ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:21.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.053+0000 7f372e800700 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c79ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.053+0000 7f372e800700 1 -- 172.21.15.71:0/2418295956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56159c5fe8d0 con 0x56159c611e40 2024-05-27T09:51:21.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.053+0000 7f372e800700 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c79a5f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f37200e07b0 tx=0x7f37200a9da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3213657a68451e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:21.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.053+0000 7f3718c00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:21.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.055+0000 7f3718c00700 1 -- 172.21.15.71:0/2418295956 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37200e0c40 con 0x56159c611e40 2024-05-27T09:51:21.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.055+0000 7f3718c00700 1 -- 172.21.15.71:0/2418295956 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f37200aa630 con 0x56159c611e40 2024-05-27T09:51:21.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.055+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f371c004500 con 0x56159c611e40 2024-05-27T09:51:21.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.055+0000 7f3718c00700 1 -- 172.21.15.71:0/2418295956 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37200aaad0 con 0x56159c611e40 2024-05-27T09:51:21.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.056+0000 7f3743ecdb80 10 client.15957 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:21.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.056+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56159c67f060 con 0x56159c611e40 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.056+0000 7f3718c00700 1 -- 172.21.15.71:0/2418295956 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371c004500 con 0x56159c611e40 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.056+0000 7f3718c00700 1 -- 172.21.15.71:0/2418295956 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f37200b2d10 con 0x56159c611e40 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.056+0000 7f3743ecdb80 10 client.15957 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.057+0000 7f3743ecdb80 10 client.15957 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.057+0000 7f3743ecdb80 20 client.15957 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.057+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c7b2e90 0x56159c7b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.057+0000 7f3743ecdb80 4 client.15957 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.057+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56159c6c0d90 con 0x56159c7b2e90 2024-05-27T09:51:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.057+0000 7f372de00700 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c7b2e90 0x56159c7b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.058+0000 7f3718c00700 10 client.15957 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:51:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.058+0000 7f372de00700 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c7b2e90 0x56159c7b52b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83a7e5987907ba2c server_cookie=e5bb9d6169c82078 in_seq=0 out_seq=0 2024-05-27T09:51:21.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.059+0000 7f3718c00700 1 -- 172.21.15.71:0/2418295956 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56159c6c0d90 con 0x56159c7b2e90 2024-05-27T09:51:21.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.059+0000 7f3718c00700 10 client.15957 handle_command_reply: tid=0 2024-05-27T09:51:21.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.059+0000 7f3743ecdb80 1 client.15957 shutdown 2024-05-27T09:51:21.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.059+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 msgr2=0x56159c79a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.059+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c79a5f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f37200e07b0 tx=0x7f37200a9da0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.060+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 shutdown_connections 2024-05-27T09:51:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.060+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c7b2e90 0x56159c7b52b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.060+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c796d30 0x56159c79b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.060+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c611e40 0x56159c79a5f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.060+0000 7f3718c00700 0 client.15957 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:51:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.060+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/2418295956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c79ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.060+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 >> 172.21.15.71:0/2418295956 conn(0x56159c671fc0 msgr2=0x56159c78b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.061+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 shutdown_connections 2024-05-27T09:51:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.061+0000 7f3743ecdb80 1 -- 172.21.15.71:0/2418295956 wait complete. 2024-05-27T09:51:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.061+0000 7f3743ecdb80 20 client.15957 trim_cache size 0 max 16384 2024-05-27T09:51:21.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 Processor -- start 2024-05-27T09:51:21.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 -- start start 2024-05-27T09:51:21.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c790870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7948f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37301af3a0 con 0x56159c796d30 2024-05-27T09:51:21.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f37301acc30 con 0x56159c790db0 2024-05-27T09:51:21.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.088+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f373010f160 con 0x56159c611e40 2024-05-27T09:51:21.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c790870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c790870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53880/0 (socket says 172.21.15.71:53880) 2024-05-27T09:51:21.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 -- 172.21.15.71:0/1470311944 learned_addr learned my addr 172.21.15.71:0/1470311944 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:21.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372f200700 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 -- 172.21.15.71:0/1470311944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 msgr2=0x56159c7948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:21.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7948f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 -- 172.21.15.71:0/1470311944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 msgr2=0x56159c7ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:21.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372e800700 1 -- 172.21.15.71:0/1470311944 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159c78d030 con 0x56159c611e40 2024-05-27T09:51:21.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.089+0000 7f372f200700 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:51:21.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.090+0000 7f372e800700 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c790870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37200a9e90 tx=0x7f3720009390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6836942e0d9c1270 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:21.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.090+0000 7f371b400700 1 -- 172.21.15.71:0/1470311944 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37200e0c40 con 0x56159c611e40 2024-05-27T09:51:21.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.090+0000 7f371b400700 1 -- 172.21.15.71:0/1470311944 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37200aa3d0 con 0x56159c611e40 2024-05-27T09:51:21.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.090+0000 7f371b400700 1 -- 172.21.15.71:0/1470311944 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37200a9b40 con 0x56159c611e40 2024-05-27T09:51:21.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.091+0000 7f3743ecdb80 1 -- 172.21.15.71:0/1470311944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 msgr2=0x56159c790870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.091+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c790870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37200a9e90 tx=0x7f3720009390 comp rx=0 tx=0).stop 2024-05-27T09:51:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.091+0000 7f3743ecdb80 1 -- 172.21.15.71:0/1470311944 shutdown_connections 2024-05-27T09:51:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.091+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.091+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c790870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.091+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/1470311944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.091+0000 7f3743ecdb80 1 -- 172.21.15.71:0/1470311944 >> 172.21.15.71:0/1470311944 conn(0x56159c671fc0 msgr2=0x56159c7941e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.092+0000 7f3743ecdb80 1 -- 172.21.15.71:0/1470311944 shutdown_connections 2024-05-27T09:51:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.092+0000 7f3743ecdb80 1 -- 172.21.15.71:0/1470311944 wait complete. 2024-05-27T09:51:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.093+0000 7f3743ecdb80 1 -- start start 2024-05-27T09:51:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.093+0000 7f3743ecdb80 1 Processor -- start 2024-05-27T09:51:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.094+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c78fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.094+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.094+0000 7f3743ecdb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7906e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.094+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37301ab0f0 con 0x56159c796d30 2024-05-27T09:51:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.094+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f37301ac560 con 0x56159c790db0 2024-05-27T09:51:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.094+0000 7f3743ecdb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37301ab7c0 con 0x56159c611e40 2024-05-27T09:51:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.094+0000 7f3743ecdb80 10 client.0 _ll_register_callbacks cb 0x56159c658c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372e800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c78fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372f200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7906e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372e800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c78fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53888/0 (socket says 172.21.15.71:53888) 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372e800700 1 -- 172.21.15.71:0/3044531238 learned_addr learned my addr 172.21.15.71:0/3044531238 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372de00700 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372f200700 1 -- 172.21.15.71:0/3044531238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 msgr2=0x56159c78fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372f200700 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c78fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372f200700 1 -- 172.21.15.71:0/3044531238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 msgr2=0x56159c7901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372f200700 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7901a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.095+0000 7f372f200700 1 -- 172.21.15.71:0/3044531238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56159c79b3e0 con 0x56159c796d30 2024-05-27T09:51:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.096+0000 7f372f200700 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7906e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3728009e90 tx=0x7f3728009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1bcf862f3fa72b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.096+0000 7f3718c00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.096+0000 7f3718c00700 1 -- 172.21.15.71:0/3044531238 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728027070 con 0x56159c796d30 2024-05-27T09:51:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.096+0000 7f3718c00700 1 -- 172.21.15.71:0/3044531238 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f3728023830 con 0x56159c796d30 2024-05-27T09:51:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.096+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37200aa3d0 con 0x56159c796d30 2024-05-27T09:51:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3718c00700 1 -- 172.21.15.71:0/3044531238 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3728023a30 con 0x56159c796d30 2024-05-27T09:51:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 10 client.15963 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56159c81d9c0 con 0x56159c796d30 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3718c00700 1 -- 172.21.15.71:0/3044531238 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3728023bd0 con 0x56159c796d30 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3718c00700 1 -- 172.21.15.71:0/3044531238 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f3728022c90 con 0x56159c796d30 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 10 client.15963 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 10 client.15963 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 20 client.15963 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c81e0d0 0x56159c8204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 4 client.15963 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:51:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.097+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 --> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f37200aa3d0 con 0x56159c81e0d0 2024-05-27T09:51:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.099+0000 7f372e800700 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c81e0d0 0x56159c8204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.100+0000 7f3718c00700 10 client.15963 ms_handle_connect on v2:172.21.15.122:6838/3712813671 2024-05-27T09:51:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.100+0000 7f372e800700 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c81e0d0 0x56159c8204f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef3e2cfbf901bc62 server_cookie=dc00fecb1aaf3b7c in_seq=0 out_seq=0 2024-05-27T09:51:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.100+0000 7f3718c00700 1 -- 172.21.15.71:0/3044531238 <== mds.2 v2:172.21.15.122:6838/3712813671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3063 (crc 0 0 0) 0x7f37200aa3d0 con 0x56159c81e0d0 2024-05-27T09:51:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.100+0000 7f3718c00700 10 client.15963 handle_command_reply: tid=0 2024-05-27T09:51:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.100+0000 7f3743ecdb80 1 client.15963 shutdown 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 msgr2=0x56159c7906e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7906e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3728009e90 tx=0x7f3728009650 comp rx=0 tx=0).stop 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 shutdown_connections 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.122:6838/3712813671,v1:172.21.15.122:6839/3712813671] conn(0x56159c81e0d0 0x56159c8204f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56159c796d30 0x56159c7906e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56159c611e40 0x56159c78fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 --2- 172.21.15.71:0/3044531238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56159c790db0 0x56159c7901a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 >> 172.21.15.71:0/3044531238 conn(0x56159c671fc0 msgr2=0x56159c7941e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.101+0000 7f3718c00700 0 client.15963 ms_handle_reset on v2:172.21.15.122:6838/3712813671 2024-05-27T09:51:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.102+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 shutdown_connections 2024-05-27T09:51:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.102+0000 7f3743ecdb80 1 -- 172.21.15.71:0/3044531238 wait complete. 2024-05-27T09:51:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.102+0000 7f3743ecdb80 20 client.15963 trim_cache size 0 max 16384 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 898846904, 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628466, 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/pattern.c" 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 988277204, 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628471, 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/tlibio.c" 2024-05-27T09:51:21.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 1196651092, 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628467, 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random.c" 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 1446114075, 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628463, 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/file_lock.c" 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.105 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 1575731090, 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628459, 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/Makefile" 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 2005763219, 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628461, 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/databin.c" 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.106 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 3044887078, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628460, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/dataascii.c" 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 3091537664, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628468, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random_range.c" 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 3282795486, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628470, 2024-05-27T09:51:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/string_to_tokens.c" 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 3321999657, 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628465, 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/open_flags.c" 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 3474651031, 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628462, 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/datapid.c" 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 3540994548, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628472, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/write_log.c" 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 3765296378, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628469, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/str_to_bytes.c" 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "damage_type": "backtrace", 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4192580263, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 1099511628464, 2024-05-27T09:51:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/forker.c" 2024-05-27T09:51:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:21.110 INFO:teuthology.orchestra.run.smithi071.stdout:] 2024-05-27T09:51:21.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37140b2af0 msgr2=0x7f37140b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37140b2af0 0x7f37140b5000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x56159c791b30 tx=0x7f372800d040 comp rx=0 tx=0).stop 2024-05-27T09:51:21.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 msgr2=0x7f373019d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:21.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f373019d150 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3720005910 tx=0x7f37200047b0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 shutdown_connections 2024-05-27T09:51:21.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37140b2af0 0x7f37140b5000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3730109860 0x7f37301a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37301045e0 0x7f373019d150 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 --2- 172.21.15.71:0/2542114216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3730108f10 0x7f373019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:21.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.103+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 >> 172.21.15.71:0/2542114216 conn(0x7f3730100030 msgr2=0x7f3730108680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:21.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.104+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 shutdown_connections 2024-05-27T09:51:21.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:21.104+0000 7f3735400700 1 -- 172.21.15.71:0/2542114216 wait complete. 2024-05-27T09:51:21.461 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-stress 2024-05-27T09:51:22.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-27T09:51:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:22.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:22 smithi071 ceph-mon[31451]: pgmap v111: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 443 KiB/s wr, 443 op/s 2024-05-27T09:51:22.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:22 smithi122 ceph-mon[36436]: pgmap v111: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 443 KiB/s wr, 443 op/s 2024-05-27T09:51:23.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:22 smithi072 ceph-mon[35951]: pgmap v111: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 443 KiB/s wr, 443 op/s 2024-05-27T09:51:23.902 INFO:tasks.workunit.client.0.smithi071.stdout: [DEP] 2024-05-27T09:51:23.903 INFO:tasks.workunit.client.0.smithi071.stdout: [DEP] 2024-05-27T09:51:23.904 INFO:tasks.workunit.client.0.smithi071.stdout: [DEP] 2024-05-27T09:51:23.907 INFO:tasks.workunit.client.0.smithi071.stdout: [DEP] 2024-05-27T09:51:24.437 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] dirstress 2024-05-27T09:51:24.437 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fill 2024-05-27T09:51:24.438 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fill2 2024-05-27T09:51:24.439 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] getpagesize 2024-05-27T09:51:24.739 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] holes 2024-05-27T09:51:24.769 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] lstat64 2024-05-27T09:51:24.853 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] nametest 2024-05-27T09:51:24.879 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] permname 2024-05-27T09:51:24.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:24 smithi122 ceph-mon[36436]: pgmap v112: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 437 op/s 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.002+0000 7f171dc00700 1 -- 172.21.15.71:0/1158105018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1718103a40 msgr2=0x7f1718110760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.002+0000 7f171dc00700 1 --2- 172.21.15.71:0/1158105018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1718103a40 0x7f1718110760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1704009990 tx=0x7f1704009ca0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.003+0000 7f171dc00700 1 -- 172.21.15.71:0/1158105018 shutdown_connections 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.003+0000 7f171dc00700 1 --2- 172.21.15.71:0/1158105018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1718110ca0 0x7f17181130c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.003+0000 7f171dc00700 1 --2- 172.21.15.71:0/1158105018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17181030f0 0x7f1718103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.003+0000 7f171dc00700 1 --2- 172.21.15.71:0/1158105018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1718103a40 0x7f1718110760 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.003+0000 7f171dc00700 1 -- 172.21.15.71:0/1158105018 >> 172.21.15.71:0/1158105018 conn(0x7f17180fedb0 msgr2=0x7f17181011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.003+0000 7f171dc00700 1 -- 172.21.15.71:0/1158105018 shutdown_connections 2024-05-27T09:51:25.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.004+0000 7f171dc00700 1 -- 172.21.15.71:0/1158105018 wait complete. 2024-05-27T09:51:25.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:24 smithi071 ceph-mon[31451]: pgmap v112: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 437 op/s 2024-05-27T09:51:25.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 Processor -- start 2024-05-27T09:51:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 -- start start 2024-05-27T09:51:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17181030f0 0x7f171819d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1718103a40 0x7f171819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1718110ca0 0x7f17181a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17181166a0 con 0x7f17181030f0 2024-05-27T09:51:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1718116520 con 0x7f1718103a40 2024-05-27T09:51:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.006+0000 7f171dc00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1718116820 con 0x7f1718110ca0 2024-05-27T09:51:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1716000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1718103a40 0x7f171819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1718110ca0 0x7f17181a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1718110ca0 0x7f17181a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33128/0 (socket says 172.21.15.71:33128) 2024-05-27T09:51:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 -- 172.21.15.71:0/3662579605 learned_addr learned my addr 172.21.15.71:0/3662579605 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 -- 172.21.15.71:0/3662579605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1718103a40 msgr2=0x7f171819d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1718103a40 0x7f171819d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 -- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17181030f0 msgr2=0x7f171819d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17181030f0 0x7f171819d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.007+0000 7f1717400700 1 -- 172.21.15.71:0/3662579605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17181a1f00 con 0x7f1718110ca0 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.008+0000 7f1717400700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1718110ca0 0x7f17181a1860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f171000c370 tx=0x7f171000c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.008+0000 7f170f400700 1 -- 172.21.15.71:0/3662579605 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171000ce20 con 0x7f1718110ca0 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.008+0000 7f170f400700 1 -- 172.21.15.71:0/3662579605 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17100090d0 con 0x7f1718110ca0 2024-05-27T09:51:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.008+0000 7f170f400700 1 -- 172.21.15.71:0/3662579605 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17100047c0 con 0x7f1718110ca0 2024-05-27T09:51:25.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.009+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17181a2190 con 0x7f1718110ca0 2024-05-27T09:51:25.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.009+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17181a2650 con 0x7f1718110ca0 2024-05-27T09:51:25.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.015+0000 7f172c791b80 1 Processor -- start 2024-05-27T09:51:25.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.015+0000 7f170f400700 1 -- 172.21.15.71:0/3662579605 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f171001a030 con 0x7f1718110ca0 2024-05-27T09:51:25.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.016+0000 7f172c791b80 1 -- start start 2024-05-27T09:51:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.016+0000 7f172c791b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 0x55d8dde5d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.016+0000 7f172c791b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde5d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.016+0000 7f172c791b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde72940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.016+0000 7f172c791b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d8ddd8be40 con 0x55d8dddca9f0 2024-05-27T09:51:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.016+0000 7f172c791b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d8ddd7b9e0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.016+0000 7f172c791b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d8ddd7fa20 con 0x55d8ddcdee40 2024-05-27T09:51:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.017+0000 7f1716000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde72940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.017+0000 7f1716000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde72940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52234/0 (socket says 172.21.15.71:52234) 2024-05-27T09:51:25.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.017+0000 7f1716000700 1 -- 172.21.15.71:0/3936553017 learned_addr learned my addr 172.21.15.71:0/3936553017 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:25.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.017+0000 7f1716a00700 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde5d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.018+0000 7f170f400700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f16fc0b2af0 0x7f16fc0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.018+0000 7f1716000700 1 -- 172.21.15.71:0/3936553017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 msgr2=0x55d8dde5d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.018+0000 7f1716000700 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde5d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.018+0000 7f1716000700 1 -- 172.21.15.71:0/3936553017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 msgr2=0x55d8dde5d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.018+0000 7f1716000700 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 0x55d8dde5d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.018+0000 7f1716000700 1 -- 172.21.15.71:0/3936553017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ddd44420 con 0x55d8dde5ddb0 2024-05-27T09:51:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.018+0000 7f170f400700 1 -- 172.21.15.71:0/3662579605 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f17100e19d0 con 0x7f1718110ca0 2024-05-27T09:51:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.019+0000 7f1716000700 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde72940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1718076d30 tx=0x7f1704005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7659b3c71cee8e2a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.019+0000 7f1703e00700 1 -- 172.21.15.71:0/3936553017 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170400bd00 con 0x55d8dde5ddb0 2024-05-27T09:51:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.019+0000 7f1703e00700 1 -- 172.21.15.71:0/3936553017 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17040095d0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.019+0000 7f1703e00700 1 -- 172.21.15.71:0/3936553017 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704003e30 con 0x55d8dde5ddb0 2024-05-27T09:51:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.020+0000 7f1717400700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f16fc0b2af0 0x7f16fc0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.020+0000 7f172c791b80 1 -- 172.21.15.71:0/3936553017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 msgr2=0x55d8dde72940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.020+0000 7f172c791b80 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde72940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1718076d30 tx=0x7f1704005e80 comp rx=0 tx=0).stop 2024-05-27T09:51:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f1717400700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f16fc0b2af0 0x7f16fc0b5000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17100df150 tx=0x7f1710009040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f172c791b80 1 -- 172.21.15.71:0/3936553017 shutdown_connections 2024-05-27T09:51:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f172c791b80 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde72940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f172c791b80 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 0x55d8dde5d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f172c791b80 1 --2- 172.21.15.71:0/3936553017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde5d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f172c791b80 1 -- 172.21.15.71:0/3936553017 >> 172.21.15.71:0/3936553017 conn(0x55d8ddd78390 msgr2=0x55d8dde594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f172c791b80 1 -- 172.21.15.71:0/3936553017 shutdown_connections 2024-05-27T09:51:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.021+0000 7f172c791b80 1 -- 172.21.15.71:0/3936553017 wait complete. 2024-05-27T09:51:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.022+0000 7f172c791b80 1 -- start start 2024-05-27T09:51:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.022+0000 7f172c791b80 1 Processor -- start 2024-05-27T09:51:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f172c791b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddcdee40 0x55d8dde6ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f172c791b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde70450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f172c791b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde70990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f172c791b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d8ddc81fa0 con 0x55d8ddcdee40 2024-05-27T09:51:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f172c791b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d8ddd1c760 con 0x55d8dde5ddb0 2024-05-27T09:51:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f172c791b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d8dde73380 con 0x55d8dddca9f0 2024-05-27T09:51:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f172c791b80 10 client.0 _ll_register_callbacks cb 0x55d8ddd25c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f1716000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde70990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f1716000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde70990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52242/0 (socket says 172.21.15.71:52242) 2024-05-27T09:51:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.023+0000 7f1716000700 1 -- 172.21.15.71:0/1413967577 learned_addr learned my addr 172.21.15.71:0/1413967577 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.024+0000 7f1716a00700 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde70450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.024+0000 7f1716000700 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddcdee40 0x55d8dde6ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:24 smithi072 ceph-mon[35951]: pgmap v112: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 437 op/s 2024-05-27T09:51:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.024+0000 7f1716000700 1 -- 172.21.15.71:0/1413967577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 msgr2=0x55d8dde70450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.024+0000 7f1716000700 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde70450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.024+0000 7f1716000700 1 -- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddcdee40 msgr2=0x55d8dde6ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.024+0000 7f1716000700 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddcdee40 0x55d8dde6ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.024+0000 7f1716000700 1 -- 172.21.15.71:0/1413967577 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ddccb8d0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.025+0000 7f1716000700 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde70990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1704005b20 tx=0x7f170400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d10236ee909521 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.025+0000 7f1700c00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.025+0000 7f1700c00700 1 -- 172.21.15.71:0/1413967577 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704003cb0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.025+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17040095d0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.026+0000 7f1700c00700 1 -- 172.21.15.71:0/1413967577 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f170400f460 con 0x55d8dde5ddb0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.026+0000 7f1700c00700 1 -- 172.21.15.71:0/1413967577 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1704003e50 con 0x55d8dde5ddb0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.026+0000 7f172c791b80 10 client.26093 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.026+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8ddd4c060 con 0x55d8dde5ddb0 2024-05-27T09:51:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.026+0000 7f1700c00700 1 -- 172.21.15.71:0/1413967577 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17040095d0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f1700c00700 1 -- 172.21.15.71:0/1413967577 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f17040326a0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f172c791b80 10 client.26093 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f172c791b80 10 client.26093 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f172c791b80 20 client.26093 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f172c791b80 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8dde80200 0x55d8dde82620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f172c791b80 4 client.26093 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8ddd8dd90 con 0x55d8dde80200 2024-05-27T09:51:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.027+0000 7f1716a00700 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8dde80200 0x55d8dde82620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.029+0000 7f1716a00700 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8dde80200 0x55d8dde82620 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e46a24eb5796a95c server_cookie=89e1c9f9e5a1a93e in_seq=0 out_seq=0 2024-05-27T09:51:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.029+0000 7f1700c00700 10 client.26093 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:51:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.030+0000 7f1700c00700 1 -- 172.21.15.71:0/1413967577 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d8ddd8dd90 con 0x55d8dde80200 2024-05-27T09:51:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.030+0000 7f1700c00700 10 client.26093 handle_command_reply: tid=0 2024-05-27T09:51:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.031+0000 7f172c791b80 1 client.26093 shutdown 2024-05-27T09:51:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.031+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 msgr2=0x55d8dde70990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.031+0000 7f172c791b80 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde70990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1704005b20 tx=0x7f170400b260 comp rx=0 tx=0).stop 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.031+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 shutdown_connections 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.031+0000 7f172c791b80 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8dde80200 0x55d8dde82620 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.031+0000 7f172c791b80 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde70990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.031+0000 7f172c791b80 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddcdee40 0x55d8dde6ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.032+0000 7f172c791b80 1 --2- 172.21.15.71:0/1413967577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde70450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.032+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 >> 172.21.15.71:0/1413967577 conn(0x55d8ddd78390 msgr2=0x55d8dde59010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.032+0000 7f1700c00700 0 client.26093 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.032+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 shutdown_connections 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.032+0000 7f172c791b80 1 -- 172.21.15.71:0/1413967577 wait complete. 2024-05-27T09:51:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.032+0000 7f172c791b80 20 client.26093 trim_cache size 0 max 16384 2024-05-27T09:51:25.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.052+0000 7f172c791b80 1 Processor -- start 2024-05-27T09:51:25.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.052+0000 7f172c791b80 1 -- start start 2024-05-27T09:51:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f172c791b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde7b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f172c791b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 0x55d8dde7bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f172c791b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde7c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f172c791b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1718072b60 con 0x55d8dddca9f0 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f172c791b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f17180703f0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f172c791b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1718109510 con 0x55d8ddcdee40 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f1716000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde7b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f1716000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde7b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33160/0 (socket says 172.21.15.71:33160) 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f1716000700 1 -- 172.21.15.71:0/3284030140 learned_addr learned my addr 172.21.15.71:0/3284030140 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f1716a00700 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 0x55d8dde7bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.053+0000 7f1716000700 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde7c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.054+0000 7f1716000700 1 -- 172.21.15.71:0/3284030140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 msgr2=0x55d8dde7c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.054+0000 7f1716000700 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde7c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.054+0000 7f1716000700 1 -- 172.21.15.71:0/3284030140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 msgr2=0x55d8dde7bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.054+0000 7f1716000700 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 0x55d8dde7bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.054+0000 7f1716000700 1 -- 172.21.15.71:0/3284030140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8dde70d00 con 0x55d8ddcdee40 2024-05-27T09:51:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.054+0000 7f1716000700 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde7b610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1704006010 tx=0x7f1704009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14d5db93777d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.055+0000 7f1703400700 1 -- 172.21.15.71:0/3284030140 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170403f020 con 0x55d8ddcdee40 2024-05-27T09:51:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.055+0000 7f1703400700 1 -- 172.21.15.71:0/3284030140 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1704029040 con 0x55d8ddcdee40 2024-05-27T09:51:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.055+0000 7f1703400700 1 -- 172.21.15.71:0/3284030140 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170400f7a0 con 0x55d8ddcdee40 2024-05-27T09:51:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.056+0000 7f172c791b80 1 -- 172.21.15.71:0/3284030140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 msgr2=0x55d8dde7b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.056+0000 7f172c791b80 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde7b610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1704006010 tx=0x7f1704009ca0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.056+0000 7f172c791b80 1 -- 172.21.15.71:0/3284030140 shutdown_connections 2024-05-27T09:51:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.056+0000 7f172c791b80 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde7c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.056+0000 7f172c791b80 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8ddcdee40 0x55d8dde7b610 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1704006010 tx=0x7f1704009ca0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.056+0000 7f172c791b80 1 --2- 172.21.15.71:0/3284030140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8dddca9f0 0x55d8dde7bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.056+0000 7f172c791b80 1 -- 172.21.15.71:0/3284030140 >> 172.21.15.71:0/3284030140 conn(0x55d8ddd78390 msgr2=0x55d8dde5d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.057+0000 7f172c791b80 1 -- 172.21.15.71:0/3284030140 shutdown_connections 2024-05-27T09:51:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.057+0000 7f172c791b80 1 -- 172.21.15.71:0/3284030140 wait complete. 2024-05-27T09:51:25.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.058+0000 7f172c791b80 1 -- start start 2024-05-27T09:51:25.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.058+0000 7f172c791b80 1 Processor -- start 2024-05-27T09:51:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f172c791b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde82b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f172c791b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f172c791b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddee6a50 0x55d8ddee8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f172c791b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f171806e8b0 con 0x55d8ddee6a50 2024-05-27T09:51:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f172c791b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f171806fd20 con 0x55d8dde5ddb0 2024-05-27T09:51:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f172c791b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f171806ef80 con 0x55d8dddca9f0 2024-05-27T09:51:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f172c791b80 10 client.0 _ll_register_callbacks cb 0x55d8ddd25c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f1716a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.059+0000 7f1716000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde82b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.060+0000 7f1716000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde82b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33170/0 (socket says 172.21.15.71:33170) 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.060+0000 7f1716000700 1 -- 172.21.15.71:0/2073687977 learned_addr learned my addr 172.21.15.71:0/2073687977 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.060+0000 7f1716000700 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddee6a50 0x55d8ddee8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.061+0000 7f1716a00700 1 -- 172.21.15.71:0/2073687977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 msgr2=0x55d8dde82b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.061+0000 7f1716a00700 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde82b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.061+0000 7f1716a00700 1 -- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddee6a50 msgr2=0x55d8ddee8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.061+0000 7f1716a00700 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddee6a50 0x55d8ddee8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.061+0000 7f1716a00700 1 -- 172.21.15.71:0/2073687977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ddee93b0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.061+0000 7f1716000700 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddee6a50 0x55d8ddee8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:51:25.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.062+0000 7f1716a00700 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde83090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55d8ddd8bf60 tx=0x7f170801c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b029919631a144b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:25.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.062+0000 7f1700c00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:51:25.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.062+0000 7f1700c00700 1 -- 172.21.15.71:0/2073687977 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708010840 con 0x55d8dde5ddb0 2024-05-27T09:51:25.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.063+0000 7f1700c00700 1 -- 172.21.15.71:0/2073687977 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f17080109e0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.063+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1704029040 con 0x55d8dde5ddb0 2024-05-27T09:51:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.064+0000 7f1700c00700 1 -- 172.21.15.71:0/2073687977 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1708010be0 con 0x55d8dde5ddb0 2024-05-27T09:51:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.064+0000 7f172c791b80 10 client.26099 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.064+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8ddeea620 con 0x55d8dde5ddb0 2024-05-27T09:51:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.064+0000 7f1700c00700 1 -- 172.21.15.71:0/2073687977 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1704029040 con 0x55d8dde5ddb0 2024-05-27T09:51:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.065+0000 7f1700c00700 1 -- 172.21.15.71:0/2073687977 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f170802d380 con 0x55d8dde5ddb0 2024-05-27T09:51:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.065+0000 7f172c791b80 10 client.26099 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.065+0000 7f172c791b80 10 client.26099 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-05-27T09:51:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.065+0000 7f172c791b80 20 client.26099 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.065+0000 7f172c791b80 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8ddeead00 0x55d8ddeed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.065+0000 7f172c791b80 4 client.26099 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:51:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.065+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 --> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8ddd87570 con 0x55d8ddeead00 2024-05-27T09:51:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.066+0000 7f1716000700 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8ddeead00 0x55d8ddeed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:25.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.068+0000 7f1716000700 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8ddeead00 0x55d8ddeed120 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f23dcef8a6cac7f2 server_cookie=f507ca9ed0f3bc70 in_seq=0 out_seq=0 2024-05-27T09:51:25.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.068+0000 7f1700c00700 10 client.26099 ms_handle_connect on v2:172.21.15.71:6840/1086406252 2024-05-27T09:51:25.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.068+0000 7f1700c00700 1 -- 172.21.15.71:0/2073687977 <== mds.1 v2:172.21.15.71:6840/1086406252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8ddd87570 con 0x55d8ddeead00 2024-05-27T09:51:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.068+0000 7f1700c00700 10 client.26099 handle_command_reply: tid=0 2024-05-27T09:51:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.068+0000 7f172c791b80 1 client.26099 shutdown 2024-05-27T09:51:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 msgr2=0x55d8dde83090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde83090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55d8ddd8bf60 tx=0x7f170801c730 comp rx=0 tx=0).stop 2024-05-27T09:51:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 shutdown_connections 2024-05-27T09:51:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:6840/1086406252,v1:172.21.15.71:6841/1086406252] conn(0x55d8ddeead00 0x55d8ddeed120 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d8ddee6a50 0x55d8ddee8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8dddca9f0 0x55d8dde82b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 --2- 172.21.15.71:0/2073687977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d8dde5ddb0 0x55d8dde83090 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 >> 172.21.15.71:0/2073687977 conn(0x55d8ddd78390 msgr2=0x55d8dde6fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.069+0000 7f1700c00700 0 client.26099 ms_handle_reset on v2:172.21.15.71:6840/1086406252 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.070+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 shutdown_connections 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.070+0000 7f172c791b80 1 -- 172.21.15.71:0/2073687977 wait complete. 2024-05-27T09:51:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.070+0000 7f172c791b80 20 client.26099 trim_cache size 0 max 16384 2024-05-27T09:51:25.071 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:51:25.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.071+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f16fc0b2af0 msgr2=0x7f16fc0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.071+0000 7f171dc00700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f16fc0b2af0 0x7f16fc0b5000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17100df150 tx=0x7f1710009040 comp rx=0 tx=0).stop 2024-05-27T09:51:25.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.071+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1718110ca0 msgr2=0x7f17181a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:25.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.071+0000 7f171dc00700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1718110ca0 0x7f17181a1860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f171000c370 tx=0x7f171000c680 comp rx=0 tx=0).stop 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.072+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 shutdown_connections 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.072+0000 7f171dc00700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f16fc0b2af0 0x7f16fc0b5000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.072+0000 7f171dc00700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1718110ca0 0x7f17181a1860 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.072+0000 7f171dc00700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17181030f0 0x7f171819d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.072+0000 7f171dc00700 1 --2- 172.21.15.71:0/3662579605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1718103a40 0x7f171819d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.072+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 >> 172.21.15.71:0/3662579605 conn(0x7f17180fedb0 msgr2=0x7f17181127d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.073+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 shutdown_connections 2024-05-27T09:51:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:25.073+0000 7f171dc00700 1 -- 172.21.15.71:0/3662579605 wait complete. 2024-05-27T09:51:25.149 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] randholes 2024-05-27T09:51:25.153 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] runas 2024-05-27T09:51:25.278 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] truncfile 2024-05-27T09:51:25.291 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] usemem 2024-05-27T09:51:25.492 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] mmapcat 2024-05-27T09:51:25.589 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] append_reader 2024-05-27T09:51:25.599 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] append_writer 2024-05-27T09:51:25.605 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] dirperf 2024-05-27T09:51:25.793 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] metaperf 2024-05-27T09:51:25.897 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] devzero 2024-05-27T09:51:25.899 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] feature 2024-05-27T09:51:25.997 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] alloc 2024-05-27T09:51:26.214 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fault 2024-05-27T09:51:26.242 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fstest 2024-05-27T09:51:26.267 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_access_root 2024-05-27T09:51:26.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-27T09:51:26.385 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] godown 2024-05-27T09:51:26.540 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] resvtest 2024-05-27T09:51:26.590 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] writemod 2024-05-27T09:51:26.687 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] writev_on_pagefault 2024-05-27T09:51:26.755 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] makeextents 2024-05-27T09:51:26.773 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:26.900 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] itrash 2024-05-27T09:51:26.924 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] rename 2024-05-27T09:51:26.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:26 smithi122 ceph-mon[36436]: pgmap v113: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 437 op/s 2024-05-27T09:51:27.001 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:26 smithi071 ceph-mon[31451]: pgmap v113: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 437 op/s 2024-05-27T09:51:27.009 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] multi_open_unlink 2024-05-27T09:51:27.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:26 smithi072 ceph-mon[35951]: pgmap v113: 97 pgs: 97 active+clean; 30 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 437 op/s 2024-05-27T09:51:27.079 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] unwritten_sync 2024-05-27T09:51:27.191 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] genhashnames 2024-05-27T09:51:27.193 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_holes 2024-05-27T09:51:27.321 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_writev 2024-05-27T09:51:27.417 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_truncate_cmtime 2024-05-27T09:51:27.487 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] dirhash_collide 2024-05-27T09:51:27.523 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_rename_overwrite 2024-05-27T09:51:27.621 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] holetest 2024-05-27T09:51:27.710 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_truncate_self 2024-05-27T09:51:27.789 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] af_unix 2024-05-27T09:51:27.837 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_stale_pmd 2024-05-27T09:51:27.981 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_cow_race 2024-05-27T09:51:28.020 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_fallocate 2024-05-27T09:51:28.058 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-27T09:51:28.058 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-27T09:51:28.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:51:28.113 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fsync-err 2024-05-27T09:51:28.127 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_write_ro 2024-05-27T09:51:28.297 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-27T09:51:28.329 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-27T09:51:28.448 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_ofd_locks 2024-05-27T09:51:28.506 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_collision 2024-05-27T09:51:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:28.674 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] mmap-write-concurrent 2024-05-27T09:51:28.684 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_get_file_time 2024-05-27T09:51:28.862 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_create_short_dirs 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 -- 172.21.15.71:0/2752055891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9bc10a1f0 msgr2=0x7fa9bc10a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2752055891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc10a600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009950 tx=0x7fa9a802a4d0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 -- 172.21.15.71:0/2752055891 shutdown_connections 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2752055891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9bc11d240 0x7fa9bc11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2752055891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc11a8e0 0x7fa9bc11cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2752055891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc10a600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 -- 172.21.15.71:0/2752055891 >> 172.21.15.71:0/2752055891 conn(0x7fa9bc06e8f0 msgr2=0x7fa9bc06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 -- 172.21.15.71:0/2752055891 shutdown_connections 2024-05-27T09:51:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.924+0000 7fa9c1000640 1 -- 172.21.15.71:0/2752055891 wait complete. 2024-05-27T09:51:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.925+0000 7fa9c1000640 1 Processor -- start 2024-05-27T09:51:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.925+0000 7fa9c1000640 1 -- start start 2024-05-27T09:51:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9c1000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc1a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9c1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9bc11a8e0 0x7fa9bc1a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9c1000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9bc11d240 0x7fa9bc1ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9c1000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc122c70 con 0x7fa9bc11a8e0 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9c1000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc122af0 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9c1000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc122df0 con 0x7fa9bc11d240 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9b9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc1a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9b9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc1a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52274/0 (socket says 172.21.15.71:52274) 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9ba800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9bc11d240 0x7fa9bc1ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.926+0000 7fa9b9e00640 1 -- 172.21.15.71:0/2266352191 learned_addr learned my addr 172.21.15.71:0/2266352191 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.927+0000 7fa9b9e00640 1 -- 172.21.15.71:0/2266352191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9bc11d240 msgr2=0x7fa9bc1ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.927+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9bc11d240 0x7fa9bc1ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.927+0000 7fa9b9e00640 1 -- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9bc11a8e0 msgr2=0x7fa9bc1a9bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.927+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9bc11a8e0 0x7fa9bc1a9bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.927+0000 7fa9b9e00640 1 -- 172.21.15.71:0/2266352191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc1ae450 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.927+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc1a9670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8031440 tx=0x7fa9a8003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.928+0000 7fa9b2a00640 1 -- 172.21.15.71:0/2266352191 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a803f070 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.928+0000 7fa9b2a00640 1 -- 172.21.15.71:0/2266352191 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a8031d60 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.928+0000 7fa9b2a00640 1 -- 172.21.15.71:0/2266352191 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8035030 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.928+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc1ae6e0 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.928+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc1aebd0 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.933+0000 7fa9c8163740 1 Processor -- start 2024-05-27T09:51:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.933+0000 7fa9c8163740 1 -- start start 2024-05-27T09:51:28.934 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_create_long_dirs 2024-05-27T09:51:28.936 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:28 smithi071 ceph-mon[31451]: pgmap v114: 97 pgs: 97 active+clean; 32 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 611 KiB/s wr, 473 op/s 2024-05-27T09:51:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.934+0000 7fa9b2a00640 1 -- 172.21.15.71:0/2266352191 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fa9a8042070 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.934+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643c11b0 0x55dd64763860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.934+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd64763da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.934+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643a04d0 0x55dd647642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.934+0000 7fa9c8163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dd646d4b90 con 0x55dd643a04d0 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.934+0000 7fa9c8163740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55dd646c4730 con 0x55dd643c11b0 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.934+0000 7fa9c8163740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd646c8770 con 0x55dd643982f0 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.935+0000 7fa9ba800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643c11b0 0x55dd64763860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.935+0000 7fa9ba800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643c11b0 0x55dd64763860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52278/0 (socket says 172.21.15.71:52278) 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.935+0000 7fa9ba800640 1 -- 172.21.15.71:0/4252824649 learned_addr learned my addr 172.21.15.71:0/4252824649 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.935+0000 7fa9b9400640 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643a04d0 0x55dd647642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.935+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd64763da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.936+0000 7fa9b9400640 1 -- 172.21.15.71:0/4252824649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 msgr2=0x55dd64763da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.936+0000 7fa9b9400640 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd64763da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.936+0000 7fa9b9400640 1 -- 172.21.15.71:0/4252824649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643c11b0 msgr2=0x55dd64763860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.936+0000 7fa9b9400640 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643c11b0 0x55dd64763860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.936+0000 7fa9b2a00640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9a00b2b20 0x7fa9a00b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.936+0000 7fa9b9400640 1 -- 172.21.15.71:0/4252824649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6465d8b0 con 0x55dd643a04d0 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.936+0000 7fa9b2a00640 1 -- 172.21.15.71:0/2266352191 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa9a8102d50 con 0x7fa9bc10a1f0 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.937+0000 7fa9b9400640 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643a04d0 0x55dd647642e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc11c740 tx=0x7fa9ac00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198c875e4be4d8ad server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.937+0000 7fa9ba800640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9a00b2b20 0x7fa9a00b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.938+0000 7fa9a7400640 1 -- 172.21.15.71:0/4252824649 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac016070 con 0x55dd643a04d0 2024-05-27T09:51:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.938+0000 7fa9a7400640 1 -- 172.21.15.71:0/4252824649 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9ac00de30 con 0x55dd643a04d0 2024-05-27T09:51:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.938+0000 7fa9a7400640 1 -- 172.21.15.71:0/4252824649 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac016070 con 0x55dd643a04d0 2024-05-27T09:51:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.939+0000 7fa9ba800640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9a00b2b20 0x7fa9a00b5030 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55dd647609d0 tx=0x7fa9b4007520 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.939+0000 7fa9c8163740 1 -- 172.21.15.71:0/4252824649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643a04d0 msgr2=0x55dd647642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.939+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643a04d0 0x55dd647642e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc11c740 tx=0x7fa9ac00be70 comp rx=0 tx=0).stop 2024-05-27T09:51:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.940+0000 7fa9c8163740 1 -- 172.21.15.71:0/4252824649 shutdown_connections 2024-05-27T09:51:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.940+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643a04d0 0x55dd647642e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.940+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd64763da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.940+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4252824649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643c11b0 0x55dd64763860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.940+0000 7fa9c8163740 1 -- 172.21.15.71:0/4252824649 >> 172.21.15.71:0/4252824649 conn(0x55dd643b5300 msgr2=0x55dd64760010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.940+0000 7fa9c8163740 1 -- 172.21.15.71:0/4252824649 shutdown_connections 2024-05-27T09:51:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.940+0000 7fa9c8163740 1 -- 172.21.15.71:0/4252824649 wait complete. 2024-05-27T09:51:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.941+0000 7fa9c8163740 1 -- start start 2024-05-27T09:51:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.941+0000 7fa9c8163740 1 Processor -- start 2024-05-27T09:51:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.942+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd6476d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.942+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643a04d0 0x55dd6476dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.942+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643c11b0 0x55dd6476e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9c8163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dd643aa790 con 0x55dd643c11b0 2024-05-27T09:51:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9c8163740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55dd6466cbc0 con 0x55dd643a04d0 2024-05-27T09:51:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9c8163740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd64770990 con 0x55dd643982f0 2024-05-27T09:51:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9c8163740 10 client.0 _ll_register_callbacks cb 0x55dd6464a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd6476d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd6476d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33228/0 (socket says 172.21.15.71:33228) 2024-05-27T09:51:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 -- 172.21.15.71:0/218574152 learned_addr learned my addr 172.21.15.71:0/218574152 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9400640 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643a04d0 0x55dd6476dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9ba800640 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643c11b0 0x55dd6476e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 -- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643a04d0 msgr2=0x55dd6476dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643a04d0 0x55dd6476dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 -- 172.21.15.71:0/218574152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643c11b0 msgr2=0x55dd6476e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643c11b0 0x55dd6476e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 -- 172.21.15.71:0/218574152 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd643d9210 con 0x55dd643982f0 2024-05-27T09:51:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.944+0000 7fa99be00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:51:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.943+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd6476d960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8005ab0 tx=0x7fa9a8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9521034a003c35e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.944+0000 7fa99be00640 1 -- 172.21.15.71:0/218574152 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80c9dd0 con 0x55dd643982f0 2024-05-27T09:51:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.944+0000 7fa99be00640 1 -- 172.21.15.71:0/218574152 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa9a80ca260 con 0x55dd643982f0 2024-05-27T09:51:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.944+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ac00de30 con 0x55dd643982f0 2024-05-27T09:51:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.945+0000 7fa99be00640 1 -- 172.21.15.71:0/218574152 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa9a80c9770 con 0x55dd643982f0 2024-05-27T09:51:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.945+0000 7fa9c8163740 10 client.26143 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.946+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd644a5620 con 0x55dd643982f0 2024-05-27T09:51:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.946+0000 7fa99be00640 1 -- 172.21.15.71:0/218574152 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9ac00de30 con 0x55dd643982f0 2024-05-27T09:51:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.946+0000 7fa99be00640 1 -- 172.21.15.71:0/218574152 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fa9a80d29d0 con 0x55dd643982f0 2024-05-27T09:51:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.947+0000 7fa9c8163740 10 client.26143 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.948+0000 7fa9c8163740 10 client.26143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.948+0000 7fa9c8163740 20 client.26143 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.948+0000 7fa9c8163740 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd6437fd80 0x55dd6477fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.948+0000 7fa9c8163740 4 client.26143 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.948+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd646d6ae0 con 0x55dd6437fd80 2024-05-27T09:51:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.949+0000 7fa9b9400640 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd6437fd80 0x55dd6477fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.950+0000 7fa9b9400640 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd6437fd80 0x55dd6477fa60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b49a277716c6a46 server_cookie=97fa650910173709 in_seq=0 out_seq=0 2024-05-27T09:51:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.950+0000 7fa99be00640 10 client.26143 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.951+0000 7fa99be00640 1 -- 172.21.15.71:0/218574152 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55dd646d6ae0 con 0x55dd6437fd80 2024-05-27T09:51:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.951+0000 7fa99be00640 10 client.26143 handle_command_reply: tid=0 2024-05-27T09:51:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.951+0000 7fa9c8163740 1 client.26143 shutdown 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.951+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 msgr2=0x55dd6476d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.951+0000 7fa9c8163740 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd6476d960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8005ab0 tx=0x7fa9a8009260 comp rx=0 tx=0).stop 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 shutdown_connections 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd6437fd80 0x55dd6477fa60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643c11b0 0x55dd6476e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643a04d0 0x55dd6476dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 --2- 172.21.15.71:0/218574152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643982f0 0x55dd6476d960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 >> 172.21.15.71:0/218574152 conn(0x55dd643b5300 msgr2=0x55dd64765580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa99be00640 0 client.26143 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 shutdown_connections 2024-05-27T09:51:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 1 -- 172.21.15.71:0/218574152 wait complete. 2024-05-27T09:51:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.952+0000 7fa9c8163740 20 client.26143 trim_cache size 0 max 16384 2024-05-27T09:51:28.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:28 smithi122 ceph-mon[36436]: pgmap v114: 97 pgs: 97 active+clean; 32 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 611 KiB/s wr, 473 op/s 2024-05-27T09:51:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 Processor -- start 2024-05-27T09:51:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 -- start start 2024-05-27T09:51:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd6476fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647646f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd6476d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc1c1020 con 0x55dd643b5300 2024-05-27T09:51:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc1be8f0 con 0x55dd643982f0 2024-05-27T09:51:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.985+0000 7fa9c8163740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc1bc6e0 con 0x55dd643a04d0 2024-05-27T09:51:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd6476fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52292/0 (socket says 172.21.15.71:52292) 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 -- 172.21.15.71:0/4272231781 learned_addr learned my addr 172.21.15.71:0/4272231781 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9ba800640 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd6476d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 -- 172.21.15.71:0/4272231781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 msgr2=0x55dd6476d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd6476d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 -- 172.21.15.71:0/4272231781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 msgr2=0x55dd6476fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd6476fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.986+0000 7fa9b9400640 1 -- 172.21.15.71:0/4272231781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd64764c30 con 0x55dd643982f0 2024-05-27T09:51:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.987+0000 7fa9b9400640 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647646f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac003980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b729d4035997dc95 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.987+0000 7fa9a6a00640 1 -- 172.21.15.71:0/4272231781 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac016040 con 0x55dd643982f0 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.987+0000 7fa9a6a00640 1 -- 172.21.15.71:0/4272231781 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9ac005870 con 0x55dd643982f0 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.987+0000 7fa9a6a00640 1 -- 172.21.15.71:0/4272231781 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac0054d0 con 0x55dd643982f0 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 -- 172.21.15.71:0/4272231781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 msgr2=0x55dd647646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647646f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac003980 comp rx=0 tx=0).stop 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 -- 172.21.15.71:0/4272231781 shutdown_connections 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd6476d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647646f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 --2- 172.21.15.71:0/4272231781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd6476fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 -- 172.21.15.71:0/4272231781 >> 172.21.15.71:0/4272231781 conn(0x55dd6475ae40 msgr2=0x55dd6476d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 -- 172.21.15.71:0/4272231781 shutdown_connections 2024-05-27T09:51:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.988+0000 7fa9c8163740 1 -- 172.21.15.71:0/4272231781 wait complete. 2024-05-27T09:51:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.989+0000 7fa9c8163740 1 -- start start 2024-05-27T09:51:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.989+0000 7fa9c8163740 1 Processor -- start 2024-05-27T09:51:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd647736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9c8163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd647e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9c8163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc1bcdb0 con 0x55dd643b5300 2024-05-27T09:51:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9c8163740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc1be220 con 0x55dd643982f0 2024-05-27T09:51:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9c8163740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc1bd480 con 0x55dd643a04d0 2024-05-27T09:51:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9c8163740 10 client.0 _ll_register_callbacks cb 0x7fa9a8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9b9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd647736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9b9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9b9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd647736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33258/0 (socket says 172.21.15.71:33258) 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9b9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52294/0 (socket says 172.21.15.71:52294) 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9b9400640 1 -- 172.21.15.71:0/1640165733 learned_addr learned my addr 172.21.15.71:0/1640165733 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.990+0000 7fa9ba800640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd647e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9b9400640 1 -- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 msgr2=0x55dd647731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9b9400640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9b9400640 1 -- 172.21.15.71:0/1640165733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 msgr2=0x55dd647e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9b9400640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd647e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9b9400640 1 -- 172.21.15.71:0/1640165733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd647e0600 con 0x55dd643a04d0 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9ba800640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd647e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9b9400640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd647736e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005110 tx=0x7fa9ac00d7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6001fc85c4ccf9d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa99be00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa99be00640 1 -- 172.21.15.71:0/1640165733 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac016040 con 0x55dd643a04d0 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.991+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ac005870 con 0x55dd643a04d0 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.992+0000 7fa99be00640 1 -- 172.21.15.71:0/1640165733 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa9ac003bf0 con 0x55dd643a04d0 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.992+0000 7fa99be00640 1 -- 172.21.15.71:0/1640165733 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa9ac005250 con 0x55dd643a04d0 2024-05-27T09:51:28.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.992+0000 7fa9c8163740 10 client.26149 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:28.997 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.992+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd647e78e0 con 0x55dd643a04d0 2024-05-27T09:51:28.997 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.993+0000 7fa99be00640 1 -- 172.21.15.71:0/1640165733 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9ac005870 con 0x55dd643a04d0 2024-05-27T09:51:28.997 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.993+0000 7fa99be00640 1 -- 172.21.15.71:0/1640165733 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fa9ac0239b0 con 0x55dd643a04d0 2024-05-27T09:51:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.994+0000 7fa9c8163740 10 client.26149 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.994+0000 7fa9c8163740 10 client.26149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.994+0000 7fa9c8163740 20 client.26149 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.994+0000 7fa9c8163740 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd643c11b0 0x55dd647e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.994+0000 7fa9c8163740 4 client.26149 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:51:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.994+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd646d02c0 con 0x55dd643c11b0 2024-05-27T09:51:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.994+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd643c11b0 0x55dd647e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:28.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.995+0000 7fa9b9e00640 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd643c11b0 0x55dd647e9db0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281d19bc7c95926f server_cookie=ade96e943912725c in_seq=0 out_seq=0 2024-05-27T09:51:28.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:28.995+0000 7fa99be00640 10 client.26149 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:28 smithi072 ceph-mon[35951]: pgmap v114: 97 pgs: 97 active+clean; 32 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 611 KiB/s wr, 473 op/s 2024-05-27T09:51:29.035 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_enospc 2024-05-27T09:51:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.048+0000 7fa99be00640 1 -- 172.21.15.71:0/1640165733 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55dd646d02c0 con 0x55dd643c11b0 2024-05-27T09:51:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.048+0000 7fa99be00640 10 client.26149 handle_command_reply: tid=0 2024-05-27T09:51:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.048+0000 7fa9c8163740 1 client.26149 shutdown 2024-05-27T09:51:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.048+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 msgr2=0x55dd647736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.048+0000 7fa9c8163740 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd647736e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005110 tx=0x7fa9ac00d7f0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:51:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:51:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:51:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 shutdown_connections 2024-05-27T09:51:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dd643c11b0 0x55dd647e9db0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd643b5300 0x55dd647e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd643a04d0 0x55dd647736e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 --2- 172.21.15.71:0/1640165733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dd643982f0 0x55dd647731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 >> 172.21.15.71:0/1640165733 conn(0x55dd6475ae40 msgr2=0x55dd6476dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa99be00640 0 client.26149 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 shutdown_connections 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.049+0000 7fa9c8163740 1 -- 172.21.15.71:0/1640165733 wait complete. 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.050+0000 7fa9c8163740 20 client.26149 trim_cache size 0 max 16384 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9a00b2b20 msgr2=0x7fa9a00b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9a00b2b20 0x7fa9a00b5030 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55dd647609d0 tx=0x7fa9b4007520 comp rx=0 tx=0).stop 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc10a1f0 msgr2=0x7fa9bc1a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc1a9670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8031440 tx=0x7fa9a8003c80 comp rx=0 tx=0).stop 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 shutdown_connections 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9a00b2b20 0x7fa9a00b5030 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9bc11d240 0x7fa9bc1ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9bc11a8e0 0x7fa9bc1a9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 --2- 172.21.15.71:0/2266352191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9bc10a1f0 0x7fa9bc1a9670 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.051+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 >> 172.21.15.71:0/2266352191 conn(0x7fa9bc06e8f0 msgr2=0x7fa9bc11acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.052+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 shutdown_connections 2024-05-27T09:51:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:29.052+0000 7fa9c1000640 1 -- 172.21.15.71:0/2266352191 wait complete. 2024-05-27T09:51:29.077 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_writev_overlap 2024-05-27T09:51:29.246 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] checkpoint_journal 2024-05-27T09:51:29.301 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] mmap-rw-fault 2024-05-27T09:51:29.375 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] allocstale 2024-05-27T09:51:29.463 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_cow_memory_failure 2024-05-27T09:51:29.559 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fake-dump-rootino 2024-05-27T09:51:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.626+0000 7f4176c00700 1 -- 172.21.15.71:0/1334991104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 msgr2=0x7f4170109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.626+0000 7f4176c00700 1 --2- 172.21.15.71:0/1334991104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f4170109300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f415c0099c0 tx=0x7f415c009cd0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.627+0000 7f4176c00700 1 -- 172.21.15.71:0/1334991104 shutdown_connections 2024-05-27T09:51:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.627+0000 7f4176c00700 1 --2- 172.21.15.71:0/1334991104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4170109840 0x7f41701111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.627+0000 7f4176c00700 1 --2- 172.21.15.71:0/1334991104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41701045c0 0x7f41701049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.627+0000 7f4176c00700 1 --2- 172.21.15.71:0/1334991104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f4170109300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.627+0000 7f4176c00700 1 -- 172.21.15.71:0/1334991104 >> 172.21.15.71:0/1334991104 conn(0x7f41700ffe90 msgr2=0x7f41701022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.628+0000 7f4176c00700 1 -- 172.21.15.71:0/1334991104 shutdown_connections 2024-05-27T09:51:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.628+0000 7f4176c00700 1 -- 172.21.15.71:0/1334991104 wait complete. 2024-05-27T09:51:29.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.630+0000 7f4176c00700 1 Processor -- start 2024-05-27T09:51:29.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.630+0000 7f4176c00700 1 -- start start 2024-05-27T09:51:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.630+0000 7f4176c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41701045c0 0x7f417019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f4176c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f417019d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f4176c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4170109840 0x7f41701a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f4176c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4170114450 con 0x7f41701045c0 2024-05-27T09:51:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f4176c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f41701142d0 con 0x7f4170109840 2024-05-27T09:51:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f4176c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41701145d0 con 0x7f4170108ef0 2024-05-27T09:51:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f416f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f417019d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f4174c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4170109840 0x7f41701a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f416f400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f417019d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33276/0 (socket says 172.21.15.71:33276) 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f416f400700 1 -- 172.21.15.71:0/1523360243 learned_addr learned my addr 172.21.15.71:0/1523360243 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f416fe00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41701045c0 0x7f417019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f416f400700 1 -- 172.21.15.71:0/1523360243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4170109840 msgr2=0x7f41701a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f416f400700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4170109840 0x7f41701a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.631+0000 7f416f400700 1 -- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41701045c0 msgr2=0x7f417019d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.632+0000 7f416f400700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41701045c0 0x7f417019d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.632+0000 7f416f400700 1 -- 172.21.15.71:0/1523360243 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41701a1ef0 con 0x7f4170108ef0 2024-05-27T09:51:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.632+0000 7f416fe00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41701045c0 0x7f417019d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:51:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.632+0000 7f416f400700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f417019d5c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f415c006010 tx=0x7f415c005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.633+0000 7f416cc00700 1 -- 172.21.15.71:0/1523360243 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c026070 con 0x7f4170108ef0 2024-05-27T09:51:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.633+0000 7f416cc00700 1 -- 172.21.15.71:0/1523360243 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f415c003c70 con 0x7f4170108ef0 2024-05-27T09:51:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.633+0000 7f416cc00700 1 -- 172.21.15.71:0/1523360243 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c00fbd0 con 0x7f4170108ef0 2024-05-27T09:51:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.633+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41701a2180 con 0x7f4170108ef0 2024-05-27T09:51:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.633+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41701a2610 con 0x7f4170108ef0 2024-05-27T09:51:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.639+0000 7f4185831b80 1 Processor -- start 2024-05-27T09:51:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.639+0000 7f4185831b80 1 -- start start 2024-05-27T09:51:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f416cc00700 1 -- 172.21.15.71:0/1523360243 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f415c021410 con 0x7f4170108ef0 2024-05-27T09:51:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f4185831b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f4185831b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0e7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f4185831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f4185831b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56077b015e40 con 0x56077b0edd30 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f4185831b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56077b0059e0 con 0x56077af68e40 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f4185831b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56077b009a20 con 0x56077b0e7db0 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f416fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f416fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0e7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39488/0 (socket says 172.21.15.71:39488) 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.640+0000 7f416fe00700 1 -- 172.21.15.71:0/2537095932 learned_addr learned my addr 172.21.15.71:0/2537095932 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.641+0000 7f416f400700 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.641+0000 7f416fe00700 1 -- 172.21.15.71:0/2537095932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 msgr2=0x56077b0e81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.641+0000 7f416fe00700 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0e81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.641+0000 7f416fe00700 1 -- 172.21.15.71:0/2537095932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 msgr2=0x56077b0ed7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:51:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.642+0000 7f416fe00700 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0ed7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.642+0000 7f416fe00700 1 -- 172.21.15.71:0/2537095932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56077afce420 con 0x56077b0edd30 2024-05-27T09:51:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.642+0000 7f416cc00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f41540b2b40 0x7f41540b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.642+0000 7f416fe00700 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0e7870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4160009750 tx=0x7f4160009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6cc8bf1c2c0b6c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.643+0000 7f416cc00700 1 -- 172.21.15.71:0/1523360243 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f415c0e2d70 con 0x7f4170108ef0 2024-05-27T09:51:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.643+0000 7f4174c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f41540b2b40 0x7f41540b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.644+0000 7f4165600700 1 -- 172.21.15.71:0/2537095932 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160014ae0 con 0x56077b0edd30 2024-05-27T09:51:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.644+0000 7f4165600700 1 -- 172.21.15.71:0/2537095932 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41600044e0 con 0x56077b0edd30 2024-05-27T09:51:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.644+0000 7f4165600700 1 -- 172.21.15.71:0/2537095932 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160016070 con 0x56077b0edd30 2024-05-27T09:51:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.645+0000 7f4185831b80 1 -- 172.21.15.71:0/2537095932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 msgr2=0x56077b0e7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.645+0000 7f4185831b80 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0e7870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4160009750 tx=0x7f4160009a60 comp rx=0 tx=0).stop 2024-05-27T09:51:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.645+0000 7f4174c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f41540b2b40 0x7f41540b5050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x56077b0e8b30 tx=0x7f416800b040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:29.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.646+0000 7f4185831b80 1 -- 172.21.15.71:0/2537095932 shutdown_connections 2024-05-27T09:51:29.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.646+0000 7f4185831b80 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.646+0000 7f4185831b80 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.646+0000 7f4185831b80 1 --2- 172.21.15.71:0/2537095932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0e7870 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.646+0000 7f4185831b80 1 -- 172.21.15.71:0/2537095932 >> 172.21.15.71:0/2537095932 conn(0x56077afc8fc0 msgr2=0x56077b0e28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.646+0000 7f4185831b80 1 -- 172.21.15.71:0/2537095932 shutdown_connections 2024-05-27T09:51:29.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.646+0000 7f4185831b80 1 -- 172.21.15.71:0/2537095932 wait complete. 2024-05-27T09:51:29.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.647+0000 7f4185831b80 1 -- start start 2024-05-27T09:51:29.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.647+0000 7f4185831b80 1 Processor -- start 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f4185831b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f4185831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f4185831b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f4185831b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56077af0bfa0 con 0x56077b0edd30 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f4185831b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56077afa6760 con 0x56077af68e40 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f4185831b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56077b0f4800 con 0x56077b0e7db0 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f4185831b80 10 client.0 _ll_register_callbacks cb 0x56077afafc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:29.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f416fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f416fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0f15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52338/0 (socket says 172.21.15.71:52338) 2024-05-27T09:51:29.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.648+0000 7f416fe00700 1 -- 172.21.15.71:0/4019557130 learned_addr learned my addr 172.21.15.71:0/4019557130 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:29.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.649+0000 7f4174c00700 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.649+0000 7f416f400700 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.650+0000 7f4174c00700 1 -- 172.21.15.71:0/4019557130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 msgr2=0x56077b0f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.650+0000 7f4174c00700 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.650+0000 7f4174c00700 1 -- 172.21.15.71:0/4019557130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 msgr2=0x56077b0f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.650+0000 7f4174c00700 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.650+0000 7f4174c00700 1 -- 172.21.15.71:0/4019557130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56077af558d0 con 0x56077b0edd30 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.650+0000 7f4174c00700 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f2020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f416800fc40 tx=0x7f4168004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca0a0b578acba93 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.650+0000 7f415a000700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.651+0000 7f415a000700 1 -- 172.21.15.71:0/4019557130 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416801b070 con 0x56077b0edd30 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.651+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41600044e0 con 0x56077b0edd30 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.651+0000 7f415a000700 1 -- 172.21.15.71:0/4019557130 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4168017ad0 con 0x56077b0edd30 2024-05-27T09:51:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.651+0000 7f415a000700 1 -- 172.21.15.71:0/4019557130 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4168030050 con 0x56077b0edd30 2024-05-27T09:51:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.651+0000 7f4185831b80 10 client.15999 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.651+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56077afd6060 con 0x56077b0edd30 2024-05-27T09:51:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f415a000700 1 -- 172.21.15.71:0/4019557130 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41600044e0 con 0x56077b0edd30 2024-05-27T09:51:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f415a000700 1 -- 172.21.15.71:0/4019557130 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f4168022c20 con 0x56077b0edd30 2024-05-27T09:51:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f4185831b80 10 client.15999 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f4185831b80 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f4185831b80 20 client.15999 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f4185831b80 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b101840 0x56077b103cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f4185831b80 4 client.15999 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.652+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56077b017d90 con 0x56077b101840 2024-05-27T09:51:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.653+0000 7f416fe00700 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b101840 0x56077b103cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.654+0000 7f415a000700 10 client.15999 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.654+0000 7f416fe00700 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b101840 0x56077b103cf0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9cfee4b1d0e501d server_cookie=933d805b08780de1 in_seq=0 out_seq=0 2024-05-27T09:51:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.655+0000 7f415a000700 1 -- 172.21.15.71:0/4019557130 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56077b017d90 con 0x56077b101840 2024-05-27T09:51:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.655+0000 7f415a000700 10 client.15999 handle_command_reply: tid=0 2024-05-27T09:51:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.655+0000 7f4185831b80 1 client.15999 shutdown 2024-05-27T09:51:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.656+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 msgr2=0x56077b0f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.656+0000 7f4185831b80 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f2020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f416800fc40 tx=0x7f4168004ad0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.659 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] dio-buf-fault 2024-05-27T09:51:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 shutdown_connections 2024-05-27T09:51:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b101840 0x56077b103cf0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f2020 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077af68e40 0x56077b0f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 --2- 172.21.15.71:0/4019557130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b0e7db0 0x56077b0f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 >> 172.21.15.71:0/4019557130 conn(0x56077afc8fc0 msgr2=0x56077b0e2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f415a000700 0 client.15999 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 shutdown_connections 2024-05-27T09:51:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.657+0000 7f4185831b80 1 -- 172.21.15.71:0/4019557130 wait complete. 2024-05-27T09:51:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.658+0000 7f4185831b80 20 client.15999 trim_cache size 0 max 16384 2024-05-27T09:51:29.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 Processor -- start 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 -- start start 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077af68e40 0x56077b0e7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0e7db0 0x56077b0ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f41701af3c0 con 0x56077b0edd30 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f41701acc50 con 0x56077b0e7db0 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.687+0000 7f4185831b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f417010f2f0 con 0x56077af68e40 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.688+0000 7f416f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0e7db0 0x56077b0ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.688+0000 7f4174c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.688+0000 7f416f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0e7db0 0x56077b0ebc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52348/0 (socket says 172.21.15.71:52348) 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.688+0000 7f416f400700 1 -- 172.21.15.71:0/537194082 learned_addr learned my addr 172.21.15.71:0/537194082 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.689+0000 7f416fe00700 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077af68e40 0x56077b0e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.689+0000 7f416f400700 1 -- 172.21.15.71:0/537194082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077af68e40 msgr2=0x56077b0e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.689+0000 7f416f400700 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077af68e40 0x56077b0e7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.689+0000 7f416f400700 1 -- 172.21.15.71:0/537194082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 msgr2=0x56077b0f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.689+0000 7f416f400700 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.689+0000 7f416f400700 1 -- 172.21.15.71:0/537194082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56077b0ff190 con 0x56077b0e7db0 2024-05-27T09:51:29.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.689+0000 7f4174c00700 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:29.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.690+0000 7f416f400700 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0e7db0 0x56077b0ebc40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f415c00b580 tx=0x7f415c0a60f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41126572393bf24c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:29.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.691+0000 7f4164c00700 1 -- 172.21.15.71:0/537194082 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c0a9880 con 0x56077b0e7db0 2024-05-27T09:51:29.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.691+0000 7f4164c00700 1 -- 172.21.15.71:0/537194082 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f415c0a9c20 con 0x56077b0e7db0 2024-05-27T09:51:29.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.691+0000 7f4164c00700 1 -- 172.21.15.71:0/537194082 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c009e60 con 0x56077b0e7db0 2024-05-27T09:51:29.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.692+0000 7f4185831b80 1 -- 172.21.15.71:0/537194082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0e7db0 msgr2=0x56077b0ebc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.692+0000 7f4185831b80 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0e7db0 0x56077b0ebc40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f415c00b580 tx=0x7f415c0a60f0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.692+0000 7f4185831b80 1 -- 172.21.15.71:0/537194082 shutdown_connections 2024-05-27T09:51:29.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.692+0000 7f4185831b80 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077b0edd30 0x56077b0f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.693+0000 7f4185831b80 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077af68e40 0x56077b0e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.693+0000 7f4185831b80 1 --2- 172.21.15.71:0/537194082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0e7db0 0x56077b0ebc40 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f415c00b580 tx=0x7f415c0a60f0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.693+0000 7f4185831b80 1 -- 172.21.15.71:0/537194082 >> 172.21.15.71:0/537194082 conn(0x56077afc8fc0 msgr2=0x56077b0f1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.693+0000 7f4185831b80 1 -- 172.21.15.71:0/537194082 shutdown_connections 2024-05-27T09:51:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.693+0000 7f4185831b80 1 -- 172.21.15.71:0/537194082 wait complete. 2024-05-27T09:51:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.694+0000 7f4185831b80 1 -- start start 2024-05-27T09:51:29.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.694+0000 7f4185831b80 1 Processor -- start 2024-05-27T09:51:29.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.695+0000 7f4185831b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077af68e40 0x56077b0fa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f4185831b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0edd30 0x56077b108df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f4185831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b109330 0x56077b109800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f4185831b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f41701ab110 con 0x56077af68e40 2024-05-27T09:51:29.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f416f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0edd30 0x56077b108df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f416f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0edd30 0x56077b108df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:52362/0 (socket says 172.21.15.71:52362) 2024-05-27T09:51:29.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f416f400700 1 -- 172.21.15.71:0/3355582742 learned_addr learned my addr 172.21.15.71:0/3355582742 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:29.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f41701ac580 con 0x56077b0edd30 2024-05-27T09:51:29.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41701ab7e0 con 0x56077b109330 2024-05-27T09:51:29.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.696+0000 7f416fe00700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077af68e40 0x56077b0fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f4185831b80 10 client.0 _ll_register_callbacks cb 0x56077afafc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:29.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f4174c00700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b109330 0x56077b109800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f416fe00700 1 -- 172.21.15.71:0/3355582742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b109330 msgr2=0x56077b109800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:29.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f416fe00700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b109330 0x56077b109800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f416fe00700 1 -- 172.21.15.71:0/3355582742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0edd30 msgr2=0x56077b108df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:29.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f416fe00700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0edd30 0x56077b108df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f416fe00700 1 -- 172.21.15.71:0/3355582742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56077b16b570 con 0x56077af68e40 2024-05-27T09:51:29.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.697+0000 7f4174c00700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b109330 0x56077b109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:51:29.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.698+0000 7f416fe00700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077af68e40 0x56077b0fa270 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f416000a010 tx=0x7f4160015d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abee5090261fb72c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:29.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.698+0000 7f415a000700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:29.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.699+0000 7f415a000700 1 -- 172.21.15.71:0/3355582742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160034060 con 0x56077af68e40 2024-05-27T09:51:29.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.699+0000 7f415a000700 1 -- 172.21.15.71:0/3355582742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4160003d00 con 0x56077af68e40 2024-05-27T09:51:29.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.699+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f415c0a9c20 con 0x56077af68e40 2024-05-27T09:51:29.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.699+0000 7f415a000700 1 -- 172.21.15.71:0/3355582742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f41600050b0 con 0x56077af68e40 2024-05-27T09:51:29.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.700+0000 7f4185831b80 10 client.16005 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:29.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.700+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56077b16c750 con 0x56077af68e40 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.700+0000 7f415a000700 1 -- 172.21.15.71:0/3355582742 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f415c0a9c20 con 0x56077af68e40 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.700+0000 7f415a000700 1 -- 172.21.15.71:0/3355582742 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f4160020a10 con 0x56077af68e40 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.701+0000 7f4185831b80 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.701+0000 7f4185831b80 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.701+0000 7f4185831b80 20 client.16005 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.701+0000 7f4185831b80 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b16cc30 0x56077b16f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.701+0000 7f4185831b80 4 client.16005 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-27T09:51:29.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.701+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56077b011570 con 0x56077b16cc30 2024-05-27T09:51:29.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.702+0000 7f416f400700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b16cc30 0x56077b16f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:29.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.702+0000 7f415a000700 10 client.16005 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:29.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.703+0000 7f416f400700 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b16cc30 0x56077b16f050 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd91b95e5e07c0c server_cookie=44303721e22760b9 in_seq=0 out_seq=0 2024-05-27T09:51:29.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f415a000700 1 -- 172.21.15.71:0/3355582742 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56077b011570 con 0x56077b16cc30 2024-05-27T09:51:29.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f415a000700 10 client.16005 handle_command_reply: tid=0 2024-05-27T09:51:29.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 client.16005 shutdown 2024-05-27T09:51:29.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077af68e40 msgr2=0x56077b0fa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077af68e40 0x56077b0fa270 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f416000a010 tx=0x7f4160015d60 comp rx=0 tx=0).stop 2024-05-27T09:51:29.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 shutdown_connections 2024-05-27T09:51:29.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56077b16cc30 0x56077b16f050 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56077b109330 0x56077b109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56077af68e40 0x56077b0fa270 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 --2- 172.21.15.71:0/3355582742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56077b0edd30 0x56077b108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.704+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 >> 172.21.15.71:0/3355582742 conn(0x56077afc8fc0 msgr2=0x56077b0f1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.705+0000 7f415a000700 0 client.16005 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:29.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.705+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 shutdown_connections 2024-05-27T09:51:29.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.705+0000 7f4185831b80 1 -- 172.21.15.71:0/3355582742 wait complete. 2024-05-27T09:51:29.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.706+0000 7f4185831b80 20 client.16005 trim_cache size 0 max 16384 2024-05-27T09:51:29.708 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-05-27T09:51:29.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f41540b2b40 msgr2=0x7f41540b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f41540b2b40 0x7f41540b5050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x56077b0e8b30 tx=0x7f416800b040 comp rx=0 tx=0).stop 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 msgr2=0x7f417019d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f417019d5c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f415c006010 tx=0x7f415c005280 comp rx=0 tx=0).stop 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 shutdown_connections 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f41540b2b40 0x7f41540b5050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4170109840 0x7f41701a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41701045c0 0x7f417019d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 --2- 172.21.15.71:0/1523360243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4170108ef0 0x7f417019d5c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:29.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 >> 172.21.15.71:0/1523360243 conn(0x7f41700ffe90 msgr2=0x7f417010a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:29.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.709+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 shutdown_connections 2024-05-27T09:51:29.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:29.710+0000 7f4176c00700 1 -- 172.21.15.71:0/1523360243 wait complete. 2024-05-27T09:51:29.742 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] rewinddir-test 2024-05-27T09:51:29.855 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] readdir-while-renames 2024-05-27T09:51:29.897 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] xfsctl 2024-05-27T09:51:29.986 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] bstat 2024-05-27T09:51:30.083 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mtab 2024-05-27T09:51:30.168 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] getdevicesize 2024-05-27T09:51:30.221 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] preallo_rw_pattern_reader 2024-05-27T09:51:30.357 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] preallo_rw_pattern_writer 2024-05-27T09:51:30.413 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] ftrunc 2024-05-27T09:51:30.443 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] trunc 2024-05-27T09:51:30.540 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fs_perms 2024-05-27T09:51:30.672 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] testx 2024-05-27T09:51:30.696 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] looptest 2024-05-27T09:51:30.743 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] locktest 2024-05-27T09:51:30.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:30 smithi071 ceph-mon[31451]: pgmap v115: 97 pgs: 97 active+clean; 32 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 301 KiB/s wr, 353 op/s 2024-05-27T09:51:30.846 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] unwritten_mmap 2024-05-27T09:51:30.936 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] bulkstat_unlink_test 2024-05-27T09:51:30.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:30 smithi122 ceph-mon[36436]: pgmap v115: 97 pgs: 97 active+clean; 32 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 301 KiB/s wr, 353 op/s 2024-05-27T09:51:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:30 smithi072 ceph-mon[35951]: pgmap v115: 97 pgs: 97 active+clean; 32 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 301 KiB/s wr, 353 op/s 2024-05-27T09:51:31.034 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] deduperace 2024-05-27T09:51:31.087 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 898846904, 'ino': 1099511628466, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/pattern.c'}, {'damage_type': 'backtrace', 'id': 988277204, 'ino': 1099511628471, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/tlibio.c'}, {'damage_type': 'backtrace', 'id': 1196651092, 'ino': 1099511628467, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random.c'}, {'damage_type': 'backtrace', 'id': 1446114075, 'ino': 1099511628463, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/file_lock.c'}, {'damage_type': 'backtrace', 'id': 1575731090, 'ino': 1099511628459, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/Makefile'}, {'damage_type': 'backtrace', 'id': 2005763219, 'ino': 1099511628461, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/databin.c'}, {'damage_type': 'backtrace', 'id': 3044887078, 'ino': 1099511628460, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/dataascii.c'}, {'damage_type': 'backtrace', 'id': 3091537664, 'ino': 1099511628468, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/random_range.c'}, {'damage_type': 'backtrace', 'id': 3282795486, 'ino': 1099511628470, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/string_to_tokens.c'}, {'damage_type': 'backtrace', 'id': 3321999657, 'ino': 1099511628465, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/open_flags.c'}, {'damage_type': 'backtrace', 'id': 3474651031, 'ino': 1099511628462, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/datapid.c'}, {'damage_type': 'backtrace', 'id': 3540994548, 'ino': 1099511628472, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/write_log.c'}, {'damage_type': 'backtrace', 'id': 3765296378, 'ino': 1099511628469, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/str_to_bytes.c'}, {'damage_type': 'backtrace', 'id': 4192580263, 'ino': 1099511628464, 'path': '/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/forker.c'}] 2024-05-27T09:51:31.087 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-05-27T09:51:31.185 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] bulkstat_unlink_test_modified 2024-05-27T09:51:31.240 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_dir_offset 2024-05-27T09:51:31.300 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_futimens 2024-05-27T09:51:31.395 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_immutable 2024-05-27T09:51:31.522 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] stale_handle 2024-05-27T09:51:31.559 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] pwrite_mmap_blocked 2024-05-27T09:51:31.575 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_dir_offset2 2024-05-27T09:51:31.867 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] seek_sanity_test 2024-05-27T09:51:31.877 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] seek_copy_test 2024-05-27T09:51:31.915 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_readdir_1 2024-05-27T09:51:32.204 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_readdir_2 2024-05-27T09:51:32.212 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fsync-tester 2024-05-27T09:51:32.368 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] nsexec 2024-05-27T09:51:32.535 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] cloner 2024-05-27T09:51:32.552 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] renameat2 2024-05-27T09:51:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.646+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2037128308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b38111bc0 msgr2=0x7f5b38111fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.646+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2037128308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b38111bc0 0x7f5b38111fd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000b0a0 tx=0x7f5b3000b3b0 comp rx=0 tx=0).stop 2024-05-27T09:51:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.647+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2037128308 shutdown_connections 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.647+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2037128308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b3810b270 0x7f5b381198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.647+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2037128308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b38111bc0 0x7f5b38111fd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.647+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2037128308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 0x7f5b3810ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.647+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2037128308 >> 172.21.15.71:0/2037128308 conn(0x7f5b3806f4c0 msgr2=0x7f5b3806f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.648+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2037128308 shutdown_connections 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.648+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2037128308 wait complete. 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.649+0000 7f5b3fa00700 1 Processor -- start 2024-05-27T09:51:32.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.649+0000 7f5b3fa00700 1 -- start start 2024-05-27T09:51:32.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.650+0000 7f5b3fa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 0x7f5b381aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:32.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.650+0000 7f5b3fa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b3810b270 0x7f5b381aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:32.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.650+0000 7f5b3fa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b38111bc0 0x7f5b381b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b3d000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 0x7f5b381aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b3d000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 0x7f5b381aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33334/0 (socket says 172.21.15.71:33334) 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b3d000700 1 -- 172.21.15.71:0/2592666337 learned_addr learned my addr 172.21.15.71:0/2592666337 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3811cc90 con 0x7f5b3810b270 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b3da00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b38111bc0 0x7f5b381b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b37e00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b3810b270 0x7f5b381aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3811cb10 con 0x7f5b38111bc0 2024-05-27T09:51:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.651+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3811ce10 con 0x7f5b3810a920 2024-05-27T09:51:32.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.652+0000 7f5b3da00700 1 -- 172.21.15.71:0/2592666337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 msgr2=0x7f5b381aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:32.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.652+0000 7f5b3da00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 0x7f5b381aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:32.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.652+0000 7f5b3da00700 1 -- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b3810b270 msgr2=0x7f5b381aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:32.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.652+0000 7f5b3da00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b3810b270 0x7f5b381aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:32.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.652+0000 7f5b3da00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b381b5f30 con 0x7f5b38111bc0 2024-05-27T09:51:32.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.652+0000 7f5b3d000700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 0x7f5b381aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:32.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.652+0000 7f5b37e00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b3810b270 0x7f5b381aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:32.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.653+0000 7f5b3da00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b38111bc0 0x7f5b381b59f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400d720 tx=0x7f5b2400da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:32.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.653+0000 7f5b35600700 1 -- 172.21.15.71:0/2592666337 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24016070 con 0x7f5b38111bc0 2024-05-27T09:51:32.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.654+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b381b6100 con 0x7f5b38111bc0 2024-05-27T09:51:32.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.654+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b381b6630 con 0x7f5b38111bc0 2024-05-27T09:51:32.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.654+0000 7f5b35600700 1 -- 172.21.15.71:0/2592666337 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b2400f690 con 0x7f5b38111bc0 2024-05-27T09:51:32.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.654+0000 7f5b35600700 1 -- 172.21.15.71:0/2592666337 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b240039e0 con 0x7f5b38111bc0 2024-05-27T09:51:32.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.656+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b18005330 con 0x7f5b38111bc0 2024-05-27T09:51:32.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.659+0000 7f5b35600700 1 -- 172.21.15.71:0/2592666337 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5b24003b80 con 0x7f5b38111bc0 2024-05-27T09:51:32.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.662+0000 7f5b35600700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b1c0b2a70 0x7f5b1c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:32.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.662+0000 7f5b35600700 1 -- 172.21.15.71:0/2592666337 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5b240e1af0 con 0x7f5b38111bc0 2024-05-27T09:51:32.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.662+0000 7f5b3d000700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b1c0b2a70 0x7f5b1c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:32.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.663+0000 7f5b3d000700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b1c0b2a70 0x7f5b1c0b4f80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009900 tx=0x7f5b30006210 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:32.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:32.670+0000 7f5b35600700 1 -- 172.21.15.71:0/2592666337 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5b2401f070 con 0x7f5b38111bc0 2024-05-27T09:51:32.714 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_getcwd 2024-05-27T09:51:32.743 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] e4compact 2024-05-27T09:51:32.920 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] test-nextquota 2024-05-27T09:51:32.940 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] punch-alternating 2024-05-27T09:51:32.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:32 smithi122 ceph-mon[36436]: pgmap v116: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 337 KiB/s wr, 383 op/s 2024-05-27T09:51:33.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:32 smithi071 ceph-mon[31451]: pgmap v116: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 337 KiB/s wr, 383 op/s 2024-05-27T09:51:33.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:32 smithi072 ceph-mon[35951]: pgmap v116: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 337 KiB/s wr, 383 op/s 2024-05-27T09:51:33.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.070+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b180058f0 con 0x7f5b38111bc0 2024-05-27T09:51:33.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.071+0000 7f5b35600700 1 -- 172.21.15.71:0/2592666337 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11858 (secure 0 0 0) 0x7f5b240a94a0 con 0x7f5b38111bc0 2024-05-27T09:51:33.073 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:51:33.073 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:50:40.326047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:51:33.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b1c0b2a70 msgr2=0x7f5b1c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:33.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b1c0b2a70 0x7f5b1c0b4f80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009900 tx=0x7f5b30006210 comp rx=0 tx=0).stop 2024-05-27T09:51:33.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b38111bc0 msgr2=0x7f5b381b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:33.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b38111bc0 0x7f5b381b59f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400d720 tx=0x7f5b2400da30 comp rx=0 tx=0).stop 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 shutdown_connections 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5b1c0b2a70 0x7f5b1c0b4f80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b38111bc0 0x7f5b381b59f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b3810a920 0x7f5b381aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 --2- 172.21.15.71:0/2592666337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b3810b270 0x7f5b381aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 >> 172.21.15.71:0/2592666337 conn(0x7f5b3806f4c0 msgr2=0x7f5b38074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 shutdown_connections 2024-05-27T09:51:33.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:33.075+0000 7f5b3fa00700 1 -- 172.21.15.71:0/2592666337 wait complete. 2024-05-27T09:51:33.079 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 28 2024-05-27T09:51:33.086 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-27T09:51:33.143 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] listxattr 2024-05-27T09:51:33.264 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] dio-interleaved 2024-05-27T09:51:33.274 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_dir_type 2024-05-27T09:51:33.425 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] dio-invalidate-cache 2024-05-27T09:51:33.427 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] stat_test 2024-05-27T09:51:33.564 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_encrypted_d_revalidate 2024-05-27T09:51:33.564 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] attr_replace_test 2024-05-27T09:51:33.800 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] swapon 2024-05-27T09:51:33.863 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] mkswap 2024-05-27T09:51:33.895 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_attr_corruption 2024-05-27T09:51:33.896 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_open_tmpfiles 2024-05-27T09:51:33.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:33 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2592666337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:34.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:33 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2592666337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:34.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:33 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2592666337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:51:34.102 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fscrypt-crypt-util 2024-05-27T09:51:34.150 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] bulkstat_null_ocount 2024-05-27T09:51:34.178 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] splice-test 2024-05-27T09:51:34.191 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-05-27T09:51:34.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-05-27T09:51:34.250 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] chprojid_fail 2024-05-27T09:51:34.475 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] detached_mounts_propagation 2024-05-27T09:51:34.520 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] ext4_resize 2024-05-27T09:51:34.609 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_readdir_3 2024-05-27T09:51:34.694 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:34.832 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] splice2pipe 2024-05-27T09:51:34.836 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] uuid_ioctl 2024-05-27T09:51:34.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:34 smithi122 ceph-mon[36436]: pgmap v117: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 292 KiB/s wr, 65 op/s 2024-05-27T09:51:34.985 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-27T09:51:35.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:34 smithi071 ceph-mon[31451]: pgmap v117: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 292 KiB/s wr, 65 op/s 2024-05-27T09:51:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:34 smithi072 ceph-mon[35951]: pgmap v117: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 292 KiB/s wr, 65 op/s 2024-05-27T09:51:35.129 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fiemap-fault 2024-05-27T09:51:35.134 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fiemap-tester 2024-05-27T09:51:35.163 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_stripealign 2024-05-27T09:51:35.303 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] open_by_handle 2024-05-27T09:51:35.430 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_mmap_dio 2024-05-27T09:51:35.459 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] xfsfind 2024-05-27T09:51:35.581 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] t_reflink_read_race 2024-05-27T09:51:35.714 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] fssum 2024-05-27T09:51:35.758 INFO:tasks.workunit.client.0.smithi071.stdout:Building log-writes 2024-05-27T09:51:35.773 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] replay-log 2024-05-27T09:51:35.814 INFO:tasks.workunit.client.0.smithi071.stdout:Building perf 2024-05-27T09:51:35.822 INFO:tasks.workunit.client.0.smithi071.stdout:Building aio-dio-regress 2024-05-27T09:51:35.836 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aiocp 2024-05-27T09:51:35.934 INFO:tasks.workunit.client.0.smithi071.stdout:Building vfs 2024-05-27T09:51:35.947 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] vfstest 2024-05-27T09:51:36.280 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-27T09:51:36.302 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-append-write-read-race 2024-05-27T09:51:36.465 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-cow-race 2024-05-27T09:51:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] mount-idmapped 2024-05-27T09:51:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-cycle-write 2024-05-27T09:51:36.750 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:36 smithi071 ceph-mon[31451]: pgmap v118: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 292 KiB/s wr, 65 op/s 2024-05-27T09:51:36.783 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-eof-race 2024-05-27T09:51:36.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:36 smithi122 ceph-mon[36436]: pgmap v118: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 292 KiB/s wr, 65 op/s 2024-05-27T09:51:36.981 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-extend-stat 2024-05-27T09:51:37.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:36 smithi072 ceph-mon[35951]: pgmap v118: 97 pgs: 97 active+clean; 29 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 292 KiB/s wr, 65 op/s 2024-05-27T09:51:37.107 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-fcntl-race 2024-05-27T09:51:37.299 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-hole-filling-race 2024-05-27T09:51:37.346 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-invalidate-failure 2024-05-27T09:51:37.421 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-invalidate-readahead 2024-05-27T09:51:37.606 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aiodio_sparse2 2024-05-27T09:51:37.681 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-subblock-eof-read 2024-05-27T09:51:37.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.698+0000 7f9f30a00700 1 -- 172.21.15.71:0/4035215921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1045e0 msgr2=0x7f9f2c1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.698+0000 7f9f30a00700 1 --2- 172.21.15.71:0/4035215921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1045e0 0x7f9f2c1049f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009990 tx=0x7f9f1c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.698+0000 7f9f30a00700 1 -- 172.21.15.71:0/4035215921 shutdown_connections 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.698+0000 7f9f30a00700 1 --2- 172.21.15.71:0/4035215921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f2c109860 0x7f9f2c1111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.698+0000 7f9f30a00700 1 --2- 172.21.15.71:0/4035215921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1045e0 0x7f9f2c1049f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.698+0000 7f9f30a00700 1 --2- 172.21.15.71:0/4035215921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f2c108f10 0x7f9f2c109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.699+0000 7f9f30a00700 1 -- 172.21.15.71:0/4035215921 >> 172.21.15.71:0/4035215921 conn(0x7f9f2c100030 msgr2=0x7f9f2c102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.699+0000 7f9f30a00700 1 -- 172.21.15.71:0/4035215921 shutdown_connections 2024-05-27T09:51:37.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.700+0000 7f9f30a00700 1 -- 172.21.15.71:0/4035215921 wait complete. 2024-05-27T09:51:37.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.701+0000 7f9f30a00700 1 Processor -- start 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.701+0000 7f9f30a00700 1 -- start start 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f30a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f2c1045e0 0x7f9f2c1a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f30a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c108f10 0x7f9f2c1a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f30a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f2c109860 0x7f9f2c1ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f30a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c114490 con 0x7f9f2c1045e0 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f30a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c114310 con 0x7f9f2c108f10 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f30a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c114610 con 0x7f9f2c109860 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f29400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c108f10 0x7f9f2c1a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f29400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c108f10 0x7f9f2c1a26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:35080/0 (socket says 172.21.15.71:35080) 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.702+0000 7f9f29400700 1 -- 172.21.15.71:0/2295424163 learned_addr learned my addr 172.21.15.71:0/2295424163 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.703+0000 7f9f2a800700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f2c109860 0x7f9f2c1ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.703+0000 7f9f29400700 1 -- 172.21.15.71:0/2295424163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f2c109860 msgr2=0x7f9f2c1ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.703+0000 7f9f29400700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f2c109860 0x7f9f2c1ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.703+0000 7f9f29400700 1 -- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f2c1045e0 msgr2=0x7f9f2c1a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.703+0000 7f9f29400700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f2c1045e0 0x7f9f2c1a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.703+0000 7f9f29400700 1 -- 172.21.15.71:0/2295424163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c06d1d0 con 0x7f9f2c108f10 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.703+0000 7f9f29400700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c108f10 0x7f9f2c1a26b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800d980 tx=0x7f9f1800dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.704+0000 7f9f22a00700 1 -- 172.21.15.71:0/2295424163 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18017070 con 0x7f9f2c108f10 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.704+0000 7f9f22a00700 1 -- 172.21.15.71:0/2295424163 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f18010460 con 0x7f9f2c108f10 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.704+0000 7f9f22a00700 1 -- 172.21.15.71:0/2295424163 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800de60 con 0x7f9f2c108f10 2024-05-27T09:51:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.704+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c06d4c0 con 0x7f9f2c108f10 2024-05-27T09:51:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.704+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c06d940 con 0x7f9f2c108f10 2024-05-27T09:51:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.711+0000 7f9f22a00700 1 -- 172.21.15.71:0/2295424163 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f9f18009b40 con 0x7f9f2c108f10 2024-05-27T09:51:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.712+0000 7f9f3f495b80 1 Processor -- start 2024-05-27T09:51:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.712+0000 7f9f3f495b80 1 -- start start 2024-05-27T09:51:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c8559b80 0x5613c85f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c846dfd0 0x5613c85f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 0x5613c85eda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5613c851afd0 con 0x5613c85ed670 2024-05-27T09:51:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5613c850ab70 con 0x5613c8559b80 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5613c850ebb0 con 0x5613c846dfd0 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f2a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c8559b80 0x5613c85f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f2a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c8559b80 0x5613c85f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:35084/0 (socket says 172.21.15.71:35084) 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.713+0000 7f9f2a800700 1 -- 172.21.15.71:0/2328567128 learned_addr learned my addr 172.21.15.71:0/2328567128 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.714+0000 7f9f29e00700 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c846dfd0 0x5613c85f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.714+0000 7f9f29400700 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 0x5613c85eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.714+0000 7f9f29e00700 1 -- 172.21.15.71:0/2328567128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c8559b80 msgr2=0x5613c85f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.714+0000 7f9f29e00700 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c8559b80 0x5613c85f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.714+0000 7f9f29e00700 1 -- 172.21.15.71:0/2328567128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 msgr2=0x5613c85eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.714+0000 7f9f29e00700 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 0x5613c85eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.714+0000 7f9f29e00700 1 -- 172.21.15.71:0/2328567128 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c84d35b0 con 0x5613c846dfd0 2024-05-27T09:51:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.715+0000 7f9f29e00700 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c846dfd0 0x5613c85f3b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0098e0 tx=0x7f9f1c005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3252aededb636061 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.715+0000 7f9f17400700 1 -- 172.21.15.71:0/2328567128 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c009510 con 0x5613c846dfd0 2024-05-27T09:51:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.715+0000 7f9f17400700 1 -- 172.21.15.71:0/2328567128 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f1c003d10 con 0x5613c846dfd0 2024-05-27T09:51:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.715+0000 7f9f17400700 1 -- 172.21.15.71:0/2328567128 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00bac0 con 0x5613c846dfd0 2024-05-27T09:51:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.715+0000 7f9f22a00700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9f100b2a70 0x7f9f100b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.716+0000 7f9f22a00700 1 -- 172.21.15.71:0/2295424163 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9f180e21b0 con 0x7f9f2c108f10 2024-05-27T09:51:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.717+0000 7f9f3f495b80 1 -- 172.21.15.71:0/2328567128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c846dfd0 msgr2=0x5613c85f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.717+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c846dfd0 0x5613c85f3b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0098e0 tx=0x7f9f1c005ef0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.718+0000 7f9f3f495b80 1 -- 172.21.15.71:0/2328567128 shutdown_connections 2024-05-27T09:51:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.718+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 0x5613c85eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.718+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c8559b80 0x5613c85f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.718+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/2328567128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c846dfd0 0x5613c85f3b20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.718+0000 7f9f3f495b80 1 -- 172.21.15.71:0/2328567128 >> 172.21.15.71:0/2328567128 conn(0x5613c8507520 msgr2=0x5613c85e86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.718+0000 7f9f2a800700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9f100b2a70 0x7f9f100b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.719+0000 7f9f3f495b80 1 -- 172.21.15.71:0/2328567128 shutdown_connections 2024-05-27T09:51:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.719+0000 7f9f2a800700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9f100b2a70 0x7f9f100b4f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009e30 tx=0x7f9f24009040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.720+0000 7f9f3f495b80 1 -- 172.21.15.71:0/2328567128 wait complete. 2024-05-27T09:51:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.720+0000 7f9f3f495b80 1 -- start start 2024-05-27T09:51:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.721+0000 7f9f3f495b80 1 Processor -- start 2024-05-27T09:51:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.721+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c85f7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.721+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.721+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 0x5613c85f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.721+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5613c8411130 con 0x5613c85ed670 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.721+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5613c84ab8f0 con 0x5613c846dfd0 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.721+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5613c85ee400 con 0x5613c8559b80 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.722+0000 7f9f3f495b80 10 client.0 _ll_register_callbacks cb 0x5613c84b4e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.722+0000 7f9f29400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.722+0000 7f9f29400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85f78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53064/0 (socket says 172.21.15.71:53064) 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.722+0000 7f9f29400700 1 -- 172.21.15.71:0/1585674463 learned_addr learned my addr 172.21.15.71:0/1585674463 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.722+0000 7f9f29400700 1 -- 172.21.15.71:0/1585674463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 msgr2=0x5613c85f7390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.722+0000 7f9f29400700 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c85f7390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.722+0000 7f9f29400700 1 -- 172.21.15.71:0/1585674463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 msgr2=0x5613c85f7e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:51:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.723+0000 7f9f29400700 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 0x5613c85f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.723+0000 7f9f29400700 1 -- 172.21.15.71:0/1585674463 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c845aa60 con 0x5613c8559b80 2024-05-27T09:51:37.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.724+0000 7f9f29400700 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85f78d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f180a9160 tx=0x7f9f180a8bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43138c2ce46295c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:37.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.724+0000 7f9f0be00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:51:37.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.724+0000 7f9f0be00700 1 -- 172.21.15.71:0/1585674463 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18020050 con 0x5613c8559b80 2024-05-27T09:51:37.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.725+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f1c003d10 con 0x5613c8559b80 2024-05-27T09:51:37.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.725+0000 7f9f0be00700 1 -- 172.21.15.71:0/1585674463 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9f180a96c0 con 0x5613c8559b80 2024-05-27T09:51:37.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.725+0000 7f9f0be00700 1 -- 172.21.15.71:0/1585674463 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f180a9b60 con 0x5613c8559b80 2024-05-27T09:51:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.727+0000 7f9f3f495b80 10 client.26182 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.727+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613c84db1f0 con 0x5613c8559b80 2024-05-27T09:51:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.727+0000 7f9f0be00700 1 -- 172.21.15.71:0/1585674463 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f1c003d10 con 0x5613c8559b80 2024-05-27T09:51:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.727+0000 7f9f0be00700 1 -- 172.21.15.71:0/1585674463 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f9f180b1e30 con 0x5613c8559b80 2024-05-27T09:51:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.728+0000 7f9f3f495b80 10 client.26182 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.728+0000 7f9f3f495b80 10 client.26182 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:51:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.728+0000 7f9f3f495b80 20 client.26182 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.728+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8606f70 0x5613c8609410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.728+0000 7f9f3f495b80 4 client.26182 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.728+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613c851cf20 con 0x5613c8606f70 2024-05-27T09:51:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.729+0000 7f9f29e00700 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8606f70 0x5613c8609410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.731+0000 7f9f0be00700 10 client.26182 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:37.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.731+0000 7f9f29e00700 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8606f70 0x5613c8609410 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dbaf52fc383d69e server_cookie=7805fa05c0ad1b18 in_seq=0 out_seq=0 2024-05-27T09:51:37.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f0be00700 1 -- 172.21.15.71:0/1585674463 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5613c851cf20 con 0x5613c8606f70 2024-05-27T09:51:37.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f0be00700 10 client.26182 handle_command_reply: tid=0 2024-05-27T09:51:37.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 client.26182 shutdown 2024-05-27T09:51:37.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 msgr2=0x5613c85f78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:37.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85f78d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f180a9160 tx=0x7f9f180a8bd0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 shutdown_connections 2024-05-27T09:51:37.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8606f70 0x5613c8609410 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c85ed670 0x5613c85f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c85f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/1585674463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85f78d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.734+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 >> 172.21.15.71:0/1585674463 conn(0x5613c8507520 msgr2=0x5613c85ec660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.735+0000 7f9f0be00700 0 client.26182 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.735+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 shutdown_connections 2024-05-27T09:51:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.735+0000 7f9f3f495b80 1 -- 172.21.15.71:0/1585674463 wait complete. 2024-05-27T09:51:37.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.735+0000 7f9f3f495b80 20 client.26182 trim_cache size 0 max 16384 2024-05-27T09:51:37.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.778+0000 7f9f3f495b80 1 Processor -- start 2024-05-27T09:51:37.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.778+0000 7f9f3f495b80 1 -- start start 2024-05-27T09:51:37.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c8603170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c8559b80 0x5613c85eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c85ed670 0x5613c85e8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1c0500 con 0x5613c8559b80 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c0750b0 con 0x5613c846dfd0 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c072ea0 con 0x5613c85ed670 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f29e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c8603170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f29e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c8603170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:35106/0 (socket says 172.21.15.71:35106) 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.779+0000 7f9f29e00700 1 -- 172.21.15.71:0/731544 learned_addr learned my addr 172.21.15.71:0/731544 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.780+0000 7f9f29e00700 1 -- 172.21.15.71:0/731544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c85ed670 msgr2=0x5613c85e8040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.780+0000 7f9f29e00700 1 --2- 172.21.15.71:0/731544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c85ed670 0x5613c85e8040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.780+0000 7f9f29e00700 1 -- 172.21.15.71:0/731544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c8559b80 msgr2=0x5613c85eccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.780+0000 7f9f29e00700 1 --2- 172.21.15.71:0/731544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c8559b80 0x5613c85eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.780+0000 7f9f29e00700 1 -- 172.21.15.71:0/731544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c85f5900 con 0x5613c846dfd0 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.780+0000 7f9f29e00700 1 --2- 172.21.15.71:0/731544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c8603170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02cfd0 tx=0x7f9f1c004ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f9cb205b266a4f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.781+0000 7f9f16a00700 1 -- 172.21.15.71:0/731544 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c003920 con 0x5613c846dfd0 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.781+0000 7f9f16a00700 1 -- 172.21.15.71:0/731544 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f1c005070 con 0x5613c846dfd0 2024-05-27T09:51:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.781+0000 7f9f16a00700 1 -- 172.21.15.71:0/731544 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00bae0 con 0x5613c846dfd0 2024-05-27T09:51:37.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.782+0000 7f9f3f495b80 1 -- 172.21.15.71:0/731544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 msgr2=0x5613c8603170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:37.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.782+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/731544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c8603170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02cfd0 tx=0x7f9f1c004ff0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.782+0000 7f9f3f495b80 1 -- 172.21.15.71:0/731544 shutdown_connections 2024-05-27T09:51:37.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.782+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/731544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c85ed670 0x5613c85e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.782+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/731544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c846dfd0 0x5613c8603170 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.782+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/731544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c8559b80 0x5613c85eccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.782+0000 7f9f3f495b80 1 -- 172.21.15.71:0/731544 >> 172.21.15.71:0/731544 conn(0x5613c8507520 msgr2=0x5613c85f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:37.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.783+0000 7f9f3f495b80 1 -- 172.21.15.71:0/731544 shutdown_connections 2024-05-27T09:51:37.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.783+0000 7f9f3f495b80 1 -- 172.21.15.71:0/731544 wait complete. 2024-05-27T09:51:37.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.784+0000 7f9f3f495b80 1 -- start start 2024-05-27T09:51:37.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.784+0000 7f9f3f495b80 1 Processor -- start 2024-05-27T09:51:37.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.785+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c846dfd0 0x5613c85ff870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.785+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85fc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.785+0000 7f9f3f495b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c85ed670 0x5613c85fc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.785+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c073570 con 0x5613c846dfd0 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.785+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c0749e0 con 0x5613c85ed670 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.785+0000 7f9f3f495b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c073c40 con 0x5613c8559b80 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.785+0000 7f9f3f495b80 10 client.0 _ll_register_callbacks cb 0x5613c84b4e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f2a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c85ed670 0x5613c85fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f2a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c85ed670 0x5613c85fc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:35116/0 (socket says 172.21.15.71:35116) 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f2a800700 1 -- 172.21.15.71:0/25961495 learned_addr learned my addr 172.21.15.71:0/25961495 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f29e00700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c846dfd0 0x5613c85ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f29400700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85fc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f2a800700 1 -- 172.21.15.71:0/25961495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 msgr2=0x5613c85fc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f2a800700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85fc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f2a800700 1 -- 172.21.15.71:0/25961495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c846dfd0 msgr2=0x5613c85ff870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.786+0000 7f9f2a800700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c846dfd0 0x5613c85ff870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.787+0000 7f9f2a800700 1 -- 172.21.15.71:0/25961495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c85fcc70 con 0x5613c85ed670 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.787+0000 7f9f29e00700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c846dfd0 0x5613c85ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.787+0000 7f9f2a800700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c85ed670 0x5613c85fc730 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f24018d90 tx=0x7f9f24004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed5f08763ee458b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.787+0000 7f9f0be00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.787+0000 7f9f0be00700 1 -- 172.21.15.71:0/25961495 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24004db0 con 0x5613c85ed670 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.787+0000 7f9f0be00700 1 -- 172.21.15.71:0/25961495 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f9f24016830 con 0x5613c85ed670 2024-05-27T09:51:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.788+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f1c005070 con 0x5613c85ed670 2024-05-27T09:51:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.788+0000 7f9f0be00700 1 -- 172.21.15.71:0/25961495 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f24016a30 con 0x5613c85ed670 2024-05-27T09:51:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.788+0000 7f9f3f495b80 10 client.26150 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.788+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613c8672800 con 0x5613c85ed670 2024-05-27T09:51:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.788+0000 7f9f0be00700 1 -- 172.21.15.71:0/25961495 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f1c005070 con 0x5613c85ed670 2024-05-27T09:51:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.789+0000 7f9f0be00700 1 -- 172.21.15.71:0/25961495 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f9f24005640 con 0x5613c85ed670 2024-05-27T09:51:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.789+0000 7f9f3f495b80 10 client.26150 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.789+0000 7f9f3f495b80 10 client.26150 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.789+0000 7f9f3f495b80 20 client.26150 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.789+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8673090 0x5613c86754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.789+0000 7f9f3f495b80 4 client.26150 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.789+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5613c85e08a0 con 0x5613c8673090 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.790+0000 7f9f29e00700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8673090 0x5613c86754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.791+0000 7f9f0be00700 10 client.26150 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:37.791+0000 7f9f29e00700 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8673090 0x5613c86754b0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69463715dc7de297 server_cookie=c7d2dd542a3953bd in_seq=0 out_seq=0 2024-05-27T09:51:37.794 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-dio-write-verify 2024-05-27T09:51:38.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:38 smithi122 ceph-mon[36436]: pgmap v119: 97 pgs: 97 active+clean; 31 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 538 KiB/s wr, 78 op/s 2024-05-27T09:51:39.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:38 smithi071 ceph-mon[31451]: pgmap v119: 97 pgs: 97 active+clean; 31 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 538 KiB/s wr, 78 op/s 2024-05-27T09:51:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:38 smithi072 ceph-mon[35951]: pgmap v119: 97 pgs: 97 active+clean; 31 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 538 KiB/s wr, 78 op/s 2024-05-27T09:51:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.200+0000 7f9f0be00700 1 -- 172.21.15.71:0/25961495 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5613c85e08a0 con 0x5613c8673090 2024-05-27T09:51:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.200+0000 7f9f0be00700 10 client.26150 handle_command_reply: tid=0 2024-05-27T09:51:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.200+0000 7f9f3f495b80 1 client.26150 shutdown 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c85ed670 msgr2=0x5613c85fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c85ed670 0x5613c85fc730 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f24018d90 tx=0x7f9f24004b40 comp rx=0 tx=0).stop 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 shutdown_connections 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5613c8673090 0x5613c86754b0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5613c85ed670 0x5613c85fc730 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613c846dfd0 0x5613c85ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 --2- 172.21.15.71:0/25961495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5613c8559b80 0x5613c85fc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f0be00700 0 client.26150 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.201+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 >> 172.21.15.71:0/25961495 conn(0x5613c8507520 msgr2=0x5613c85f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.202+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 shutdown_connections 2024-05-27T09:51:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.202+0000 7f9f3f495b80 1 -- 172.21.15.71:0/25961495 wait complete. 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.202+0000 7f9f3f495b80 20 client.26150 trim_cache size 0 max 16384 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 28, 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 10, 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "56072c7e": { 2024-05-27T09:51:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 10, 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 150.0, 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:51:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:51:40.206 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9f100b2a70 msgr2=0x7f9f100b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9f100b2a70 0x7f9f100b4f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009e30 tx=0x7f9f24009040 comp rx=0 tx=0).stop 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c108f10 msgr2=0x7f9f2c1a26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c108f10 0x7f9f2c1a26b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800d980 tx=0x7f9f1800dd40 comp rx=0 tx=0).stop 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 shutdown_connections 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9f100b2a70 0x7f9f100b4f80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f2c109860 0x7f9f2c1ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f2c1045e0 0x7f9f2c1a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 --2- 172.21.15.71:0/2295424163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c108f10 0x7f9f2c1a26b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.204+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 >> 172.21.15.71:0/2295424163 conn(0x7f9f2c100030 msgr2=0x7f9f2c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.205+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 shutdown_connections 2024-05-27T09:51:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:51:40.205+0000 7f9f30a00700 1 -- 172.21.15.71:0/2295424163 wait complete. 2024-05-27T09:51:40.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:40 smithi122 ceph-mon[36436]: pgmap v120: 97 pgs: 97 active+clean; 31 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 281 KiB/s wr, 42 op/s 2024-05-27T09:51:41.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:40 smithi071 ceph-mon[31451]: pgmap v120: 97 pgs: 97 active+clean; 31 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 281 KiB/s wr, 42 op/s 2024-05-27T09:51:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:40 smithi072 ceph-mon[35951]: pgmap v120: 97 pgs: 97 active+clean; 31 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 281 KiB/s wr, 42 op/s 2024-05-27T09:51:41.154 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '56072c7e', quiesce took 13.1 seconds. Will release after: 16.9 2024-05-27T09:51:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 -- 172.21.15.71:0/260879890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810c180 msgr2=0x7f19d8105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 --2- 172.21.15.71:0/260879890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810c180 0x7f19d8105dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009900 tx=0x7f19cc02a3f0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 -- 172.21.15.71:0/260879890 shutdown_connections 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 --2- 172.21.15.71:0/260879890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d8106430 0x7f19d8112800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 --2- 172.21.15.71:0/260879890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810c180 0x7f19d8105dc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 --2- 172.21.15.71:0/260879890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810bce0 0x7f19d8105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 -- 172.21.15.71:0/260879890 >> 172.21.15.71:0/260879890 conn(0x7f19d8101380 msgr2=0x7f19d81037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 -- 172.21.15.71:0/260879890 shutdown_connections 2024-05-27T09:51:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.283+0000 7f19dea00640 1 -- 172.21.15.71:0/260879890 wait complete. 2024-05-27T09:51:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 Processor -- start 2024-05-27T09:51:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 -- start start 2024-05-27T09:51:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d8106430 0x7f19d81a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810bce0 0x7f19d81a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810c180 0x7f19d819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8115f20 con 0x7f19d810bce0 2024-05-27T09:51:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8115da0 con 0x7f19d8106430 2024-05-27T09:51:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.285+0000 7f19dea00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81160a0 con 0x7f19d810c180 2024-05-27T09:51:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19dcc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810bce0 0x7f19d81a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19de000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810c180 0x7f19d819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19dcc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810bce0 0x7f19d81a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59634/0 (socket says 172.21.15.71:59634) 2024-05-27T09:51:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19de000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810c180 0x7f19d819c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53114/0 (socket says 172.21.15.71:53114) 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19dcc00640 1 -- 172.21.15.71:0/3777810976 learned_addr learned my addr 172.21.15.71:0/3777810976 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19dd600640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d8106430 0x7f19d81a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19de000640 1 -- 172.21.15.71:0/3777810976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d8106430 msgr2=0x7f19d81a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19de000640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d8106430 0x7f19d81a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19de000640 1 -- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810bce0 msgr2=0x7f19d81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19de000640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810bce0 0x7f19d81a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19de000640 1 -- 172.21.15.71:0/3777810976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d819ce70 con 0x7f19d810c180 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.286+0000 7f19dcc00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810bce0 0x7f19d81a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.287+0000 7f19de000640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810c180 0x7f19d819c740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009fd0 tx=0x7f19d000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.287+0000 7f19d6000640 1 -- 172.21.15.71:0/3777810976 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d000ce20 con 0x7f19d810c180 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.287+0000 7f19d6000640 1 -- 172.21.15.71:0/3777810976 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d0005020 con 0x7f19d810c180 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.287+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d819d100 con 0x7f19d810c180 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.287+0000 7f19d6000640 1 -- 172.21.15.71:0/3777810976 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0010690 con 0x7f19d810c180 2024-05-27T09:51:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.287+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81a9360 con 0x7f19d810c180 2024-05-27T09:51:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.291+0000 7f19e7002740 1 Processor -- start 2024-05-27T09:51:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.292+0000 7f19d6000640 1 -- 172.21.15.71:0/3777810976 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f19d00054d0 con 0x7f19d810c180 2024-05-27T09:51:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.292+0000 7f19e7002740 1 -- start start 2024-05-27T09:51:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.292+0000 7f19e7002740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be0fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.292+0000 7f19e7002740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be0ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19e7002740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19e7002740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ad6bd80b90 con 0x55ad6ba442f0 2024-05-27T09:51:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19e7002740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ad6bd70730 con 0x55ad6ba6d1b0 2024-05-27T09:51:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19e7002740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad6bd74770 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be0ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be0ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59650/0 (socket says 172.21.15.71:59650) 2024-05-27T09:51:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 -- 172.21.15.71:0/1693841109 learned_addr learned my addr 172.21.15.71:0/1693841109 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dcc00640 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dcc00640 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be0fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 -- 172.21.15.71:0/1693841109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba4c4d0 msgr2=0x55ad6be104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be104e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 -- 172.21.15.71:0/1693841109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba6d1b0 msgr2=0x55ad6be0fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be0fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.293+0000 7f19dd600640 1 -- 172.21.15.71:0/1693841109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad6bd098b0 con 0x55ad6ba442f0 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.294+0000 7f19dd600640 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be0ffa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009c20 tx=0x7f19c4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84415151a7ba7dd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.294+0000 7f19ca600640 1 -- 172.21.15.71:0/1693841109 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4004230 con 0x55ad6ba442f0 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.294+0000 7f19d6000640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f19c00b2950 0x7f19c00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.294+0000 7f19ca600640 1 -- 172.21.15.71:0/1693841109 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19c40043d0 con 0x55ad6ba442f0 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.294+0000 7f19ca600640 1 -- 172.21.15.71:0/1693841109 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4004bd0 con 0x55ad6ba442f0 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.294+0000 7f19d6000640 1 -- 172.21.15.71:0/3777810976 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f19d00e2ca0 con 0x7f19d810c180 2024-05-27T09:51:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.294+0000 7f19dcc00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f19c00b2950 0x7f19c00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 -- 172.21.15.71:0/1693841109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 msgr2=0x55ad6be0ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be0ffa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009c20 tx=0x7f19c4011810 comp rx=0 tx=0).stop 2024-05-27T09:51:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 -- 172.21.15.71:0/1693841109 shutdown_connections 2024-05-27T09:51:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be0ffa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 --2- 172.21.15.71:0/1693841109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be0fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19dcc00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f19c00b2950 0x7f19c00b4e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f19cc006010 tx=0x7f19cc005a20 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 -- 172.21.15.71:0/1693841109 >> 172.21.15.71:0/1693841109 conn(0x55ad6ba61300 msgr2=0x55ad6be0c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 -- 172.21.15.71:0/1693841109 shutdown_connections 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.295+0000 7f19e7002740 1 -- 172.21.15.71:0/1693841109 wait complete. 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.296+0000 7f19e7002740 1 -- start start 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.296+0000 7f19e7002740 1 Processor -- start 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19e7002740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be19b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19e7002740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19e7002740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19e7002740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ad6ba56790 con 0x55ad6ba6d1b0 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19e7002740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ad6bd18bc0 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19e7002740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad6be1cb90 con 0x55ad6ba442f0 2024-05-27T09:51:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19e7002740 10 client.0 _ll_register_callbacks cb 0x55ad6bcf6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be19b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be19b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53134/0 (socket says 172.21.15.71:53134) 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 -- 172.21.15.71:0/2999294620 learned_addr learned my addr 172.21.15.71:0/2999294620 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dcc00640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19de000640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 -- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 msgr2=0x55ad6be1a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 -- 172.21.15.71:0/2999294620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 msgr2=0x55ad6be1a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dd600640 1 -- 172.21.15.71:0/2999294620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad6ba85210 con 0x55ad6ba442f0 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19dcc00640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.297+0000 7f19de000640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.298+0000 7f19dd600640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be19b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009bf0 tx=0x7f19c4019b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a243dd87a20fcbb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.298+0000 7f19bea00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:51:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.298+0000 7f19bea00640 1 -- 172.21.15.71:0/2999294620 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4028020 con 0x55ad6ba442f0 2024-05-27T09:51:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.298+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19c40043d0 con 0x55ad6ba442f0 2024-05-27T09:51:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.298+0000 7f19bea00640 1 -- 172.21.15.71:0/2999294620 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f19c4024620 con 0x55ad6ba442f0 2024-05-27T09:51:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.298+0000 7f19bea00640 1 -- 172.21.15.71:0/2999294620 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19c4033050 con 0x55ad6ba442f0 2024-05-27T09:51:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 10 client.26197 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad6bb51620 con 0x55ad6ba442f0 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19bea00640 1 -- 172.21.15.71:0/2999294620 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19c40043d0 con 0x55ad6ba442f0 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19bea00640 1 -- 172.21.15.71:0/2999294620 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f19c4018070 con 0x55ad6ba442f0 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 10 client.26197 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 10 client.26197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 20 client.26197 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba2bd80 0x55ad6be2bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 4 client.26197 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.299+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad6bd82ae0 con 0x55ad6ba2bd80 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.300+0000 7f19dcc00640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba2bd80 0x55ad6be2bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.300+0000 7f19dcc00640 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba2bd80 0x55ad6be2bcf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ef5275a2640891 server_cookie=40114fc160d2191a in_seq=0 out_seq=0 2024-05-27T09:51:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.300+0000 7f19bea00640 10 client.26197 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.301+0000 7f19bea00640 1 -- 172.21.15.71:0/2999294620 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ad6bd82ae0 con 0x55ad6ba2bd80 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.301+0000 7f19bea00640 10 client.26197 handle_command_reply: tid=0 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.301+0000 7f19e7002740 1 client.26197 shutdown 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.301+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 msgr2=0x55ad6be19b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.301+0000 7f19e7002740 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be19b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009bf0 tx=0x7f19c4019b10 comp rx=0 tx=0).stop 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 shutdown_connections 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba2bd80 0x55ad6be2bcf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19bea00640 0 client.26197 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 --2- 172.21.15.71:0/2999294620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be19b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 >> 172.21.15.71:0/2999294620 conn(0x55ad6ba61300 msgr2=0x55ad6be0fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 shutdown_connections 2024-05-27T09:51:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 1 -- 172.21.15.71:0/2999294620 wait complete. 2024-05-27T09:51:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.302+0000 7f19e7002740 20 client.26197 trim_cache size 0 max 16384 2024-05-27T09:51:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.318+0000 7f19e7002740 1 Processor -- start 2024-05-27T09:51:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.318+0000 7f19e7002740 1 -- start start 2024-05-27T09:51:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19e7002740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be1c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19e7002740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be19b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19e7002740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19e7002740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81b4370 con 0x55ad6ba6d1b0 2024-05-27T09:51:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19e7002740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81b1c40 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19e7002740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81afa90 con 0x55ad6ba442f0 2024-05-27T09:51:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19de000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19dcc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be19b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19de000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59670/0 (socket says 172.21.15.71:59670) 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19de000640 1 -- 172.21.15.71:0/3035881520 learned_addr learned my addr 172.21.15.71:0/3035881520 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.319+0000 7f19dd600640 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be1c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19dcc00640 1 -- 172.21.15.71:0/3035881520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 msgr2=0x55ad6be1c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19dcc00640 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be1c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19dcc00640 1 -- 172.21.15.71:0/3035881520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 msgr2=0x55ad6be1a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19dcc00640 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19dcc00640 1 -- 172.21.15.71:0/3035881520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad6be0cd10 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19de000640 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19dcc00640 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be19b00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f19cc005ab0 tx=0x7f19cc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66643c8363f23823 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19c9c00640 1 -- 172.21.15.71:0/3035881520 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc031ab0 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19c9c00640 1 -- 172.21.15.71:0/3035881520 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19cc031c50 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.320+0000 7f19c9c00640 1 -- 172.21.15.71:0/3035881520 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc03d7d0 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 -- 172.21.15.71:0/3035881520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 msgr2=0x55ad6be19b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be19b00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f19cc005ab0 tx=0x7f19cc009260 comp rx=0 tx=0).stop 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 -- 172.21.15.71:0/3035881520 shutdown_connections 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be19b00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 --2- 172.21.15.71:0/3035881520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba442f0 0x55ad6be1c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 -- 172.21.15.71:0/3035881520 >> 172.21.15.71:0/3035881520 conn(0x55ad6ba61300 msgr2=0x55ad6be193f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 -- 172.21.15.71:0/3035881520 shutdown_connections 2024-05-27T09:51:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.321+0000 7f19e7002740 1 -- 172.21.15.71:0/3035881520 wait complete. 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.322+0000 7f19e7002740 1 -- start start 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.322+0000 7f19e7002740 1 Processor -- start 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.322+0000 7f19e7002740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be22600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.322+0000 7f19e7002740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19e7002740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19e7002740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81b0100 con 0x55ad6ba442f0 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19e7002740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81b1570 con 0x55ad6ba4c4d0 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19e7002740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81b07d0 con 0x55ad6ba6d1b0 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19e7002740 10 client.0 _ll_register_callbacks cb 0x7f19cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be22600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be22600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59678/0 (socket says 172.21.15.71:59678) 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 -- 172.21.15.71:0/2191946514 learned_addr learned my addr 172.21.15.71:0/2191946514 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19de000640 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dcc00640 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 -- 172.21.15.71:0/2191946514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba6d1b0 msgr2=0x55ad6be1eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 -- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 msgr2=0x55ad6be1e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.323+0000 7f19dd600640 1 -- 172.21.15.71:0/2191946514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad6be0f7f0 con 0x55ad6ba442f0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19dd600640 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be22600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009c20 tx=0x7f19c4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9c036b2ed960a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19bea00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19bea00640 1 -- 172.21.15.71:0/2191946514 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c403c060 con 0x55ad6ba442f0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19bea00640 1 -- 172.21.15.71:0/2191946514 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f19c4004240 con 0x55ad6ba442f0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19cc031c50 con 0x55ad6ba442f0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19bea00640 1 -- 172.21.15.71:0/2191946514 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19c4028070 con 0x55ad6ba442f0 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19e7002740 10 client.16038 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad6be930f0 con 0x55ad6ba442f0 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.324+0000 7f19bea00640 1 -- 172.21.15.71:0/2191946514 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19cc031c50 con 0x55ad6ba442f0 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19bea00640 1 -- 172.21.15.71:0/2191946514 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f19c40035f0 con 0x55ad6ba442f0 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19e7002740 10 client.16038 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19e7002740 10 client.16038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19e7002740 20 client.16038 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19e7002740 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba011c0 0x55ad6be95820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19e7002740 4 client.16038 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad6bd7c2c0 con 0x55ad6ba011c0 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.325+0000 7f19dcc00640 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba011c0 0x55ad6be95820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.326+0000 7f19dcc00640 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba011c0 0x55ad6be95820 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f56560374f8e0465 server_cookie=85118b5cf16533ec in_seq=0 out_seq=0 2024-05-27T09:51:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.326+0000 7f19bea00640 10 client.16038 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19bea00640 1 -- 172.21.15.71:0/2191946514 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ad6bd7c2c0 con 0x55ad6ba011c0 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19bea00640 10 client.16038 handle_command_reply: tid=0 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 client.16038 shutdown 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 msgr2=0x55ad6be22600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be22600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009c20 tx=0x7f19c4019700 comp rx=0 tx=0).stop 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 shutdown_connections 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad6ba6d1b0 0x55ad6be1eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ad6ba4c4d0 0x55ad6be1e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ad6ba011c0 0x55ad6be95820 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 --2- 172.21.15.71:0/2191946514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad6ba442f0 0x55ad6be22600 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19bea00640 0 client.16038 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.375+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 >> 172.21.15.71:0/2191946514 conn(0x55ad6ba61300 msgr2=0x55ad6be25680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.376+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 shutdown_connections 2024-05-27T09:51:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.376+0000 7f19e7002740 1 -- 172.21.15.71:0/2191946514 wait complete. 2024-05-27T09:51:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.376+0000 7f19e7002740 20 client.16038 trim_cache size 0 max 16384 2024-05-27T09:51:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:51:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:51:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:51:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f19c00b2950 msgr2=0x7f19c00b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f19c00b2950 0x7f19c00b4e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f19cc006010 tx=0x7f19cc005a20 comp rx=0 tx=0).stop 2024-05-27T09:51:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810c180 msgr2=0x7f19d819c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810c180 0x7f19d819c740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009fd0 tx=0x7f19d000ef10 comp rx=0 tx=0).stop 2024-05-27T09:51:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 shutdown_connections 2024-05-27T09:51:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f19c00b2950 0x7f19c00b4e60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19d810c180 0x7f19d819c740 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d810bce0 0x7f19d81a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 --2- 172.21.15.71:0/3777810976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d8106430 0x7f19d81a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 >> 172.21.15.71:0/3777810976 conn(0x7f19d8101380 msgr2=0x7f19d8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 shutdown_connections 2024-05-27T09:51:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:42.377+0000 7f19dea00640 1 -- 172.21.15.71:0/3777810976 wait complete. 2024-05-27T09:51:42.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:42 smithi122 ceph-mon[36436]: pgmap v121: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 407 KiB/s wr, 63 op/s 2024-05-27T09:51:43.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:42 smithi071 ceph-mon[31451]: pgmap v121: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 407 KiB/s wr, 63 op/s 2024-05-27T09:51:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:42 smithi072 ceph-mon[35951]: pgmap v121: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 407 KiB/s wr, 63 op/s 2024-05-27T09:51:44.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:44 smithi122 ceph-mon[36436]: pgmap v122: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 370 KiB/s wr, 33 op/s 2024-05-27T09:51:45.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:44 smithi071 ceph-mon[31451]: pgmap v122: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 370 KiB/s wr, 33 op/s 2024-05-27T09:51:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:44 smithi072 ceph-mon[35951]: pgmap v122: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 370 KiB/s wr, 33 op/s 2024-05-27T09:51:46.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:46 smithi122 ceph-mon[36436]: pgmap v123: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 370 KiB/s wr, 33 op/s 2024-05-27T09:51:47.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:46 smithi071 ceph-mon[31451]: pgmap v123: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 370 KiB/s wr, 33 op/s 2024-05-27T09:51:47.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:46 smithi072 ceph-mon[35951]: pgmap v123: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 370 KiB/s wr, 33 op/s 2024-05-27T09:51:49.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:48 smithi071 ceph-mon[31451]: pgmap v124: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 392 KiB/s wr, 61 op/s 2024-05-27T09:51:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:48 smithi072 ceph-mon[35951]: pgmap v124: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 392 KiB/s wr, 61 op/s 2024-05-27T09:51:49.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:48 smithi122 ceph-mon[36436]: pgmap v124: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 392 KiB/s wr, 61 op/s 2024-05-27T09:51:51.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:50 smithi071 ceph-mon[31451]: pgmap v125: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 147 KiB/s wr, 49 op/s 2024-05-27T09:51:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:50 smithi072 ceph-mon[35951]: pgmap v125: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 147 KiB/s wr, 49 op/s 2024-05-27T09:51:51.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:50 smithi122 ceph-mon[36436]: pgmap v125: 97 pgs: 97 active+clean; 33 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 147 KiB/s wr, 49 op/s 2024-05-27T09:51:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:52 smithi071 ceph-mon[31451]: pgmap v126: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 229 KiB/s wr, 54 op/s 2024-05-27T09:51:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:52 smithi072 ceph-mon[35951]: pgmap v126: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 229 KiB/s wr, 54 op/s 2024-05-27T09:51:53.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:52 smithi122 ceph-mon[36436]: pgmap v126: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 229 KiB/s wr, 54 op/s 2024-05-27T09:51:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:54 smithi071 ceph-mon[31451]: pgmap v127: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-05-27T09:51:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:54 smithi072 ceph-mon[35951]: pgmap v127: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-05-27T09:51:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:54 smithi122 ceph-mon[36436]: pgmap v127: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-05-27T09:51:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 -- 172.21.15.71:0/829079101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 msgr2=0x7fbe18103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 --2- 172.21.15.71:0/829079101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 0x7fbe18103650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009900 tx=0x7fbe0c02a3f0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 -- 172.21.15.71:0/829079101 shutdown_connections 2024-05-27T09:51:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 --2- 172.21.15.71:0/829079101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe1810e510 0x7fbe18110930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 --2- 172.21.15.71:0/829079101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe18103b90 0x7fbe18103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 --2- 172.21.15.71:0/829079101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 0x7fbe18103650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 -- 172.21.15.71:0/829079101 >> 172.21.15.71:0/829079101 conn(0x7fbe180ff170 msgr2=0x7fbe181015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:55.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 -- 172.21.15.71:0/829079101 shutdown_connections 2024-05-27T09:51:55.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.603+0000 7fbe1e200640 1 -- 172.21.15.71:0/829079101 wait complete. 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.604+0000 7fbe1e200640 1 Processor -- start 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.604+0000 7fbe1e200640 1 -- start start 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1e200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe18103b90 0x7fbe180760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 0x7fbe18076610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1e200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe1810e510 0x7fbe18076b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18113cc0 con 0x7fbe18109b40 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1e200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18113b40 con 0x7fbe18103b90 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1e200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18113e40 con 0x7fbe1810e510 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 0x7fbe18076610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1ce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe18103b90 0x7fbe180760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 0x7fbe18076610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52314/0 (socket says 172.21.15.71:52314) 2024-05-27T09:51:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe17e00640 1 -- 172.21.15.71:0/1508911270 learned_addr learned my addr 172.21.15.71:0/1508911270 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1d800640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe1810e510 0x7fbe18076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.605+0000 7fbe1ce00640 1 -- 172.21.15.71:0/1508911270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe1810e510 msgr2=0x7fbe18076b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe1ce00640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe1810e510 0x7fbe18076b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe1ce00640 1 -- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 msgr2=0x7fbe18076610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe1ce00640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 0x7fbe18076610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe1ce00640 1 -- 172.21.15.71:0/1508911270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe181a8ac0 con 0x7fbe18103b90 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe1ce00640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe18103b90 0x7fbe180760d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02a910 tx=0x7fbe0c031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe15600640 1 -- 172.21.15.71:0/1508911270 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c03f030 con 0x7fbe18103b90 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe181a8d50 con 0x7fbe18103b90 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe15600640 1 -- 172.21.15.71:0/1508911270 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe0c0043d0 con 0x7fbe18103b90 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe15600640 1 -- 172.21.15.71:0/1508911270 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c035070 con 0x7fbe18103b90 2024-05-27T09:51:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.606+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe181a9180 con 0x7fbe18103b90 2024-05-27T09:51:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.610+0000 7fbe267a7740 1 Processor -- start 2024-05-27T09:51:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.610+0000 7fbe267a7740 1 -- start start 2024-05-27T09:51:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe15600640 1 -- 172.21.15.71:0/1508911270 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fbe0c042030 con 0x7fbe18103b90 2024-05-27T09:51:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846961b0 0x558584a38a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a38fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe267a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5585849a9b90 con 0x5585846961b0 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe267a7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558584999730 con 0x55858466d2f0 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe267a7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55858499d770 con 0x5585846754d0 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe1d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846961b0 0x558584a38a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe1d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846961b0 0x558584a38a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52318/0 (socket says 172.21.15.71:52318) 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe1d800640 1 -- 172.21.15.71:0/3660198646 learned_addr learned my addr 172.21.15.71:0/3660198646 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe1ce00640 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a38fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.611+0000 7fbe17e00640 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe1d800640 1 -- 172.21.15.71:0/3660198646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 msgr2=0x558584a394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe1d800640 1 -- 172.21.15.71:0/3660198646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 msgr2=0x558584a38fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a38fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe1d800640 1 -- 172.21.15.71:0/3660198646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585849328b0 con 0x5585846961b0 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe17e00640 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846961b0 0x558584a38a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe10009f40 tx=0x7fbe100118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d0f0276d4b54a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe0a000640 1 -- 172.21.15.71:0/3660198646 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10004d20 con 0x5585846961b0 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe0a000640 1 -- 172.21.15.71:0/3660198646 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe10004050 con 0x5585846961b0 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe0a000640 1 -- 172.21.15.71:0/3660198646 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10005280 con 0x5585846961b0 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.612+0000 7fbe15600640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe000b2950 0x7fbe000b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.613+0000 7fbe15600640 1 -- 172.21.15.71:0/1508911270 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fbe0c102870 con 0x7fbe18103b90 2024-05-27T09:51:55.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.613+0000 7fbe1ce00640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe000b2950 0x7fbe000b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.613+0000 7fbe267a7740 1 -- 172.21.15.71:0/3660198646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846961b0 msgr2=0x558584a38a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.613+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846961b0 0x558584a38a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe10009f40 tx=0x7fbe100118d0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe1ce00640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe000b2950 0x7fbe000b4e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c1000a0 tx=0x7fbe0c108550 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 -- 172.21.15.71:0/3660198646 shutdown_connections 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a38fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3660198646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846961b0 0x558584a38a60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 -- 172.21.15.71:0/3660198646 >> 172.21.15.71:0/3660198646 conn(0x55858468a300 msgr2=0x558584a35210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 -- 172.21.15.71:0/3660198646 shutdown_connections 2024-05-27T09:51:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 -- 172.21.15.71:0/3660198646 wait complete. 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.614+0000 7fbe267a7740 1 -- start start 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 1 Processor -- start 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a42c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846754d0 0x558584a43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55858467f790 con 0x5585846754d0 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558584941bc0 con 0x55858466d2f0 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558584a45b90 con 0x5585846961b0 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe267a7740 10 client.0 _ll_register_callbacks cb 0x55858491f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846754d0 0x558584a43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846754d0 0x558584a43140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52334/0 (socket says 172.21.15.71:52334) 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe17e00640 1 -- 172.21.15.71:0/4170066215 learned_addr learned my addr 172.21.15.71:0/4170066215 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.615+0000 7fbe1d800640 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbe1d800640 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbe17e00640 1 -- 172.21.15.71:0/4170066215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 msgr2=0x558584a4eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbe17e00640 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbe17e00640 1 -- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 msgr2=0x558584a42c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbe17e00640 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a42c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbe17e00640 1 -- 172.21.15.71:0/4170066215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585846ae210 con 0x5585846754d0 2024-05-27T09:51:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbe17e00640 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846754d0 0x558584a43140 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbe04012770 tx=0x7fbe04012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16525152936911e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbdfea00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.616+0000 7fbdfea00640 1 -- 172.21.15.71:0/4170066215 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400f920 con 0x5585846754d0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbdfea00640 1 -- 172.21.15.71:0/4170066215 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fbe0400fac0 con 0x5585846754d0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe10004050 con 0x5585846754d0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbdfea00640 1 -- 172.21.15.71:0/4170066215 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe0400fcc0 con 0x5585846754d0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 10 client.16050 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55858477a620 con 0x5585846754d0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbdfea00640 1 -- 172.21.15.71:0/4170066215 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe10004050 con 0x5585846754d0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbdfea00640 1 -- 172.21.15.71:0/4170066215 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fbe04025450 con 0x5585846754d0 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 10 client.16050 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 20 client.16050 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558584654d80 0x558584a54e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 4 client.16050 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:51:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.617+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585849abae0 con 0x558584654d80 2024-05-27T09:51:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.618+0000 7fbe1d800640 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558584654d80 0x558584a54e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.618+0000 7fbe1d800640 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558584654d80 0x558584a54e50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=622a2f54f66b98dc server_cookie=8c0b96176929c47d in_seq=0 out_seq=0 2024-05-27T09:51:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.618+0000 7fbdfea00640 10 client.16050 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.619+0000 7fbdfea00640 1 -- 172.21.15.71:0/4170066215 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5585849abae0 con 0x558584654d80 2024-05-27T09:51:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.619+0000 7fbdfea00640 10 client.16050 handle_command_reply: tid=0 2024-05-27T09:51:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.619+0000 7fbe267a7740 1 client.16050 shutdown 2024-05-27T09:51:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.619+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846754d0 msgr2=0x558584a43140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.619+0000 7fbe267a7740 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846754d0 0x558584a43140 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbe04012770 tx=0x7fbe04012c30 comp rx=0 tx=0).stop 2024-05-27T09:51:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 shutdown_connections 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558584654d80 0x558584a54e50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585846754d0 0x558584a43140 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 --2- 172.21.15.71:0/4170066215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55858466d2f0 0x558584a42c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbdfea00640 0 client.16050 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 >> 172.21.15.71:0/4170066215 conn(0x55858468a300 msgr2=0x558584a38890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 shutdown_connections 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 1 -- 172.21.15.71:0/4170066215 wait complete. 2024-05-27T09:51:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.620+0000 7fbe267a7740 20 client.16050 trim_cache size 0 max 16384 2024-05-27T09:51:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.636+0000 7fbe267a7740 1 Processor -- start 2024-05-27T09:51:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.636+0000 7fbe267a7740 1 -- start start 2024-05-27T09:51:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a45330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846754d0 0x558584a4ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe267a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181b43e0 con 0x55858466d2f0 2024-05-27T09:51:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe267a7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181b1cb0 con 0x5585846754d0 2024-05-27T09:51:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe267a7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181afb00 con 0x5585846961b0 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846754d0 0x558584a4ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe1d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a45330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846754d0 0x558584a4ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:39104/0 (socket says 172.21.15.71:39104) 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe17e00640 1 -- 172.21.15.71:0/3587286507 learned_addr learned my addr 172.21.15.71:0/3587286507 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.637+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe17e00640 1 -- 172.21.15.71:0/3587286507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 msgr2=0x558584a4f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe17e00640 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe17e00640 1 -- 172.21.15.71:0/3587286507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 msgr2=0x558584a45330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe17e00640 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a45330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe17e00640 1 -- 172.21.15.71:0/3587286507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558584a41150 con 0x5585846754d0 2024-05-27T09:51:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe17e00640 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846754d0 0x558584a4ec30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe040095e0 tx=0x7fbe0400f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a656aa266e34d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe09600640 1 -- 172.21.15.71:0/3587286507 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0402a030 con 0x5585846754d0 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe09600640 1 -- 172.21.15.71:0/3587286507 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe04025450 con 0x5585846754d0 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.638+0000 7fbe09600640 1 -- 172.21.15.71:0/3587286507 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04005130 con 0x5585846754d0 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 -- 172.21.15.71:0/3587286507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846754d0 msgr2=0x558584a4ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846754d0 0x558584a4ec30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe040095e0 tx=0x7fbe0400f810 comp rx=0 tx=0).stop 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 -- 172.21.15.71:0/3587286507 shutdown_connections 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846961b0 0x558584a4f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846754d0 0x558584a4ec30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 --2- 172.21.15.71:0/3587286507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a45330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 -- 172.21.15.71:0/3587286507 >> 172.21.15.71:0/3587286507 conn(0x55858468a300 msgr2=0x558584a42b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 -- 172.21.15.71:0/3587286507 shutdown_connections 2024-05-27T09:51:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.639+0000 7fbe267a7740 1 -- 172.21.15.71:0/3587286507 wait complete. 2024-05-27T09:51:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.640+0000 7fbe267a7740 1 -- start start 2024-05-27T09:51:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.640+0000 7fbe267a7740 1 Processor -- start 2024-05-27T09:51:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.640+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a46a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.640+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a46fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe267a7740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846961b0 0x558584a474e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe267a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181b0170 con 0x55858466d2f0 2024-05-27T09:51:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe267a7740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181b15e0 con 0x5585846961b0 2024-05-27T09:51:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe267a7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181b0840 con 0x5585846754d0 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe267a7740 10 client.0 _ll_register_callbacks cb 0x7fbe04009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe1d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a46a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a46fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe1d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a46a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52360/0 (socket says 172.21.15.71:52360) 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe1d800640 1 -- 172.21.15.71:0/1799473542 learned_addr learned my addr 172.21.15.71:0/1799473542 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe1d800640 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846961b0 0x558584a474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe17e00640 1 -- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846961b0 msgr2=0x558584a474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe17e00640 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846961b0 0x558584a474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe17e00640 1 -- 172.21.15.71:0/1799473542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 msgr2=0x558584a46a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:51:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe17e00640 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a46a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe17e00640 1 -- 172.21.15.71:0/1799473542 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558584abc530 con 0x5585846754d0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.641+0000 7fbe1d800640 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a46a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbe17e00640 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a46fa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe040095e0 tx=0x7fbe04009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49743103b0ad8fc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbdfea00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbdfea00640 1 -- 172.21.15.71:0/1799473542 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04033020 con 0x5585846754d0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe04025450 con 0x5585846754d0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbdfea00640 1 -- 172.21.15.71:0/1799473542 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fbe04025bf0 con 0x5585846754d0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbdfea00640 1 -- 172.21.15.71:0/1799473542 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe04025600 con 0x5585846754d0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbe267a7740 10 client.26218 fetch_fsmap learned FSMap version 28 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.642+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558584abd570 con 0x5585846754d0 2024-05-27T09:51:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbdfea00640 1 -- 172.21.15.71:0/1799473542 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe04025450 con 0x5585846754d0 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbdfea00640 1 -- 172.21.15.71:0/1799473542 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fbe040048f0 con 0x5585846754d0 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbe267a7740 10 client.26218 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbe267a7740 10 client.26218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbe267a7740 20 client.26218 populate_metadata read hostname 'smithi071' 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbe267a7740 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55858462a1c0 0x558584abfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbe267a7740 4 client.26218 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5585849a52c0 con 0x55858462a1c0 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.643+0000 7fbe1d800640 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55858462a1c0 0x558584abfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:51:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.644+0000 7fbe1d800640 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55858462a1c0 0x558584abfcd0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73473e0ac7594eac server_cookie=17f713aa5c7c4905 in_seq=0 out_seq=0 2024-05-27T09:51:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.644+0000 7fbdfea00640 10 client.26218 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbdfea00640 1 -- 172.21.15.71:0/1799473542 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5585849a52c0 con 0x55858462a1c0 2024-05-27T09:51:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbdfea00640 10 client.26218 handle_command_reply: tid=0 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 client.26218 shutdown 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 msgr2=0x558584a46fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a46fa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe040095e0 tx=0x7fbe04009fd0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 shutdown_connections 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585846961b0 0x558584a474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585846754d0 0x558584a46fa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55858462a1c0 0x558584abfcd0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 --2- 172.21.15.71:0/1799473542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55858466d2f0 0x558584a46a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbdfea00640 0 client.26218 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 >> 172.21.15.71:0/1799473542 conn(0x55858468a300 msgr2=0x558584a428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 shutdown_connections 2024-05-27T09:51:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.665+0000 7fbe267a7740 1 -- 172.21.15.71:0/1799473542 wait complete. 2024-05-27T09:51:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe267a7740 20 client.26218 trim_cache size 0 max 16384 2024-05-27T09:51:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:51:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:51:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe000b2950 msgr2=0x7fbe000b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe000b2950 0x7fbe000b4e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c1000a0 tx=0x7fbe0c108550 comp rx=0 tx=0).stop 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe18103b90 msgr2=0x7fbe180760d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe18103b90 0x7fbe180760d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02a910 tx=0x7fbe0c031a20 comp rx=0 tx=0).stop 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 shutdown_connections 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fbe000b2950 0x7fbe000b4e60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe1810e510 0x7fbe18076b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe18109b40 0x7fbe18076610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 --2- 172.21.15.71:0/1508911270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe18103b90 0x7fbe180760d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:51:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.666+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 >> 172.21.15.71:0/1508911270 conn(0x7fbe180ff170 msgr2=0x7fbe1810a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:51:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.667+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 shutdown_connections 2024-05-27T09:51:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:51:55.667+0000 7fbe1e200640 1 -- 172.21.15.71:0/1508911270 wait complete. 2024-05-27T09:51:57.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:56 smithi071 ceph-mon[31451]: pgmap v128: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-05-27T09:51:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:56 smithi072 ceph-mon[35951]: pgmap v128: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-05-27T09:51:57.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:56 smithi122 ceph-mon[36436]: pgmap v128: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-05-27T09:51:58.055 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:51:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:51:58.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:51:58 smithi071 ceph-mon[31451]: pgmap v129: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 119 KiB/s wr, 42 op/s 2024-05-27T09:51:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:51:58 smithi072 ceph-mon[35951]: pgmap v129: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 119 KiB/s wr, 42 op/s 2024-05-27T09:51:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:51:58 smithi122 ceph-mon[36436]: pgmap v129: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 119 KiB/s wr, 42 op/s 2024-05-27T09:52:00.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 -- 172.21.15.71:0/1197050980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274103c30 msgr2=0x7f0274104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:00.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 --2- 172.21.15.71:0/1197050980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274103c30 0x7f0274104040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f026800b0d0 tx=0x7f026800b3e0 comp rx=0 tx=0).stop 2024-05-27T09:52:00.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 -- 172.21.15.71:0/1197050980 shutdown_connections 2024-05-27T09:52:00.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 --2- 172.21.15.71:0/1197050980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274108780 0x7f02741100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:00.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 --2- 172.21.15.71:0/1197050980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274103c30 0x7f0274104040 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:00.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 --2- 172.21.15.71:0/1197050980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274107e30 0x7f0274108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:00.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 -- 172.21.15.71:0/1197050980 >> 172.21.15.71:0/1197050980 conn(0x7f02740fe6e0 msgr2=0x7f0274100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:00.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:00 smithi071 ceph-mon[31451]: pgmap v130: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 98 KiB/s wr, 14 op/s 2024-05-27T09:52:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 -- 172.21.15.71:0/1197050980 shutdown_connections 2024-05-27T09:52:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.830+0000 7f027b400700 1 -- 172.21.15.71:0/1197050980 wait complete. 2024-05-27T09:52:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.831+0000 7f027b400700 1 Processor -- start 2024-05-27T09:52:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.831+0000 7f027b400700 1 -- start start 2024-05-27T09:52:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f027b400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274103c30 0x7f027419d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f027b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274107e30 0x7f027419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f027b400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274108780 0x7f02741a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f027b400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0274113400 con 0x7f0274108780 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f027b400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0274113280 con 0x7f0274107e30 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f027b400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0274113580 con 0x7f0274103c30 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f0279400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274108780 0x7f02741a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f0278a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274103c30 0x7f027419d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f0273e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274107e30 0x7f027419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f0279400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274108780 0x7f02741a1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52386/0 (socket says 172.21.15.71:52386) 2024-05-27T09:52:00.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.832+0000 7f0279400700 1 -- 172.21.15.71:0/1821722763 learned_addr learned my addr 172.21.15.71:0/1821722763 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:00.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0273e00700 1 -- 172.21.15.71:0/1821722763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274103c30 msgr2=0x7f027419d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0273e00700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274103c30 0x7f027419d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0273e00700 1 -- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274108780 msgr2=0x7f02741a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0273e00700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274108780 0x7f02741a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0273e00700 1 -- 172.21.15.71:0/1821722763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02741a2000 con 0x7f0274107e30 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0273e00700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274107e30 0x7f027419d6d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f026000e9c0 tx=0x7f026000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0271600700 1 -- 172.21.15.71:0/1821722763 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026000c9c0 con 0x7f0274107e30 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0271600700 1 -- 172.21.15.71:0/1821722763 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f026000cb60 con 0x7f0274107e30 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02741a22f0 con 0x7f0274107e30 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.833+0000 7f0271600700 1 -- 172.21.15.71:0/1821722763 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260018680 con 0x7f0274107e30 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.834+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02741a9c10 con 0x7f0274107e30 2024-05-27T09:52:00.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.835+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02740512b0 con 0x7f0274107e30 2024-05-27T09:52:00.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.837+0000 7f0271600700 1 -- 172.21.15.71:0/1821722763 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0260010430 con 0x7f0274107e30 2024-05-27T09:52:00.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.839+0000 7f0271600700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f025c0b2a70 0x7f025c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:00.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.839+0000 7f0271600700 1 -- 172.21.15.71:0/1821722763 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f02600e2770 con 0x7f0274107e30 2024-05-27T09:52:00.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.839+0000 7f0278a00700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f025c0b2a70 0x7f025c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:00.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.840+0000 7f0278a00700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f025c0b2a70 0x7f025c0b4f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0268009fd0 tx=0x7f026800b040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:00.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:00.844+0000 7f0271600700 1 -- 172.21.15.71:0/1821722763 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f02600aa120 con 0x7f0274107e30 2024-05-27T09:52:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:00 smithi072 ceph-mon[35951]: pgmap v130: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 98 KiB/s wr, 14 op/s 2024-05-27T09:52:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.131+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f027419e490 con 0x7f0274107e30 2024-05-27T09:52:01.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.132+0000 7f0271600700 1 -- 172.21.15.71:0/1821722763 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11858 (secure 0 0 0) 0x7f02600b21a0 con 0x7f0274107e30 2024-05-27T09:52:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:52:01.133 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:50:40.326047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:52:01.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f025c0b2a70 msgr2=0x7f025c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f025c0b2a70 0x7f025c0b4f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0268009fd0 tx=0x7f026800b040 comp rx=0 tx=0).stop 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274107e30 msgr2=0x7f027419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274107e30 0x7f027419d6d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f026000e9c0 tx=0x7f026000ecd0 comp rx=0 tx=0).stop 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 shutdown_connections 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f025c0b2a70 0x7f025c0b4f80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0274108780 0x7f02741a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0274103c30 0x7f027419d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 --2- 172.21.15.71:0/1821722763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274107e30 0x7f027419d6d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 >> 172.21.15.71:0/1821722763 conn(0x7f02740fe6e0 msgr2=0x7f02741065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.136+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 shutdown_connections 2024-05-27T09:52:01.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:01.137+0000 7f027b400700 1 -- 172.21.15.71:0/1821722763 wait complete. 2024-05-27T09:52:01.138 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 28 2024-05-27T09:52:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:00 smithi122 ceph-mon[36436]: pgmap v130: 97 pgs: 97 active+clean; 34 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 98 KiB/s wr, 14 op/s 2024-05-27T09:52:02.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:01 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1821722763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:02.086 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:01 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1821722763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:02.155 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id 56072c7e --release --await' 2024-05-27T09:52:02.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id 56072c7e --release --await 2024-05-27T09:52:02.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:01 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1821722763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:02.606 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:52:03.014 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:02 smithi071 ceph-mon[31451]: pgmap v131: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 120 KiB/s wr, 31 op/s 2024-05-27T09:52:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:02 smithi122 ceph-mon[36436]: pgmap v131: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 120 KiB/s wr, 31 op/s 2024-05-27T09:52:03.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:02 smithi072 ceph-mon[35951]: pgmap v131: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 120 KiB/s wr, 31 op/s 2024-05-27T09:52:04.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 -- 172.21.15.71:0/2729645840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc1045c0 msgr2=0x7f74cc1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:04.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 --2- 172.21.15.71:0/2729645840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc1045c0 0x7f74cc1049d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0098f0 tx=0x7f74bc009c00 comp rx=0 tx=0).stop 2024-05-27T09:52:04.998 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:04 smithi071 ceph-mon[31451]: pgmap v132: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-05-27T09:52:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 -- 172.21.15.71:0/2729645840 shutdown_connections 2024-05-27T09:52:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 --2- 172.21.15.71:0/2729645840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74cc109840 0x7f74cc1111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 --2- 172.21.15.71:0/2729645840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc1045c0 0x7f74cc1049d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 --2- 172.21.15.71:0/2729645840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74cc108ef0 0x7f74cc109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 -- 172.21.15.71:0/2729645840 >> 172.21.15.71:0/2729645840 conn(0x7f74cc0ffe90 msgr2=0x7f74cc1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 -- 172.21.15.71:0/2729645840 shutdown_connections 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.996+0000 7f74d3000700 1 -- 172.21.15.71:0/2729645840 wait complete. 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.998+0000 7f74d3000700 1 Processor -- start 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.998+0000 7f74d3000700 1 -- start start 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.998+0000 7f74d3000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74cc1045c0 0x7f74cc19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.998+0000 7f74d3000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74cc108ef0 0x7f74cc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.998+0000 7f74d3000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc109840 0x7f74cc1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d3000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc1144c0 con 0x7f74cc1045c0 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d3000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc114340 con 0x7f74cc109840 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d3000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc114640 con 0x7f74cc108ef0 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74cbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74cc1045c0 0x7f74cc19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc109840 0x7f74cc1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74cbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74cc1045c0 0x7f74cc19d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52892/0 (socket says 172.21.15.71:52892) 2024-05-27T09:52:05.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74cbe00700 1 -- 172.21.15.71:0/3984610592 learned_addr learned my addr 172.21.15.71:0/3984610592 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:05.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74cb400700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74cc108ef0 0x7f74cc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d1000700 1 -- 172.21.15.71:0/3984610592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74cc108ef0 msgr2=0x7f74cc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d1000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74cc108ef0 0x7f74cc19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d1000700 1 -- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74cc1045c0 msgr2=0x7f74cc19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d1000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74cc1045c0 0x7f74cc19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:04.999+0000 7f74d1000700 1 -- 172.21.15.71:0/3984610592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74cc1a1f80 con 0x7f74cc109840 2024-05-27T09:52:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.000+0000 7f74d1000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc109840 0x7f74cc1a18e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009cd0 tx=0x7f74c400c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.000+0000 7f74c8c00700 1 -- 172.21.15.71:0/3984610592 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c400cd10 con 0x7f74cc109840 2024-05-27T09:52:05.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.000+0000 7f74c8c00700 1 -- 172.21.15.71:0/3984610592 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74c4003a00 con 0x7f74cc109840 2024-05-27T09:52:05.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.000+0000 7f74c8c00700 1 -- 172.21.15.71:0/3984610592 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4004520 con 0x7f74cc109840 2024-05-27T09:52:05.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.000+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74cc1a2210 con 0x7f74cc109840 2024-05-27T09:52:05.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.000+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74cc1a2700 con 0x7f74cc109840 2024-05-27T09:52:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.005+0000 7f74c8c00700 1 -- 172.21.15.71:0/3984610592 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f74c401a020 con 0x7f74cc109840 2024-05-27T09:52:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.005+0000 7f74e1b0eb80 1 Processor -- start 2024-05-27T09:52:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.005+0000 7f74e1b0eb80 1 -- start start 2024-05-27T09:52:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd12db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd132f0 0x55601dd0cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55601dc3af40 con 0x55601dd0d440 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55601dc2aae0 con 0x55601dd132f0 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55601dc2eb20 con 0x55601db8df40 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd12db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd12db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33300/0 (socket says 172.21.15.71:33300) 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 -- 172.21.15.71:0/3698861054 learned_addr learned my addr 172.21.15.71:0/3698861054 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cbe00700 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd132f0 0x55601dd0cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 -- 172.21.15.71:0/3698861054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd132f0 msgr2=0x55601dd0cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd132f0 0x55601dd0cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 -- 172.21.15.71:0/3698861054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 msgr2=0x55601dd0d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.006+0000 7f74cb400700 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.007+0000 7f74cb400700 1 -- 172.21.15.71:0/3698861054 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55601dbf3520 con 0x55601db8df40 2024-05-27T09:52:05.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.007+0000 7f74cbe00700 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd132f0 0x55601dd0cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:52:05.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.007+0000 7f74cb400700 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd12db0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f74b80095f0 tx=0x7f74b80058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75fa64b53c23225 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:05.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.007+0000 7f74c1600700 1 -- 172.21.15.71:0/3698861054 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8004030 con 0x55601db8df40 2024-05-27T09:52:05.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.007+0000 7f74c1600700 1 -- 172.21.15.71:0/3698861054 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74b8004830 con 0x55601db8df40 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.007+0000 7f74c1600700 1 -- 172.21.15.71:0/3698861054 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8005400 con 0x55601db8df40 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.007+0000 7f74c8c00700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f74b00b2a70 0x7f74b00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74c8c00700 1 -- 172.21.15.71:0/3984610592 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f74c40e1e00 con 0x7f74cc109840 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74cbe00700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f74b00b2a70 0x7f74b00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3698861054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 msgr2=0x55601dd12db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd12db0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f74b80095f0 tx=0x7f74b80058e0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3698861054 shutdown_connections 2024-05-27T09:52:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd12db0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3698861054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd132f0 0x55601dd0cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.008+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3698861054 >> 172.21.15.71:0/3698861054 conn(0x55601dbee0c0 msgr2=0x55601dd08100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.009+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3698861054 shutdown_connections 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.009+0000 7f74cbe00700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f74b00b2a70 0x7f74b00b4f80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009680 tx=0x7f74bc019040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.009+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3698861054 wait complete. 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.009+0000 7f74e1b0eb80 1 -- start start 2024-05-27T09:52:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.009+0000 7f74e1b0eb80 1 Processor -- start 2024-05-27T09:52:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd0d440 0x55601dd16f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd17460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55601db310a0 con 0x55601dd132f0 2024-05-27T09:52:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55601dbcb860 con 0x55601dd0d440 2024-05-27T09:52:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55601dd19dc0 con 0x55601db8df40 2024-05-27T09:52:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74e1b0eb80 10 client.0 _ll_register_callbacks cb 0x55601dbd4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74cb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd0d440 0x55601dd16f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74d1000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd17460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74cb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd0d440 0x55601dd16f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55734/0 (socket says 172.21.15.71:55734) 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74cb400700 1 -- 172.21.15.71:0/275415560 learned_addr learned my addr 172.21.15.71:0/275415560 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.010+0000 7f74cbe00700 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74d1000700 1 -- 172.21.15.71:0/275415560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 msgr2=0x55601dd169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74d1000700 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74d1000700 1 -- 172.21.15.71:0/275415560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd0d440 msgr2=0x55601dd16f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74d1000700 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd0d440 0x55601dd16f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74d1000700 1 -- 172.21.15.71:0/275415560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55601db7a9d0 con 0x55601dd132f0 2024-05-27T09:52:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74d1000700 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd17460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f74c40df520 tx=0x7f74c4003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67dd751a591ba70 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74b6000700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74b6000700 1 -- 172.21.15.71:0/275415560 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c40a8bc0 con 0x55601dd132f0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74b6000700 1 -- 172.21.15.71:0/275415560 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f74c40a9520 con 0x55601dd132f0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.011+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74b8004830 con 0x55601dd132f0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74b6000700 1 -- 172.21.15.71:0/275415560 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f74c40a97b0 con 0x55601dd132f0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74e1b0eb80 10 client.16074 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55601dbfb160 con 0x55601dd132f0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74b6000700 1 -- 172.21.15.71:0/275415560 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74b8004830 con 0x55601dd132f0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74b6000700 1 -- 172.21.15.71:0/275415560 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f74c4004bd0 con 0x55601dd132f0 2024-05-27T09:52:05.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74e1b0eb80 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74e1b0eb80 10 client.16074 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74e1b0eb80 20 client.16074 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.012+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd26c30 0x55601dd29050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.013+0000 7f74e1b0eb80 4 client.16074 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.013+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55601dc3ce90 con 0x55601dd26c30 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.013+0000 7f74cbe00700 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd26c30 0x55601dd29050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.014+0000 7f74cbe00700 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd26c30 0x55601dd29050 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae9c9a7e1c55e2b8 server_cookie=d2ff42479cb72816 in_seq=0 out_seq=0 2024-05-27T09:52:05.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.014+0000 7f74b6000700 10 client.16074 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:05.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.014+0000 7f74b6000700 1 -- 172.21.15.71:0/275415560 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55601dc3ce90 con 0x55601dd26c30 2024-05-27T09:52:05.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74b6000700 10 client.16074 handle_command_reply: tid=0 2024-05-27T09:52:05.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 client.16074 shutdown 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 msgr2=0x55601dd17460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd17460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f74c40df520 tx=0x7f74c4003de0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 shutdown_connections 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd26c30 0x55601dd29050 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd17460 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601db8df40 0x55601dd169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/275415560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601dd0d440 0x55601dd16f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74b6000700 0 client.16074 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 >> 172.21.15.71:0/275415560 conn(0x55601dbee0c0 msgr2=0x55601dd0bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:05.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 shutdown_connections 2024-05-27T09:52:05.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/275415560 wait complete. 2024-05-27T09:52:05.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.015+0000 7f74e1b0eb80 20 client.16074 trim_cache size 0 max 16384 2024-05-27T09:52:05.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.037+0000 7f74e1b0eb80 1 Processor -- start 2024-05-27T09:52:05.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.037+0000 7f74e1b0eb80 1 -- start start 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd18e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd132f0 0x55601dd22e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc1b3a30 con 0x55601dd0d440 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc1b12c0 con 0x55601db8df40 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc1af110 con 0x55601dd132f0 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd18e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd18e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55744/0 (socket says 172.21.15.71:55744) 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 -- 172.21.15.71:0/3092623130 learned_addr learned my addr 172.21.15.71:0/3092623130 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74d1000700 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd132f0 0x55601dd22e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cb400700 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 -- 172.21.15.71:0/3092623130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd132f0 msgr2=0x55601dd22e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd132f0 0x55601dd22e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 -- 172.21.15.71:0/3092623130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 msgr2=0x55601dd0c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.038+0000 7f74cbe00700 1 -- 172.21.15.71:0/3092623130 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55601dd233a0 con 0x55601db8df40 2024-05-27T09:52:05.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.039+0000 7f74cbe00700 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd18e80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005950 tx=0x7f74bc027040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63dffed57e2898e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:05.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.039+0000 7f74c0c00700 1 -- 172.21.15.71:0/3092623130 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc003680 con 0x55601db8df40 2024-05-27T09:52:05.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.039+0000 7f74c0c00700 1 -- 172.21.15.71:0/3092623130 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74bc003cd0 con 0x55601db8df40 2024-05-27T09:52:05.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.039+0000 7f74c0c00700 1 -- 172.21.15.71:0/3092623130 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00bdd0 con 0x55601db8df40 2024-05-27T09:52:05.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3092623130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 msgr2=0x55601dd18e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd18e80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005950 tx=0x7f74bc027040 comp rx=0 tx=0).stop 2024-05-27T09:52:05.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3092623130 shutdown_connections 2024-05-27T09:52:05.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd132f0 0x55601dd22e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd18e80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/3092623130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd0d440 0x55601dd0c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3092623130 >> 172.21.15.71:0/3092623130 conn(0x55601dbee0c0 msgr2=0x55601dd10d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3092623130 shutdown_connections 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.040+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/3092623130 wait complete. 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.041+0000 7f74e1b0eb80 1 -- start start 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.041+0000 7f74e1b0eb80 1 Processor -- start 2024-05-27T09:52:05.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd1c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd0d440 0x55601dd1c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74e1b0eb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd1caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc1af780 con 0x55601dd132f0 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc1b0bf0 con 0x55601db8df40 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74e1b0eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc1afe50 con 0x55601dd0d440 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74e1b0eb80 10 client.0 _ll_register_callbacks cb 0x55601dbd4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74d1000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd1caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74d1000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd1caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52924/0 (socket says 172.21.15.71:52924) 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74d1000700 1 -- 172.21.15.71:0/1034608180 learned_addr learned my addr 172.21.15.71:0/1034608180 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74cbe00700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd1c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.042+0000 7f74cb400700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd0d440 0x55601dd1c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74d1000700 1 -- 172.21.15.71:0/1034608180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd0d440 msgr2=0x55601dd1c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74d1000700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd0d440 0x55601dd1c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74d1000700 1 -- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 msgr2=0x55601dd1c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74d1000700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd1c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74d1000700 1 -- 172.21.15.71:0/1034608180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55601dd99ee0 con 0x55601dd132f0 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74cbe00700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd1c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74d1000700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd1caa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f74c40df520 tx=0x7f74c4009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7897d0d40bc09d39 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74b6000700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74b6000700 1 -- 172.21.15.71:0/1034608180 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c40b1f10 con 0x55601dd132f0 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74b6000700 1 -- 172.21.15.71:0/1034608180 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f74c40a8310 con 0x55601dd132f0 2024-05-27T09:52:05.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74bc003cd0 con 0x55601dd132f0 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.043+0000 7f74b6000700 1 -- 172.21.15.71:0/1034608180 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f74c40a8bc0 con 0x55601dd132f0 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 10 client.16080 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55601dd9b0e0 con 0x55601dd132f0 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74b6000700 1 -- 172.21.15.71:0/1034608180 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74bc003cd0 con 0x55601dd132f0 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74b6000700 1 -- 172.21.15.71:0/1034608180 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f74c40a7ea0 con 0x55601dd132f0 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 10 client.16080 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 20 client.16080 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:05.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd9b6e0 0x55601dd9db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:05.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 4 client.16080 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "56072c7e", "release": true, "await": true}] 2024-05-27T09:52:05.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.044+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "56072c7e", "release": true, "await": true}) -- 0x55601dc36670 con 0x55601dd9b6e0 2024-05-27T09:52:05.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.045+0000 7f74cbe00700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd9b6e0 0x55601dd9db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:05.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.045+0000 7f74b6000700 10 client.16080 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:05.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.045+0000 7f74cbe00700 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd9b6e0 0x55601dd9db00 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4339a8116fac9377 server_cookie=f0850701990e172 in_seq=0 out_seq=0 2024-05-27T09:52:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:04 smithi122 ceph-mon[36436]: pgmap v132: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-05-27T09:52:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:04 smithi072 ceph-mon[35951]: pgmap v132: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-05-27T09:52:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.304+0000 7f74b6000700 1 -- 172.21.15.71:0/1034608180 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55601dc36670 con 0x55601dd9b6e0 2024-05-27T09:52:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.304+0000 7f74b6000700 10 client.16080 handle_command_reply: tid=0 2024-05-27T09:52:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.305+0000 7f74e1b0eb80 1 client.16080 shutdown 2024-05-27T09:52:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.306+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 msgr2=0x55601dd1caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.306+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd1caa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f74c40df520 tx=0x7f74c4009d00 comp rx=0 tx=0).stop 2024-05-27T09:52:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 shutdown_connections 2024-05-27T09:52:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55601dd9b6e0 0x55601dd9db00 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55601dd132f0 0x55601dd1caa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55601db8df40 0x55601dd1c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74e1b0eb80 1 --2- 172.21.15.71:0/1034608180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55601dd0d440 0x55601dd1c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74b6000700 0 client.16080 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 >> 172.21.15.71:0/1034608180 conn(0x55601dbee0c0 msgr2=0x55601dd139f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.307+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 shutdown_connections 2024-05-27T09:52:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.308+0000 7f74e1b0eb80 1 -- 172.21.15.71:0/1034608180 wait complete. 2024-05-27T09:52:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.308+0000 7f74e1b0eb80 20 client.16080 trim_cache size 0 max 16384 2024-05-27T09:52:05.309 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:52:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 28, 2024-05-27T09:52:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:52:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 12, 2024-05-27T09:52:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:52:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "56072c7e": { 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 12, 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 150.0, 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:52:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:05.311 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:52:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f74b00b2a70 msgr2=0x7f74b00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f74b00b2a70 0x7f74b00b4f80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009680 tx=0x7f74bc019040 comp rx=0 tx=0).stop 2024-05-27T09:52:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc109840 msgr2=0x7f74cc1a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc109840 0x7f74cc1a18e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009cd0 tx=0x7f74c400c620 comp rx=0 tx=0).stop 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 shutdown_connections 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f74b00b2a70 0x7f74b00b4f80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74cc109840 0x7f74cc1a18e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74cc1045c0 0x7f74cc19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 --2- 172.21.15.71:0/3984610592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74cc108ef0 0x7f74cc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 >> 172.21.15.71:0/3984610592 conn(0x7f74cc0ffe90 msgr2=0x7f74cc10a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.310+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 shutdown_connections 2024-05-27T09:52:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:05.311+0000 7f74d3000700 1 -- 172.21.15.71:0/3984610592 wait complete. 2024-05-27T09:52:05.314 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-27T09:52:05.317 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-27T09:52:05.345 INFO:tasks.workunit.client.0.smithi071.stdout: [CC] aio-last-ref-held-by-io 2024-05-27T09:52:05.696 INFO:tasks.workunit.client.0.smithi071.stderr:+ cd .. 2024-05-27T09:52:05.696 INFO:tasks.workunit.client.0.smithi071.stderr:+ cp xfstests-dev/ltp/fsx . 2024-05-27T09:52:05.708 INFO:tasks.workunit.client.0.smithi071.stderr:+ OPTIONS=-z 2024-05-27T09:52:05.708 INFO:tasks.workunit.client.0.smithi071.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-05-27T09:52:05.710 INFO:tasks.workunit.client.0.smithi071.stdout:Seed set to 1 2024-05-27T09:52:05.742 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-05-27T09:52:05.742 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-05-27T09:52:05.745 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-05-27T09:52:05.745 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-05-27T09:52:05.745 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support clone range, disabling! 2024-05-27T09:52:05.747 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support dedupe range, disabling! 2024-05-27T09:52:05.751 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support exchange range, disabling! 2024-05-27T09:52:05.751 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero size read 2024-05-27T09:52:05.751 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero size read 2024-05-27T09:52:05.752 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x81d54 2024-05-27T09:52:05.758 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xb86d7 2024-05-27T09:52:05.772 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xe627e 2024-05-27T09:52:05.839 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0xf3194 2024-05-27T09:52:05.875 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xf3ceb 2024-05-27T09:52:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0xf47e4 2024-05-27T09:52:06.071 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xfaccc 2024-05-27T09:52:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:05 smithi122 ceph-mon[36436]: pgmap v133: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-05-27T09:52:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:05 smithi071 ceph-mon[31451]: pgmap v133: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-05-27T09:52:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:05 smithi072 ceph-mon[35951]: pgmap v133: 97 pgs: 97 active+clean; 34 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-05-27T09:52:06.360 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '56072c7e', total seconds elapsed: 38.3 2024-05-27T09:52:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-27T09:52:06.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:52:06.767 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xfe423 2024-05-27T09:52:06.836 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:52:08.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:08 smithi071 ceph-mon[31451]: pgmap v134: 97 pgs: 97 active+clean; 35 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 245 KiB/s wr, 59 op/s 2024-05-27T09:52:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 -- 172.21.15.71:0/814852474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010bea0 msgr2=0x7f2510105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 --2- 172.21.15.71:0/814852474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010bea0 0x7f2510105a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2504009900 tx=0x7f250402a3f0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 -- 172.21.15.71:0/814852474 shutdown_connections 2024-05-27T09:52:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 --2- 172.21.15.71:0/814852474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25101065f0 0x7f25101129c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 --2- 172.21.15.71:0/814852474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251010c340 0x7f2510105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 --2- 172.21.15.71:0/814852474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010bea0 0x7f2510105a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 -- 172.21.15.71:0/814852474 >> 172.21.15.71:0/814852474 conn(0x7f2510101520 msgr2=0x7f2510103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 -- 172.21.15.71:0/814852474 shutdown_connections 2024-05-27T09:52:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.908+0000 7f2518400640 1 -- 172.21.15.71:0/814852474 wait complete. 2024-05-27T09:52:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.910+0000 7f2518400640 1 Processor -- start 2024-05-27T09:52:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.910+0000 7f2518400640 1 -- start start 2024-05-27T09:52:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2518400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25101065f0 0x7f25101a2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2518400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f251010bea0 0x7f25101a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2518400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010c340 0x7f251019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2518400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25101160a0 con 0x7f251010bea0 2024-05-27T09:52:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2518400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2510115f20 con 0x7f25101065f0 2024-05-27T09:52:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2518400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2510116220 con 0x7f251010c340 2024-05-27T09:52:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2516400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010c340 0x7f251019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2515a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25101065f0 0x7f25101a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2516400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010c340 0x7f251019c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33334/0 (socket says 172.21.15.71:33334) 2024-05-27T09:52:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2516400640 1 -- 172.21.15.71:0/3917246626 learned_addr learned my addr 172.21.15.71:0/3917246626 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.911+0000 7f2515000640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f251010bea0 0x7f25101a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f2515a00640 1 -- 172.21.15.71:0/3917246626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010c340 msgr2=0x7f251019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f2515a00640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010c340 0x7f251019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f2515a00640 1 -- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f251010bea0 msgr2=0x7f25101a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f2515a00640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f251010bea0 0x7f25101a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f2515a00640 1 -- 172.21.15.71:0/3917246626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251019cfe0 con 0x7f25101065f0 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f2515a00640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25101065f0 0x7f25101a2730 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f250402a910 tx=0x7f2504031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f250e000640 1 -- 172.21.15.71:0/3917246626 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250403f070 con 0x7f25101065f0 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f250e000640 1 -- 172.21.15.71:0/3917246626 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2504004490 con 0x7f25101065f0 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f250e000640 1 -- 172.21.15.71:0/3917246626 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2504035070 con 0x7f25101065f0 2024-05-27T09:52:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.912+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251019d270 con 0x7f25101065f0 2024-05-27T09:52:08.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.913+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25101a95b0 con 0x7f25101065f0 2024-05-27T09:52:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.917+0000 7f251f365740 1 Processor -- start 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.917+0000 7f251f365740 1 -- start start 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.917+0000 7f250e000640 1 -- 172.21.15.71:0/3917246626 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2504043400 con 0x7f25101065f0 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.918+0000 7f251f365740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x5557792ea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.918+0000 7f251f365740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 0x5557792eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.918+0000 7f251f365740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x5557792eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.918+0000 7f251f365740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55577925bb90 con 0x555778f1f2f0 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.918+0000 7f251f365740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55577924b730 con 0x555778f481b0 2024-05-27T09:52:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.918+0000 7f251f365740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55577924f770 con 0x555778f274d0 2024-05-27T09:52:08.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x5557792ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x5557792ea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55790/0 (socket says 172.21.15.71:55790) 2024-05-27T09:52:08.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 -- 172.21.15.71:0/2702071421 learned_addr learned my addr 172.21.15.71:0/2702071421 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:08.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2515000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x5557792eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 -- 172.21.15.71:0/2702071421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 msgr2=0x5557792eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 --2- 172.21.15.71:0/2702071421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x5557792eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 -- 172.21.15.71:0/2702071421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 msgr2=0x5557792eada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 --2- 172.21.15.71:0/2702071421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 0x5557792eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 -- 172.21.15.71:0/2702071421 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557791e48b0 con 0x555778f481b0 2024-05-27T09:52:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.919+0000 7f2516400640 1 --2- 172.21.15.71:0/2702071421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x5557792ea860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2508011570 tx=0x7f2508011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8520affa35aa633 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.920+0000 7f250e000640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f24f80b2a50 0x7f24f80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.920+0000 7f250e000640 1 -- 172.21.15.71:0/3917246626 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f2504102a40 con 0x7f25101065f0 2024-05-27T09:52:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.920+0000 7f2502a00640 1 -- 172.21.15.71:0/2702071421 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508004b20 con 0x555778f481b0 2024-05-27T09:52:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.920+0000 7f2515a00640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f24f80b2a50 0x7f24f80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.920+0000 7f2502a00640 1 -- 172.21.15.71:0/2702071421 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2508004cc0 con 0x555778f481b0 2024-05-27T09:52:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.920+0000 7f2502a00640 1 -- 172.21.15.71:0/2702071421 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508005490 con 0x555778f481b0 2024-05-27T09:52:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 -- 172.21.15.71:0/2702071421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 msgr2=0x5557792ea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 --2- 172.21.15.71:0/2702071421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x5557792ea860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2508011570 tx=0x7f2508011a30 comp rx=0 tx=0).stop 2024-05-27T09:52:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f2515a00640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f24f80b2a50 0x7f24f80b4f60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5557792e8350 tx=0x7f2504009560 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 -- 172.21.15.71:0/2702071421 shutdown_connections 2024-05-27T09:52:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 --2- 172.21.15.71:0/2702071421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x5557792eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 --2- 172.21.15.71:0/2702071421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 0x5557792eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 --2- 172.21.15.71:0/2702071421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x5557792ea860 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 -- 172.21.15.71:0/2702071421 >> 172.21.15.71:0/2702071421 conn(0x555778f3c300 msgr2=0x5557792e7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 -- 172.21.15.71:0/2702071421 shutdown_connections 2024-05-27T09:52:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.922+0000 7f251f365740 1 -- 172.21.15.71:0/2702071421 wait complete. 2024-05-27T09:52:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.923+0000 7f251f365740 1 -- start start 2024-05-27T09:52:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.923+0000 7f251f365740 1 Processor -- start 2024-05-27T09:52:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f251f365740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f251f365740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f251f365740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 0x555779311cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f251f365740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555778f31790 con 0x555778f481b0 2024-05-27T09:52:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f251f365740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5557791f3bc0 con 0x555778f274d0 2024-05-27T09:52:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f251f365740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5557793089a0 con 0x555778f1f2f0 2024-05-27T09:52:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f251f365740 10 client.0 _ll_register_callbacks cb 0x5557791d1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f2515000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f2515000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55806/0 (socket says 172.21.15.71:55806) 2024-05-27T09:52:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.924+0000 7f2515000640 1 -- 172.21.15.71:0/2416057270 learned_addr learned my addr 172.21.15.71:0/2416057270 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f2515000640 1 -- 172.21.15.71:0/2416057270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 msgr2=0x5557792f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f2516400640 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f2515000640 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f2515000640 1 -- 172.21.15.71:0/2416057270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 msgr2=0x555779311cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f2515000640 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 0x555779311cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f2515000640 1 -- 172.21.15.71:0/2416057270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555778f60210 con 0x555778f274d0 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f2515000640 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4f30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24fc012700 tx=0x7f24fc012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240432e10f408048 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f24f7400640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f24f7400640 1 -- 172.21.15.71:0/2416057270 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00f920 con 0x555778f274d0 2024-05-27T09:52:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2508004cc0 con 0x555778f274d0 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.925+0000 7f24f7400640 1 -- 172.21.15.71:0/2416057270 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f24fc00fac0 con 0x555778f274d0 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f24f7400640 1 -- 172.21.15.71:0/2416057270 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24fc00fcc0 con 0x555778f274d0 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 10 client.26222 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55577902c620 con 0x555778f274d0 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f24f7400640 1 -- 172.21.15.71:0/2416057270 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2508004cc0 con 0x555778f274d0 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f24f7400640 1 -- 172.21.15.71:0/2416057270 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f24fc01c420 con 0x555778f274d0 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 10 client.26222 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 10 client.26222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 20 client.26222 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778f06d80 0x555779317e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 4 client.26222 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55577925dae0 con 0x555778f06d80 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.926+0000 7f2516400640 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778f06d80 0x555779317e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.927+0000 7f2516400640 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778f06d80 0x555779317e90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ba140cec0c86fe5 server_cookie=4fdf13de3da7b0b2 in_seq=0 out_seq=0 2024-05-27T09:52:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.927+0000 7f24f7400640 10 client.26222 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.928+0000 7f24f7400640 1 -- 172.21.15.71:0/2416057270 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55577925dae0 con 0x555778f06d80 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.928+0000 7f24f7400640 10 client.26222 handle_command_reply: tid=0 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.928+0000 7f251f365740 1 client.26222 shutdown 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 msgr2=0x5557792f4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4f30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24fc012700 tx=0x7f24fc012bc0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 shutdown_connections 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778f06d80 0x555779317e90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 0x555779311cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4f30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 --2- 172.21.15.71:0/2416057270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 >> 172.21.15.71:0/2416057270 conn(0x555778f3c300 msgr2=0x5557792ea630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f24f7400640 0 client.26222 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 shutdown_connections 2024-05-27T09:52:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 1 -- 172.21.15.71:0/2416057270 wait complete. 2024-05-27T09:52:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.929+0000 7f251f365740 20 client.26222 trim_cache size 0 max 16384 2024-05-27T09:52:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.950+0000 7f251f365740 1 Processor -- start 2024-05-27T09:52:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.950+0000 7f251f365740 1 -- start start 2024-05-27T09:52:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.950+0000 7f251f365740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.950+0000 7f251f365740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.950+0000 7f251f365740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 0x5557792f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f251f365740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25101abe10 con 0x555778f481b0 2024-05-27T09:52:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f251f365740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25101a9780 con 0x555778f274d0 2024-05-27T09:52:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f251f365740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f251006a230 con 0x555778f1f2f0 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2516400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55808/0 (socket says 172.21.15.71:55808) 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 -- 172.21.15.71:0/1987023356 learned_addr learned my addr 172.21.15.71:0/1987023356 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2516400640 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 0x5557792f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 -- 172.21.15.71:0/1987023356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 msgr2=0x5557792f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 -- 172.21.15.71:0/1987023356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 msgr2=0x5557792f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 0x5557792f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.951+0000 7f2515000640 1 -- 172.21.15.71:0/1987023356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557792eb0a0 con 0x555778f274d0 2024-05-27T09:52:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.952+0000 7f2515000640 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f24fc001eb0 tx=0x7f24fc01dee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7cb0d6de893e51a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.952+0000 7f2502000640 1 -- 172.21.15.71:0/1987023356 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc029070 con 0x555778f274d0 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.952+0000 7f2502000640 1 -- 172.21.15.71:0/1987023356 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24fc00f920 con 0x555778f274d0 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.952+0000 7f2502000640 1 -- 172.21.15.71:0/1987023356 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0035f0 con 0x555778f274d0 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 -- 172.21.15.71:0/1987023356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 msgr2=0x5557792f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f24fc001eb0 tx=0x7f24fc01dee0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 -- 172.21.15.71:0/1987023356 shutdown_connections 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f481b0 0x5557792f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f274d0 0x5557792f4990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 --2- 172.21.15.71:0/1987023356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f1f2f0 0x5557792f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 -- 172.21.15.71:0/1987023356 >> 172.21.15.71:0/1987023356 conn(0x555778f3c300 msgr2=0x5557792f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 -- 172.21.15.71:0/1987023356 shutdown_connections 2024-05-27T09:52:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 -- 172.21.15.71:0/1987023356 wait complete. 2024-05-27T09:52:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.953+0000 7f251f365740 1 -- start start 2024-05-27T09:52:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 1 Processor -- start 2024-05-27T09:52:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 0x55577930a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x55577930aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x55577930b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2510073340 con 0x555778f1f2f0 2024-05-27T09:52:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25100747b0 con 0x555778f481b0 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2510073a10 con 0x555778f274d0 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f251f365740 10 client.0 _ll_register_callbacks cb 0x7f24fc009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f2515000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x55577930aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f2516400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 0x55577930a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f2515000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x55577930aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33368/0 (socket says 172.21.15.71:33368) 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.954+0000 7f2515000640 1 -- 172.21.15.71:0/3405488766 learned_addr learned my addr 172.21.15.71:0/3405488766 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f2516400640 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x55577930b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f2515000640 1 -- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 msgr2=0x55577930b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f2515000640 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x55577930b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f2515000640 1 -- 172.21.15.71:0/3405488766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 msgr2=0x55577930a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f2515000640 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 0x55577930a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f2515000640 1 -- 172.21.15.71:0/3405488766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577937e520 con 0x555778f274d0 2024-05-27T09:52:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f2515000640 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x55577930aea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24fc012c00 tx=0x7f24fc01cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7efc4ea1d2d2c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f24f7400640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:52:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f24f7400640 1 -- 172.21.15.71:0/3405488766 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc029040 con 0x555778f274d0 2024-05-27T09:52:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.955+0000 7f24f7400640 1 -- 172.21.15.71:0/3405488766 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f24fc01c630 con 0x555778f274d0 2024-05-27T09:52:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.956+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24fc00f920 con 0x555778f274d0 2024-05-27T09:52:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.956+0000 7f24f7400640 1 -- 172.21.15.71:0/3405488766 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24fc03d050 con 0x555778f274d0 2024-05-27T09:52:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.957+0000 7f251f365740 10 client.26257 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.957+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55577937f6d0 con 0x555778f274d0 2024-05-27T09:52:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.957+0000 7f24f7400640 1 -- 172.21.15.71:0/3405488766 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24fc00f920 con 0x555778f274d0 2024-05-27T09:52:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f24f7400640 1 -- 172.21.15.71:0/3405488766 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f24fc025450 con 0x555778f274d0 2024-05-27T09:52:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f251f365740 10 client.26257 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f251f365740 10 client.26257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f251f365740 20 client.26257 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f251f365740 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778edc1c0 0x555779381e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f251f365740 4 client.26257 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:52:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5557792572c0 con 0x555778edc1c0 2024-05-27T09:52:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.958+0000 7f2516400640 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778edc1c0 0x555779381e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.959+0000 7f24f7400640 10 client.26257 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.959+0000 7f2516400640 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778edc1c0 0x555779381e70 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31f226a759c79973 server_cookie=86ec448d67628f58 in_seq=0 out_seq=0 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.979+0000 7f24f7400640 1 -- 172.21.15.71:0/3405488766 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5557792572c0 con 0x555778edc1c0 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.979+0000 7f24f7400640 10 client.26257 handle_command_reply: tid=0 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.979+0000 7f251f365740 1 client.26257 shutdown 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.979+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 msgr2=0x55577930aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.979+0000 7f251f365740 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x55577930aea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24fc012c00 tx=0x7f24fc01cd30 comp rx=0 tx=0).stop 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 shutdown_connections 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555778f481b0 0x55577930b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555778f274d0 0x55577930aea0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555778edc1c0 0x555779381e70 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 --2- 172.21.15.71:0/3405488766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778f1f2f0 0x55577930a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f24f7400640 0 client.26257 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 >> 172.21.15.71:0/3405488766 conn(0x555778f3c300 msgr2=0x5557792f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 shutdown_connections 2024-05-27T09:52:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 1 -- 172.21.15.71:0/3405488766 wait complete. 2024-05-27T09:52:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.980+0000 7f251f365740 20 client.26257 trim_cache size 0 max 16384 2024-05-27T09:52:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:52:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:52:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:52:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f24f80b2a50 msgr2=0x7f24f80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f24f80b2a50 0x7f24f80b4f60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5557792e8350 tx=0x7f2504009560 comp rx=0 tx=0).stop 2024-05-27T09:52:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25101065f0 msgr2=0x7f25101a2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25101065f0 0x7f25101a2730 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f250402a910 tx=0x7f2504031a20 comp rx=0 tx=0).stop 2024-05-27T09:52:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 shutdown_connections 2024-05-27T09:52:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f24f80b2a50 0x7f24f80b4f60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f251010c340 0x7f251019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f251010bea0 0x7f25101a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 --2- 172.21.15.71:0/3917246626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25101065f0 0x7f25101a2730 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 >> 172.21.15.71:0/3917246626 conn(0x7f2510101520 msgr2=0x7f2510111ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 shutdown_connections 2024-05-27T09:52:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:08.981+0000 7f2518400640 1 -- 172.21.15.71:0/3917246626 wait complete. 2024-05-27T09:52:08.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:08 smithi122 ceph-mon[36436]: pgmap v134: 97 pgs: 97 active+clean; 35 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 245 KiB/s wr, 59 op/s 2024-05-27T09:52:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:08 smithi072 ceph-mon[35951]: pgmap v134: 97 pgs: 97 active+clean; 35 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 245 KiB/s wr, 59 op/s 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.367+0000 7f4bc6e00700 1 -- 172.21.15.71:0/2098344608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc0105c50 msgr2=0x7f4bc010e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.367+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/2098344608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc0105c50 0x7f4bc010e1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009990 tx=0x7f4bac009ca0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.367+0000 7f4bc6e00700 1 -- 172.21.15.71:0/2098344608 shutdown_connections 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.367+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/2098344608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc010e730 0x7f4bc0110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.367+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/2098344608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc0105300 0x7f4bc0105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.367+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/2098344608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc0105c50 0x7f4bc010e1a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.367+0000 7f4bc6e00700 1 -- 172.21.15.71:0/2098344608 >> 172.21.15.71:0/2098344608 conn(0x7f4bc0078ab0 msgr2=0x7f4bc0078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.368+0000 7f4bc6e00700 1 -- 172.21.15.71:0/2098344608 shutdown_connections 2024-05-27T09:52:09.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.368+0000 7f4bc6e00700 1 -- 172.21.15.71:0/2098344608 wait complete. 2024-05-27T09:52:09.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.369+0000 7f4bc6e00700 1 Processor -- start 2024-05-27T09:52:09.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.369+0000 7f4bc6e00700 1 -- start start 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.369+0000 7f4bc6e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc0105300 0x7f4bc0102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc6e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0105c50 0x7f4bc0103530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc6e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc010e730 0x7f4bc0103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc6e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc01142a0 con 0x7f4bc010e730 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc6e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc0114120 con 0x7f4bc0105300 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc6e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc0114420 con 0x7f4bc0105c50 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc0105300 0x7f4bc0102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0105c50 0x7f4bc0103530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc0105300 0x7f4bc0102ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55832/0 (socket says 172.21.15.71:55832) 2024-05-27T09:52:09.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5a00700 1 -- 172.21.15.71:0/579758025 learned_addr learned my addr 172.21.15.71:0/579758025 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:09.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0105c50 0x7f4bc0103530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33384/0 (socket says 172.21.15.71:33384) 2024-05-27T09:52:09.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc6400700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc010e730 0x7f4bc0103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:09.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5000700 1 -- 172.21.15.71:0/579758025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc0105300 msgr2=0x7f4bc0102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:09.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5000700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc0105300 0x7f4bc0102ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5000700 1 -- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc010e730 msgr2=0x7f4bc0103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5000700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc010e730 0x7f4bc0103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.370+0000 7f4bc5000700 1 -- 172.21.15.71:0/579758025 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc01a9010 con 0x7f4bc0105c50 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.371+0000 7f4bc6400700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc010e730 0x7f4bc0103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.371+0000 7f4bc5000700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0105c50 0x7f4bc0103530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0098e0 tx=0x7f4bac0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.371+0000 7f4bbe000700 1 -- 172.21.15.71:0/579758025 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac027070 con 0x7f4bc0105c50 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.371+0000 7f4bbe000700 1 -- 172.21.15.71:0/579758025 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bac022470 con 0x7f4bc0105c50 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.371+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc01a92a0 con 0x7f4bc0105c50 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.371+0000 7f4bbe000700 1 -- 172.21.15.71:0/579758025 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac017650 con 0x7f4bc0105c50 2024-05-27T09:52:09.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.371+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc01a97d0 con 0x7f4bc0105c50 2024-05-27T09:52:09.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.373+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc00512b0 con 0x7f4bc0105c50 2024-05-27T09:52:09.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.375+0000 7f4bbe000700 1 -- 172.21.15.71:0/579758025 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4bac009d10 con 0x7f4bc0105c50 2024-05-27T09:52:09.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.377+0000 7f4bbe000700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4ba80b2a70 0x7f4ba80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:09.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.377+0000 7f4bbe000700 1 -- 172.21.15.71:0/579758025 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4bac0e2fa0 con 0x7f4bc0105c50 2024-05-27T09:52:09.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.377+0000 7f4bc5a00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4ba80b2a70 0x7f4ba80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:09.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.378+0000 7f4bc5a00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4ba80b2a70 0x7f4ba80b4f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009680 tx=0x7f4bb4009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:09.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.382+0000 7f4bbe000700 1 -- 172.21.15.71:0/579758025 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4bac013070 con 0x7f4bc0105c50 2024-05-27T09:52:09.671 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:09 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:52:09.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.747+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bc0104520 con 0x7f4bc0105c50 2024-05-27T09:52:09.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.748+0000 7f4bbe000700 1 -- 172.21.15.71:0/579758025 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11858 (secure 0 0 0) 0x7f4bac0aa9e0 con 0x7f4bc0105c50 2024-05-27T09:52:09.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:52:09.749 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:50:40.326047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:52:09.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4ba80b2a70 msgr2=0x7f4ba80b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:09.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4ba80b2a70 0x7f4ba80b4f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009680 tx=0x7f4bb4009260 comp rx=0 tx=0).stop 2024-05-27T09:52:09.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0105c50 msgr2=0x7f4bc0103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:09.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0105c50 0x7f4bc0103530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0098e0 tx=0x7f4bac0057c0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 shutdown_connections 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4ba80b2a70 0x7f4ba80b4f80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bc010e730 0x7f4bc0103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc0105300 0x7f4bc0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.752+0000 7f4bc6e00700 1 --2- 172.21.15.71:0/579758025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0105c50 0x7f4bc0103530 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.753+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 >> 172.21.15.71:0/579758025 conn(0x7f4bc0078ab0 msgr2=0x7f4bc00ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.753+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 shutdown_connections 2024-05-27T09:52:09.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:09.753+0000 7f4bc6e00700 1 -- 172.21.15.71:0/579758025 wait complete. 2024-05-27T09:52:09.755 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 28 2024-05-27T09:52:09.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:09 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:52:10.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:09 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:52:10.621 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xfe492 2024-05-27T09:52:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-05-27T09:52:10.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-05-27T09:52:10.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:10 smithi122 ceph-mon[36436]: pgmap v135: 97 pgs: 97 active+clean; 35 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 230 KiB/s wr, 50 op/s 2024-05-27T09:52:10.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:10 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/579758025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:11.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:10 smithi071 ceph-mon[31451]: pgmap v135: 97 pgs: 97 active+clean; 35 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 230 KiB/s wr, 50 op/s 2024-05-27T09:52:11.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:10 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/579758025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:10 smithi072 ceph-mon[35951]: pgmap v135: 97 pgs: 97 active+clean; 35 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 230 KiB/s wr, 50 op/s 2024-05-27T09:52:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:10 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/579758025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:11.235 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:52:11.679 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:11 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:52:11.679 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:11 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:52:11.679 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:11 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:52:11.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:11 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:52:11.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:11 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:52:11.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:11 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:52:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:11 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:52:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:11 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:52:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:11 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:52:12.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:12 smithi122 ceph-mon[36436]: pgmap v136: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-05-27T09:52:13.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:12 smithi071 ceph-mon[31451]: pgmap v136: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-05-27T09:52:13.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:12 smithi072 ceph-mon[35951]: pgmap v136: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 -- 172.21.15.71:0/3732324595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 msgr2=0x7f4b2c10c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 --2- 172.21.15.71:0/3732324595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 0x7f4b2c10c9b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00b0a0 tx=0x7f4b1c00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 -- 172.21.15.71:0/3732324595 shutdown_connections 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 --2- 172.21.15.71:0/3732324595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2c106eb0 0x7f4b2c113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 --2- 172.21.15.71:0/3732324595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 0x7f4b2c10c9b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 --2- 172.21.15.71:0/3732324595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 0x7f4b2c106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 -- 172.21.15.71:0/3732324595 >> 172.21.15.71:0/3732324595 conn(0x7f4b2c102040 msgr2=0x7f4b2c104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 -- 172.21.15.71:0/3732324595 shutdown_connections 2024-05-27T09:52:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.782+0000 7f4b30a00700 1 -- 172.21.15.71:0/3732324595 wait complete. 2024-05-27T09:52:13.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.784+0000 7f4b30a00700 1 Processor -- start 2024-05-27T09:52:13.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.784+0000 7f4b30a00700 1 -- start start 2024-05-27T09:52:13.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.785+0000 7f4b30a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 0x7f4b2c19cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.785+0000 7f4b30a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2c106eb0 0x7f4b2c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.785+0000 7f4b30a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 0x7f4b2c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.785+0000 7f4b30a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c1166b0 con 0x7f4b2c106eb0 2024-05-27T09:52:13.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.785+0000 7f4b30a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c116530 con 0x7f4b2c106560 2024-05-27T09:52:13.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.785+0000 7f4b30a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c116830 con 0x7f4b2c10c5a0 2024-05-27T09:52:13.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.785+0000 7f4b29e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 0x7f4b2c19cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 0x7f4b2c19cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55846/0 (socket says 172.21.15.71:55846) 2024-05-27T09:52:13.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 -- 172.21.15.71:0/159253180 learned_addr learned my addr 172.21.15.71:0/159253180 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b2a800700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 0x7f4b2c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29400700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2c106eb0 0x7f4b2c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 -- 172.21.15.71:0/159253180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 msgr2=0x7f4b2c1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 0x7f4b2c1a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 -- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2c106eb0 msgr2=0x7f4b2c19d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2c106eb0 0x7f4b2c19d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 -- 172.21.15.71:0/159253180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c1a1eb0 con 0x7f4b2c106560 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.786+0000 7f4b29e00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 0x7f4b2c19cfe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d010 tx=0x7f4b1c004db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.787+0000 7f4b22a00700 1 -- 172.21.15.71:0/159253180 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c021070 con 0x7f4b2c106560 2024-05-27T09:52:13.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.787+0000 7f4b22a00700 1 -- 172.21.15.71:0/159253180 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b1c003c00 con 0x7f4b2c106560 2024-05-27T09:52:13.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.787+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c1a2140 con 0x7f4b2c106560 2024-05-27T09:52:13.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.787+0000 7f4b22a00700 1 -- 172.21.15.71:0/159253180 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c004750 con 0x7f4b2c106560 2024-05-27T09:52:13.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.787+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c1a9ac0 con 0x7f4b2c106560 2024-05-27T09:52:13.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.791+0000 7f4b22a00700 1 -- 172.21.15.71:0/159253180 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4b1c007a00 con 0x7f4b2c106560 2024-05-27T09:52:13.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.793+0000 7f4b3f543b80 1 Processor -- start 2024-05-27T09:52:13.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.793+0000 7f4b3f543b80 1 -- start start 2024-05-27T09:52:13.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.793+0000 7f4b22a00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4b100b29f0 0x7f4b100b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x5631788815c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b22a00700 1 -- 172.21.15.71:0/159253180 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4b1c00f020 con 0x7f4b2c106560 2024-05-27T09:52:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x563178881b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56317887b670 0x56317887ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5631787a8fd0 con 0x5631787e7b80 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x563178798b70 con 0x5631786fbfd0 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56317879cbb0 con 0x56317887b670 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b2a800700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4b100b29f0 0x7f4b100b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b2a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56317887b670 0x56317887ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b2a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56317887b670 0x56317887ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33412/0 (socket says 172.21.15.71:33412) 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b2a800700 1 -- 172.21.15.71:0/348131688 learned_addr learned my addr 172.21.15.71:0/348131688 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b29e00700 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x5631788815c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.794+0000 7f4b29400700 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x563178881b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b29400700 1 -- 172.21.15.71:0/348131688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56317887b670 msgr2=0x56317887ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b29400700 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56317887b670 0x56317887ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b29400700 1 -- 172.21.15.71:0/348131688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 msgr2=0x5631788815c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b29400700 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x5631788815c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b29400700 1 -- 172.21.15.71:0/348131688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631787615b0 con 0x5631786fbfd0 2024-05-27T09:52:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b29e00700 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x5631788815c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b2a800700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4b100b29f0 0x7f4b100b4f00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b24013970 tx=0x7f4b24009b70 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b29400700 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x563178881b20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c06c610 tx=0x7f4b18009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ced7122dd8a09a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b17400700 1 -- 172.21.15.71:0/348131688 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b18011ae0 con 0x5631786fbfd0 2024-05-27T09:52:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b17400700 1 -- 172.21.15.71:0/348131688 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b18011c80 con 0x5631786fbfd0 2024-05-27T09:52:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.795+0000 7f4b17400700 1 -- 172.21.15.71:0/348131688 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800f6a0 con 0x5631786fbfd0 2024-05-27T09:52:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.796+0000 7f4b3f543b80 1 -- 172.21.15.71:0/348131688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 msgr2=0x563178881b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.796+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x563178881b20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c06c610 tx=0x7f4b18009eb0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 -- 172.21.15.71:0/348131688 shutdown_connections 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56317887b670 0x56317887ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x5631788815c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/348131688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x563178881b20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 -- 172.21.15.71:0/348131688 >> 172.21.15.71:0/348131688 conn(0x563178795520 msgr2=0x5631788766e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 -- 172.21.15.71:0/348131688 shutdown_connections 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 -- 172.21.15.71:0/348131688 wait complete. 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.797+0000 7f4b3f543b80 1 -- start start 2024-05-27T09:52:13.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 1 Processor -- start 2024-05-27T09:52:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x563178885330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178885870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56317887b670 0x563178885db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56317869f130 con 0x5631787e7b80 2024-05-27T09:52:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5631787398f0 con 0x56317887b670 2024-05-27T09:52:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56317887c460 con 0x5631786fbfd0 2024-05-27T09:52:13.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.798+0000 7f4b3f543b80 10 client.0 _ll_register_callbacks cb 0x563178742e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178885870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178885870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53008/0 (socket says 172.21.15.71:53008) 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 -- 172.21.15.71:0/297701340 learned_addr learned my addr 172.21.15.71:0/297701340 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b2a800700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56317887b670 0x563178885db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29e00700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x563178885330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 -- 172.21.15.71:0/297701340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 msgr2=0x563178885330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x563178885330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 -- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56317887b670 msgr2=0x563178885db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56317887b670 0x563178885db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.799+0000 7f4b29400700 1 -- 172.21.15.71:0/297701340 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631786e8a60 con 0x5631787e7b80 2024-05-27T09:52:13.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.800+0000 7f4b29e00700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x563178885330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:13.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.800+0000 7f4b2a800700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56317887b670 0x563178885db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:52:13.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.800+0000 7f4b29400700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178885870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4b18012d50 tx=0x7f4b18005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1e872ad6006dad server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:13.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.800+0000 7f4b0be00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:52:13.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.801+0000 7f4b0be00700 1 -- 172.21.15.71:0/297701340 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b18028020 con 0x5631787e7b80 2024-05-27T09:52:13.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.801+0000 7f4b0be00700 1 -- 172.21.15.71:0/297701340 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4b180128c0 con 0x5631787e7b80 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.801+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b18011c80 con 0x5631787e7b80 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.801+0000 7f4b0be00700 1 -- 172.21.15.71:0/297701340 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b18005050 con 0x5631787e7b80 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.801+0000 7f4b3f543b80 10 client.16107 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.801+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631787691f0 con 0x5631787e7b80 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b0be00700 1 -- 172.21.15.71:0/297701340 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b18011c80 con 0x5631787e7b80 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b0be00700 1 -- 172.21.15.71:0/297701340 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f4b18024450 con 0x5631787e7b80 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b3f543b80 10 client.16107 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b3f543b80 10 client.16107 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b3f543b80 20 client.16107 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631788950c0 0x5631788974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b3f543b80 4 client.16107 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631787aaf20 con 0x5631788950c0 2024-05-27T09:52:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.802+0000 7f4b29e00700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631788950c0 0x5631788974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.803+0000 7f4b0be00700 10 client.16107 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:13.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.803+0000 7f4b29e00700 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631788950c0 0x5631788974e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb72e9c61cdb4669 server_cookie=14a164f00d4e5430 in_seq=0 out_seq=0 2024-05-27T09:52:13.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.804+0000 7f4b0be00700 1 -- 172.21.15.71:0/297701340 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5631787aaf20 con 0x5631788950c0 2024-05-27T09:52:13.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.804+0000 7f4b0be00700 10 client.16107 handle_command_reply: tid=0 2024-05-27T09:52:13.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.804+0000 7f4b3f543b80 1 client.16107 shutdown 2024-05-27T09:52:13.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 msgr2=0x563178885870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:13.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178885870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4b18012d50 tx=0x7f4b18005990 comp rx=0 tx=0).stop 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 shutdown_connections 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5631788950c0 0x5631788974e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56317887b670 0x563178885db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x563178885330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/297701340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178885870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b0be00700 0 client.16107 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.805+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 >> 172.21.15.71:0/297701340 conn(0x563178795520 msgr2=0x56317887a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.806+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 shutdown_connections 2024-05-27T09:52:13.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.806+0000 7f4b3f543b80 1 -- 172.21.15.71:0/297701340 wait complete. 2024-05-27T09:52:13.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.806+0000 7f4b3f543b80 20 client.16107 trim_cache size 0 max 16384 2024-05-27T09:52:13.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 Processor -- start 2024-05-27T09:52:13.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 -- start start 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563178795520 0x5631788914a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x56317887ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631787e7b80 0x563178876040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c1b3800 con 0x563178795520 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c1b1090 con 0x5631786fbfd0 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.831+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c1aeee0 con 0x5631787e7b80 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x56317887ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563178795520 0x5631788914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x56317887ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55862/0 (socket says 172.21.15.71:55862) 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 -- 172.21.15.71:0/275189803 learned_addr learned my addr 172.21.15.71:0/275189803 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b2a800700 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631787e7b80 0x563178876040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 -- 172.21.15.71:0/275189803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631787e7b80 msgr2=0x563178876040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631787e7b80 0x563178876040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 -- 172.21.15.71:0/275189803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563178795520 msgr2=0x5631788914a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563178795520 0x5631788914a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 -- 172.21.15.71:0/275189803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563178881e90 con 0x5631786fbfd0 2024-05-27T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.832+0000 7f4b29400700 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x56317887ad70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4b18024870 tx=0x7f4b18009350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4514b4ee9093a5e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.833+0000 7f4b16a00700 1 -- 172.21.15.71:0/275189803 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1803a030 con 0x5631786fbfd0 2024-05-27T09:52:13.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.833+0000 7f4b16a00700 1 -- 172.21.15.71:0/275189803 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b180056a0 con 0x5631786fbfd0 2024-05-27T09:52:13.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.833+0000 7f4b16a00700 1 -- 172.21.15.71:0/275189803 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b18028040 con 0x5631786fbfd0 2024-05-27T09:52:13.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 -- 172.21.15.71:0/275189803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 msgr2=0x56317887ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:13.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x56317887ad70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4b18024870 tx=0x7f4b18009350 comp rx=0 tx=0).stop 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 -- 172.21.15.71:0/275189803 shutdown_connections 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631787e7b80 0x563178876040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563178795520 0x5631788914a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/275189803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5631786fbfd0 0x56317887ad70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 -- 172.21.15.71:0/275189803 >> 172.21.15.71:0/275189803 conn(0x56317887bd50 msgr2=0x56317887a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 -- 172.21.15.71:0/275189803 shutdown_connections 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.834+0000 7f4b3f543b80 1 -- 172.21.15.71:0/275189803 wait complete. 2024-05-27T09:52:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.835+0000 7f4b3f543b80 1 -- start start 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.835+0000 7f4b3f543b80 1 Processor -- start 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x56317889a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563178795520 0x563178898d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b3f543b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178899260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c1af550 con 0x5631787e7b80 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c1b09c0 con 0x563178795520 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b3f543b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c1afc20 con 0x5631786fbfd0 2024-05-27T09:52:13.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b3f543b80 10 client.0 _ll_register_callbacks cb 0x563178742e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b29e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x56317889a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.836+0000 7f4b29e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x56317889a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33440/0 (socket says 172.21.15.71:33440) 2024-05-27T09:52:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29e00700 1 -- 172.21.15.71:0/424834293 learned_addr learned my addr 172.21.15.71:0/424834293 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b2a800700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178899260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29400700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563178795520 0x563178898d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29e00700 1 -- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563178795520 msgr2=0x563178898d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29e00700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563178795520 0x563178898d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29e00700 1 -- 172.21.15.71:0/424834293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 msgr2=0x563178899260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29e00700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178899260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29e00700 1 -- 172.21.15.71:0/424834293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631788997d0 con 0x5631786fbfd0 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b2a800700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178899260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b29e00700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x56317889a990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0aade0 tx=0x7f4b1c0a6dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe4317b3d494509 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.837+0000 7f4b0be00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.838+0000 7f4b0be00700 1 -- 172.21.15.71:0/424834293 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c06e070 con 0x5631786fbfd0 2024-05-27T09:52:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.838+0000 7f4b0be00700 1 -- 172.21.15.71:0/424834293 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f4b1c0ab0b0 con 0x5631786fbfd0 2024-05-27T09:52:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.838+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56317886e8a0 con 0x5631786fbfd0 2024-05-27T09:52:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.838+0000 7f4b0be00700 1 -- 172.21.15.71:0/424834293 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b1c0af200 con 0x5631786fbfd0 2024-05-27T09:52:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.838+0000 7f4b3f543b80 10 client.26281 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.838+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563178900660 con 0x5631786fbfd0 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.838+0000 7f4b0be00700 1 -- 172.21.15.71:0/424834293 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56317886e8a0 con 0x5631786fbfd0 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b0be00700 1 -- 172.21.15.71:0/424834293 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f4b1c011070 con 0x5631786fbfd0 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b3f543b80 10 client.26281 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b3f543b80 10 client.26281 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b3f543b80 20 client.26281 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56317887b670 0x563178902e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b3f543b80 4 client.26281 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5631787a4700 con 0x56317887b670 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.839+0000 7f4b29400700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56317887b670 0x563178902e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.840+0000 7f4b29400700 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56317887b670 0x563178902e00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35056383157b868d server_cookie=d4224c245ee41a23 in_seq=0 out_seq=0 2024-05-27T09:52:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:13.840+0000 7f4b0be00700 10 client.26281 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:14.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:14 smithi122 ceph-mon[36436]: pgmap v137: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 252 op/s 2024-05-27T09:52:15.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:14 smithi071 ceph-mon[31451]: pgmap v137: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 252 op/s 2024-05-27T09:52:15.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:14 smithi072 ceph-mon[35951]: pgmap v137: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 252 op/s 2024-05-27T09:52:15.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.032+0000 7f4b0be00700 1 -- 172.21.15.71:0/424834293 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5631787a4700 con 0x56317887b670 2024-05-27T09:52:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.032+0000 7f4b0be00700 10 client.26281 handle_command_reply: tid=0 2024-05-27T09:52:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.032+0000 7f4b3f543b80 1 client.26281 shutdown 2024-05-27T09:52:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 msgr2=0x56317889a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x56317889a990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0aade0 tx=0x7f4b1c0a6dc0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 shutdown_connections 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56317887b670 0x563178902e00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631787e7b80 0x563178899260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631786fbfd0 0x56317889a990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 --2- 172.21.15.71:0/424834293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563178795520 0x563178898d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b0be00700 0 client.26281 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.033+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 >> 172.21.15.71:0/424834293 conn(0x56317887bd50 msgr2=0x563178882080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.034+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 shutdown_connections 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.034+0000 7f4b3f543b80 1 -- 172.21.15.71:0/424834293 wait complete. 2024-05-27T09:52:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.034+0000 7f4b3f543b80 20 client.26281 trim_cache size 0 max 16384 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 28, 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 14, 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "6b9091a7": { 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 14, 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:52:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 150.0, 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:15.037 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:52:15.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4b100b29f0 msgr2=0x7f4b100b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:15.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4b100b29f0 0x7f4b100b4f00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b24013970 tx=0x7f4b24009b70 comp rx=0 tx=0).stop 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 msgr2=0x7f4b2c19cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 0x7f4b2c19cfe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d010 tx=0x7f4b1c004db0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 shutdown_connections 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4b100b29f0 0x7f4b100b4f00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b2c10c5a0 0x7f4b2c1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c106560 0x7f4b2c19cfe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 --2- 172.21.15.71:0/159253180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2c106eb0 0x7f4b2c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.035+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 >> 172.21.15.71:0/159253180 conn(0x7f4b2c102040 msgr2=0x7f4b2c103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.036+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 shutdown_connections 2024-05-27T09:52:15.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:15.036+0000 7f4b30a00700 1 -- 172.21.15.71:0/159253180 wait complete. 2024-05-27T09:52:15.933 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6b9091a7', quiesce took 9.6 seconds. Will release after: 20.4 2024-05-27T09:52:16.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:16 smithi122 ceph-mon[36436]: pgmap v138: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 252 op/s 2024-05-27T09:52:17.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:16 smithi071 ceph-mon[31451]: pgmap v138: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 252 op/s 2024-05-27T09:52:17.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:16 smithi072 ceph-mon[35951]: pgmap v138: 97 pgs: 97 active+clean; 38 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 252 op/s 2024-05-27T09:52:18.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:18 smithi122 ceph-mon[36436]: pgmap v139: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 340 op/s 2024-05-27T09:52:19.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:18 smithi071 ceph-mon[31451]: pgmap v139: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 340 op/s 2024-05-27T09:52:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:18 smithi072 ceph-mon[35951]: pgmap v139: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 340 op/s 2024-05-27T09:52:20.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:20 smithi122 ceph-mon[36436]: pgmap v140: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 306 op/s 2024-05-27T09:52:21.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:20 smithi071 ceph-mon[31451]: pgmap v140: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 306 op/s 2024-05-27T09:52:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:20 smithi072 ceph-mon[35951]: pgmap v140: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 306 op/s 2024-05-27T09:52:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 -- 172.21.15.71:0/2980427976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f641010c180 msgr2=0x7f6410105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 --2- 172.21.15.71:0/2980427976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f641010c180 0x7f6410105dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009900 tx=0x7f63fc02a3f0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 -- 172.21.15.71:0/2980427976 shutdown_connections 2024-05-27T09:52:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 --2- 172.21.15.71:0/2980427976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6410106430 0x7f6410112800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 --2- 172.21.15.71:0/2980427976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f641010c180 0x7f6410105dc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 --2- 172.21.15.71:0/2980427976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f641010bce0 0x7f6410105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 -- 172.21.15.71:0/2980427976 >> 172.21.15.71:0/2980427976 conn(0x7f6410101380 msgr2=0x7f64101037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 -- 172.21.15.71:0/2980427976 shutdown_connections 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.210+0000 7f6415000640 1 -- 172.21.15.71:0/2980427976 wait complete. 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.211+0000 7f6415000640 1 Processor -- start 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.211+0000 7f6415000640 1 -- start start 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f6415000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6410106430 0x7f64101a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f6415000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f641010bce0 0x7f64101a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f6415000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641010c180 0x7f641019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f6415000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6410115ed0 con 0x7f6410106430 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f6415000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6410115d50 con 0x7f641010c180 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f6415000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6410116050 con 0x7f641010bce0 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f640f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6410106430 0x7f64101a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f640f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6410106430 0x7f64101a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48590/0 (socket says 172.21.15.71:48590) 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f640ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f641010bce0 0x7f64101a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f640f400640 1 -- 172.21.15.71:0/2184649917 learned_addr learned my addr 172.21.15.71:0/2184649917 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.212+0000 7f640fe00640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641010c180 0x7f641019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f640f400640 1 -- 172.21.15.71:0/2184649917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f641010bce0 msgr2=0x7f64101a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f640f400640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f641010bce0 0x7f64101a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f640f400640 1 -- 172.21.15.71:0/2184649917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641010c180 msgr2=0x7f641019c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f640f400640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641010c180 0x7f641019c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f640f400640 1 -- 172.21.15.71:0/2184649917 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641019ce90 con 0x7f6410106430 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f640ea00640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f641010bce0 0x7f64101a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f640f400640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6410106430 0x7f64101a2580 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f640000e9f0 tx=0x7f640000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f6407e00640 1 -- 172.21.15.71:0/2184649917 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640000ccc0 con 0x7f6410106430 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f6407e00640 1 -- 172.21.15.71:0/2184649917 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64000054d0 con 0x7f6410106430 2024-05-27T09:52:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f6407e00640 1 -- 172.21.15.71:0/2184649917 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400010430 con 0x7f6410106430 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.213+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641019d180 con 0x7f6410106430 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.214+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64101a93d0 con 0x7f6410106430 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.217+0000 7f641d645740 1 Processor -- start 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.217+0000 7f641d645740 1 -- start start 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.217+0000 7f6407e00640 1 -- 172.21.15.71:0/2184649917 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f64000046c0 con 0x7f6410106430 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.217+0000 7f641d645740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88301b0 0x55d0f8bd2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f641d645740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bd2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f641d645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bd34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f641d645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0f8b43b90 con 0x55d0f880f4d0 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f641d645740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d0f8b33730 con 0x55d0f88301b0 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f641d645740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d0f8b37770 con 0x55d0f88072f0 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bd2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bd2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:45354/0 (socket says 172.21.15.71:45354) 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640f400640 1 -- 172.21.15.71:0/3881356052 learned_addr learned my addr 172.21.15.71:0/3881356052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640ea00640 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bd34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640fe00640 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88301b0 0x55d0f8bd2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640fe00640 1 -- 172.21.15.71:0/3881356052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 msgr2=0x55d0f8bd2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640fe00640 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bd2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640fe00640 1 -- 172.21.15.71:0/3881356052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 msgr2=0x55d0f8bd34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640fe00640 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bd34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640fe00640 1 -- 172.21.15.71:0/3881356052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f8acc8b0 con 0x55d0f88301b0 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.218+0000 7f640f400640 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bd2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.219+0000 7f640fe00640 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88301b0 0x55d0f8bd2a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6408009f10 tx=0x7f6408011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a59195b95bd8067 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.219+0000 7f6404c00640 1 -- 172.21.15.71:0/3881356052 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408004d20 con 0x55d0f88301b0 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.219+0000 7f6404c00640 1 -- 172.21.15.71:0/3881356052 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6408004030 con 0x55d0f88301b0 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.219+0000 7f6404c00640 1 -- 172.21.15.71:0/3881356052 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408005260 con 0x55d0f88301b0 2024-05-27T09:52:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.219+0000 7f6407e00640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f63f40b2950 0x7f63f40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f6407e00640 1 -- 172.21.15.71:0/2184649917 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f64000e2920 con 0x7f6410106430 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f640f400640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f63f40b2950 0x7f63f40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 -- 172.21.15.71:0/3881356052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88301b0 msgr2=0x55d0f8bd2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88301b0 0x55d0f8bd2a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6408009f10 tx=0x7f6408011810 comp rx=0 tx=0).stop 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 -- 172.21.15.71:0/3881356052 shutdown_connections 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bd34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bd2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 --2- 172.21.15.71:0/3881356052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88301b0 0x55d0f8bd2a60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 -- 172.21.15.71:0/3881356052 >> 172.21.15.71:0/3881356052 conn(0x55d0f8824300 msgr2=0x55d0f8bcf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 -- 172.21.15.71:0/3881356052 shutdown_connections 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f641d645740 1 -- 172.21.15.71:0/3881356052 wait complete. 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.220+0000 7f640f400640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f63f40b2950 0x7f63f40b4e60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f640000c6a0 tx=0x7f64000e8530 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.221+0000 7f641d645740 1 -- start start 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.221+0000 7f641d645740 1 Processor -- start 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f641d645740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f641d645740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8bdd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f641d645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f641d645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0f8819790 con 0x55d0f88301b0 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f641d645740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d0f8adbbc0 con 0x55d0f880f4d0 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f641d645740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d0f8bdfb90 con 0x55d0f88072f0 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f641d645740 10 client.0 _ll_register_callbacks cb 0x55d0f8ab9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8bdd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8bdd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32886/0 (socket says 172.21.15.71:32886) 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 -- 172.21.15.71:0/527282964 learned_addr learned my addr 172.21.15.71:0/527282964 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640fe00640 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 -- 172.21.15.71:0/527282964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 msgr2=0x55d0f8bdceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 -- 172.21.15.71:0/527282964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 msgr2=0x55d0f8be8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640ea00640 1 -- 172.21.15.71:0/527282964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f8848210 con 0x55d0f880f4d0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.222+0000 7f640fe00640 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f640ea00640 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8bdd3f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f641006c450 tx=0x7f63fc0316d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c0fdb5139d0787f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f63f9600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f63f9600640 1 -- 172.21.15.71:0/527282964 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc035040 con 0x55d0f880f4d0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6408004030 con 0x55d0f880f4d0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f63f9600640 1 -- 172.21.15.71:0/527282964 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f63fc004240 con 0x55d0f880f4d0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f63f9600640 1 -- 172.21.15.71:0/527282964 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63fc031900 con 0x55d0f880f4d0 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f641d645740 10 client.26264 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.223+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0f8914620 con 0x55d0f880f4d0 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f63f9600640 1 -- 172.21.15.71:0/527282964 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6408004030 con 0x55d0f880f4d0 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f63f9600640 1 -- 172.21.15.71:0/527282964 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f63fc004ad0 con 0x55d0f880f4d0 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f641d645740 10 client.26264 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f641d645740 10 client.26264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f641d645740 20 client.26264 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f641d645740 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87eed80 0x55d0f8beef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f641d645740 4 client.26264 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f8b45ae0 con 0x55d0f87eed80 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.224+0000 7f640fe00640 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87eed80 0x55d0f8beef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.225+0000 7f63f9600640 10 client.26264 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.225+0000 7f640fe00640 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87eed80 0x55d0f8beef20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fbb9e678e4c18cd server_cookie=7e3311c89cdec8cc in_seq=0 out_seq=0 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f63f9600640 1 -- 172.21.15.71:0/527282964 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d0f8b45ae0 con 0x55d0f87eed80 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f63f9600640 10 client.26264 handle_command_reply: tid=0 2024-05-27T09:52:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 client.26264 shutdown 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 msgr2=0x55d0f8bdd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8bdd3f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f641006c450 tx=0x7f63fc0316d0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 shutdown_connections 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87eed80 0x55d0f8beef20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8bdd3f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f63f9600640 0 client.26264 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 --2- 172.21.15.71:0/527282964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 >> 172.21.15.71:0/527282964 conn(0x55d0f8824300 msgr2=0x55d0f8bd2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 shutdown_connections 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.226+0000 7f641d645740 1 -- 172.21.15.71:0/527282964 wait complete. 2024-05-27T09:52:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.227+0000 7f641d645740 20 client.26264 trim_cache size 0 max 16384 2024-05-27T09:52:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.243+0000 7f641d645740 1 Processor -- start 2024-05-27T09:52:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.243+0000 7f641d645740 1 -- start start 2024-05-27T09:52:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f641d645740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88072f0 0x55d0f8bd8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f641d645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bcf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f641d645740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88301b0 0x55d0f8be8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f641d645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64101b43b0 con 0x55d0f880f4d0 2024-05-27T09:52:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f641d645740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64101b1c80 con 0x55d0f88072f0 2024-05-27T09:52:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f641d645740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f64101afad0 con 0x55d0f88301b0 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f640ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bcf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f640fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88072f0 0x55d0f8bd8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f640fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88072f0 0x55d0f8bd8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32900/0 (socket says 172.21.15.71:32900) 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f640fe00640 1 -- 172.21.15.71:0/861020876 learned_addr learned my addr 172.21.15.71:0/861020876 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f640ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bcf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48618/0 (socket says 172.21.15.71:48618) 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.244+0000 7f640fe00640 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88301b0 0x55d0f8be8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f640fe00640 1 -- 172.21.15.71:0/861020876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88301b0 msgr2=0x55d0f8be8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f640fe00640 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88301b0 0x55d0f8be8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f640fe00640 1 -- 172.21.15.71:0/861020876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 msgr2=0x55d0f8bcf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f640fe00640 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bcf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f640fe00640 1 -- 172.21.15.71:0/861020876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f8beba70 con 0x55d0f88072f0 2024-05-27T09:52:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f640fe00640 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88072f0 0x55d0f8bd8440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6408009ee0 tx=0x7f6408009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=557dde289f124f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f63fbe00640 1 -- 172.21.15.71:0/861020876 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640801e040 con 0x55d0f88072f0 2024-05-27T09:52:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f63fbe00640 1 -- 172.21.15.71:0/861020876 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6408005020 con 0x55d0f88072f0 2024-05-27T09:52:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.245+0000 7f63fbe00640 1 -- 172.21.15.71:0/861020876 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408003f30 con 0x55d0f88072f0 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 -- 172.21.15.71:0/861020876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88072f0 msgr2=0x55d0f8bd8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88072f0 0x55d0f8bd8440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6408009ee0 tx=0x7f6408009500 comp rx=0 tx=0).stop 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 -- 172.21.15.71:0/861020876 shutdown_connections 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88301b0 0x55d0f8be8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f880f4d0 0x55d0f8bcf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 --2- 172.21.15.71:0/861020876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f88072f0 0x55d0f8bd8440 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 -- 172.21.15.71:0/861020876 >> 172.21.15.71:0/861020876 conn(0x55d0f8824300 msgr2=0x55d0f8bcebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 -- 172.21.15.71:0/861020876 shutdown_connections 2024-05-27T09:52:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.246+0000 7f641d645740 1 -- 172.21.15.71:0/861020876 wait complete. 2024-05-27T09:52:22.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.247+0000 7f641d645740 1 -- start start 2024-05-27T09:52:22.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.247+0000 7f641d645740 1 Processor -- start 2024-05-27T09:52:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f641d645740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f641d645740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8be0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f641d645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f641d645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64101b0140 con 0x55d0f88301b0 2024-05-27T09:52:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f641d645740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64101b15b0 con 0x55d0f880f4d0 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f641d645740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f64101b0810 con 0x55d0f88072f0 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f641d645740 10 client.0 _ll_register_callbacks cb 0x7f63fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f640fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f640fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f640ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8be0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f640fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48634/0 (socket says 172.21.15.71:48634) 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f640ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8be0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32908/0 (socket says 172.21.15.71:32908) 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f640fe00640 1 -- 172.21.15.71:0/1992776089 learned_addr learned my addr 172.21.15.71:0/1992776089 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.248+0000 7f640ea00640 1 -- 172.21.15.71:0/1992776089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 msgr2=0x55d0f8bdfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f640ea00640 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f640ea00640 1 -- 172.21.15.71:0/1992776089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 msgr2=0x55d0f8be0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f640ea00640 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f640ea00640 1 -- 172.21.15.71:0/1992776089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f8c55690 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f640ea00640 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8be0320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f63fc02a910 tx=0x7f63fc004c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e971eecc48252c8f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f63f9600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f63f9600640 1 -- 172.21.15.71:0/1992776089 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc035070 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f63f9600640 1 -- 172.21.15.71:0/1992776089 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f63fc004fa0 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6408005020 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f63f9600640 1 -- 172.21.15.71:0/1992776089 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63fc053040 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f641d645740 10 client.26270 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.249+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0f8c56900 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f63f9600640 1 -- 172.21.15.71:0/1992776089 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6408005020 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f63f9600640 1 -- 172.21.15.71:0/1992776089 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f63fc056070 con 0x55d0f880f4d0 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f641d645740 10 client.26270 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f641d645740 10 client.26270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f641d645740 20 client.26270 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f641d645740 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87c41c0 0x55d0f8c59170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f641d645740 4 client.26270 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:52:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0f8b3f2c0 con 0x55d0f87c41c0 2024-05-27T09:52:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.250+0000 7f640fe00640 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87c41c0 0x55d0f8c59170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.251+0000 7f640fe00640 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87c41c0 0x55d0f8c59170 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59956bd2db5f867b server_cookie=3112b44541a8623a in_seq=0 out_seq=0 2024-05-27T09:52:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.251+0000 7f63f9600640 10 client.26270 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f63f9600640 1 -- 172.21.15.71:0/1992776089 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d0f8b3f2c0 con 0x55d0f87c41c0 2024-05-27T09:52:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f63f9600640 10 client.26270 handle_command_reply: tid=0 2024-05-27T09:52:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 client.26270 shutdown 2024-05-27T09:52:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 msgr2=0x55d0f8be0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8be0320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f63fc02a910 tx=0x7f63fc004c40 comp rx=0 tx=0).stop 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 shutdown_connections 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d0f87c41c0 0x55d0f8c59170 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f88301b0 0x55d0f8be0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d0f880f4d0 0x55d0f8be0320 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 --2- 172.21.15.71:0/1992776089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f88072f0 0x55d0f8bdfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f63f9600640 0 client.26270 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 >> 172.21.15.71:0/1992776089 conn(0x55d0f8824300 msgr2=0x55d0f8bd27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 shutdown_connections 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.272+0000 7f641d645740 1 -- 172.21.15.71:0/1992776089 wait complete. 2024-05-27T09:52:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.273+0000 7f641d645740 20 client.26270 trim_cache size 0 max 16384 2024-05-27T09:52:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:52:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:52:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.273+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f63f40b2950 msgr2=0x7f63f40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.273+0000 7f6415000640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f63f40b2950 0x7f63f40b4e60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f640000c6a0 tx=0x7f64000e8530 comp rx=0 tx=0).stop 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.273+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6410106430 msgr2=0x7f64101a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.273+0000 7f6415000640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6410106430 0x7f64101a2580 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f640000e9f0 tx=0x7f640000edf0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 shutdown_connections 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f63f40b2950 0x7f63f40b4e60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641010c180 0x7f641019c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f641010bce0 0x7f64101a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 --2- 172.21.15.71:0/2184649917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6410106430 0x7f64101a2580 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 >> 172.21.15.71:0/2184649917 conn(0x7f6410101380 msgr2=0x7f64101117c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 shutdown_connections 2024-05-27T09:52:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:22.274+0000 7f6415000640 1 -- 172.21.15.71:0/2184649917 wait complete. 2024-05-27T09:52:22.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:22 smithi122 ceph-mon[36436]: pgmap v141: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-05-27T09:52:23.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:22 smithi071 ceph-mon[31451]: pgmap v141: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-05-27T09:52:23.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:22 smithi072 ceph-mon[35951]: pgmap v141: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 309 op/s 2024-05-27T09:52:24.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:24 smithi122 ceph-mon[36436]: pgmap v142: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 655 KiB/s wr, 90 op/s 2024-05-27T09:52:25.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:24 smithi071 ceph-mon[31451]: pgmap v142: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 655 KiB/s wr, 90 op/s 2024-05-27T09:52:25.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:24 smithi072 ceph-mon[35951]: pgmap v142: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 655 KiB/s wr, 90 op/s 2024-05-27T09:52:26.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:26 smithi122 ceph-mon[36436]: pgmap v143: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 655 KiB/s wr, 90 op/s 2024-05-27T09:52:27.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:26 smithi071 ceph-mon[31451]: pgmap v143: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 655 KiB/s wr, 90 op/s 2024-05-27T09:52:27.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:26 smithi072 ceph-mon[35951]: pgmap v143: 97 pgs: 97 active+clean; 40 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 655 KiB/s wr, 90 op/s 2024-05-27T09:52:28.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:28 smithi122 ceph-mon[36436]: pgmap v144: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 665 KiB/s wr, 99 op/s 2024-05-27T09:52:29.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:28 smithi071 ceph-mon[31451]: pgmap v144: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 665 KiB/s wr, 99 op/s 2024-05-27T09:52:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:28 smithi072 ceph-mon[35951]: pgmap v144: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 665 KiB/s wr, 99 op/s 2024-05-27T09:52:30.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:30 smithi122 ceph-mon[36436]: pgmap v145: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-05-27T09:52:31.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:30 smithi071 ceph-mon[31451]: pgmap v145: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-05-27T09:52:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:30 smithi072 ceph-mon[35951]: pgmap v145: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-05-27T09:52:33.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:32 smithi071 ceph-mon[31451]: pgmap v146: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-05-27T09:52:33.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:32 smithi072 ceph-mon[35951]: pgmap v146: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-05-27T09:52:33.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:32 smithi122 ceph-mon[36436]: pgmap v146: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-05-27T09:52:35.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:34 smithi071 ceph-mon[31451]: pgmap v147: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-27T09:52:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:34 smithi072 ceph-mon[35951]: pgmap v147: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-27T09:52:35.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:34 smithi122 ceph-mon[36436]: pgmap v147: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-27T09:52:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 -- 172.21.15.71:0/227704684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 msgr2=0x7fa758110500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 --2- 172.21.15.71:0/227704684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 0x7fa758110500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa750009ca0 tx=0x7fa75002a950 comp rx=0 tx=0).stop 2024-05-27T09:52:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 -- 172.21.15.71:0/227704684 shutdown_connections 2024-05-27T09:52:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 --2- 172.21.15.71:0/227704684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 0x7fa758110500 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 --2- 172.21.15.71:0/227704684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75810b6b0 0x7fa75810dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 --2- 172.21.15.71:0/227704684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 0x7fa758105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 -- 172.21.15.71:0/227704684 >> 172.21.15.71:0/227704684 conn(0x7fa7580fe210 msgr2=0x7fa758100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 -- 172.21.15.71:0/227704684 shutdown_connections 2024-05-27T09:52:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.499+0000 7fa757e00640 1 -- 172.21.15.71:0/227704684 wait complete. 2024-05-27T09:52:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.500+0000 7fa757e00640 1 Processor -- start 2024-05-27T09:52:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.501+0000 7fa757e00640 1 -- start start 2024-05-27T09:52:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.501+0000 7fa757e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 0x7fa758102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.501+0000 7fa757e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75810b6b0 0x7fa758102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.501+0000 7fa757e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 0x7fa758102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.501+0000 7fa757e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa758113cc0 con 0x7fa758104c50 2024-05-27T09:52:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.501+0000 7fa757e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa758113b40 con 0x7fa75810e010 2024-05-27T09:52:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.501+0000 7fa757e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa758113e40 con 0x7fa75810b6b0 2024-05-27T09:52:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 0x7fa758102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75810b6b0 0x7fa758102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75810b6b0 0x7fa758102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42548/0 (socket says 172.21.15.71:42548) 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756000640 1 -- 172.21.15.71:0/3404848841 learned_addr learned my addr 172.21.15.71:0/3404848841 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 0x7fa758102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57930/0 (socket says 172.21.15.71:57930) 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa757400640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 0x7fa758102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 -- 172.21.15.71:0/3404848841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75810b6b0 msgr2=0x7fa758102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75810b6b0 0x7fa758102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 -- 172.21.15.71:0/3404848841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 msgr2=0x7fa758102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 0x7fa758102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 -- 172.21.15.71:0/3404848841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7581a8980 con 0x7fa758104c50 2024-05-27T09:52:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.502+0000 7fa756a00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 0x7fa758102510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa74800e9f0 tx=0x7fa74800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.503+0000 7fa74f400640 1 -- 172.21.15.71:0/3404848841 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74800ccc0 con 0x7fa758104c50 2024-05-27T09:52:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.503+0000 7fa74f400640 1 -- 172.21.15.71:0/3404848841 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7480108e0 con 0x7fa758104c50 2024-05-27T09:52:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.503+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7581a8c70 con 0x7fa758104c50 2024-05-27T09:52:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.503+0000 7fa74f400640 1 -- 172.21.15.71:0/3404848841 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748018880 con 0x7fa758104c50 2024-05-27T09:52:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.503+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7581a91c0 con 0x7fa758104c50 2024-05-27T09:52:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.506+0000 7fa764b94740 1 Processor -- start 2024-05-27T09:52:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.506+0000 7fa764b94740 1 -- start start 2024-05-27T09:52:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa74f400640 1 -- 172.21.15.71:0/3404848841 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fa748010430 con 0x7fa758104c50 2024-05-27T09:52:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa764b94740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f4892a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa764b94740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f4892fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa764b94740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44cf4d0 0x5570f48934e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa764b94740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5570f4803b90 con 0x5570f44c72f0 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa764b94740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5570f47f3730 con 0x5570f44f01b0 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa764b94740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f47f7770 con 0x5570f44cf4d0 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f4892fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa757400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f4892a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f4892fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57936/0 (socket says 172.21.15.71:57936) 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa756a00640 1 -- 172.21.15.71:0/1167038696 learned_addr learned my addr 172.21.15.71:0/1167038696 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa757400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f4892a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53240/0 (socket says 172.21.15.71:53240) 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.507+0000 7fa756000640 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44cf4d0 0x5570f48934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa756a00640 1 -- 172.21.15.71:0/1167038696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44cf4d0 msgr2=0x5570f48934e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa756a00640 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44cf4d0 0x5570f48934e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa756a00640 1 -- 172.21.15.71:0/1167038696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 msgr2=0x5570f4892a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa756a00640 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f4892a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa756a00640 1 -- 172.21.15.71:0/1167038696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f478c8b0 con 0x5570f44c72f0 2024-05-27T09:52:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa757400640 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f4892a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa756a00640 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f4892fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7480dfff0 tx=0x7fa7480ea2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf0c154e68711f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa74f400640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa73c0b2950 0x7fa73c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa743e00640 1 -- 172.21.15.71:0/1167038696 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480f1070 con 0x5570f44c72f0 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.508+0000 7fa743e00640 1 -- 172.21.15.71:0/1167038696 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7480a9800 con 0x5570f44c72f0 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.509+0000 7fa743e00640 1 -- 172.21.15.71:0/1167038696 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480bd0a0 con 0x5570f44c72f0 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.509+0000 7fa74f400640 1 -- 172.21.15.71:0/3404848841 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa7480e2990 con 0x7fa758104c50 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.509+0000 7fa757400640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa73c0b2950 0x7fa73c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.509+0000 7fa764b94740 1 -- 172.21.15.71:0/1167038696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 msgr2=0x5570f4892fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.509+0000 7fa764b94740 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f4892fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7480dfff0 tx=0x7fa7480ea2a0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.509+0000 7fa757400640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa73c0b2950 0x7fa73c0b4e60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa750006010 tx=0x7fa750005d80 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 -- 172.21.15.71:0/1167038696 shutdown_connections 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44cf4d0 0x5570f48934e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f4892fa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 --2- 172.21.15.71:0/1167038696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f4892a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 -- 172.21.15.71:0/1167038696 >> 172.21.15.71:0/1167038696 conn(0x5570f44e4300 msgr2=0x5570f488f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 -- 172.21.15.71:0/1167038696 shutdown_connections 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 -- 172.21.15.71:0/1167038696 wait complete. 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 -- start start 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.510+0000 7fa764b94740 1 Processor -- start 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa764b94740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f489cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa764b94740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44cf4d0 0x5570f489d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa764b94740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f48a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa764b94740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5570f44d9790 con 0x5570f44cf4d0 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa764b94740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5570f479bbc0 con 0x5570f44f01b0 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa764b94740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f489fb90 con 0x5570f44c72f0 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa764b94740 10 client.0 _ll_register_callbacks cb 0x5570f4779400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa756000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44cf4d0 0x5570f489d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa756000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44cf4d0 0x5570f489d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57952/0 (socket says 172.21.15.71:57952) 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa756000640 1 -- 172.21.15.71:0/2468631485 learned_addr learned my addr 172.21.15.71:0/2468631485 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa756a00640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f489cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.511+0000 7fa757400640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f48a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa756000640 1 -- 172.21.15.71:0/2468631485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 msgr2=0x5570f489cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa756000640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f489cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa756000640 1 -- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 msgr2=0x5570f48a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa756000640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f48a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa756000640 1 -- 172.21.15.71:0/2468631485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f4508210 con 0x5570f44cf4d0 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa756a00640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f489cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa756000640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44cf4d0 0x5570f489d150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa744012790 tx=0x7fa744012c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cbdb0e36073904 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa740c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa740c00640 1 -- 172.21.15.71:0/2468631485 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74400f920 con 0x5570f44cf4d0 2024-05-27T09:52:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa740c00640 1 -- 172.21.15.71:0/2468631485 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa74400fac0 con 0x5570f44cf4d0 2024-05-27T09:52:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.512+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7480a9800 con 0x5570f44cf4d0 2024-05-27T09:52:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa740c00640 1 -- 172.21.15.71:0/2468631485 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa74400fcc0 con 0x5570f44cf4d0 2024-05-27T09:52:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 10 client.16143 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570f45d4620 con 0x5570f44cf4d0 2024-05-27T09:52:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa740c00640 1 -- 172.21.15.71:0/2468631485 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7480a9800 con 0x5570f44cf4d0 2024-05-27T09:52:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa740c00640 1 -- 172.21.15.71:0/2468631485 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fa74401c420 con 0x5570f44cf4d0 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 10 client.16143 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 20 client.16143 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44aed80 0x5570f48aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 4 client.16143 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.513+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570f4805ae0 con 0x5570f44aed80 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.514+0000 7fa756a00640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44aed80 0x5570f48aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.514+0000 7fa756a00640 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44aed80 0x5570f48aefb0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=925d4bda0ccadcb1 server_cookie=5d741ff6efee08db in_seq=0 out_seq=0 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.514+0000 7fa740c00640 10 client.16143 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.515+0000 7fa740c00640 1 -- 172.21.15.71:0/2468631485 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5570f4805ae0 con 0x5570f44aed80 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.515+0000 7fa740c00640 10 client.16143 handle_command_reply: tid=0 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 client.16143 shutdown 2024-05-27T09:52:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44cf4d0 msgr2=0x5570f489d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44cf4d0 0x5570f489d150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa744012790 tx=0x7fa744012c50 comp rx=0 tx=0).stop 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 shutdown_connections 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44f01b0 0x5570f48a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44aed80 0x5570f48aefb0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44cf4d0 0x5570f489d150 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 --2- 172.21.15.71:0/2468631485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f489cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa740c00640 0 client.16143 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 >> 172.21.15.71:0/2468631485 conn(0x5570f44e4300 msgr2=0x5570f4892890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 shutdown_connections 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 1 -- 172.21.15.71:0/2468631485 wait complete. 2024-05-27T09:52:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.516+0000 7fa764b94740 20 client.16143 trim_cache size 0 max 16384 2024-05-27T09:52:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.533+0000 7fa764b94740 1 Processor -- start 2024-05-27T09:52:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa764b94740 1 -- start start 2024-05-27T09:52:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa764b94740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f48983a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa764b94740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f489ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa764b94740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44f01b0 0x5570f48b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa764b94740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7581b43e0 con 0x5570f44f01b0 2024-05-27T09:52:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa764b94740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa7581b1cb0 con 0x5570f44cf4d0 2024-05-27T09:52:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa764b94740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa7581afb00 con 0x5570f44c72f0 2024-05-27T09:52:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa756a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f48983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa756a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f48983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42572/0 (socket says 172.21.15.71:42572) 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa756a00640 1 -- 172.21.15.71:0/2696267602 learned_addr learned my addr 172.21.15.71:0/2696267602 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa756000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f489ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.534+0000 7fa757400640 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44f01b0 0x5570f48b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa756a00640 1 -- 172.21.15.71:0/2696267602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 msgr2=0x5570f489ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa756a00640 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f489ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa756a00640 1 -- 172.21.15.71:0/2696267602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44f01b0 msgr2=0x5570f48b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa756a00640 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44f01b0 0x5570f48b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa756a00640 1 -- 172.21.15.71:0/2696267602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f48ab9e0 con 0x5570f44c72f0 2024-05-27T09:52:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa756000640 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f489ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa756a00640 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f48983a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7480a5d70 tx=0x7fa748009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecbb2328b119a82b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa743400640 1 -- 172.21.15.71:0/2696267602 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480c0490 con 0x5570f44c72f0 2024-05-27T09:52:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.535+0000 7fa743400640 1 -- 172.21.15.71:0/2696267602 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa748010720 con 0x5570f44c72f0 2024-05-27T09:52:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa743400640 1 -- 172.21.15.71:0/2696267602 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480c0680 con 0x5570f44c72f0 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 -- 172.21.15.71:0/2696267602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 msgr2=0x5570f48983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f48983a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7480a5d70 tx=0x7fa748009700 comp rx=0 tx=0).stop 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 -- 172.21.15.71:0/2696267602 shutdown_connections 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44f01b0 0x5570f48b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f489ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 --2- 172.21.15.71:0/2696267602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44c72f0 0x5570f48983a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 -- 172.21.15.71:0/2696267602 >> 172.21.15.71:0/2696267602 conn(0x5570f44e4300 msgr2=0x5570f489c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 -- 172.21.15.71:0/2696267602 shutdown_connections 2024-05-27T09:52:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.536+0000 7fa764b94740 1 -- 172.21.15.71:0/2696267602 wait complete. 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.537+0000 7fa764b94740 1 -- start start 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.537+0000 7fa764b94740 1 Processor -- start 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa764b94740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f48a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa764b94740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f48a2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa764b94740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44f01b0 0x5570f491de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa764b94740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7581b0170 con 0x5570f44c72f0 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa764b94740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa7581b15e0 con 0x5570f44cf4d0 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa764b94740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa7581b0840 con 0x5570f44f01b0 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa764b94740 10 client.0 _ll_register_callbacks cb 0x7fa744009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f48a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f48a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57964/0 (socket says 172.21.15.71:57964) 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 -- 172.21.15.71:0/93532494 learned_addr learned my addr 172.21.15.71:0/93532494 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756000640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f48a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa757400640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44f01b0 0x5570f491de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 -- 172.21.15.71:0/93532494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44f01b0 msgr2=0x5570f491de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44f01b0 0x5570f491de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 -- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 msgr2=0x5570f48a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f48a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756a00640 1 -- 172.21.15.71:0/93532494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f48a2c70 con 0x5570f44c72f0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.538+0000 7fa756000640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f48a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa756a00640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f48a1ec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa748000c00 tx=0x7fa74800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd124501c09b6bd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa740c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa740c00640 1 -- 172.21.15.71:0/93532494 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480f1040 con 0x5570f44c72f0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa740c00640 1 -- 172.21.15.71:0/93532494 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fa748010a90 con 0x5570f44c72f0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570f47ff2c0 con 0x5570f44c72f0 2024-05-27T09:52:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa740c00640 1 -- 172.21.15.71:0/93532494 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa7480bdde0 con 0x5570f44c72f0 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa764b94740 10 client.16149 fetch_fsmap learned FSMap version 28 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570f491f3a0 con 0x5570f44c72f0 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.539+0000 7fa740c00640 1 -- 172.21.15.71:0/93532494 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5570f47ff2c0 con 0x5570f44c72f0 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa740c00640 1 -- 172.21.15.71:0/93532494 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fa7480a5f80 con 0x5570f44c72f0 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa764b94740 10 client.16149 fetch_fsmap finished waiting for FSMap version 28 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa764b94740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa764b94740 20 client.16149 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa764b94740 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44841c0 0x5570f4921400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa764b94740 4 client.16149 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570f47794b0 con 0x5570f44841c0 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa756000640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44841c0 0x5570f4921400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa756000640 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44841c0 0x5570f4921400 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be890701b234dd36 server_cookie=be86983ef2d30fd5 in_seq=0 out_seq=0 2024-05-27T09:52:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.540+0000 7fa740c00640 10 client.16149 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.555+0000 7fa740c00640 1 -- 172.21.15.71:0/93532494 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5570f47794b0 con 0x5570f44841c0 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.555+0000 7fa740c00640 10 client.16149 handle_command_reply: tid=0 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.555+0000 7fa764b94740 1 client.16149 shutdown 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.555+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 msgr2=0x5570f48a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.555+0000 7fa764b94740 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f48a1ec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa748000c00 tx=0x7fa74800c7d0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 shutdown_connections 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f44f01b0 0x5570f491de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570f44cf4d0 0x5570f48a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5570f44841c0 0x5570f4921400 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 --2- 172.21.15.71:0/93532494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5570f44c72f0 0x5570f48a1ec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa740c00640 0 client.16149 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 >> 172.21.15.71:0/93532494 conn(0x5570f44e4300 msgr2=0x5570f489ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 shutdown_connections 2024-05-27T09:52:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 1 -- 172.21.15.71:0/93532494 wait complete. 2024-05-27T09:52:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.556+0000 7fa764b94740 20 client.16149 trim_cache size 0 max 16384 2024-05-27T09:52:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:52:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:52:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:52:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa73c0b2950 msgr2=0x7fa73c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa73c0b2950 0x7fa73c0b4e60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa750006010 tx=0x7fa750005d80 comp rx=0 tx=0).stop 2024-05-27T09:52:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 msgr2=0x7fa758102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 0x7fa758102510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa74800e9f0 tx=0x7fa74800eeb0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 shutdown_connections 2024-05-27T09:52:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa73c0b2950 0x7fa73c0b4e60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75810e010 0x7fa758102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75810b6b0 0x7fa758102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 --2- 172.21.15.71:0/3404848841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa758104c50 0x7fa758102510 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 >> 172.21.15.71:0/3404848841 conn(0x7fa7580fe210 msgr2=0x7fa75810e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 shutdown_connections 2024-05-27T09:52:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:35.557+0000 7fa757e00640 1 -- 172.21.15.71:0/3404848841 wait complete. 2024-05-27T09:52:36.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:52:36.788 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:52:37.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:36 smithi071 ceph-mon[31451]: pgmap v148: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-27T09:52:37.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:36 smithi072 ceph-mon[35951]: pgmap v148: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-27T09:52:37.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:36 smithi122 ceph-mon[36436]: pgmap v148: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-27T09:52:38.844 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:38 smithi071 ceph-mon[31451]: pgmap v149: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 38 KiB/s wr, 18 op/s 2024-05-27T09:52:39.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:38 smithi072 ceph-mon[35951]: pgmap v149: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 38 KiB/s wr, 18 op/s 2024-05-27T09:52:39.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:38 smithi122 ceph-mon[36436]: pgmap v149: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 38 KiB/s wr, 18 op/s 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 -- 172.21.15.71:0/1811133820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b4105450 msgr2=0x7fb2b4105860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 --2- 172.21.15.71:0/1811133820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b4105450 0x7fb2b4105860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009990 tx=0x7fb2a4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 -- 172.21.15.71:0/1811133820 shutdown_connections 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 --2- 172.21.15.71:0/1811133820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b410e8c0 0x7fb2b4110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 --2- 172.21.15.71:0/1811133820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b4105450 0x7fb2b4105860 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 --2- 172.21.15.71:0/1811133820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2b4105da0 0x7fb2b410e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 -- 172.21.15.71:0/1811133820 >> 172.21.15.71:0/1811133820 conn(0x7fb2b40fede0 msgr2=0x7fb2b4101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 -- 172.21.15.71:0/1811133820 shutdown_connections 2024-05-27T09:52:39.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.425+0000 7fb2ba800700 1 -- 172.21.15.71:0/1811133820 wait complete. 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 Processor -- start 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 -- start start 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2b4105da0 0x7fb2b419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b410e8c0 0x7fb2b419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b41a19a0 0x7fb2b41a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b41144c0 con 0x7fb2b410e8c0 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b4114340 con 0x7fb2b41a19a0 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2ba800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b4114640 con 0x7fb2b4105da0 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.427+0000 7fb2b2a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b410e8c0 0x7fb2b419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b2a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b410e8c0 0x7fb2b419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57986/0 (socket says 172.21.15.71:57986) 2024-05-27T09:52:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b2a00700 1 -- 172.21.15.71:0/4023612110 learned_addr learned my addr 172.21.15.71:0/4023612110 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2b4105da0 0x7fb2b419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3e00700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b41a19a0 0x7fb2b41a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3400700 1 -- 172.21.15.71:0/4023612110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b41a19a0 msgr2=0x7fb2b41a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3400700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b41a19a0 0x7fb2b41a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3400700 1 -- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b410e8c0 msgr2=0x7fb2b419d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3400700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b410e8c0 0x7fb2b419d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3400700 1 -- 172.21.15.71:0/4023612110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b41a24f0 con 0x7fb2b4105da0 2024-05-27T09:52:39.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b2a00700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b410e8c0 0x7fb2b419d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:39.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.428+0000 7fb2b3400700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2b4105da0 0x7fb2b419d230 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4076010 tx=0x7fb2a40057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:39.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.429+0000 7fb2abe00700 1 -- 172.21.15.71:0/4023612110 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4026070 con 0x7fb2b4105da0 2024-05-27T09:52:39.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.429+0000 7fb2abe00700 1 -- 172.21.15.71:0/4023612110 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2a4021410 con 0x7fb2b4105da0 2024-05-27T09:52:39.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.429+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b41a2780 con 0x7fb2b4105da0 2024-05-27T09:52:39.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.429+0000 7fb2abe00700 1 -- 172.21.15.71:0/4023612110 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4017650 con 0x7fb2b4105da0 2024-05-27T09:52:39.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.429+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b41a9e70 con 0x7fb2b4105da0 2024-05-27T09:52:39.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.430+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b40512b0 con 0x7fb2b4105da0 2024-05-27T09:52:39.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.433+0000 7fb2abe00700 1 -- 172.21.15.71:0/4023612110 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fb2a4029070 con 0x7fb2b4105da0 2024-05-27T09:52:39.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.435+0000 7fb2abe00700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb2980b2a70 0x7fb2980b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:39.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.435+0000 7fb2abe00700 1 -- 172.21.15.71:0/4023612110 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fb2a40e3340 con 0x7fb2b4105da0 2024-05-27T09:52:39.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.435+0000 7fb2b2a00700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb2980b2a70 0x7fb2980b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:39.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.436+0000 7fb2b2a00700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb2980b2a70 0x7fb2980b4f80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4102420 tx=0x7fb2a0009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:39.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.437+0000 7fb2abe00700 1 -- 172.21.15.71:0/4023612110 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb2a405edf0 con 0x7fb2b4105da0 2024-05-27T09:52:39.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.713+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2b41aa1a0 con 0x7fb2b4105da0 2024-05-27T09:52:39.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.714+0000 7fb2abe00700 1 -- 172.21.15.71:0/4023612110 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11856 (secure 0 0 0) 0x7fb2a4013070 con 0x7fb2b4105da0 2024-05-27T09:52:39.716 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:52:39.716 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:52:38.289193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/2510446999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":2510446999},{"type":"v1","addr":"172.21.15.71:6839","nonce":2510446999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:52:39.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb2980b2a70 msgr2=0x7fb2980b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:39.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb2980b2a70 0x7fb2980b4f80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4102420 tx=0x7fb2a0009260 comp rx=0 tx=0).stop 2024-05-27T09:52:39.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2b4105da0 msgr2=0x7fb2b419d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:39.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2b4105da0 0x7fb2b419d230 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4076010 tx=0x7fb2a40057c0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 shutdown_connections 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb2980b2a70 0x7fb2980b4f80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b41a19a0 0x7fb2b41a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2b4105da0 0x7fb2b419d230 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 --2- 172.21.15.71:0/4023612110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2b410e8c0 0x7fb2b419d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 >> 172.21.15.71:0/4023612110 conn(0x7fb2b40fede0 msgr2=0x7fb2b4100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.718+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 shutdown_connections 2024-05-27T09:52:39.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:39.719+0000 7fb2ba800700 1 -- 172.21.15.71:0/4023612110 wait complete. 2024-05-27T09:52:39.721 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 29 2024-05-27T09:52:40.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:39 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:52:40.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:39 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4023612110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:39 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:52:40.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:39 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4023612110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:40.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:39 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:52:40.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:39 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4023612110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:52:40.539 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id 6b9091a7 --release --await' 2024-05-27T09:52:40.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id 6b9091a7 --release --await 2024-05-27T09:52:40.992 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:52:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:40 smithi072 ceph-mon[35951]: pgmap v150: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-05-27T09:52:41.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:40 smithi071 ceph-mon[31451]: pgmap v150: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-05-27T09:52:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:40 smithi122 ceph-mon[36436]: pgmap v150: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-05-27T09:52:43.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:42 smithi071 ceph-mon[31451]: pgmap v151: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-05-27T09:52:43.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:42 smithi072 ceph-mon[35951]: pgmap v151: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-05-27T09:52:43.032 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:42 smithi122 ceph-mon[36436]: pgmap v151: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-05-27T09:52:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 -- 172.21.15.71:0/1284017348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec108d00 msgr2=0x7f37ec109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 --2- 172.21.15.71:0/1284017348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec108d00 0x7f37ec109110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37d80099c0 tx=0x7f37d8009cd0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 -- 172.21.15.71:0/1284017348 shutdown_connections 2024-05-27T09:52:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 --2- 172.21.15.71:0/1284017348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec109650 0x7f37ec110fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 --2- 172.21.15.71:0/1284017348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104420 0x7f37ec104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 --2- 172.21.15.71:0/1284017348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec108d00 0x7f37ec109110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 -- 172.21.15.71:0/1284017348 >> 172.21.15.71:0/1284017348 conn(0x7f37ec0ffe10 msgr2=0x7f37ec102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 -- 172.21.15.71:0/1284017348 shutdown_connections 2024-05-27T09:52:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.281+0000 7f37ebe00700 1 -- 172.21.15.71:0/1284017348 wait complete. 2024-05-27T09:52:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.282+0000 7f37ebe00700 1 Processor -- start 2024-05-27T09:52:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.282+0000 7f37ebe00700 1 -- start start 2024-05-27T09:52:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec104420 0x7f37ec19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ebe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec108d00 0x7f37ec19d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ebe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec109650 0x7f37ec1a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ebe00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1142b0 con 0x7f37ec108d00 2024-05-27T09:52:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ebe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec114130 con 0x7f37ec104420 2024-05-27T09:52:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ebe00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec114430 con 0x7f37ec109650 2024-05-27T09:52:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec108d00 0x7f37ec19d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec104420 0x7f37ec19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37eb400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec109650 0x7f37ec1a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec108d00 0x7f37ec19d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58004/0 (socket says 172.21.15.71:58004) 2024-05-27T09:52:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec104420 0x7f37ec19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53292/0 (socket says 172.21.15.71:53292) 2024-05-27T09:52:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37ea000700 1 -- 172.21.15.71:0/3495874800 learned_addr learned my addr 172.21.15.71:0/3495874800 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37eb400700 1 -- 172.21.15.71:0/3495874800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec104420 msgr2=0x7f37ec19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.283+0000 7f37eb400700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec104420 0x7f37ec19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37eb400700 1 -- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec108d00 msgr2=0x7f37ec19d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37eb400700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec108d00 0x7f37ec19d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37eb400700 1 -- 172.21.15.71:0/3495874800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec1a1d90 con 0x7f37ec109650 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37eaa00700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec104420 0x7f37ec19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37eb400700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec109650 0x7f37ec1a16f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37e400efc0 tx=0x7f37e400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37e3400700 1 -- 172.21.15.71:0/3495874800 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e40092e0 con 0x7f37ec109650 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec1a2020 con 0x7f37ec109650 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37e3400700 1 -- 172.21.15.71:0/3495874800 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37e4004bb0 con 0x7f37ec109650 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37e3400700 1 -- 172.21.15.71:0/3495874800 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4004020 con 0x7f37ec109650 2024-05-27T09:52:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.284+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec1a2510 con 0x7f37ec109650 2024-05-27T09:52:43.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.288+0000 7f37e3400700 1 -- 172.21.15.71:0/3495874800 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f37e401b030 con 0x7f37ec109650 2024-05-27T09:52:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.289+0000 7f38001e2b80 1 Processor -- start 2024-05-27T09:52:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.289+0000 7f38001e2b80 1 -- start start 2024-05-27T09:52:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37e3400700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37d00b29f0 0x7f37d00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5d45af0 0x55d2f5dd8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37e3400700 1 -- 172.21.15.71:0/3495874800 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f37e40e20b0 con 0x7f37ec109650 2024-05-27T09:52:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5de3840 0x55d2f5de5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f38001e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d2f5d06f40 con 0x55d2f5c59f40 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f38001e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d2f5cf6ae0 con 0x55d2f5d45af0 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f38001e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d2f5cfab20 con 0x55d2f5de3840 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37ea000700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37d00b29f0 0x7f37d00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5d45af0 0x55d2f5dd8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5d45af0 0x55d2f5dd8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53308/0 (socket says 172.21.15.71:53308) 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37eaa00700 1 -- 172.21.15.71:0/3591878267 learned_addr learned my addr 172.21.15.71:0/3591878267 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37eb400700 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5de3840 0x55d2f5de5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.290+0000 7f37ea000700 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37eb400700 1 -- 172.21.15.71:0/3591878267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5d45af0 msgr2=0x55d2f5dd8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37eb400700 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5d45af0 0x55d2f5dd8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37eb400700 1 -- 172.21.15.71:0/3591878267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5c59f40 msgr2=0x55d2f5dd9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37eb400700 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37eb400700 1 -- 172.21.15.71:0/3591878267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2f5cbf520 con 0x55d2f5de3840 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37eb400700 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5de3840 0x55d2f5de5c60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f37e40df7d0 tx=0x7f37e4004d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a5a935f7799db62 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37ea000700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37d00b29f0 0x7f37d00b4f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009750 tx=0x7f37d80058e0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.291+0000 7f37d7e00700 1 -- 172.21.15.71:0/3591878267 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e40a93f0 con 0x55d2f5de3840 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.292+0000 7f37d7e00700 1 -- 172.21.15.71:0/3591878267 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37e40ad7a0 con 0x55d2f5de3840 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.292+0000 7f37d7e00700 1 -- 172.21.15.71:0/3591878267 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e40a3d10 con 0x55d2f5de3840 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 -- 172.21.15.71:0/3591878267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5de3840 msgr2=0x55d2f5de5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5de3840 0x55d2f5de5c60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f37e40df7d0 tx=0x7f37e4004d60 comp rx=0 tx=0).stop 2024-05-27T09:52:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 -- 172.21.15.71:0/3591878267 shutdown_connections 2024-05-27T09:52:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5de3840 0x55d2f5de5c60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5d45af0 0x55d2f5dd8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 --2- 172.21.15.71:0/3591878267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 -- 172.21.15.71:0/3591878267 >> 172.21.15.71:0/3591878267 conn(0x55d2f5cf3490 msgr2=0x55d2f5dd4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 -- 172.21.15.71:0/3591878267 shutdown_connections 2024-05-27T09:52:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.293+0000 7f38001e2b80 1 -- 172.21.15.71:0/3591878267 wait complete. 2024-05-27T09:52:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 -- start start 2024-05-27T09:52:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 Processor -- start 2024-05-27T09:52:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5de07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5de0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d2f5bfd0a0 con 0x55d2f5d45af0 2024-05-27T09:52:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d2f5c97860 con 0x55d2f5de3840 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.294+0000 7f38001e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d2f5de6350 con 0x55d2f5c59f40 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f38001e2b80 10 client.0 _ll_register_callbacks cb 0x55d2f5ca0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5de07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5de0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5de07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42636/0 (socket says 172.21.15.71:42636) 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5de0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58032/0 (socket says 172.21.15.71:58032) 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 -- 172.21.15.71:0/2086621010 learned_addr learned my addr 172.21.15.71:0/2086621010 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eb400700 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 -- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 msgr2=0x55d2f5de1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 -- 172.21.15.71:0/2086621010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 msgr2=0x55d2f5de0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5de0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eaa00700 1 -- 172.21.15.71:0/2086621010 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2f5c469d0 con 0x55d2f5c59f40 2024-05-27T09:52:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.295+0000 7f37eb400700 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f37eaa00700 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5de07b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37dc012d20 tx=0x7f37dc00f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc1ce8fa6b96fa2e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f37d4c00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:52:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f37d4c00700 1 -- 172.21.15.71:0/2086621010 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00fb80 con 0x55d2f5c59f40 2024-05-27T09:52:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f37d4c00700 1 -- 172.21.15.71:0/2086621010 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f37dc00fd20 con 0x55d2f5c59f40 2024-05-27T09:52:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37e40ad7a0 con 0x55d2f5c59f40 2024-05-27T09:52:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f37d4c00700 1 -- 172.21.15.71:0/2086621010 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f37dc004050 con 0x55d2f5c59f40 2024-05-27T09:52:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f38001e2b80 10 client.26335 fetch_fsmap learned FSMap version 29 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.296+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2f5cc7160 con 0x55d2f5c59f40 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f37d4c00700 1 -- 172.21.15.71:0/2086621010 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37e40ad7a0 con 0x55d2f5c59f40 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f37d4c00700 1 -- 172.21.15.71:0/2086621010 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8342+0+0 (secure 0 0 0) 0x7f37dc010430 con 0x55d2f5c59f40 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f38001e2b80 10 client.26335 fetch_fsmap finished waiting for FSMap version 29 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f38001e2b80 10 client.26335 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f38001e2b80 20 client.26335 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5df3310 0x55d2f5df5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f38001e2b80 4 client.26335 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2f5d08e90 con 0x55d2f5df3310 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.297+0000 7f37ea000700 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5df3310 0x55d2f5df5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.298+0000 7f37ea000700 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5df3310 0x55d2f5df5790 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7816316c11e3312 server_cookie=f63f6caca2f57e16 in_seq=0 out_seq=0 2024-05-27T09:52:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.298+0000 7f37d4c00700 10 client.26335 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f37d4c00700 1 -- 172.21.15.71:0/2086621010 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d2f5d08e90 con 0x55d2f5df3310 2024-05-27T09:52:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f37d4c00700 10 client.26335 handle_command_reply: tid=0 2024-05-27T09:52:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 client.26335 shutdown 2024-05-27T09:52:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 msgr2=0x55d2f5de07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5de07b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37dc012d20 tx=0x7f37dc00f6a0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 shutdown_connections 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5df3310 0x55d2f5df5790 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5de07b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f37d4c00700 0 client.26335 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2086621010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5de0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 >> 172.21.15.71:0/2086621010 conn(0x55d2f5cf3490 msgr2=0x55d2f5dd8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 shutdown_connections 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.299+0000 7f38001e2b80 1 -- 172.21.15.71:0/2086621010 wait complete. 2024-05-27T09:52:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.300+0000 7f38001e2b80 20 client.26335 trim_cache size 0 max 16384 2024-05-27T09:52:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.321+0000 7f38001e2b80 1 Processor -- start 2024-05-27T09:52:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.321+0000 7f38001e2b80 1 -- start start 2024-05-27T09:52:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5def3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f38001e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1b36d0 con 0x55d2f5d45af0 2024-05-27T09:52:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f38001e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1b0f60 con 0x55d2f5de3840 2024-05-27T09:52:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f38001e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1aedb0 con 0x55d2f5c59f40 2024-05-27T09:52:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5def3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5def3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58036/0 (socket says 172.21.15.71:58036) 2024-05-27T09:52:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f37ea000700 1 -- 172.21.15.71:0/533256926 learned_addr learned my addr 172.21.15.71:0/533256926 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f37eb400700 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.322+0000 7f37eaa00700 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37ea000700 1 -- 172.21.15.71:0/533256926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 msgr2=0x55d2f5dd8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37ea000700 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37ea000700 1 -- 172.21.15.71:0/533256926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 msgr2=0x55d2f5de4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37ea000700 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37ea000700 1 -- 172.21.15.71:0/533256926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2f5de15a0 con 0x55d2f5d45af0 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37eb400700 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37ea000700 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5def3f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f37d8003760 tx=0x7f37d8005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed48a92dc596f52e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.323+0000 7f37d7400700 1 -- 172.21.15.71:0/533256926 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d800b790 con 0x55d2f5d45af0 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.324+0000 7f37d7400700 1 -- 172.21.15.71:0/533256926 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d800bde0 con 0x55d2f5d45af0 2024-05-27T09:52:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.324+0000 7f37d7400700 1 -- 172.21.15.71:0/533256926 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8029440 con 0x55d2f5d45af0 2024-05-27T09:52:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 -- 172.21.15.71:0/533256926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 msgr2=0x55d2f5def3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5def3f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f37d8003760 tx=0x7f37d8005fb0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 -- 172.21.15.71:0/533256926 shutdown_connections 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5de4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5dd8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 --2- 172.21.15.71:0/533256926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5def3f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 -- 172.21.15.71:0/533256926 >> 172.21.15.71:0/533256926 conn(0x55d2f5cf3490 msgr2=0x55d2f5ddf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 -- 172.21.15.71:0/533256926 shutdown_connections 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.325+0000 7f38001e2b80 1 -- 172.21.15.71:0/533256926 wait complete. 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 -- start start 2024-05-27T09:52:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 Processor -- start 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5debe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5ddb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5ddb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1af420 con 0x55d2f5d45af0 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1b0890 con 0x55d2f5de3840 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.326+0000 7f38001e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1afaf0 con 0x55d2f5c59f40 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f38001e2b80 10 client.0 _ll_register_callbacks cb 0x55d2f5ca0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5ddb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5debe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5ddb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58040/0 (socket says 172.21.15.71:58040) 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37eaa00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5debe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:42650/0 (socket says 172.21.15.71:42650) 2024-05-27T09:52:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 -- 172.21.15.71:0/2396907497 learned_addr learned my addr 172.21.15.71:0/2396907497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37eb400700 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5ddb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 -- 172.21.15.71:0/2396907497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 msgr2=0x55d2f5debe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5debe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 -- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 msgr2=0x55d2f5ddb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5ddb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.327+0000 7f37ea000700 1 -- 172.21.15.71:0/2396907497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2f5ddc000 con 0x55d2f5d45af0 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f37ea000700 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5ddb1e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c010 tx=0x7f37d8033bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800037d19ca2a5e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f37d4c00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f37d4c00700 1 -- 172.21.15.71:0/2396907497 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8041060 con 0x55d2f5d45af0 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f37d4c00700 1 -- 172.21.15.71:0/2396907497 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f37d80335d0 con 0x55d2f5d45af0 2024-05-27T09:52:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d800bde0 con 0x55d2f5d45af0 2024-05-27T09:52:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f37d4c00700 1 -- 172.21.15.71:0/2396907497 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f37d80337d0 con 0x55d2f5d45af0 2024-05-27T09:52:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f38001e2b80 10 client.16173 fetch_fsmap learned FSMap version 29 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.328+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2f5e5dee0 con 0x55d2f5d45af0 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f37d4c00700 1 -- 172.21.15.71:0/2396907497 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d800bde0 con 0x55d2f5d45af0 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f37d4c00700 1 -- 172.21.15.71:0/2396907497 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8342+0+0 (secure 0 0 0) 0x7f37d80299a0 con 0x55d2f5d45af0 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f38001e2b80 10 client.16173 fetch_fsmap finished waiting for FSMap version 29 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f38001e2b80 10 client.16173 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f38001e2b80 20 client.16173 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5e5e500 0x55d2f5e60920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f38001e2b80 4 client.16173 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6b9091a7", "release": true, "await": true}] 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6b9091a7", "release": true, "await": true}) -- 0x55d2f5d02670 con 0x55d2f5e5e500 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.329+0000 7f37eaa00700 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5e5e500 0x55d2f5e60920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.330+0000 7f37eaa00700 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5e5e500 0x55d2f5e60920 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeae09480d13961 server_cookie=4619a79ae42fd0a9 in_seq=0 out_seq=0 2024-05-27T09:52:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.330+0000 7f37d4c00700 10 client.16173 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:43.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.574+0000 7f37d4c00700 1 -- 172.21.15.71:0/2396907497 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d2f5d02670 con 0x55d2f5e5e500 2024-05-27T09:52:43.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.574+0000 7f37d4c00700 10 client.16173 handle_command_reply: tid=0 2024-05-27T09:52:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.574+0000 7f38001e2b80 1 client.16173 shutdown 2024-05-27T09:52:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.575+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 msgr2=0x55d2f5ddb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.575+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5ddb1e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c010 tx=0x7f37d8033bb0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.576+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 shutdown_connections 2024-05-27T09:52:43.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.576+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d2f5e5e500 0x55d2f5e60920 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.577+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2f5de3840 0x55d2f5ddb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.577+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2f5c59f40 0x55d2f5debe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.577+0000 7f38001e2b80 1 --2- 172.21.15.71:0/2396907497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2f5d45af0 0x55d2f5ddb1e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.577+0000 7f37d4c00700 0 client.16173 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:43.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.577+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 >> 172.21.15.71:0/2396907497 conn(0x55d2f5cf3490 msgr2=0x55d2f5de0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.577+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 shutdown_connections 2024-05-27T09:52:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.577+0000 7f38001e2b80 1 -- 172.21.15.71:0/2396907497 wait complete. 2024-05-27T09:52:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.578+0000 7f38001e2b80 20 client.16173 trim_cache size 0 max 16384 2024-05-27T09:52:43.580 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:52:43.580 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 29, 2024-05-27T09:52:43.580 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:52:43.580 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 16, 2024-05-27T09:52:43.580 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "6b9091a7": { 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 16, 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 150.0, 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:52:43.581 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:52:43.582 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37d00b29f0 msgr2=0x7f37d00b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37d00b29f0 0x7f37d00b4f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009750 tx=0x7f37d80058e0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec109650 msgr2=0x7f37ec1a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec109650 0x7f37ec1a16f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37e400efc0 tx=0x7f37e400c3a0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 shutdown_connections 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37d00b29f0 0x7f37d00b4f00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ec109650 0x7f37ec1a16f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37ec104420 0x7f37ec19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 --2- 172.21.15.71:0/3495874800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec108d00 0x7f37ec19d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 >> 172.21.15.71:0/3495874800 conn(0x7f37ec0ffe10 msgr2=0x7f37ec110ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 shutdown_connections 2024-05-27T09:52:43.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:52:43.580+0000 7f37ebe00700 1 -- 172.21.15.71:0/3495874800 wait complete. 2024-05-27T09:52:43.608 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xff038 2024-05-27T09:52:44.465 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6b9091a7', total seconds elapsed: 38.1 2024-05-27T09:52:45.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:44 smithi072 ceph-mon[35951]: pgmap v152: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-27T09:52:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:44 smithi122 ceph-mon[36436]: pgmap v152: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-27T09:52:45.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:44 smithi071 ceph-mon[31451]: pgmap v152: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-27T09:52:45.536 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0xffcac 2024-05-27T09:52:45.826 INFO:tasks.workunit.client.0.smithi071.stdout:10000 copy from 0x2d237 to 0x30552, (0x331b bytes) at 0x82aed 2024-05-27T09:52:47.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:46 smithi122 ceph-mon[36436]: pgmap v153: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-27T09:52:47.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:46 smithi071 ceph-mon[31451]: pgmap v153: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-27T09:52:47.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:46 smithi072 ceph-mon[35951]: pgmap v153: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-27T09:52:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.815+0000 7f55cac00640 1 -- 172.21.15.71:0/773304328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4104200 msgr2=0x7f55c41105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.815+0000 7f55cac00640 1 --2- 172.21.15.71:0/773304328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4104200 0x7f55c41105d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009ca0 tx=0x7f55bc02a8c0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.815+0000 7f55cac00640 1 -- 172.21.15.71:0/773304328 shutdown_connections 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.815+0000 7f55cac00640 1 --2- 172.21.15.71:0/773304328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4104200 0x7f55c41105d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.815+0000 7f55cac00640 1 --2- 172.21.15.71:0/773304328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c4109f50 0x7f55c4103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.815+0000 7f55cac00640 1 --2- 172.21.15.71:0/773304328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4109ab0 0x7f55c4103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.815+0000 7f55cac00640 1 -- 172.21.15.71:0/773304328 >> 172.21.15.71:0/773304328 conn(0x7f55c4079140 msgr2=0x7f55c4079580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.816+0000 7f55cac00640 1 -- 172.21.15.71:0/773304328 shutdown_connections 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.816+0000 7f55cac00640 1 -- 172.21.15.71:0/773304328 wait complete. 2024-05-27T09:52:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.817+0000 7f55cac00640 1 Processor -- start 2024-05-27T09:52:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.817+0000 7f55cac00640 1 -- start start 2024-05-27T09:52:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55cac00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4104200 0x7f55c41a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55cac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c4109ab0 0x7f55c41a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55cac00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4109f50 0x7f55c419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55cac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4113cf0 con 0x7f55c4109ab0 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55cac00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4113b70 con 0x7f55c4109f50 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55cac00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4113e70 con 0x7f55c4104200 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55c9800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4104200 0x7f55c41a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55c9800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4104200 0x7f55c41a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53108/0 (socket says 172.21.15.71:53108) 2024-05-27T09:52:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55c9800640 1 -- 172.21.15.71:0/2533518758 learned_addr learned my addr 172.21.15.71:0/2533518758 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.818+0000 7f55c8e00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c4109ab0 0x7f55c41a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55c9800640 1 -- 172.21.15.71:0/2533518758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4109f50 msgr2=0x7f55c419c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55ca200640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4109f50 0x7f55c419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55c9800640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4109f50 0x7f55c419c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55c9800640 1 -- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c4109ab0 msgr2=0x7f55c41a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55c9800640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c4109ab0 0x7f55c41a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55c9800640 1 -- 172.21.15.71:0/2533518758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c419ce80 con 0x7f55c4104200 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55ca200640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4109f50 0x7f55c419c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55c8e00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c4109ab0 0x7f55c41a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.819+0000 7f55c9800640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4104200 0x7f55c41a25d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f55b800e9c0 tx=0x7f55b800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.820+0000 7f55c2000640 1 -- 172.21.15.71:0/2533518758 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b800cd80 con 0x7f55c4104200 2024-05-27T09:52:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.820+0000 7f55c2000640 1 -- 172.21.15.71:0/2533518758 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55b80054d0 con 0x7f55c4104200 2024-05-27T09:52:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.820+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c419d110 con 0x7f55c4104200 2024-05-27T09:52:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.820+0000 7f55c2000640 1 -- 172.21.15.71:0/2533518758 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8010430 con 0x7f55c4104200 2024-05-27T09:52:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.820+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c41a9370 con 0x7f55c4104200 2024-05-27T09:52:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55c2000640 1 -- 172.21.15.71:0/2533518758 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f55b8004fd0 con 0x7f55c4104200 2024-05-27T09:52:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55d31bb740 1 Processor -- start 2024-05-27T09:52:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55d31bb740 1 -- start start 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcde1b0 0x561e50080a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcb52f0 0x561e50080fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e500814e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55d31bb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561e4fff1b90 con 0x561e4fcde1b0 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.824+0000 7f55d31bb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561e4ffe1730 con 0x561e4fcb52f0 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55d31bb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561e4ffe5770 con 0x561e4fcbd4d0 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c9800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcb52f0 0x561e50080fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e500814e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55ca200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcde1b0 0x561e50080a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e500814e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53118/0 (socket says 172.21.15.71:53118) 2024-05-27T09:52:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c9800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcb52f0 0x561e50080fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56918/0 (socket says 172.21.15.71:56918) 2024-05-27T09:52:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 -- 172.21.15.71:0/129924335 learned_addr learned my addr 172.21.15.71:0/129924335 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 -- 172.21.15.71:0/129924335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcb52f0 msgr2=0x561e50080fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcb52f0 0x561e50080fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 -- 172.21.15.71:0/129924335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcde1b0 msgr2=0x561e50080a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcde1b0 0x561e50080a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c8e00640 1 -- 172.21.15.71:0/129924335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e4ff7a8b0 con 0x561e4fcbd4d0 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.825+0000 7f55c9800640 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcb52f0 0x561e50080fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.826+0000 7f55c8e00640 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e500814e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009f50 tx=0x7f55b00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71468717d5861160 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.826+0000 7f55b6a00640 1 -- 172.21.15.71:0/129924335 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0004310 con 0x561e4fcbd4d0 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.826+0000 7f55c2000640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f55ac0b29d0 0x7f55ac0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.826+0000 7f55b6a00640 1 -- 172.21.15.71:0/129924335 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55b00044b0 con 0x561e4fcbd4d0 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.826+0000 7f55b6a00640 1 -- 172.21.15.71:0/129924335 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00035f0 con 0x561e4fcbd4d0 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.826+0000 7f55c2000640 1 -- 172.21.15.71:0/2533518758 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f55b80e29f0 con 0x7f55c4104200 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.826+0000 7f55ca200640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f55ac0b29d0 0x7f55ac0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55ca200640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f55ac0b29d0 0x7f55ac0b4ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55bc006010 tx=0x7f55bc004a40 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 -- 172.21.15.71:0/129924335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 msgr2=0x561e500814e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e500814e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009f50 tx=0x7f55b00118d0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 -- 172.21.15.71:0/129924335 shutdown_connections 2024-05-27T09:52:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e500814e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcb52f0 0x561e50080fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 --2- 172.21.15.71:0/129924335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcde1b0 0x561e50080a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 -- 172.21.15.71:0/129924335 >> 172.21.15.71:0/129924335 conn(0x561e4fcd2300 msgr2=0x561e5007d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 -- 172.21.15.71:0/129924335 shutdown_connections 2024-05-27T09:52:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.827+0000 7f55d31bb740 1 -- 172.21.15.71:0/129924335 wait complete. 2024-05-27T09:52:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.828+0000 7f55d31bb740 1 -- start start 2024-05-27T09:52:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.828+0000 7f55d31bb740 1 Processor -- start 2024-05-27T09:52:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcb52f0 0x561e5008abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcbd4d0 0x561e5008b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50096ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55d31bb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561e4fcc7790 con 0x561e4fcbd4d0 2024-05-27T09:52:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55d31bb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561e4ff89bc0 con 0x561e4fcde1b0 2024-05-27T09:52:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55d31bb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561e5008db90 con 0x561e4fcb52f0 2024-05-27T09:52:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55d31bb740 10 client.0 _ll_register_callbacks cb 0x561e4ff67400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55c9800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcb52f0 0x561e5008abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55c9800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcb52f0 0x561e5008abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53120/0 (socket says 172.21.15.71:53120) 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55c9800640 1 -- 172.21.15.71:0/971945118 learned_addr learned my addr 172.21.15.71:0/971945118 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.829+0000 7f55ca200640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50096ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c9800640 1 -- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 msgr2=0x561e50096ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c9800640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50096ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c8e00640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcbd4d0 0x561e5008b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c9800640 1 -- 172.21.15.71:0/971945118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcbd4d0 msgr2=0x561e5008b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c9800640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcbd4d0 0x561e5008b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c9800640 1 -- 172.21.15.71:0/971945118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e4fcf6210 con 0x561e4fcb52f0 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c8e00640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcbd4d0 0x561e5008b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55c9800640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcb52f0 0x561e5008abb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55b80a6f70 tx=0x7f55b80048b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41e6ca192622806c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55ab400640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:52:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55ab400640 1 -- 172.21.15.71:0/971945118 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b80a9650 con 0x561e4fcb52f0 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55ab400640 1 -- 172.21.15.71:0/971945118 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f55b80b26d0 con 0x561e4fcb52f0 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.830+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b00044b0 con 0x561e4fcb52f0 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55ab400640 1 -- 172.21.15.71:0/971945118 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55b80e0600 con 0x561e4fcb52f0 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 10 client.26353 fetch_fsmap learned FSMap version 29 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e4fdc2620 con 0x561e4fcb52f0 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55ab400640 1 -- 172.21.15.71:0/971945118 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55b00044b0 con 0x561e4fcb52f0 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55ab400640 1 -- 172.21.15.71:0/971945118 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8342+0+0 (secure 0 0 0) 0x7f55b80a5670 con 0x561e4fcb52f0 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 10 client.26353 fetch_fsmap finished waiting for FSMap version 29 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 10 client.26353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 20 client.26353 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc9cd80 0x561e5009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 4 client.26353 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.831+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e4fff3ae0 con 0x561e4fc9cd80 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55c8e00640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc9cd80 0x561e5009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55c8e00640 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc9cd80 0x561e5009cea0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1174496b8d319c6 server_cookie=3c255854feffc890 in_seq=0 out_seq=0 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55ab400640 10 client.26353 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55ab400640 1 -- 172.21.15.71:0/971945118 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x561e4fff3ae0 con 0x561e4fc9cd80 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55ab400640 10 client.26353 handle_command_reply: tid=0 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55d31bb740 1 client.26353 shutdown 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcb52f0 msgr2=0x561e5008abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.833+0000 7f55d31bb740 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcb52f0 0x561e5008abb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55b80a6f70 tx=0x7f55b80048b0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 shutdown_connections 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50096ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc9cd80 0x561e5009cea0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcbd4d0 0x561e5008b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 --2- 172.21.15.71:0/971945118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcb52f0 0x561e5008abb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55ab400640 0 client.26353 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 >> 172.21.15.71:0/971945118 conn(0x561e4fcd2300 msgr2=0x561e50082780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 shutdown_connections 2024-05-27T09:52:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 1 -- 172.21.15.71:0/971945118 wait complete. 2024-05-27T09:52:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.834+0000 7f55d31bb740 20 client.26353 trim_cache size 0 max 16384 2024-05-27T09:52:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.854+0000 7f55d31bb740 1 Processor -- start 2024-05-27T09:52:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55d31bb740 1 -- start start 2024-05-27T09:52:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e50096c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50097170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55d31bb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41b4400 con 0x561e4fcb52f0 2024-05-27T09:52:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55d31bb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41b1cd0 con 0x561e4fcde1b0 2024-05-27T09:52:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55d31bb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41afb20 con 0x561e4fcbd4d0 2024-05-27T09:52:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.855+0000 7f55c8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e50096c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e50096c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53128/0 (socket says 172.21.15.71:53128) 2024-05-27T09:52:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55ca200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 -- 172.21.15.71:0/1044163178 learned_addr learned my addr 172.21.15.71:0/1044163178 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c9800640 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 -- 172.21.15.71:0/1044163178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 msgr2=0x561e50097170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50097170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 -- 172.21.15.71:0/1044163178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 msgr2=0x561e5008cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 -- 172.21.15.71:0/1044163178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e50089100 con 0x561e4fcbd4d0 2024-05-27T09:52:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.856+0000 7f55c8e00640 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e50096c30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55b001b040 tx=0x7f55b0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca5d51e73fe641d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.857+0000 7f55b6000640 1 -- 172.21.15.71:0/1044163178 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0032070 con 0x561e4fcbd4d0 2024-05-27T09:52:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.857+0000 7f55b6000640 1 -- 172.21.15.71:0/1044163178 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55b00035f0 con 0x561e4fcbd4d0 2024-05-27T09:52:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.857+0000 7f55b6000640 1 -- 172.21.15.71:0/1044163178 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0004e90 con 0x561e4fcbd4d0 2024-05-27T09:52:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 -- 172.21.15.71:0/1044163178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 msgr2=0x561e50096c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e50096c30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55b001b040 tx=0x7f55b0000bc0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 -- 172.21.15.71:0/1044163178 shutdown_connections 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcde1b0 0x561e50097170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcbd4d0 0x561e50096c30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 --2- 172.21.15.71:0/1044163178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 -- 172.21.15.71:0/1044163178 >> 172.21.15.71:0/1044163178 conn(0x561e4fcd2300 msgr2=0x561e5008ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 -- 172.21.15.71:0/1044163178 shutdown_connections 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.858+0000 7f55d31bb740 1 -- 172.21.15.71:0/1044163178 wait complete. 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 -- start start 2024-05-27T09:52:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 Processor -- start 2024-05-27T09:52:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcbd4d0 0x561e5008ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcde1b0 0x561e500fd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41b0190 con 0x561e4fcb52f0 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41b1600 con 0x561e4fcbd4d0 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41b0860 con 0x561e4fcde1b0 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.859+0000 7f55d31bb740 10 client.0 _ll_register_callbacks cb 0x7f55b800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcbd4d0 0x561e5008ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c9800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcbd4d0 0x561e5008ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56942/0 (socket says 172.21.15.71:56942) 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 -- 172.21.15.71:0/6974815 learned_addr learned my addr 172.21.15.71:0/6974815 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55ca200640 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcde1b0 0x561e500fd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 -- 172.21.15.71:0/6974815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcde1b0 msgr2=0x561e500fd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcde1b0 0x561e500fd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 -- 172.21.15.71:0/6974815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 msgr2=0x561e5008e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:52:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 -- 172.21.15.71:0/6974815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e500fdb70 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55c8e00640 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcbd4d0 0x561e5008ec70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006010 tx=0x7f55b0004220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f561ed320e57a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.860+0000 7f55ab400640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55ab400640 1 -- 172.21.15.71:0/6974815 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0032040 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b00035f0 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55ab400640 1 -- 172.21.15.71:0/6974815 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f55b00045a0 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55ab400640 1 -- 172.21.15.71:0/6974815 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55b0045050 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55d31bb740 10 client.26327 fetch_fsmap learned FSMap version 29 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e50104f30 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55ab400640 1 -- 172.21.15.71:0/6974815 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55b00035f0 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55ab400640 1 -- 172.21.15.71:0/6974815 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 29) ==== 8342+0+0 (secure 0 0 0) 0x7f55b0035050 con 0x561e4fcbd4d0 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55d31bb740 10 client.26327 fetch_fsmap finished waiting for FSMap version 29 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55d31bb740 10 client.26327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:52:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55d31bb740 20 client.26327 populate_metadata read hostname 'smithi071' 2024-05-27T09:52:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.861+0000 7f55d31bb740 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc721c0 0x561e50105480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:52:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.862+0000 7f55d31bb740 4 client.26327 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:52:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.862+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e4ffed2c0 con 0x561e4fc721c0 2024-05-27T09:52:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.862+0000 7f55c9800640 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc721c0 0x561e50105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:52:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.862+0000 7f55ab400640 10 client.26327 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.862+0000 7f55c9800640 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc721c0 0x561e50105480 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f09d8178282aaf server_cookie=65edf9c03d99224c in_seq=0 out_seq=0 2024-05-27T09:52:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55ab400640 1 -- 172.21.15.71:0/6974815 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561e4ffed2c0 con 0x561e4fc721c0 2024-05-27T09:52:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55ab400640 10 client.26327 handle_command_reply: tid=0 2024-05-27T09:52:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 client.26327 shutdown 2024-05-27T09:52:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcbd4d0 msgr2=0x561e5008ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcbd4d0 0x561e5008ec70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006010 tx=0x7f55b0004220 comp rx=0 tx=0).stop 2024-05-27T09:52:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 shutdown_connections 2024-05-27T09:52:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561e4fcde1b0 0x561e500fd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561e4fcbd4d0 0x561e5008ec70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561e4fc721c0 0x561e50105480 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 --2- 172.21.15.71:0/6974815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e4fcb52f0 0x561e5008e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55ab400640 0 client.26327 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:52:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.874+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 >> 172.21.15.71:0/6974815 conn(0x561e4fcd2300 msgr2=0x561e5008ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.875+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 shutdown_connections 2024-05-27T09:52:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.875+0000 7f55d31bb740 1 -- 172.21.15.71:0/6974815 wait complete. 2024-05-27T09:52:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.875+0000 7f55d31bb740 20 client.26327 trim_cache size 0 max 16384 2024-05-27T09:52:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:52:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:52:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f55ac0b29d0 msgr2=0x7f55ac0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f55ac0b29d0 0x7f55ac0b4ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55bc006010 tx=0x7f55bc004a40 comp rx=0 tx=0).stop 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4104200 msgr2=0x7f55c41a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4104200 0x7f55c41a25d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f55b800e9c0 tx=0x7f55b800ee80 comp rx=0 tx=0).stop 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 shutdown_connections 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f55ac0b29d0 0x7f55ac0b4ee0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c4109f50 0x7f55c419c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c4109ab0 0x7f55c41a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 --2- 172.21.15.71:0/2533518758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55c4104200 0x7f55c41a25d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:52:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.876+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 >> 172.21.15.71:0/2533518758 conn(0x7f55c4079140 msgr2=0x7f55c40768b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:52:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.877+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 shutdown_connections 2024-05-27T09:52:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:52:48.877+0000 7f55cac00640 1 -- 172.21.15.71:0/2533518758 wait complete. 2024-05-27T09:52:49.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:48 smithi122 ceph-mon[36436]: pgmap v154: 97 pgs: 97 active+clean; 37 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 607 KiB/s wr, 96 op/s 2024-05-27T09:52:49.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:48 smithi071 ceph-mon[31451]: pgmap v154: 97 pgs: 97 active+clean; 37 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 607 KiB/s wr, 96 op/s 2024-05-27T09:52:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:48 smithi072 ceph-mon[35951]: pgmap v154: 97 pgs: 97 active+clean; 37 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 607 KiB/s wr, 96 op/s 2024-05-27T09:52:51.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:50 smithi122 ceph-mon[36436]: pgmap v155: 97 pgs: 97 active+clean; 37 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 580 KiB/s wr, 89 op/s 2024-05-27T09:52:51.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:50 smithi071 ceph-mon[31451]: pgmap v155: 97 pgs: 97 active+clean; 37 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 580 KiB/s wr, 89 op/s 2024-05-27T09:52:51.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:50 smithi072 ceph-mon[35951]: pgmap v155: 97 pgs: 97 active+clean; 37 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 580 KiB/s wr, 89 op/s 2024-05-27T09:52:53.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:52 smithi122 ceph-mon[36436]: pgmap v156: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-05-27T09:52:53.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:52 smithi071 ceph-mon[31451]: pgmap v156: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-05-27T09:52:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:52 smithi072 ceph-mon[35951]: pgmap v156: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-05-27T09:52:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:54 smithi122 ceph-mon[36436]: pgmap v157: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-05-27T09:52:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:54 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:52:55.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:54 smithi071 ceph-mon[31451]: pgmap v157: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-05-27T09:52:55.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:54 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:52:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:54 smithi072 ceph-mon[35951]: pgmap v157: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-05-27T09:52:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:54 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:52:57.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:56 smithi122 ceph-mon[36436]: pgmap v158: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-05-27T09:52:57.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:56 smithi071 ceph-mon[31451]: pgmap v158: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-05-27T09:52:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:56 smithi072 ceph-mon[35951]: pgmap v158: 97 pgs: 97 active+clean; 35 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-05-27T09:52:58.178 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:52:57 smithi072 ceph-mon[35951]: pgmap v159: 97 pgs: 97 active+clean; 36 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 314 op/s 2024-05-27T09:52:58.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:52:57 smithi122 ceph-mon[36436]: pgmap v159: 97 pgs: 97 active+clean; 36 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 314 op/s 2024-05-27T09:52:58.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:52:57 smithi071 ceph-mon[31451]: pgmap v159: 97 pgs: 97 active+clean; 36 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 314 op/s 2024-05-27T09:53:00.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:00 smithi122 ceph-mon[36436]: pgmap v160: 97 pgs: 97 active+clean; 36 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 227 op/s 2024-05-27T09:53:01.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:00 smithi071 ceph-mon[31451]: pgmap v160: 97 pgs: 97 active+clean; 36 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 227 op/s 2024-05-27T09:53:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:00 smithi072 ceph-mon[35951]: pgmap v160: 97 pgs: 97 active+clean; 36 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 227 op/s 2024-05-27T09:53:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 -- 172.21.15.71:0/2063278939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 msgr2=0x7ff1f8075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 --2- 172.21.15.71:0/2063278939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 0x7ff1f8075a70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009900 tx=0x7ff1e802a410 comp rx=0 tx=0).stop 2024-05-27T09:53:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 -- 172.21.15.71:0/2063278939 shutdown_connections 2024-05-27T09:53:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 --2- 172.21.15.71:0/2063278939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f8110480 0x7ff1f81128e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 --2- 172.21.15.71:0/2063278939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 0x7ff1f810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 --2- 172.21.15.71:0/2063278939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 0x7ff1f8075a70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 -- 172.21.15.71:0/2063278939 >> 172.21.15.71:0/2063278939 conn(0x7ff1f8079390 msgr2=0x7ff1f80797d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 -- 172.21.15.71:0/2063278939 shutdown_connections 2024-05-27T09:53:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.135+0000 7ff1fea00640 1 -- 172.21.15.71:0/2063278939 wait complete. 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.136+0000 7ff1fea00640 1 Processor -- start 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.136+0000 7ff1fea00640 1 -- start start 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1fea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 0x7ff1f81a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1fea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 0x7ff1f81a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1fea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f8110480 0x7ff1f819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1fea00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f81160a0 con 0x7ff1f8110480 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1fea00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f8115f20 con 0x7ff1f810db20 2024-05-27T09:53:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1fea00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f8116220 con 0x7ff1f8075660 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1f7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 0x7ff1f81a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1f7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 0x7ff1f81a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46782/0 (socket says 172.21.15.71:46782) 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1f7400640 1 -- 172.21.15.71:0/1938848747 learned_addr learned my addr 172.21.15.71:0/1938848747 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 0x7ff1f81a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.137+0000 7ff1fca00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f8110480 0x7ff1f819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f7e00640 1 -- 172.21.15.71:0/1938848747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 msgr2=0x7ff1f81a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 0x7ff1f81a2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f7e00640 1 -- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f8110480 msgr2=0x7ff1f819c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f8110480 0x7ff1f819c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f7e00640 1 -- 172.21.15.71:0/1938848747 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f819cfc0 con 0x7ff1f8075660 2024-05-27T09:53:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f7400640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 0x7ff1f81a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 0x7ff1f81a2710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff1e802aa00 tx=0x7ff1e8003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f4c00640 1 -- 172.21.15.71:0/1938848747 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e803f070 con 0x7ff1f8075660 2024-05-27T09:53:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1f4c00640 1 -- 172.21.15.71:0/1938848747 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1e8031d60 con 0x7ff1f8075660 2024-05-27T09:53:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.138+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f819d250 con 0x7ff1f8075660 2024-05-27T09:53:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.139+0000 7ff1f4c00640 1 -- 172.21.15.71:0/1938848747 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8035030 con 0x7ff1f8075660 2024-05-27T09:53:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.139+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f819d760 con 0x7ff1f8075660 2024-05-27T09:53:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 Processor -- start 2024-05-27T09:53:02.143 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 -- start start 2024-05-27T09:53:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a0063fb90 con 0x557a0030b4d0 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557a0062f730 con 0x557a003032f0 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.143+0000 7ff2059f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557a00633770 con 0x557a0032c1b0 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f4c00640 1 -- 172.21.15.71:0/1938848747 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7ff1e8042070 con 0x7ff1f8075660 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44282/0 (socket says 172.21.15.71:44282) 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7400640 1 -- 172.21.15.71:0/2585725816 learned_addr learned my addr 172.21.15.71:0/2585725816 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1fca00640 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7400640 1 -- 172.21.15.71:0/2585725816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 msgr2=0x557a006ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7400640 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7400640 1 -- 172.21.15.71:0/2585725816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 msgr2=0x557a006ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.144+0000 7ff1f7400640 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.145+0000 7ff1f7400640 1 -- 172.21.15.71:0/2585725816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a005c88b0 con 0x557a0030b4d0 2024-05-27T09:53:02.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.145+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.145+0000 7ff1f7400640 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf2e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40104d0 tx=0x7ff1e4010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d06989e6402f165 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.145+0000 7ff1ed200640 1 -- 172.21.15.71:0/2585725816 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4004220 con 0x557a0030b4d0 2024-05-27T09:53:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.146+0000 7ff1ed200640 1 -- 172.21.15.71:0/2585725816 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1e40043c0 con 0x557a0030b4d0 2024-05-27T09:53:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.146+0000 7ff1ed200640 1 -- 172.21.15.71:0/2585725816 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4011a70 con 0x557a0030b4d0 2024-05-27T09:53:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.146+0000 7ff1f4c00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1dc0b29d0 0x7ff1dc0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.146+0000 7ff1f4c00640 1 -- 172.21.15.71:0/1938848747 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff1e8102c80 con 0x7ff1f8075660 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.146+0000 7ff1fca00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1dc0b29d0 0x7ff1dc0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 -- 172.21.15.71:0/2585725816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 msgr2=0x557a006cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf2e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40104d0 tx=0x7ff1e4010990 comp rx=0 tx=0).stop 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 -- 172.21.15.71:0/2585725816 shutdown_connections 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf2e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2585725816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 -- 172.21.15.71:0/2585725816 >> 172.21.15.71:0/2585725816 conn(0x557a00320300 msgr2=0x557a006cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 -- 172.21.15.71:0/2585725816 shutdown_connections 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff2059f0740 1 -- 172.21.15.71:0/2585725816 wait complete. 2024-05-27T09:53:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.147+0000 7ff1fca00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1dc0b29d0 0x7ff1dc0b4ee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x557a006cb9d0 tx=0x7ff1f00096a0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.148+0000 7ff2059f0740 1 -- start start 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.148+0000 7ff2059f0740 1 Processor -- start 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a003032f0 0x557a006d8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0030b4d0 0x557a006d8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff2059f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a00315790 con 0x557a003032f0 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff2059f0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557a005d7bc0 con 0x557a0030b4d0 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff2059f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557a006db990 con 0x557a0032c1b0 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff2059f0740 10 client.0 _ll_register_callbacks cb 0x557a005b5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0030b4d0 0x557a006d8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0030b4d0 0x557a006d8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46802/0 (socket says 172.21.15.71:46802) 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 -- 172.21.15.71:0/1660140732 learned_addr learned my addr 172.21.15.71:0/1660140732 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1fca00640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a003032f0 0x557a006d8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 -- 172.21.15.71:0/1660140732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 msgr2=0x557a006e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 -- 172.21.15.71:0/1660140732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a003032f0 msgr2=0x557a006d8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a003032f0 0x557a006d8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.149+0000 7ff1f7400640 1 -- 172.21.15.71:0/1660140732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a00344210 con 0x557a0030b4d0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.150+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a003032f0 0x557a006d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.150+0000 7ff1f7400640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0030b4d0 0x557a006d8eb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400b690 tx=0x7ff1e40042a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c59fd38de9c28b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.150+0000 7ff1e1600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.150+0000 7ff1e1600640 1 -- 172.21.15.71:0/1660140732 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e402a060 con 0x557a0030b4d0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.150+0000 7ff1e1600640 1 -- 172.21.15.71:0/1660140732 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff1e40054d0 con 0x557a0030b4d0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.150+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1e40043c0 con 0x557a0030b4d0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff1e1600640 1 -- 172.21.15.71:0/1660140732 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff1e4011770 con 0x557a0030b4d0 2024-05-27T09:53:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 10 client.26339 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a00410620 con 0x557a0030b4d0 2024-05-27T09:53:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff1e1600640 1 -- 172.21.15.71:0/1660140732 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1e40043c0 con 0x557a0030b4d0 2024-05-27T09:53:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff1e1600640 1 -- 172.21.15.71:0/1660140732 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7ff1e4004c50 con 0x557a0030b4d0 2024-05-27T09:53:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 10 client.26339 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 10 client.26339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 20 client.26339 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002ead80 0x557a006eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 4 client.26339 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.151+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a00641ae0 con 0x557a002ead80 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.152+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002ead80 0x557a006eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.152+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002ead80 0x557a006eaa80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc874d5a5bd101a server_cookie=9195a30c27b2a658 in_seq=0 out_seq=0 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.152+0000 7ff1e1600640 10 client.26339 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff1e1600640 1 -- 172.21.15.71:0/1660140732 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x557a00641ae0 con 0x557a002ead80 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff1e1600640 10 client.26339 handle_command_reply: tid=0 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 client.26339 shutdown 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0030b4d0 msgr2=0x557a006d8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0030b4d0 0x557a006d8eb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400b690 tx=0x7ff1e40042a0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 shutdown_connections 2024-05-27T09:53:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0030b4d0 0x557a006d8eb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002ead80 0x557a006eaa80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 --2- 172.21.15.71:0/1660140732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a003032f0 0x557a006d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff1e1600640 0 client.26339 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.153+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 >> 172.21.15.71:0/1660140732 conn(0x557a00320300 msgr2=0x557a006d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.154+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 shutdown_connections 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.154+0000 7ff2059f0740 1 -- 172.21.15.71:0/1660140732 wait complete. 2024-05-27T09:53:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.154+0000 7ff2059f0740 20 client.26339 trim_cache size 0 max 16384 2024-05-27T09:53:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.174+0000 7ff2059f0740 1 Processor -- start 2024-05-27T09:53:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.174+0000 7ff2059f0740 1 -- start start 2024-05-27T09:53:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a003032f0 0x557a006da090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0032c1b0 0x557a006d8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff2059f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f81b45a0 con 0x557a0030b4d0 2024-05-27T09:53:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff2059f0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f81b1e70 con 0x557a0032c1b0 2024-05-27T09:53:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff2059f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f81afcc0 con 0x557a003032f0 2024-05-27T09:53:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff1f7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a003032f0 0x557a006da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff1f7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a003032f0 0x557a006da090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37504/0 (socket says 172.21.15.71:37504) 2024-05-27T09:53:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff1fca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0032c1b0 0x557a006d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff1f7e00640 1 -- 172.21.15.71:0/912986229 learned_addr learned my addr 172.21.15.71:0/912986229 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.175+0000 7ff1f7400640 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1f7e00640 1 -- 172.21.15.71:0/912986229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0032c1b0 msgr2=0x557a006d8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0032c1b0 0x557a006d8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1f7e00640 1 -- 172.21.15.71:0/912986229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 msgr2=0x557a006cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1f7e00640 1 -- 172.21.15.71:0/912986229 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a006cbc00 con 0x557a003032f0 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1f7400640 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a003032f0 0x557a006da090 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80c60c0 tx=0x7ff1e8031f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36812e5fdc1342f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1e3e00640 1 -- 172.21.15.71:0/912986229 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8049040 con 0x557a003032f0 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1e3e00640 1 -- 172.21.15.71:0/912986229 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1e80c9b50 con 0x557a003032f0 2024-05-27T09:53:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.176+0000 7ff1e3e00640 1 -- 172.21.15.71:0/912986229 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80c62d0 con 0x557a003032f0 2024-05-27T09:53:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 -- 172.21.15.71:0/912986229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a003032f0 msgr2=0x557a006da090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a003032f0 0x557a006da090 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80c60c0 tx=0x7ff1e8031f10 comp rx=0 tx=0).stop 2024-05-27T09:53:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 -- 172.21.15.71:0/912986229 shutdown_connections 2024-05-27T09:53:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a0032c1b0 0x557a006d8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 --2- 172.21.15.71:0/912986229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a003032f0 0x557a006da090 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 -- 172.21.15.71:0/912986229 >> 172.21.15.71:0/912986229 conn(0x557a00320300 msgr2=0x557a006d8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 -- 172.21.15.71:0/912986229 shutdown_connections 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.177+0000 7ff2059f0740 1 -- 172.21.15.71:0/912986229 wait complete. 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.178+0000 7ff2059f0740 1 -- start start 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.178+0000 7ff2059f0740 1 Processor -- start 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006edb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006ee050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff2059f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006eaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff2059f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f81b0330 con 0x557a0030b4d0 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff2059f0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f81b17a0 con 0x557a003032f0 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff2059f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f81b0a00 con 0x557a0032c1b0 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff2059f0740 10 client.0 _ll_register_callbacks cb 0x7ff1e81066a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006eaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1f7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006eaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37510/0 (socket says 172.21.15.71:37510) 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 -- 172.21.15.71:0/2602670180 learned_addr learned my addr 172.21.15.71:0/2602670180 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1f7400640 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006ee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 -- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 msgr2=0x557a006edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 -- 172.21.15.71:0/2602670180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 msgr2=0x557a006ee050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006ee050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1fca00640 1 -- 172.21.15.71:0/2602670180 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a006eb670 con 0x557a0032c1b0 2024-05-27T09:53:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.179+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:02.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff1fca00640 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006eaf80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0012c00 tx=0x7ff1f0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e663977d8f52c13c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff1e1600640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff1e1600640 1 -- 172.21.15.71:0/2602670180 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0020cc0 con 0x557a0032c1b0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff1e1600640 1 -- 172.21.15.71:0/2602670180 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff1f0004b20 con 0x557a0032c1b0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1e80c9b50 con 0x557a0032c1b0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff1e1600640 1 -- 172.21.15.71:0/2602670180 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff1f0020e60 con 0x557a0032c1b0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff2059f0740 10 client.26374 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.180+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a00752800 con 0x557a0032c1b0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff1e1600640 1 -- 172.21.15.71:0/2602670180 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1e80c9b50 con 0x557a0032c1b0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff1e1600640 1 -- 172.21.15.71:0/2602670180 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7ff1f0029410 con 0x557a0032c1b0 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff2059f0740 10 client.26374 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff2059f0740 10 client.26374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff2059f0740 20 client.26374 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002c01c0 0x557a00755010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff2059f0740 4 client.26374 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:53:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a0063b2c0 con 0x557a002c01c0 2024-05-27T09:53:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.181+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002c01c0 0x557a00755010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.182+0000 7ff1f7e00640 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002c01c0 0x557a00755010 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14a00323d7dcab37 server_cookie=7f7b44f36dec53e5 in_seq=0 out_seq=0 2024-05-27T09:53:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.182+0000 7ff1e1600640 10 client.26374 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff1e1600640 1 -- 172.21.15.71:0/2602670180 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557a0063b2c0 con 0x557a002c01c0 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff1e1600640 10 client.26374 handle_command_reply: tid=0 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 client.26374 shutdown 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 msgr2=0x557a006eaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006eaf80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0012c00 tx=0x7ff1f0004a40 comp rx=0 tx=0).stop 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 shutdown_connections 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a0032c1b0 0x557a006eaf80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557a002c01c0 0x557a00755010 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a0030b4d0 0x557a006ee050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 --2- 172.21.15.71:0/2602670180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a003032f0 0x557a006edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff1e1600640 0 client.26374 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.197+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 >> 172.21.15.71:0/2602670180 conn(0x557a00320300 msgr2=0x557a006d81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.198+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 shutdown_connections 2024-05-27T09:53:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.198+0000 7ff2059f0740 1 -- 172.21.15.71:0/2602670180 wait complete. 2024-05-27T09:53:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.198+0000 7ff2059f0740 20 client.26374 trim_cache size 0 max 16384 2024-05-27T09:53:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:53:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:53:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1dc0b29d0 msgr2=0x7ff1dc0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1dc0b29d0 0x7ff1dc0b4ee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x557a006cb9d0 tx=0x7ff1f00096a0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 msgr2=0x7ff1f81a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 0x7ff1f81a2710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff1e802aa00 tx=0x7ff1e8003cd0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 shutdown_connections 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1dc0b29d0 0x7ff1dc0b4ee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f8110480 0x7ff1f819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f810db20 0x7ff1f81a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 --2- 172.21.15.71:0/1938848747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f8075660 0x7ff1f81a2710 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 >> 172.21.15.71:0/1938848747 conn(0x7ff1f8079390 msgr2=0x7ff1f81023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 shutdown_connections 2024-05-27T09:53:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:02.199+0000 7ff1fea00640 1 -- 172.21.15.71:0/1938848747 wait complete. 2024-05-27T09:53:02.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:02 smithi122 ceph-mon[36436]: pgmap v161: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 345 op/s 2024-05-27T09:53:03.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:02 smithi071 ceph-mon[31451]: pgmap v161: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 345 op/s 2024-05-27T09:53:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:02 smithi072 ceph-mon[35951]: pgmap v161: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 345 op/s 2024-05-27T09:53:04.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:04 smithi122 ceph-mon[36436]: pgmap v162: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 223 op/s 2024-05-27T09:53:05.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:04 smithi071 ceph-mon[31451]: pgmap v162: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 223 op/s 2024-05-27T09:53:05.025 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:04 smithi072 ceph-mon[35951]: pgmap v162: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 223 op/s 2024-05-27T09:53:06.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:06 smithi122 ceph-mon[36436]: pgmap v163: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 223 op/s 2024-05-27T09:53:07.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:06 smithi071 ceph-mon[31451]: pgmap v163: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 223 op/s 2024-05-27T09:53:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:06 smithi072 ceph-mon[35951]: pgmap v163: 97 pgs: 97 active+clean; 38 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 223 op/s 2024-05-27T09:53:08.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:08 smithi122 ceph-mon[36436]: pgmap v164: 97 pgs: 97 active+clean; 36 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 334 op/s 2024-05-27T09:53:09.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:08 smithi071 ceph-mon[31451]: pgmap v164: 97 pgs: 97 active+clean; 36 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 334 op/s 2024-05-27T09:53:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:08 smithi072 ceph-mon[35951]: pgmap v164: 97 pgs: 97 active+clean; 36 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 334 op/s 2024-05-27T09:53:10.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:10 smithi122 ceph-mon[36436]: pgmap v165: 97 pgs: 97 active+clean; 36 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-05-27T09:53:11.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:10 smithi071 ceph-mon[31451]: pgmap v165: 97 pgs: 97 active+clean; 36 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-05-27T09:53:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:10 smithi072 ceph-mon[35951]: pgmap v165: 97 pgs: 97 active+clean; 36 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-05-27T09:53:11.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:11 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:53:12.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:11 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:53:12.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:11 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:53:12.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:12 smithi122 ceph-mon[36436]: pgmap v166: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 328 op/s 2024-05-27T09:53:13.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:12 smithi071 ceph-mon[31451]: pgmap v166: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 328 op/s 2024-05-27T09:53:13.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:12 smithi072 ceph-mon[35951]: pgmap v166: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 328 op/s 2024-05-27T09:53:13.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:13 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:53:13.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:13 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:53:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:13 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:53:14.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:13 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:53:14.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:13 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:53:14.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:13 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:53:14.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:13 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:53:14.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:13 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:53:14.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:13 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:53:15.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:14 smithi071 ceph-mon[31451]: pgmap v167: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-05-27T09:53:15.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:14 smithi072 ceph-mon[35951]: pgmap v167: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-05-27T09:53:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:14 smithi122 ceph-mon[36436]: pgmap v167: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-05-27T09:53:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 -- 172.21.15.71:0/3732333775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 msgr2=0x7ff758105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 --2- 172.21.15.71:0/3732333775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 0x7ff758105f80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff744009900 tx=0x7ff74402a3f0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 -- 172.21.15.71:0/3732333775 shutdown_connections 2024-05-27T09:53:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 --2- 172.21.15.71:0/3732333775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581065f0 0x7ff7581129c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 --2- 172.21.15.71:0/3732333775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 0x7ff758105f80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 --2- 172.21.15.71:0/3732333775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff75810bea0 0x7ff758105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 -- 172.21.15.71:0/3732333775 >> 172.21.15.71:0/3732333775 conn(0x7ff7580771f0 msgr2=0x7ff758077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 -- 172.21.15.71:0/3732333775 shutdown_connections 2024-05-27T09:53:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.438+0000 7ff75d800640 1 -- 172.21.15.71:0/3732333775 wait complete. 2024-05-27T09:53:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.439+0000 7ff75d800640 1 Processor -- start 2024-05-27T09:53:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff75d800640 1 -- start start 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff75d800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7581065f0 0x7ff7581a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff75d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff75810bea0 0x7ff7581a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff75d800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 0x7ff75819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff75d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581160c0 con 0x7ff75810bea0 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff75d800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff758115f40 con 0x7ff7581065f0 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff75d800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff758116240 con 0x7ff75810c340 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff756a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7581065f0 0x7ff7581a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.440+0000 7ff756a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7581065f0 0x7ff7581a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50328/0 (socket says 172.21.15.71:50328) 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756a00640 1 -- 172.21.15.71:0/615514153 learned_addr learned my addr 172.21.15.71:0/615514153 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff757400640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 0x7ff75819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756000640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff75810bea0 0x7ff7581a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756a00640 1 -- 172.21.15.71:0/615514153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 msgr2=0x7ff75819c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756a00640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 0x7ff75819c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756a00640 1 -- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff75810bea0 msgr2=0x7ff7581a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756a00640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff75810bea0 0x7ff7581a2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756a00640 1 -- 172.21.15.71:0/615514153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75819cfc0 con 0x7ff7581065f0 2024-05-27T09:53:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.441+0000 7ff756a00640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7581065f0 0x7ff7581a2710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff74800e9c0 tx=0x7ff74800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.442+0000 7ff74f400640 1 -- 172.21.15.71:0/615514153 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74800cd80 con 0x7ff7581065f0 2024-05-27T09:53:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.442+0000 7ff74f400640 1 -- 172.21.15.71:0/615514153 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7480054d0 con 0x7ff7581065f0 2024-05-27T09:53:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.442+0000 7ff74f400640 1 -- 172.21.15.71:0/615514153 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748010430 con 0x7ff7581065f0 2024-05-27T09:53:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.442+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75819d2b0 con 0x7ff7581065f0 2024-05-27T09:53:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.442+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7581a9590 con 0x7ff7581065f0 2024-05-27T09:53:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.446+0000 7ff74f400640 1 -- 172.21.15.71:0/615514153 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7ff748004fb0 con 0x7ff7581065f0 2024-05-27T09:53:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.446+0000 7ff7647c0740 1 Processor -- start 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff7647c0740 1 -- start start 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955c31b0 0x55bb95965860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95965da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb959662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff7647c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bb958d6b90 con 0x55bb9559a2f0 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff7647c0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bb958c6730 con 0x55bb955c31b0 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff7647c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb958ca770 con 0x55bb955a24d0 2024-05-27T09:53:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff757400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955c31b0 0x55bb95965860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff756000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb959662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff757400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955c31b0 0x55bb95965860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50332/0 (socket says 172.21.15.71:50332) 2024-05-27T09:53:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.447+0000 7ff757400640 1 -- 172.21.15.71:0/2072924041 learned_addr learned my addr 172.21.15.71:0/2072924041 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff757400640 1 -- 172.21.15.71:0/2072924041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 msgr2=0x55bb959662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff757400640 1 --2- 172.21.15.71:0/2072924041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb959662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff757400640 1 -- 172.21.15.71:0/2072924041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 msgr2=0x55bb95965da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff757400640 1 --2- 172.21.15.71:0/2072924041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95965da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff757400640 1 -- 172.21.15.71:0/2072924041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9585f8b0 con 0x55bb955c31b0 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff757400640 1 --2- 172.21.15.71:0/2072924041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955c31b0 0x55bb95965860 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff750009fd0 tx=0x7ff750010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a166bebb3b4f85cd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff74f400640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff73c0b29d0 0x7ff73c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.448+0000 7ff743e00640 1 -- 172.21.15.71:0/2072924041 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff750011700 con 0x55bb955c31b0 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.449+0000 7ff74f400640 1 -- 172.21.15.71:0/615514153 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff7480e29b0 con 0x7ff7581065f0 2024-05-27T09:53:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.449+0000 7ff743e00640 1 -- 172.21.15.71:0/2072924041 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff750011d50 con 0x55bb955c31b0 2024-05-27T09:53:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.449+0000 7ff743e00640 1 -- 172.21.15.71:0/2072924041 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75001a380 con 0x55bb955c31b0 2024-05-27T09:53:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.449+0000 7ff756a00640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff73c0b29d0 0x7ff73c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 -- 172.21.15.71:0/2072924041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955c31b0 msgr2=0x55bb95965860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 --2- 172.21.15.71:0/2072924041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955c31b0 0x55bb95965860 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff750009fd0 tx=0x7ff750010860 comp rx=0 tx=0).stop 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff756a00640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff73c0b29d0 0x7ff73c0b4ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55bb95963350 tx=0x7ff748005680 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 -- 172.21.15.71:0/2072924041 shutdown_connections 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 --2- 172.21.15.71:0/2072924041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb959662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 --2- 172.21.15.71:0/2072924041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95965da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 --2- 172.21.15.71:0/2072924041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955c31b0 0x55bb95965860 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 -- 172.21.15.71:0/2072924041 >> 172.21.15.71:0/2072924041 conn(0x55bb955b7300 msgr2=0x55bb95962010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 -- 172.21.15.71:0/2072924041 shutdown_connections 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.450+0000 7ff7647c0740 1 -- 172.21.15.71:0/2072924041 wait complete. 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.451+0000 7ff7647c0740 1 -- start start 2024-05-27T09:53:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.451+0000 7ff7647c0740 1 Processor -- start 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb9559a2f0 0x55bb9596fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb9596ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb9597bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff7647c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bb955ac790 con 0x55bb955c31b0 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff7647c0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bb9586ebc0 con 0x55bb9559a2f0 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff7647c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb95972990 con 0x55bb955a24d0 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff7647c0740 10 client.0 _ll_register_callbacks cb 0x55bb9584c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff756000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb9596ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff756000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb9596ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:60480/0 (socket says 172.21.15.71:60480) 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff756000640 1 -- 172.21.15.71:0/1328904343 learned_addr learned my addr 172.21.15.71:0/1328904343 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff757400640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb9597bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.452+0000 7ff757400640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb9559a2f0 0x55bb9596fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff756000640 1 -- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb9559a2f0 msgr2=0x55bb9596fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff756000640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb9559a2f0 0x55bb9596fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff756000640 1 -- 172.21.15.71:0/1328904343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 msgr2=0x55bb9597bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff756000640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb9597bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff756000640 1 -- 172.21.15.71:0/1328904343 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb955db210 con 0x55bb955a24d0 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff757400640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb9597bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:53:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff756000640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb9596ff70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff744005ab0 tx=0x7ff744004440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932561d6a9e16dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.453+0000 7ff740c00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:53:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.454+0000 7ff740c00640 1 -- 172.21.15.71:0/1328904343 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744035040 con 0x55bb955a24d0 2024-05-27T09:53:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.454+0000 7ff740c00640 1 -- 172.21.15.71:0/1328904343 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff744005510 con 0x55bb955a24d0 2024-05-27T09:53:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.454+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff750011d50 con 0x55bb955a24d0 2024-05-27T09:53:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.454+0000 7ff740c00640 1 -- 172.21.15.71:0/1328904343 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff744004750 con 0x55bb955a24d0 2024-05-27T09:53:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.454+0000 7ff7647c0740 10 client.26386 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.454+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bb956a7620 con 0x55bb955a24d0 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff740c00640 1 -- 172.21.15.71:0/1328904343 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff750011d50 con 0x55bb955a24d0 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff740c00640 1 -- 172.21.15.71:0/1328904343 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7ff744003ae0 con 0x55bb955a24d0 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff7647c0740 10 client.26386 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff7647c0740 10 client.26386 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff7647c0740 20 client.26386 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb95581d80 0x55bb95981c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff7647c0740 4 client.26386 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.455+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb958d8ae0 con 0x55bb95581d80 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.456+0000 7ff757400640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb95581d80 0x55bb95981c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.456+0000 7ff757400640 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb95581d80 0x55bb95981c50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbdadc93ec5799a server_cookie=e001ea11bb58d8d in_seq=0 out_seq=0 2024-05-27T09:53:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.456+0000 7ff740c00640 10 client.26386 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff740c00640 1 -- 172.21.15.71:0/1328904343 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55bb958d8ae0 con 0x55bb95581d80 2024-05-27T09:53:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff740c00640 10 client.26386 handle_command_reply: tid=0 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 client.26386 shutdown 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 msgr2=0x55bb9596ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb9596ff70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff744005ab0 tx=0x7ff744004440 comp rx=0 tx=0).stop 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 shutdown_connections 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb95581d80 0x55bb95981c50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb9597bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955a24d0 0x55bb9596ff70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1328904343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb9559a2f0 0x55bb9596fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff740c00640 0 client.26386 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.457+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 >> 172.21.15.71:0/1328904343 conn(0x55bb955b7300 msgr2=0x55bb95965630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.458+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 shutdown_connections 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.458+0000 7ff7647c0740 1 -- 172.21.15.71:0/1328904343 wait complete. 2024-05-27T09:53:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.458+0000 7ff7647c0740 20 client.26386 trim_cache size 0 max 16384 2024-05-27T09:53:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.477+0000 7ff7647c0740 1 Processor -- start 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.477+0000 7ff7647c0740 1 -- start start 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.477+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95972160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.477+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb95961330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.477+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955c31b0 0x55bb9596f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.477+0000 7ff7647c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581b4770 con 0x55bb9559a2f0 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff7647c0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581b2040 con 0x55bb955a24d0 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff7647c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581afe90 con 0x55bb955c31b0 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff757400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95972160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff756000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb95961330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff757400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95972160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36398/0 (socket says 172.21.15.71:36398) 2024-05-27T09:53:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff756000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb95961330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50350/0 (socket says 172.21.15.71:50350) 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff757400640 1 -- 172.21.15.71:0/3608673273 learned_addr learned my addr 172.21.15.71:0/3608673273 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff757400640 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955c31b0 0x55bb9596f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff756000640 1 -- 172.21.15.71:0/3608673273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955c31b0 msgr2=0x55bb9596f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff756000640 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955c31b0 0x55bb9596f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff756000640 1 -- 172.21.15.71:0/3608673273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 msgr2=0x55bb95972160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff756000640 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95972160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.478+0000 7ff756000640 1 -- 172.21.15.71:0/3608673273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9595bfc0 con 0x55bb955a24d0 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.479+0000 7ff756000640 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb95961330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff744009900 tx=0x7ff7440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f7245dbb0f13fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.479+0000 7ff743400640 1 -- 172.21.15.71:0/3608673273 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744035070 con 0x55bb955a24d0 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.479+0000 7ff743400640 1 -- 172.21.15.71:0/3608673273 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff744041070 con 0x55bb955a24d0 2024-05-27T09:53:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.479+0000 7ff743400640 1 -- 172.21.15.71:0/3608673273 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744004b50 con 0x55bb955a24d0 2024-05-27T09:53:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 -- 172.21.15.71:0/3608673273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 msgr2=0x55bb95961330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb95961330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff744009900 tx=0x7ff7440046c0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 -- 172.21.15.71:0/3608673273 shutdown_connections 2024-05-27T09:53:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb955c31b0 0x55bb9596f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb95961330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 --2- 172.21.15.71:0/3608673273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb9559a2f0 0x55bb95972160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 -- 172.21.15.71:0/3608673273 >> 172.21.15.71:0/3608673273 conn(0x55bb955b7300 msgr2=0x55bb9596f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 -- 172.21.15.71:0/3608673273 shutdown_connections 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.480+0000 7ff7647c0740 1 -- 172.21.15.71:0/3608673273 wait complete. 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.481+0000 7ff7647c0740 1 -- start start 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.481+0000 7ff7647c0740 1 Processor -- start 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.481+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb9559a2f0 0x55bb95978070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb959733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff7647c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb95973900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff7647c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581b0500 con 0x55bb955c31b0 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff7647c0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581b1970 con 0x55bb955a24d0 2024-05-27T09:53:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff7647c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581b0bd0 con 0x55bb9559a2f0 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff7647c0740 10 client.0 _ll_register_callbacks cb 0x7ff744009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb959733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff757400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb9559a2f0 0x55bb95978070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb959733c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:50356/0 (socket says 172.21.15.71:50356) 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 -- 172.21.15.71:0/1257817424 learned_addr learned my addr 172.21.15.71:0/1257817424 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff757400640 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb9559a2f0 0x55bb95978070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:60486/0 (socket says 172.21.15.71:60486) 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff757400640 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb95973900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 -- 172.21.15.71:0/1257817424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb9559a2f0 msgr2=0x55bb95978070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb9559a2f0 0x55bb95978070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 -- 172.21.15.71:0/1257817424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 msgr2=0x55bb95973900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb95973900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.482+0000 7ff756000640 1 -- 172.21.15.71:0/1257817424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb95973e40 con 0x55bb955a24d0 2024-05-27T09:53:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.483+0000 7ff756000640 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb959733c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff74402a9e0 tx=0x7ff744000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee77412bf506991 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.483+0000 7ff740c00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:53:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.483+0000 7ff740c00640 1 -- 172.21.15.71:0/1257817424 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744035070 con 0x55bb955a24d0 2024-05-27T09:53:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.483+0000 7ff740c00640 1 -- 172.21.15.71:0/1257817424 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7ff744031b40 con 0x55bb955a24d0 2024-05-27T09:53:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.483+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff744041070 con 0x55bb955a24d0 2024-05-27T09:53:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff740c00640 1 -- 172.21.15.71:0/1257817424 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff7440316b0 con 0x55bb955a24d0 2024-05-27T09:53:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 10 client.26363 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bb959e9f60 con 0x55bb955a24d0 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff740c00640 1 -- 172.21.15.71:0/1257817424 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff744041070 con 0x55bb955a24d0 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff740c00640 1 -- 172.21.15.71:0/1257817424 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7ff744046470 con 0x55bb955a24d0 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 10 client.26363 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 10 client.26363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 20 client.26363 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb955571c0 0x55bb959ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 4 client.26363 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.484+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb958d22c0 con 0x55bb955571c0 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.485+0000 7ff757400640 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb955571c0 0x55bb959ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.485+0000 7ff740c00640 10 client.26363 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.485+0000 7ff757400640 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb955571c0 0x55bb959ec5a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aecd55d81a4b18ee server_cookie=f2b526eadb4b4c06 in_seq=0 out_seq=0 2024-05-27T09:53:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff740c00640 1 -- 172.21.15.71:0/1257817424 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bb958d22c0 con 0x55bb955571c0 2024-05-27T09:53:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff740c00640 10 client.26363 handle_command_reply: tid=0 2024-05-27T09:53:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 client.26363 shutdown 2024-05-27T09:53:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 msgr2=0x55bb959733c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb959733c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff74402a9e0 tx=0x7ff744000bc0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 shutdown_connections 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55bb955571c0 0x55bb959ec5a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb955c31b0 0x55bb95973900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff740c00640 0 client.26363 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bb955a24d0 0x55bb959733c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 --2- 172.21.15.71:0/1257817424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb9559a2f0 0x55bb95978070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 >> 172.21.15.71:0/1257817424 conn(0x55bb955b7300 msgr2=0x55bb9596a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 shutdown_connections 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.502+0000 7ff7647c0740 1 -- 172.21.15.71:0/1257817424 wait complete. 2024-05-27T09:53:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.503+0000 7ff7647c0740 20 client.26363 trim_cache size 0 max 16384 2024-05-27T09:53:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:53:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:53:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:53:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff73c0b29d0 msgr2=0x7ff73c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff73c0b29d0 0x7ff73c0b4ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55bb95963350 tx=0x7ff748005680 comp rx=0 tx=0).stop 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7581065f0 msgr2=0x7ff7581a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7581065f0 0x7ff7581a2710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff74800e9c0 tx=0x7ff74800ee80 comp rx=0 tx=0).stop 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 shutdown_connections 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff73c0b29d0 0x7ff73c0b4ee0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff75810c340 0x7ff75819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff75810bea0 0x7ff7581a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 --2- 172.21.15.71:0/615514153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7581065f0 0x7ff7581a2710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 >> 172.21.15.71:0/615514153 conn(0x7ff7580771f0 msgr2=0x7ff758104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 shutdown_connections 2024-05-27T09:53:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:15.504+0000 7ff75d800640 1 -- 172.21.15.71:0/615514153 wait complete. 2024-05-27T09:53:17.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:16 smithi071 ceph-mon[31451]: pgmap v168: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-05-27T09:53:17.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:16 smithi072 ceph-mon[35951]: pgmap v168: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-05-27T09:53:17.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:16 smithi122 ceph-mon[36436]: pgmap v168: 97 pgs: 97 active+clean; 37 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-05-27T09:53:19.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:18 smithi071 ceph-mon[31451]: pgmap v169: 97 pgs: 97 active+clean; 35 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 331 op/s 2024-05-27T09:53:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:18 smithi072 ceph-mon[35951]: pgmap v169: 97 pgs: 97 active+clean; 35 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 331 op/s 2024-05-27T09:53:19.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:18 smithi122 ceph-mon[36436]: pgmap v169: 97 pgs: 97 active+clean; 35 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 331 op/s 2024-05-27T09:53:21.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:20 smithi071 ceph-mon[31451]: pgmap v170: 97 pgs: 97 active+clean; 35 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 220 op/s 2024-05-27T09:53:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:20 smithi072 ceph-mon[35951]: pgmap v170: 97 pgs: 97 active+clean; 35 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 220 op/s 2024-05-27T09:53:21.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:20 smithi122 ceph-mon[36436]: pgmap v170: 97 pgs: 97 active+clean; 35 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 220 op/s 2024-05-27T09:53:23.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:22 smithi071 ceph-mon[31451]: pgmap v171: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 319 op/s 2024-05-27T09:53:23.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:22 smithi072 ceph-mon[35951]: pgmap v171: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 319 op/s 2024-05-27T09:53:23.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:22 smithi122 ceph-mon[36436]: pgmap v171: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 319 op/s 2024-05-27T09:53:23.644 INFO:tasks.workunit.client.0.smithi071.stdout:30000 trunc from 0x7bb2f to 0xcdf83 2024-05-27T09:53:24.555 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xffcdd 2024-05-27T09:53:25.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:24 smithi071 ceph-mon[31451]: pgmap v172: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-05-27T09:53:25.025 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:24 smithi072 ceph-mon[35951]: pgmap v172: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-05-27T09:53:25.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:24 smithi122 ceph-mon[36436]: pgmap v172: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-05-27T09:53:27.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:26 smithi072 ceph-mon[35951]: pgmap v173: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-05-27T09:53:27.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:26 smithi122 ceph-mon[36436]: pgmap v173: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-05-27T09:53:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:26 smithi071 ceph-mon[31451]: pgmap v173: 97 pgs: 97 active+clean; 37 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.763+0000 7f0352a00640 1 -- 172.21.15.71:0/3839330866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 msgr2=0x7f034c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.763+0000 7f0352a00640 1 --2- 172.21.15.71:0/3839330866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c075810 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f033c009900 tx=0x7f033c02a480 comp rx=0 tx=0).stop 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.764+0000 7f0352a00640 1 -- 172.21.15.71:0/3839330866 shutdown_connections 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.764+0000 7f0352a00640 1 --2- 172.21.15.71:0/3839330866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c110540 0x7f034c112960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.764+0000 7f0352a00640 1 --2- 172.21.15.71:0/3839330866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f034c10dbe0 0x7f034c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.764+0000 7f0352a00640 1 --2- 172.21.15.71:0/3839330866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c075810 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.764+0000 7f0352a00640 1 -- 172.21.15.71:0/3839330866 >> 172.21.15.71:0/3839330866 conn(0x7f034c079440 msgr2=0x7f034c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.764+0000 7f0352a00640 1 -- 172.21.15.71:0/3839330866 shutdown_connections 2024-05-27T09:53:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.764+0000 7f0352a00640 1 -- 172.21.15.71:0/3839330866 wait complete. 2024-05-27T09:53:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 Processor -- start 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 -- start start 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c1a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c10dbe0 0x7f034c1a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f034c110540 0x7f034c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1160d0 con 0x7f034c10dbe0 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f034c115f50 con 0x7f034c075400 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.765+0000 7f0352a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f034c116250 con 0x7f034c110540 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c10dbe0 0x7f034c1a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c1a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c1a2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51732/0 (socket says 172.21.15.71:51732) 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c10dbe0 0x7f034c1a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35736/0 (socket says 172.21.15.71:35736) 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 -- 172.21.15.71:0/4235746921 learned_addr learned my addr 172.21.15.71:0/4235746921 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f0350a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f034c110540 0x7f034c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 -- 172.21.15.71:0/4235746921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f034c110540 msgr2=0x7f034c19c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f034c110540 0x7f034c19c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 -- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c10dbe0 msgr2=0x7f034c1a2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c10dbe0 0x7f034c1a2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.766+0000 7f034be00640 1 -- 172.21.15.71:0/4235746921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c19cfb0 con 0x7f034c075400 2024-05-27T09:53:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.767+0000 7f034be00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c1a2700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f033c005ab0 tx=0x7f033c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.767+0000 7f0348c00640 1 -- 172.21.15.71:0/4235746921 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c03f070 con 0x7f034c075400 2024-05-27T09:53:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.767+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c19d240 con 0x7f034c075400 2024-05-27T09:53:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.767+0000 7f0348c00640 1 -- 172.21.15.71:0/4235746921 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f033c031b60 con 0x7f034c075400 2024-05-27T09:53:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.767+0000 7f0348c00640 1 -- 172.21.15.71:0/4235746921 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c035030 con 0x7f034c075400 2024-05-27T09:53:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.767+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c1a9580 con 0x7f034c075400 2024-05-27T09:53:28.771 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 Processor -- start 2024-05-27T09:53:28.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 -- start start 2024-05-27T09:53:28.772 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790be860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790beda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f7902fb90 con 0x555f78d1c1b0 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555f7901f730 con 0x555f78cfb4d0 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.771+0000 7f03599df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555f79023770 con 0x555f78cf32f0 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f0348c00640 1 -- 172.21.15.71:0/4235746921 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f033c042070 con 0x7f034c075400 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f0350a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790be860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f034b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f0350a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790be860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35746/0 (socket says 172.21.15.71:35746) 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f0350a00640 1 -- 172.21.15.71:0/768549011 learned_addr learned my addr 172.21.15.71:0/768549011 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f034be00640 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f034b400640 1 -- 172.21.15.71:0/768549011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 msgr2=0x555f790beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f034b400640 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f034b400640 1 -- 172.21.15.71:0/768549011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 msgr2=0x555f790be860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f034b400640 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790be860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f034b400640 1 -- 172.21.15.71:0/768549011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f78fb88b0 con 0x555f78cfb4d0 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.772+0000 7f0350a00640 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790be860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.773+0000 7f034b400640 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790bf2e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f034c110f80 tx=0x7f0338011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1df40bda8a9cdeaf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.773+0000 7f0341200640 1 -- 172.21.15.71:0/768549011 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338004050 con 0x555f78cfb4d0 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.773+0000 7f0341200640 1 -- 172.21.15.71:0/768549011 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03380054d0 con 0x555f78cfb4d0 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.773+0000 7f0341200640 1 -- 172.21.15.71:0/768549011 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338004c80 con 0x555f78cfb4d0 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.774+0000 7f03599df740 1 -- 172.21.15.71:0/768549011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 msgr2=0x555f790bf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.774+0000 7f03599df740 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790bf2e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f034c110f80 tx=0x7f0338011810 comp rx=0 tx=0).stop 2024-05-27T09:53:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.774+0000 7f0348c00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03300b29d0 0x7f03300b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f03599df740 1 -- 172.21.15.71:0/768549011 shutdown_connections 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f0348c00640 1 -- 172.21.15.71:0/4235746921 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f033c102cc0 con 0x7f034c075400 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f03599df740 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790bf2e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f03599df740 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f03599df740 1 --2- 172.21.15.71:0/768549011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790be860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f03599df740 1 -- 172.21.15.71:0/768549011 >> 172.21.15.71:0/768549011 conn(0x555f78d10300 msgr2=0x555f790bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f03599df740 1 -- 172.21.15.71:0/768549011 shutdown_connections 2024-05-27T09:53:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.775+0000 7f03599df740 1 -- 172.21.15.71:0/768549011 wait complete. 2024-05-27T09:53:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.776+0000 7f03599df740 1 -- start start 2024-05-27T09:53:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.776+0000 7f03599df740 1 Processor -- start 2024-05-27T09:53:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f0350a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03300b29d0 0x7f03300b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f03599df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f03599df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f03599df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f03599df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f78d05790 con 0x555f78d1c1b0 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f03599df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555f78fc7bc0 con 0x555f78cf32f0 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f03599df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555f790cb990 con 0x555f78cfb4d0 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f034b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f034be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f034b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37308/0 (socket says 172.21.15.71:37308) 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f03599df740 10 client.0 _ll_register_callbacks cb 0x555f78fa5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f034b400640 1 -- 172.21.15.71:0/1075577123 learned_addr learned my addr 172.21.15.71:0/1075577123 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.777+0000 7f034be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51758/0 (socket says 172.21.15.71:51758) 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f0350a00640 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f034be00640 1 -- 172.21.15.71:0/1075577123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 msgr2=0x555f790c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f034be00640 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f034be00640 1 -- 172.21.15.71:0/1075577123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 msgr2=0x555f790d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f034be00640 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f034be00640 1 -- 172.21.15.71:0/1075577123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f78d34210 con 0x555f78cf32f0 2024-05-27T09:53:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f0350a00640 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f034be00640 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790c89a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f033c1003e0 tx=0x7f033c0c9f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32cc9e93648a592 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f0335600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f0350a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03300b29d0 0x7f03300b4ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0344005fd0 tx=0x7f0344009b80 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f0335600640 1 -- 172.21.15.71:0/1075577123 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c049070 con 0x555f78cf32f0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f0335600640 1 -- 172.21.15.71:0/1075577123 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f033c100660 con 0x555f78cf32f0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.778+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03380054d0 con 0x555f78cf32f0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f0335600640 1 -- 172.21.15.71:0/1075577123 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f033c100860 con 0x555f78cf32f0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f03599df740 10 client.26375 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f78e00620 con 0x555f78cf32f0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f0335600640 1 -- 172.21.15.71:0/1075577123 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03380054d0 con 0x555f78cf32f0 2024-05-27T09:53:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f0335600640 1 -- 172.21.15.71:0/1075577123 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f033c0d2940 con 0x555f78cf32f0 2024-05-27T09:53:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f03599df740 10 client.26375 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f03599df740 10 client.26375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f03599df740 20 client.26375 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.780+0000 7f03599df740 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cdad80 0x555f790dac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.781+0000 7f03599df740 4 client.26375 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:53:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.781+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f79031ae0 con 0x555f78cdad80 2024-05-27T09:53:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.781+0000 7f034b400640 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cdad80 0x555f790dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.781+0000 7f0335600640 10 client.26375 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.782+0000 7f034b400640 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cdad80 0x555f790dac30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48762bb46a87509a server_cookie=162ab39f4242e2ff in_seq=0 out_seq=0 2024-05-27T09:53:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.782+0000 7f0335600640 1 -- 172.21.15.71:0/1075577123 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x555f79031ae0 con 0x555f78cdad80 2024-05-27T09:53:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.782+0000 7f0335600640 10 client.26375 handle_command_reply: tid=0 2024-05-27T09:53:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.782+0000 7f03599df740 1 client.26375 shutdown 2024-05-27T09:53:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 msgr2=0x555f790c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790c89a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f033c1003e0 tx=0x7f033c0c9f20 comp rx=0 tx=0).stop 2024-05-27T09:53:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 shutdown_connections 2024-05-27T09:53:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cdad80 0x555f790dac30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f0335600640 0 client.26375 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 --2- 172.21.15.71:0/1075577123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790c89a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 >> 172.21.15.71:0/1075577123 conn(0x555f78d10300 msgr2=0x555f790c0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 shutdown_connections 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.783+0000 7f03599df740 1 -- 172.21.15.71:0/1075577123 wait complete. 2024-05-27T09:53:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.784+0000 7f03599df740 20 client.26375 trim_cache size 0 max 16384 2024-05-27T09:53:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.804+0000 7f03599df740 1 Processor -- start 2024-05-27T09:53:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.804+0000 7f03599df740 1 -- start start 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f03599df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f03599df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f03599df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f03599df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1b0220 con 0x555f78d1c1b0 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f03599df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1adaf0 con 0x555f78cfb4d0 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f03599df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1ab9c0 con 0x555f78cf32f0 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f034b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f034b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51764/0 (socket says 172.21.15.71:51764) 2024-05-27T09:53:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f034b400640 1 -- 172.21.15.71:0/2225630472 learned_addr learned my addr 172.21.15.71:0/2225630472 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f034be00640 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f0350a00640 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f034b400640 1 -- 172.21.15.71:0/2225630472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 msgr2=0x555f790ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.805+0000 7f034b400640 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.806+0000 7f034b400640 1 -- 172.21.15.71:0/2225630472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 msgr2=0x555f790c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.806+0000 7f034b400640 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.806+0000 7f034b400640 1 -- 172.21.15.71:0/2225630472 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f790caf70 con 0x555f78cfb4d0 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.806+0000 7f034b400640 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790c25c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0338000c00 tx=0x7f0338009fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=673a580131e7a56b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.806+0000 7f0337e00640 1 -- 172.21.15.71:0/2225630472 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033801d040 con 0x555f78cfb4d0 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.806+0000 7f0337e00640 1 -- 172.21.15.71:0/2225630472 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0338025bf0 con 0x555f78cfb4d0 2024-05-27T09:53:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.806+0000 7f0337e00640 1 -- 172.21.15.71:0/2225630472 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338031630 con 0x555f78cfb4d0 2024-05-27T09:53:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 -- 172.21.15.71:0/2225630472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 msgr2=0x555f790c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790c25c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0338000c00 tx=0x7f0338009fa0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 -- 172.21.15.71:0/2225630472 shutdown_connections 2024-05-27T09:53:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f790c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cfb4d0 0x555f790c25c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 --2- 172.21.15.71:0/2225630472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cf32f0 0x555f790ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 -- 172.21.15.71:0/2225630472 >> 172.21.15.71:0/2225630472 conn(0x555f78d10300 msgr2=0x555f790c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 -- 172.21.15.71:0/2225630472 shutdown_connections 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.807+0000 7f03599df740 1 -- 172.21.15.71:0/2225630472 wait complete. 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.808+0000 7f03599df740 1 -- start start 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.808+0000 7f03599df740 1 Processor -- start 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f03599df740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f03599df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f03599df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f791412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f03599df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1ac010 con 0x555f78d1c1b0 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f03599df740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1ad420 con 0x555f78cf32f0 2024-05-27T09:53:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f03599df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1ac680 con 0x555f78cfb4d0 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f03599df740 10 client.0 _ll_register_callbacks cb 0x7f033c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51768/0 (socket says 172.21.15.71:51768) 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 -- 172.21.15.71:0/2152310702 learned_addr learned my addr 172.21.15.71:0/2152310702 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f0350a00640 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f791412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 -- 172.21.15.71:0/2152310702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 msgr2=0x555f790cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 -- 172.21.15.71:0/2152310702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 msgr2=0x555f791412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f791412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034be00640 1 -- 172.21.15.71:0/2152310702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f79141830 con 0x555f78cf32f0 2024-05-27T09:53:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.809+0000 7f034b400640 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f034be00640 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790cc200 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f033c1051c0 tx=0x7f033c0ca4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fad8d30476ac203e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f0335600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f0335600640 1 -- 172.21.15.71:0/2152310702 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0c9790 con 0x555f78cf32f0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0338025bf0 con 0x555f78cf32f0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f0335600640 1 -- 172.21.15.71:0/2152310702 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f033c100b80 con 0x555f78cf32f0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f0335600640 1 -- 172.21.15.71:0/2152310702 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f033c100870 con 0x555f78cf32f0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f03599df740 10 client.26381 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.810+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f79141830 con 0x555f78cf32f0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f0335600640 1 -- 172.21.15.71:0/2152310702 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0338025bf0 con 0x555f78cf32f0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f0335600640 1 -- 172.21.15.71:0/2152310702 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f033c0b00f0 con 0x555f78cf32f0 2024-05-27T09:53:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f03599df740 10 client.26381 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f03599df740 10 client.26381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f03599df740 20 client.26381 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f03599df740 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cb01c0 0x555f79144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f03599df740 4 client.26381 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f7902b2c0 con 0x555f78cb01c0 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.811+0000 7f034b400640 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cb01c0 0x555f79144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.812+0000 7f0335600640 10 client.26381 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.812+0000 7f034b400640 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cb01c0 0x555f79144d00 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2730dc8b54fb8cad server_cookie=f585e2c5fbc2ad37 in_seq=0 out_seq=0 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f0335600640 1 -- 172.21.15.71:0/2152310702 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x555f7902b2c0 con 0x555f78cb01c0 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f0335600640 10 client.26381 handle_command_reply: tid=0 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 client.26381 shutdown 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 msgr2=0x555f790cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790cc200 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f033c1051c0 tx=0x7f033c0ca4b0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 shutdown_connections 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555f78cb01c0 0x555f79144d00 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f78d1c1b0 0x555f791412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555f78cfb4d0 0x555f790cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 --2- 172.21.15.71:0/2152310702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555f78cf32f0 0x555f790cc200 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f0335600640 0 client.26381 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 >> 172.21.15.71:0/2152310702 conn(0x555f78d10300 msgr2=0x555f790c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 shutdown_connections 2024-05-27T09:53:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.828+0000 7f03599df740 1 -- 172.21.15.71:0/2152310702 wait complete. 2024-05-27T09:53:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.829+0000 7f03599df740 20 client.26381 trim_cache size 0 max 16384 2024-05-27T09:53:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:53:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:53:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:53:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.829+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03300b29d0 msgr2=0x7f03300b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.829+0000 7f0352a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03300b29d0 0x7f03300b4ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0344005fd0 tx=0x7f0344009b80 comp rx=0 tx=0).stop 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.829+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 msgr2=0x7f034c1a2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.829+0000 7f0352a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c1a2700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f033c005ab0 tx=0x7f033c003c10 comp rx=0 tx=0).stop 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 shutdown_connections 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03300b29d0 0x7f03300b4ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f034c110540 0x7f034c19c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c10dbe0 0x7f034c1a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 --2- 172.21.15.71:0/4235746921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c075400 0x7f034c1a2700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 >> 172.21.15.71:0/4235746921 conn(0x7f034c079440 msgr2=0x7f034c1023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 shutdown_connections 2024-05-27T09:53:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:28.830+0000 7f0352a00640 1 -- 172.21.15.71:0/4235746921 wait complete. 2024-05-27T09:53:29.198 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xffd97 2024-05-27T09:53:29.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:28 smithi122 ceph-mon[36436]: pgmap v174: 97 pgs: 97 active+clean; 38 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 312 op/s 2024-05-27T09:53:29.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:28 smithi071 ceph-mon[31451]: pgmap v174: 97 pgs: 97 active+clean; 38 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 312 op/s 2024-05-27T09:53:29.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:28 smithi072 ceph-mon[35951]: pgmap v174: 97 pgs: 97 active+clean; 38 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 312 op/s 2024-05-27T09:53:31.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:30 smithi122 ceph-mon[36436]: pgmap v175: 97 pgs: 97 active+clean; 38 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.3 MiB/s wr, 191 op/s 2024-05-27T09:53:31.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:30 smithi071 ceph-mon[31451]: pgmap v175: 97 pgs: 97 active+clean; 38 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.3 MiB/s wr, 191 op/s 2024-05-27T09:53:31.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:30 smithi072 ceph-mon[35951]: pgmap v175: 97 pgs: 97 active+clean; 38 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.3 MiB/s wr, 191 op/s 2024-05-27T09:53:33.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:32 smithi122 ceph-mon[36436]: pgmap v176: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 280 op/s 2024-05-27T09:53:33.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:32 smithi071 ceph-mon[31451]: pgmap v176: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 280 op/s 2024-05-27T09:53:33.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:32 smithi072 ceph-mon[35951]: pgmap v176: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 280 op/s 2024-05-27T09:53:35.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:34 smithi122 ceph-mon[36436]: pgmap v177: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:35.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:34 smithi071 ceph-mon[31451]: pgmap v177: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:35.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:34 smithi072 ceph-mon[35951]: pgmap v177: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:37.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:36 smithi122 ceph-mon[36436]: pgmap v178: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:37.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:36 smithi071 ceph-mon[31451]: pgmap v178: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:37.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:36 smithi072 ceph-mon[35951]: pgmap v178: 97 pgs: 97 active+clean; 36 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:39.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:38 smithi122 ceph-mon[36436]: pgmap v179: 97 pgs: 97 active+clean; 37 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 256 op/s 2024-05-27T09:53:39.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:38 smithi071 ceph-mon[31451]: pgmap v179: 97 pgs: 97 active+clean; 37 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 256 op/s 2024-05-27T09:53:39.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:38 smithi072 ceph-mon[35951]: pgmap v179: 97 pgs: 97 active+clean; 37 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 256 op/s 2024-05-27T09:53:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:40 smithi122 ceph-mon[36436]: pgmap v180: 97 pgs: 97 active+clean; 37 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.1 MiB/s wr, 164 op/s 2024-05-27T09:53:41.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:40 smithi071 ceph-mon[31451]: pgmap v180: 97 pgs: 97 active+clean; 37 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.1 MiB/s wr, 164 op/s 2024-05-27T09:53:41.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:40 smithi072 ceph-mon[35951]: pgmap v180: 97 pgs: 97 active+clean; 37 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.1 MiB/s wr, 164 op/s 2024-05-27T09:53:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 -- 172.21.15.71:0/247858488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810b7f0 msgr2=0x7f566810dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 --2- 172.21.15.71:0/247858488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810b7f0 0x7f566810dc10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5654009900 tx=0x7f565402a3f0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 -- 172.21.15.71:0/247858488 shutdown_connections 2024-05-27T09:53:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 --2- 172.21.15.71:0/247858488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810e1e0 0x7f56681106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 --2- 172.21.15.71:0/247858488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810b7f0 0x7f566810dc10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 --2- 172.21.15.71:0/247858488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 0x7f56681051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 -- 172.21.15.71:0/247858488 >> 172.21.15.71:0/247858488 conn(0x7f56680782d0 msgr2=0x7f5668078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 -- 172.21.15.71:0/247858488 shutdown_connections 2024-05-27T09:53:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.087+0000 7f566d600640 1 -- 172.21.15.71:0/247858488 wait complete. 2024-05-27T09:53:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.088+0000 7f566d600640 1 Processor -- start 2024-05-27T09:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.088+0000 7f566d600640 1 -- start start 2024-05-27T09:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f566d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 0x7f56681a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f566d600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810b7f0 0x7f56681a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f566d600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810e1e0 0x7f566819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f566d600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5668113e90 con 0x7f5668104d90 2024-05-27T09:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f566d600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5668113d10 con 0x7f566810b7f0 2024-05-27T09:53:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f566d600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5668114010 con 0x7f566810e1e0 2024-05-27T09:53:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f5666a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 0x7f56681a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f5666000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810b7f0 0x7f56681a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f5666000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810b7f0 0x7f56681a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57244/0 (socket says 172.21.15.71:57244) 2024-05-27T09:53:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f5666a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 0x7f56681a2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49466/0 (socket says 172.21.15.71:49466) 2024-05-27T09:53:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f5666000640 1 -- 172.21.15.71:0/992515355 learned_addr learned my addr 172.21.15.71:0/992515355 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.089+0000 7f5667400640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810e1e0 0x7f566819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5666000640 1 -- 172.21.15.71:0/992515355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810e1e0 msgr2=0x7f566819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5666000640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810e1e0 0x7f566819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5666000640 1 -- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 msgr2=0x7f56681a2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5666000640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 0x7f56681a2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5666000640 1 -- 172.21.15.71:0/992515355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566819cfb0 con 0x7f566810b7f0 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5667400640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810e1e0 0x7f566819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5666a00640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 0x7f56681a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f5666000640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810b7f0 0x7f56681a2c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5654005ab0 tx=0x7f5654003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f565f400640 1 -- 172.21.15.71:0/992515355 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565403f070 con 0x7f566810b7f0 2024-05-27T09:53:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f565f400640 1 -- 172.21.15.71:0/992515355 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5654031d60 con 0x7f566810b7f0 2024-05-27T09:53:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566819d240 con 0x7f566810b7f0 2024-05-27T09:53:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.090+0000 7f565f400640 1 -- 172.21.15.71:0/992515355 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654035030 con 0x7f566810b7f0 2024-05-27T09:53:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.091+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56681a9580 con 0x7f566810b7f0 2024-05-27T09:53:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.094+0000 7f5674636740 1 Processor -- start 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.094+0000 7f5674636740 1 -- start start 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f565f400640 1 -- 172.21.15.71:0/992515355 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5654042070 con 0x7f566810b7f0 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5674636740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873a3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5674636740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5674636740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d9873a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5674636740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d987314b90 con 0x55d9870011b0 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5674636740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d987304730 con 0x55d986fd82f0 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5674636740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d987308770 con 0x55d986fe04d0 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5666a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5666a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873a3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57258/0 (socket says 172.21.15.71:57258) 2024-05-27T09:53:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5666a00640 1 -- 172.21.15.71:0/2887589751 learned_addr learned my addr 172.21.15.71:0/2887589751 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5667400640 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.095+0000 7f5666000640 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d9873a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.096+0000 7f5666a00640 1 -- 172.21.15.71:0/2887589751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 msgr2=0x55d9873a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.096+0000 7f5666a00640 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d9873a41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.096+0000 7f5666a00640 1 -- 172.21.15.71:0/2887589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 msgr2=0x55d9873a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.096+0000 7f5666a00640 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873a3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.096+0000 7f5666a00640 1 -- 172.21.15.71:0/2887589751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d98729d8b0 con 0x55d986fd82f0 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.096+0000 7f5666000640 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d9873a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.096+0000 7f5666a00640 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873a3c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5658010480 tx=0x7f5658010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f665c999cf99e365 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.097+0000 7f5653400640 1 -- 172.21.15.71:0/2887589751 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658005220 con 0x55d986fd82f0 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.097+0000 7f5653400640 1 -- 172.21.15.71:0/2887589751 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5658004c50 con 0x55d986fd82f0 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.097+0000 7f5653400640 1 -- 172.21.15.71:0/2887589751 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658011b50 con 0x55d986fd82f0 2024-05-27T09:53:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.097+0000 7f565f400640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f564c0b29d0 0x7f564c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.097+0000 7f565f400640 1 -- 172.21.15.71:0/992515355 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5654102d20 con 0x7f566810b7f0 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.097+0000 7f5667400640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f564c0b29d0 0x7f564c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 -- 172.21.15.71:0/2887589751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 msgr2=0x55d9873a3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873a3c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5658010480 tx=0x7f5658010940 comp rx=0 tx=0).stop 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 -- 172.21.15.71:0/2887589751 shutdown_connections 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d9873a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873a3c90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 --2- 172.21.15.71:0/2887589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873a3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 -- 172.21.15.71:0/2887589751 >> 172.21.15.71:0/2887589751 conn(0x55d986ff5300 msgr2=0x55d9873a0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5667400640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f564c0b29d0 0x7f564c0b4ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55d9873a4910 tx=0x7f5660009500 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 -- 172.21.15.71:0/2887589751 shutdown_connections 2024-05-27T09:53:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.098+0000 7f5674636740 1 -- 172.21.15.71:0/2887589751 wait complete. 2024-05-27T09:53:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.099+0000 7f5674636740 1 -- start start 2024-05-27T09:53:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.099+0000 7f5674636740 1 Processor -- start 2024-05-27T09:53:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5674636740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fd82f0 0x55d9873b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5674636740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fe04d0 0x55d9873b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5674636740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5674636740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d986fea790 con 0x55d986fd82f0 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5674636740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d9872acbc0 con 0x55d986fe04d0 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5674636740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9873b91a0 con 0x55d9870011b0 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5674636740 10 client.0 _ll_register_callbacks cb 0x55d98728a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fe04d0 0x55d9873b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5667400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fd82f0 0x55d9873b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fe04d0 0x55d9873b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57270/0 (socket says 172.21.15.71:57270) 2024-05-27T09:53:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 -- 172.21.15.71:0/2371180384 learned_addr learned my addr 172.21.15.71:0/2371180384 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 -- 172.21.15.71:0/2371180384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 msgr2=0x55d9873c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 -- 172.21.15.71:0/2371180384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fd82f0 msgr2=0x55d9873b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fd82f0 0x55d9873b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.100+0000 7f5666000640 1 -- 172.21.15.71:0/2371180384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d987019210 con 0x55d986fe04d0 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5666000640 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fe04d0 0x55d9873b6720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f565403b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6ec9a6cf36e39ed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5647e00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5647e00640 1 -- 172.21.15.71:0/2371180384 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654049070 con 0x55d986fe04d0 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5658004c50 con 0x55d986fe04d0 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5647e00640 1 -- 172.21.15.71:0/2371180384 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f5654100700 con 0x55d986fe04d0 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5647e00640 1 -- 172.21.15.71:0/2371180384 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f56540c9e90 con 0x55d986fe04d0 2024-05-27T09:53:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5674636740 10 client.26393 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.101+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d9870e5620 con 0x55d986fe04d0 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5647e00640 1 -- 172.21.15.71:0/2371180384 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5658004c50 con 0x55d986fe04d0 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5647e00640 1 -- 172.21.15.71:0/2371180384 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f56540d29e0 con 0x55d986fe04d0 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5674636740 10 client.26393 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5674636740 10 client.26393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5674636740 20 client.26393 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5674636740 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986fbfd80 0x55d9873c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5674636740 4 client.26393 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d987316ae0 con 0x55d986fbfd80 2024-05-27T09:53:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.102+0000 7f5666a00640 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986fbfd80 0x55d9873c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.103+0000 7f5666a00640 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986fbfd80 0x55d9873c8510 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ee7cd9e6d3be972 server_cookie=fbdb338878bf936f in_seq=0 out_seq=0 2024-05-27T09:53:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.103+0000 7f5647e00640 10 client.26393 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5647e00640 1 -- 172.21.15.71:0/2371180384 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d987316ae0 con 0x55d986fbfd80 2024-05-27T09:53:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5647e00640 10 client.26393 handle_command_reply: tid=0 2024-05-27T09:53:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 client.26393 shutdown 2024-05-27T09:53:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fe04d0 msgr2=0x55d9873b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fe04d0 0x55d9873b6720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f565403b460 comp rx=0 tx=0).stop 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 shutdown_connections 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fe04d0 0x55d9873b6720 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986fbfd80 0x55d9873c8510 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 --2- 172.21.15.71:0/2371180384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fd82f0 0x55d9873b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5647e00640 0 client.26393 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 >> 172.21.15.71:0/2371180384 conn(0x55d986ff5300 msgr2=0x55d9873a5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 shutdown_connections 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.104+0000 7f5674636740 1 -- 172.21.15.71:0/2371180384 wait complete. 2024-05-27T09:53:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.105+0000 7f5674636740 20 client.26393 trim_cache size 0 max 16384 2024-05-27T09:53:42.125 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 Processor -- start 2024-05-27T09:53:42.125 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 -- start start 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873b8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d98739f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56681b00a0 con 0x55d9870011b0 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f56681ad970 con 0x55d986fd82f0 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.124+0000 7f5674636740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56681ab820 con 0x55d986fe04d0 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d98739f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d98739f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40338/0 (socket says 172.21.15.71:40338) 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 -- 172.21.15.71:0/3652403217 learned_addr learned my addr 172.21.15.71:0/3652403217 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666a00640 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5667400640 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 -- 172.21.15.71:0/3652403217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 msgr2=0x55d9873b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873b8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 -- 172.21.15.71:0/3652403217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 msgr2=0x55d9873b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 -- 172.21.15.71:0/3652403217 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d98739ff00 con 0x55d986fe04d0 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666a00640 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5667400640 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.125+0000 7f5666000640 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d98739f330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56540c9320 tx=0x7f5654009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=573c92713673c964 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.126+0000 7f5652a00640 1 -- 172.21.15.71:0/3652403217 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654049070 con 0x55d986fe04d0 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.126+0000 7f5652a00640 1 -- 172.21.15.71:0/3652403217 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56540c9bd0 con 0x55d986fe04d0 2024-05-27T09:53:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.126+0000 7f5652a00640 1 -- 172.21.15.71:0/3652403217 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56540c9830 con 0x55d986fe04d0 2024-05-27T09:53:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 -- 172.21.15.71:0/3652403217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 msgr2=0x55d98739f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d98739f330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56540c9320 tx=0x7f5654009260 comp rx=0 tx=0).stop 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 -- 172.21.15.71:0/3652403217 shutdown_connections 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9870011b0 0x55d9873b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d986fe04d0 0x55d98739f330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 --2- 172.21.15.71:0/3652403217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 -- 172.21.15.71:0/3652403217 >> 172.21.15.71:0/3652403217 conn(0x55d986ff5300 msgr2=0x55d9873a40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 -- 172.21.15.71:0/3652403217 shutdown_connections 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.127+0000 7f5674636740 1 -- 172.21.15.71:0/3652403217 wait complete. 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.128+0000 7f5674636740 1 -- start start 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.128+0000 7f5674636740 1 Processor -- start 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5674636740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5674636740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fe04d0 0x55d9873becd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5674636740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5674636740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56681abe70 con 0x55d986fe04d0 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5674636740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f56681ad2a0 con 0x55d986fd82f0 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5674636740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56681ac500 con 0x55d9870011b0 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5674636740 10 client.0 _ll_register_callbacks cb 0x7f5654106500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5666a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5666a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873be790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57286/0 (socket says 172.21.15.71:57286) 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5666a00640 1 -- 172.21.15.71:0/501181945 learned_addr learned my addr 172.21.15.71:0/501181945 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5666000640 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fe04d0 0x55d9873becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.129+0000 7f5667400640 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5666a00640 1 -- 172.21.15.71:0/501181945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 msgr2=0x55d9873b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5666a00640 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5666a00640 1 -- 172.21.15.71:0/501181945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fe04d0 msgr2=0x55d9873becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5666a00640 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fe04d0 0x55d9873becd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5666a00640 1 -- 172.21.15.71:0/501181945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9873b0df0 con 0x55d986fd82f0 2024-05-27T09:53:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5666a00640 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873be790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5658010e40 tx=0x7f5658005c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2910c4bb73857e1f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5647e00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:53:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5647e00640 1 -- 172.21.15.71:0/501181945 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658005450 con 0x55d986fd82f0 2024-05-27T09:53:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5647e00640 1 -- 172.21.15.71:0/501181945 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f56580055f0 con 0x55d986fd82f0 2024-05-27T09:53:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.130+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56540c9bd0 con 0x55d986fd82f0 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5647e00640 1 -- 172.21.15.71:0/501181945 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5658039050 con 0x55d986fd82f0 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 10 client.26399 fetch_fsmap learned FSMap version 30 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d9873bdfd0 con 0x55d986fd82f0 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5647e00640 1 -- 172.21.15.71:0/501181945 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56540c9bd0 con 0x55d986fd82f0 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5647e00640 1 -- 172.21.15.71:0/501181945 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f5658004930 con 0x55d986fd82f0 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 10 client.26399 fetch_fsmap finished waiting for FSMap version 30 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 10 client.26399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 20 client.26399 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986f951c0 0x55d987432c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 4 client.26399 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d9873102c0 con 0x55d986f951c0 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.131+0000 7f5666000640 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986f951c0 0x55d987432c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.132+0000 7f5647e00640 10 client.26399 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.132+0000 7f5666000640 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986f951c0 0x55d987432c70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c9a9ab1c1e49fa server_cookie=9c41e982658db30c in_seq=0 out_seq=0 2024-05-27T09:53:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.143+0000 7f5647e00640 1 -- 172.21.15.71:0/501181945 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d9873102c0 con 0x55d986f951c0 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.143+0000 7f5647e00640 10 client.26399 handle_command_reply: tid=0 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.143+0000 7f5674636740 1 client.26399 shutdown 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.143+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 msgr2=0x55d9873be790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.143+0000 7f5674636740 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873be790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5658010e40 tx=0x7f5658005c60 comp rx=0 tx=0).stop 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 shutdown_connections 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9870011b0 0x55d9873b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d986f951c0 0x55d987432c70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d986fe04d0 0x55d9873becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 --2- 172.21.15.71:0/501181945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d986fd82f0 0x55d9873be790 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5647e00640 0 client.26399 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 >> 172.21.15.71:0/501181945 conn(0x55d986ff5300 msgr2=0x55d9873b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 shutdown_connections 2024-05-27T09:53:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 1 -- 172.21.15.71:0/501181945 wait complete. 2024-05-27T09:53:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.144+0000 7f5674636740 20 client.26399 trim_cache size 0 max 16384 2024-05-27T09:53:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:53:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:53:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f564c0b29d0 msgr2=0x7f564c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f564c0b29d0 0x7f564c0b4ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55d9873a4910 tx=0x7f5660009500 comp rx=0 tx=0).stop 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810b7f0 msgr2=0x7f56681a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810b7f0 0x7f56681a2c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5654005ab0 tx=0x7f5654003c80 comp rx=0 tx=0).stop 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 shutdown_connections 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f564c0b29d0 0x7f564c0b4ee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f566810e1e0 0x7f566819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566810b7f0 0x7f56681a2c40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 --2- 172.21.15.71:0/992515355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5668104d90 0x7f56681a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 >> 172.21.15.71:0/992515355 conn(0x7f56680782d0 msgr2=0x7f566810e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 shutdown_connections 2024-05-27T09:53:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:42.145+0000 7f566d600640 1 -- 172.21.15.71:0/992515355 wait complete. 2024-05-27T09:53:43.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:42 smithi071 ceph-mon[31451]: pgmap v181: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 237 op/s 2024-05-27T09:53:43.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:42 smithi122 ceph-mon[36436]: pgmap v181: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 237 op/s 2024-05-27T09:53:43.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:42 smithi072 ceph-mon[35951]: pgmap v181: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 237 op/s 2024-05-27T09:53:43.508 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:53:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: ignoring --setuser ceph since I am not root 2024-05-27T09:53:43.508 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:53:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: ignoring --setgroup ceph since I am not root 2024-05-27T09:53:43.508 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:53:43 smithi071 ceph-mds[73885]: -- 172.21.15.71:0/1581803966 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd23495a40 con 0x55bd234dd180 2024-05-27T09:53:43.509 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 09:53:43 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: starting mds.g at 2024-05-27T09:53:44.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:43 smithi122 ceph-mon[36436]: daemon mds.g restarted 2024-05-27T09:53:44.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:43 smithi122 ceph-mon[36436]: pgmap v182: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 993 KiB/s wr, 148 op/s 2024-05-27T09:53:44.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:43 smithi071 ceph-mon[31451]: daemon mds.g restarted 2024-05-27T09:53:44.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:43 smithi071 ceph-mon[31451]: pgmap v182: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 993 KiB/s wr, 148 op/s 2024-05-27T09:53:44.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:43 smithi072 ceph-mon[35951]: daemon mds.g restarted 2024-05-27T09:53:44.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:43 smithi072 ceph-mon[35951]: pgmap v182: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 993 KiB/s wr, 148 op/s 2024-05-27T09:53:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:44 smithi122 ceph-mon[36436]: osdmap e85: 12 total, 12 up, 12 in 2024-05-27T09:53:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:44 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6838/3914343352,v1:172.21.15.71:6839/3914343352] up:boot 2024-05-27T09:53:45.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:44 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-05-27T09:53:45.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:44 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:53:45.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:44 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:53:45.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:44 smithi071 ceph-mon[31451]: osdmap e85: 12 total, 12 up, 12 in 2024-05-27T09:53:45.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:44 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6838/3914343352,v1:172.21.15.71:6839/3914343352] up:boot 2024-05-27T09:53:45.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:44 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-05-27T09:53:45.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:44 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:53:45.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:44 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:53:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:44 smithi072 ceph-mon[35951]: osdmap e85: 12 total, 12 up, 12 in 2024-05-27T09:53:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:44 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6838/3914343352,v1:172.21.15.71:6839/3914343352] up:boot 2024-05-27T09:53:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:44 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-05-27T09:53:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:44 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T09:53:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:44 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:53:46.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:45 smithi122 ceph-mon[36436]: pgmap v184: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 178 op/s 2024-05-27T09:53:46.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:45 smithi071 ceph-mon[31451]: pgmap v184: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 178 op/s 2024-05-27T09:53:46.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:45 smithi072 ceph-mon[35951]: pgmap v184: 97 pgs: 97 active+clean; 38 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 178 op/s 2024-05-27T09:53:48.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:48 smithi122 ceph-mon[36436]: pgmap v185: 97 pgs: 97 active+clean; 35 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-05-27T09:53:49.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:48 smithi071 ceph-mon[31451]: pgmap v185: 97 pgs: 97 active+clean; 35 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-05-27T09:53:49.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:48 smithi072 ceph-mon[35951]: pgmap v185: 97 pgs: 97 active+clean; 35 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-05-27T09:53:50.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:50 smithi122 ceph-mon[36436]: pgmap v186: 97 pgs: 97 active+clean; 35 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-05-27T09:53:51.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:50 smithi071 ceph-mon[31451]: pgmap v186: 97 pgs: 97 active+clean; 35 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-05-27T09:53:51.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:50 smithi072 ceph-mon[35951]: pgmap v186: 97 pgs: 97 active+clean; 35 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-05-27T09:53:52.257 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0xffdb8 2024-05-27T09:53:52.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:52 smithi122 ceph-mon[36436]: pgmap v187: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 213 op/s 2024-05-27T09:53:53.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:52 smithi071 ceph-mon[31451]: pgmap v187: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 213 op/s 2024-05-27T09:53:53.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:52 smithi072 ceph-mon[35951]: pgmap v187: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 213 op/s 2024-05-27T09:53:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:54 smithi071 ceph-mon[31451]: pgmap v188: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 213 op/s 2024-05-27T09:53:55.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:54 smithi072 ceph-mon[35951]: pgmap v188: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 213 op/s 2024-05-27T09:53:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:54 smithi122 ceph-mon[36436]: pgmap v188: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 213 op/s 2024-05-27T09:53:55.392 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.392+0000 7eff62800640 1 -- 172.21.15.71:0/1774769968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c1103c0 msgr2=0x7eff5c1127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.392 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.392+0000 7eff62800640 1 --2- 172.21.15.71:0/1774769968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c1103c0 0x7eff5c1127e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7eff54009be0 tx=0x7eff5402a6c0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.392+0000 7eff62800640 1 -- 172.21.15.71:0/1774769968 shutdown_connections 2024-05-27T09:53:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.392+0000 7eff62800640 1 --2- 172.21.15.71:0/1774769968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c1103c0 0x7eff5c1127e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.392+0000 7eff62800640 1 --2- 172.21.15.71:0/1774769968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 0x7eff5c10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.392+0000 7eff62800640 1 --2- 172.21.15.71:0/1774769968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c102820 0x7eff5c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.392+0000 7eff62800640 1 -- 172.21.15.71:0/1774769968 >> 172.21.15.71:0/1774769968 conn(0x7eff5c0fe210 msgr2=0x7eff5c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.393+0000 7eff62800640 1 -- 172.21.15.71:0/1774769968 shutdown_connections 2024-05-27T09:53:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.393+0000 7eff62800640 1 -- 172.21.15.71:0/1774769968 wait complete. 2024-05-27T09:53:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 Processor -- start 2024-05-27T09:53:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 -- start start 2024-05-27T09:53:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c102820 0x7eff5c1a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 0x7eff5c1a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c1103c0 0x7eff5c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c115e80 con 0x7eff5c102820 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c115d00 con 0x7eff5c1103c0 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.394+0000 7eff62800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c116000 con 0x7eff5c10da60 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff61400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c102820 0x7eff5c1a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 0x7eff5c1a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 0x7eff5c1a2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53708/0 (socket says 172.21.15.71:53708) 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff61400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c102820 0x7eff5c1a2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53646/0 (socket says 172.21.15.71:53646) 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 -- 172.21.15.71:0/4084375205 learned_addr learned my addr 172.21.15.71:0/4084375205 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff61e00640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c1103c0 0x7eff5c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 -- 172.21.15.71:0/4084375205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c1103c0 msgr2=0x7eff5c19c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c1103c0 0x7eff5c19c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 -- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c102820 msgr2=0x7eff5c1a2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c102820 0x7eff5c1a2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 -- 172.21.15.71:0/4084375205 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c19cdb0 con 0x7eff5c10da60 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.395+0000 7eff60a00640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 0x7eff5c1a2a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff4800e9a0 tx=0x7eff4800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.396+0000 7eff5a000640 1 -- 172.21.15.71:0/4084375205 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4800cd80 con 0x7eff5c10da60 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.396+0000 7eff5a000640 1 -- 172.21.15.71:0/4084375205 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff480035f0 con 0x7eff5c10da60 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.396+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c19d040 con 0x7eff5c10da60 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.396+0000 7eff5a000640 1 -- 172.21.15.71:0/4084375205 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48010690 con 0x7eff5c10da60 2024-05-27T09:53:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.396+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c1a92a0 con 0x7eff5c10da60 2024-05-27T09:53:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.399+0000 7eff6adb3740 1 Processor -- start 2024-05-27T09:53:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.399+0000 7eff6adb3740 1 -- start start 2024-05-27T09:53:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff5a000640 1 -- 172.21.15.71:0/4084375205 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7eff48004000 con 0x7eff5c10da60 2024-05-27T09:53:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebdba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebdc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff6adb3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56499eb4cb90 con 0x56499e8102f0 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff6adb3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56499eb3c730 con 0x56499e8184d0 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff6adb3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56499eb40770 con 0x56499e8391b0 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff61400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff60a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebdc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff61e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebdba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff61400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53656/0 (socket says 172.21.15.71:53656) 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff61400640 1 -- 172.21.15.71:0/1902734111 learned_addr learned my addr 172.21.15.71:0/1902734111 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.400+0000 7eff61e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebdba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53712/0 (socket says 172.21.15.71:53712) 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff61400640 1 -- 172.21.15.71:0/1902734111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 msgr2=0x56499ebdba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff61400640 1 --2- 172.21.15.71:0/1902734111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebdba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff61400640 1 -- 172.21.15.71:0/1902734111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 msgr2=0x56499ebdc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff61400640 1 --2- 172.21.15.71:0/1902734111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebdc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff61400640 1 -- 172.21.15.71:0/1902734111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56499ead58b0 con 0x56499e8102f0 2024-05-27T09:53:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff61400640 1 --2- 172.21.15.71:0/1902734111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdbfa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7eff50009cc0 tx=0x7eff50011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e35f6d358faee5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff4e600640 1 -- 172.21.15.71:0/1902734111 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50005220 con 0x56499e8102f0 2024-05-27T09:53:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff4e600640 1 -- 172.21.15.71:0/1902734111 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff50004c50 con 0x56499e8102f0 2024-05-27T09:53:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.401+0000 7eff4e600640 1 -- 172.21.15.71:0/1902734111 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500197f0 con 0x56499e8102f0 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.402+0000 7eff5a000640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7eff440b2950 0x7eff440b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.402+0000 7eff5a000640 1 -- 172.21.15.71:0/4084375205 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7eff480e2860 con 0x7eff5c10da60 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.402+0000 7eff61e00640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7eff440b2950 0x7eff440b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.402+0000 7eff6adb3740 1 -- 172.21.15.71:0/1902734111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 msgr2=0x56499ebdbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.402+0000 7eff6adb3740 1 --2- 172.21.15.71:0/1902734111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdbfa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7eff50009cc0 tx=0x7eff50011810 comp rx=0 tx=0).stop 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 -- 172.21.15.71:0/1902734111 shutdown_connections 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 --2- 172.21.15.71:0/1902734111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebdc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 --2- 172.21.15.71:0/1902734111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdbfa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 --2- 172.21.15.71:0/1902734111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebdba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 -- 172.21.15.71:0/1902734111 >> 172.21.15.71:0/1902734111 conn(0x56499e82d300 msgr2=0x56499ebd8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff61e00640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7eff440b2950 0x7eff440b4e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff54004af0 tx=0x7eff54005fd0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 -- 172.21.15.71:0/1902734111 shutdown_connections 2024-05-27T09:53:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 -- 172.21.15.71:0/1902734111 wait complete. 2024-05-27T09:53:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.403+0000 7eff6adb3740 1 -- start start 2024-05-27T09:53:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 1 Processor -- start 2024-05-27T09:53:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56499e822790 con 0x56499e8184d0 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56499eae4bc0 con 0x56499e8391b0 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56499ebe8b90 con 0x56499e8102f0 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff6adb3740 10 client.0 _ll_register_callbacks cb 0x56499eac2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff61400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff61400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53714/0 (socket says 172.21.15.71:53714) 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff61400640 1 -- 172.21.15.71:0/3135332964 learned_addr learned my addr 172.21.15.71:0/3135332964 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.404+0000 7eff61e00640 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff60a00640 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff61400640 1 -- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 msgr2=0x56499ebf1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff61400640 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff61400640 1 -- 172.21.15.71:0/3135332964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 msgr2=0x56499ebe6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff61400640 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff61400640 1 -- 172.21.15.71:0/3135332964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56499e851210 con 0x56499e8102f0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff61400640 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe5c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff5001b040 tx=0x7eff50005650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e86791c72d8cb90c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff42a00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff42a00640 1 -- 172.21.15.71:0/3135332964 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50029070 con 0x56499e8102f0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff50004c50 con 0x56499e8102f0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.405+0000 7eff42a00640 1 -- 172.21.15.71:0/3135332964 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7eff50005210 con 0x56499e8102f0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff42a00640 1 -- 172.21.15.71:0/3135332964 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7eff50034050 con 0x56499e8102f0 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 10 client.26446 fetch_fsmap learned FSMap version 32 2024-05-27T09:53:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56499e91d620 con 0x56499e8102f0 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff42a00640 1 -- 172.21.15.71:0/3135332964 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff50004c50 con 0x56499e8102f0 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff42a00640 1 -- 172.21.15.71:0/3135332964 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7eff50022440 con 0x56499e8102f0 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 10 client.26446 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 10 client.26446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 20 client.26446 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7f7d80 0x56499ebf7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 4 client.26446 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.406+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56499eb4eae0 con 0x56499e7f7d80 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.407+0000 7eff60a00640 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7f7d80 0x56499ebf7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.407+0000 7eff60a00640 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7f7d80 0x56499ebf7d50 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b01182dddb0a2ff7 server_cookie=d776dfc59ce22d17 in_seq=0 out_seq=0 2024-05-27T09:53:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.407+0000 7eff42a00640 10 client.26446 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff42a00640 1 -- 172.21.15.71:0/3135332964 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56499eb4eae0 con 0x56499e7f7d80 2024-05-27T09:53:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff42a00640 10 client.26446 handle_command_reply: tid=0 2024-05-27T09:53:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 client.26446 shutdown 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 msgr2=0x56499ebe5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe5c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff5001b040 tx=0x7eff50005650 comp rx=0 tx=0).stop 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 shutdown_connections 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7f7d80 0x56499ebf7d50 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3135332964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe5c00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff42a00640 0 client.26446 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.408+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 >> 172.21.15.71:0/3135332964 conn(0x56499e82d300 msgr2=0x56499ebdd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.409+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 shutdown_connections 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.409+0000 7eff6adb3740 1 -- 172.21.15.71:0/3135332964 wait complete. 2024-05-27T09:53:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.409+0000 7eff6adb3740 20 client.26446 trim_cache size 0 max 16384 2024-05-27T09:53:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 Processor -- start 2024-05-27T09:53:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 -- start start 2024-05-27T09:53:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1b43c0 con 0x56499e8184d0 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1b1c90 con 0x56499e8391b0 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff6adb3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1afae0 con 0x56499e8102f0 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff61400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff61e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff61400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53724/0 (socket says 172.21.15.71:53724) 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.428+0000 7eff61400640 1 -- 172.21.15.71:0/3069843401 learned_addr learned my addr 172.21.15.71:0/3069843401 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff60a00640 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff61400640 1 -- 172.21.15.71:0/3069843401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 msgr2=0x56499ebf1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff61400640 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff61400640 1 -- 172.21.15.71:0/3069843401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 msgr2=0x56499ebe5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff61400640 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff61400640 1 -- 172.21.15.71:0/3069843401 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56499ebe4150 con 0x56499e8102f0 2024-05-27T09:53:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff60a00640 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:53:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff61400640 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe13a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7eff50006010 tx=0x7eff50009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ec026bdf75f3096 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff4dc00640 1 -- 172.21.15.71:0/3069843401 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50029050 con 0x56499e8102f0 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff4dc00640 1 -- 172.21.15.71:0/3069843401 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff50026070 con 0x56499e8102f0 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.429+0000 7eff4dc00640 1 -- 172.21.15.71:0/3069843401 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50005010 con 0x56499e8102f0 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.430+0000 7eff6adb3740 1 -- 172.21.15.71:0/3069843401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 msgr2=0x56499ebe13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.430+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe13a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7eff50006010 tx=0x7eff50009640 comp rx=0 tx=0).stop 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 -- 172.21.15.71:0/3069843401 shutdown_connections 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8391b0 0x56499ebf1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8184d0 0x56499ebe5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3069843401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8102f0 0x56499ebe13a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 -- 172.21.15.71:0/3069843401 >> 172.21.15.71:0/3069843401 conn(0x56499e82d300 msgr2=0x56499ebe7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 -- 172.21.15.71:0/3069843401 shutdown_connections 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 -- 172.21.15.71:0/3069843401 wait complete. 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 -- start start 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.431+0000 7eff6adb3740 1 Processor -- start 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebe0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff6adb3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebece20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff6adb3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1b0150 con 0x56499e8102f0 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff6adb3740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1b15c0 con 0x56499e8184d0 2024-05-27T09:53:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff6adb3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1b0820 con 0x56499e8391b0 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff6adb3740 10 client.0 _ll_register_callbacks cb 0x7eff480e8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff60a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebe0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff61e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff60a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebe0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47104/0 (socket says 172.21.15.71:47104) 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff60a00640 1 -- 172.21.15.71:0/3842370192 learned_addr learned my addr 172.21.15.71:0/3842370192 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.432+0000 7eff61400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff61e00640 1 -- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 msgr2=0x56499ebe0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff61e00640 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebe0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff61e00640 1 -- 172.21.15.71:0/3842370192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 msgr2=0x56499ebdffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff61e00640 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff61e00640 1 -- 172.21.15.71:0/3842370192 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56499ebed360 con 0x56499e8391b0 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff60a00640 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebe0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:53:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff61e00640 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebece20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7eff54009b30 tx=0x7eff54009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9141707af97bd518 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:53:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff42a00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:53:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff42a00640 1 -- 172.21.15.71:0/3842370192 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54036040 con 0x56499e8391b0 2024-05-27T09:53:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff50026070 con 0x56499e8391b0 2024-05-27T09:53:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.433+0000 7eff42a00640 1 -- 172.21.15.71:0/3842370192 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7eff54004240 con 0x56499e8391b0 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff42a00640 1 -- 172.21.15.71:0/3842370192 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7eff54004440 con 0x56499e8391b0 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 10 client.26452 fetch_fsmap learned FSMap version 32 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56499ebee530 con 0x56499e8391b0 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff42a00640 1 -- 172.21.15.71:0/3842370192 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff50026070 con 0x56499e8391b0 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff42a00640 1 -- 172.21.15.71:0/3842370192 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7eff54054020 con 0x56499e8391b0 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 10 client.26452 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 10 client.26452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 20 client.26452 populate_metadata read hostname 'smithi071' 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7cd1c0 0x56499ec62350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 4 client.26452 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:53:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.434+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56499eb482c0 con 0x56499e7cd1c0 2024-05-27T09:53:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.435+0000 7eff61400640 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7cd1c0 0x56499ec62350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:53:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.435+0000 7eff42a00640 10 client.26452 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.435+0000 7eff61400640 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7cd1c0 0x56499ec62350 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1778b3598cae11f server_cookie=8eaf9764193c4ccf in_seq=0 out_seq=0 2024-05-27T09:53:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff42a00640 1 -- 172.21.15.71:0/3842370192 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56499eb482c0 con 0x56499e7cd1c0 2024-05-27T09:53:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff42a00640 10 client.26452 handle_command_reply: tid=0 2024-05-27T09:53:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 client.26452 shutdown 2024-05-27T09:53:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 msgr2=0x56499ebece20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebece20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7eff54009b30 tx=0x7eff54009500 comp rx=0 tx=0).stop 2024-05-27T09:53:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 shutdown_connections 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56499e8391b0 0x56499ebece20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56499e8184d0 0x56499ebe0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56499e7cd1c0 0x56499ec62350 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 --2- 172.21.15.71:0/3842370192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56499e8102f0 0x56499ebdffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 >> 172.21.15.71:0/3842370192 conn(0x56499e82d300 msgr2=0x56499ebe71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff42a00640 0 client.26452 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 shutdown_connections 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.452+0000 7eff6adb3740 1 -- 172.21.15.71:0/3842370192 wait complete. 2024-05-27T09:53:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff6adb3740 20 client.26452 trim_cache size 0 max 16384 2024-05-27T09:53:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:53:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:53:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:53:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7eff440b2950 msgr2=0x7eff440b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7eff440b2950 0x7eff440b4e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff54004af0 tx=0x7eff54005fd0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 msgr2=0x7eff5c1a2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 0x7eff5c1a2a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff4800e9a0 tx=0x7eff4800ee60 comp rx=0 tx=0).stop 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 shutdown_connections 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7eff440b2950 0x7eff440b4e60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c1103c0 0x7eff5c19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff5c10da60 0x7eff5c1a2a40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 --2- 172.21.15.71:0/4084375205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5c102820 0x7eff5c1a2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.453+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 >> 172.21.15.71:0/4084375205 conn(0x7eff5c0fe210 msgr2=0x7eff5c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.454+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 shutdown_connections 2024-05-27T09:53:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:53:55.454+0000 7eff62800640 1 -- 172.21.15.71:0/4084375205 wait complete. 2024-05-27T09:53:57.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:56 smithi071 ceph-mon[31451]: pgmap v189: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:57.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:56 smithi072 ceph-mon[35951]: pgmap v189: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:57.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:56 smithi122 ceph-mon[36436]: pgmap v189: 97 pgs: 97 active+clean; 36 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-27T09:53:59.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:53:58 smithi071 ceph-mon[31451]: pgmap v190: 97 pgs: 97 active+clean; 38 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 262 op/s 2024-05-27T09:53:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:53:58 smithi072 ceph-mon[35951]: pgmap v190: 97 pgs: 97 active+clean; 38 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 262 op/s 2024-05-27T09:53:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:53:58 smithi122 ceph-mon[36436]: pgmap v190: 97 pgs: 97 active+clean; 38 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 262 op/s 2024-05-27T09:54:01.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:00 smithi071 ceph-mon[31451]: pgmap v191: 97 pgs: 97 active+clean; 38 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.0 MiB/s wr, 169 op/s 2024-05-27T09:54:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:00 smithi072 ceph-mon[35951]: pgmap v191: 97 pgs: 97 active+clean; 38 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.0 MiB/s wr, 169 op/s 2024-05-27T09:54:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:00 smithi122 ceph-mon[36436]: pgmap v191: 97 pgs: 97 active+clean; 38 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.0 MiB/s wr, 169 op/s 2024-05-27T09:54:03.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:02 smithi071 ceph-mon[31451]: pgmap v192: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 262 op/s 2024-05-27T09:54:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:02 smithi072 ceph-mon[35951]: pgmap v192: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 262 op/s 2024-05-27T09:54:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:02 smithi122 ceph-mon[36436]: pgmap v192: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 262 op/s 2024-05-27T09:54:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:04 smithi072 ceph-mon[35951]: pgmap v193: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1010 KiB/s wr, 176 op/s 2024-05-27T09:54:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:04 smithi122 ceph-mon[36436]: pgmap v193: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1010 KiB/s wr, 176 op/s 2024-05-27T09:54:05.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:04 smithi071 ceph-mon[31451]: pgmap v193: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1010 KiB/s wr, 176 op/s 2024-05-27T09:54:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:06 smithi072 ceph-mon[35951]: pgmap v194: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1010 KiB/s wr, 176 op/s 2024-05-27T09:54:07.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:06 smithi122 ceph-mon[36436]: pgmap v194: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1010 KiB/s wr, 176 op/s 2024-05-27T09:54:07.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:06 smithi071 ceph-mon[31451]: pgmap v194: 97 pgs: 97 active+clean; 40 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1010 KiB/s wr, 176 op/s 2024-05-27T09:54:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.697+0000 7fb41f200640 1 -- 172.21.15.71:0/98080633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010e8b0 msgr2=0x7fb42010ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.697+0000 7fb41f200640 1 --2- 172.21.15.71:0/98080633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010e8b0 0x7fb42010ece0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009900 tx=0x7fb40c02a410 comp rx=0 tx=0).stop 2024-05-27T09:54:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.698+0000 7fb41f200640 1 -- 172.21.15.71:0/98080633 shutdown_connections 2024-05-27T09:54:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.698+0000 7fb41f200640 1 --2- 172.21.15.71:0/98080633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb42010f370 0x7fb420116b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.698+0000 7fb41f200640 1 --2- 172.21.15.71:0/98080633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010e8b0 0x7fb42010ece0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.698+0000 7fb41f200640 1 --2- 172.21.15.71:0/98080633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42010a320 0x7fb42010a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.698+0000 7fb41f200640 1 -- 172.21.15.71:0/98080633 >> 172.21.15.71:0/98080633 conn(0x7fb420076070 msgr2=0x7fb420076480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.698+0000 7fb41f200640 1 -- 172.21.15.71:0/98080633 shutdown_connections 2024-05-27T09:54:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.698+0000 7fb41f200640 1 -- 172.21.15.71:0/98080633 wait complete. 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.699+0000 7fb41f200640 1 Processor -- start 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.699+0000 7fb41f200640 1 -- start start 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010a320 0x7fb4201a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41f200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42010e8b0 0x7fb4201a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41f200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb42010f370 0x7fb4201a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb42011a250 con 0x7fb42010a320 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41f200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb42011a0d0 con 0x7fb42010e8b0 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41f200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb42011a3d0 con 0x7fb42010f370 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010a320 0x7fb4201a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010a320 0x7fb4201a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48762/0 (socket says 172.21.15.71:48762) 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41de00640 1 -- 172.21.15.71:0/2626824886 learned_addr learned my addr 172.21.15.71:0/2626824886 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41e800640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb42010f370 0x7fb4201a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.700+0000 7fb41d400640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42010e8b0 0x7fb4201a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.701+0000 7fb41d400640 1 -- 172.21.15.71:0/2626824886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb42010f370 msgr2=0x7fb4201a5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.701+0000 7fb41d400640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb42010f370 0x7fb4201a5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.701+0000 7fb41d400640 1 -- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010a320 msgr2=0x7fb4201a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.701+0000 7fb41d400640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010a320 0x7fb4201a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.701+0000 7fb41d400640 1 -- 172.21.15.71:0/2626824886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4201a5b90 con 0x7fb42010e8b0 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.701+0000 7fb41de00640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010a320 0x7fb4201a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:54:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.701+0000 7fb41d400640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42010e8b0 0x7fb4201a1290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb40c02a930 tx=0x7fb40c031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.702+0000 7fb416a00640 1 -- 172.21.15.71:0/2626824886 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c03f070 con 0x7fb42010e8b0 2024-05-27T09:54:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.702+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4201a5e20 con 0x7fb42010e8b0 2024-05-27T09:54:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.702+0000 7fb416a00640 1 -- 172.21.15.71:0/2626824886 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb40c004490 con 0x7fb42010e8b0 2024-05-27T09:54:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.702+0000 7fb416a00640 1 -- 172.21.15.71:0/2626824886 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c035070 con 0x7fb42010e8b0 2024-05-27T09:54:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.702+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4201a6360 con 0x7fb42010e8b0 2024-05-27T09:54:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.706+0000 7fb416a00640 1 -- 172.21.15.71:0/2626824886 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fb40c043400 con 0x7fb42010e8b0 2024-05-27T09:54:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.706+0000 7fb42bd6e740 1 Processor -- start 2024-05-27T09:54:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.706+0000 7fb42bd6e740 1 -- start start 2024-05-27T09:54:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa404a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa404fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0414d0 0x564afa4054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564afa375b90 con 0x564afa0392f0 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564afa365730 con 0x564afa0621b0 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564afa369770 con 0x564afa0414d0 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb41e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa404a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb41e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa404a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:39950/0 (socket says 172.21.15.71:39950) 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb41e800640 1 -- 172.21.15.71:0/666830065 learned_addr learned my addr 172.21.15.71:0/666830065 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb41d400640 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0414d0 0x564afa4054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.707+0000 7fb41de00640 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa404fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb416a00640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb4040b2950 0x7fb4040b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41e800640 1 -- 172.21.15.71:0/666830065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0414d0 msgr2=0x564afa4054e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41e800640 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0414d0 0x564afa4054e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41e800640 1 -- 172.21.15.71:0/666830065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 msgr2=0x564afa404fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41e800640 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa404fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41e800640 1 -- 172.21.15.71:0/666830065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564afa2fe8b0 con 0x564afa0621b0 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb416a00640 1 -- 172.21.15.71:0/2626824886 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fb40c102ac0 con 0x7fb42010e8b0 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41de00640 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa404fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41e800640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb4040b2950 0x7fb4040b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.708+0000 7fb41e800640 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa404a60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb418011590 tx=0x7fb418011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f455f4d39d24cc66 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.709+0000 7fb40b000640 1 -- 172.21.15.71:0/666830065 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418017050 con 0x564afa0621b0 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.709+0000 7fb40b000640 1 -- 172.21.15.71:0/666830065 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41801bb90 con 0x564afa0621b0 2024-05-27T09:54:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.709+0000 7fb40b000640 1 -- 172.21.15.71:0/666830065 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41800e3b0 con 0x564afa0621b0 2024-05-27T09:54:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.709+0000 7fb41e800640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb4040b2950 0x7fb4040b4e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb418022000 tx=0x7fb418023000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 -- 172.21.15.71:0/666830065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 msgr2=0x564afa404a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa404a60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb418011590 tx=0x7fb418011a50 comp rx=0 tx=0).stop 2024-05-27T09:54:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 -- 172.21.15.71:0/666830065 shutdown_connections 2024-05-27T09:54:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0414d0 0x564afa4054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa404fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/666830065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa404a60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 -- 172.21.15.71:0/666830065 >> 172.21.15.71:0/666830065 conn(0x564afa056300 msgr2=0x564afa401210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 -- 172.21.15.71:0/666830065 shutdown_connections 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.710+0000 7fb42bd6e740 1 -- 172.21.15.71:0/666830065 wait complete. 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.711+0000 7fb42bd6e740 1 -- start start 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.711+0000 7fb42bd6e740 1 Processor -- start 2024-05-27T09:54:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa40ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0414d0 0x564afa40f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0621b0 0x564afa41aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564afa04b790 con 0x564afa0392f0 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564afa30dbc0 con 0x564afa0414d0 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564afa411b90 con 0x564afa0621b0 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb42bd6e740 10 client.0 _ll_register_callbacks cb 0x564afa2eb400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa40ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0414d0 0x564afa40f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0621b0 0x564afa41aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0414d0 0x564afa40f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:39962/0 (socket says 172.21.15.71:39962) 2024-05-27T09:54:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41d400640 1 -- 172.21.15.71:0/3441233682 learned_addr learned my addr 172.21.15.71:0/3441233682 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa40ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48782/0 (socket says 172.21.15.71:48782) 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0621b0 0x564afa41aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:35368/0 (socket says 172.21.15.71:35368) 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41d400640 1 -- 172.21.15.71:0/3441233682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0621b0 msgr2=0x564afa41aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41d400640 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0621b0 0x564afa41aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41d400640 1 -- 172.21.15.71:0/3441233682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 msgr2=0x564afa40ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.712+0000 7fb41d400640 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa40ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb41d400640 1 -- 172.21.15.71:0/3441233682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564afa07a210 con 0x564afa0414d0 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb41d400640 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0414d0 0x564afa40f170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb40c031440 tx=0x7fb40c03b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c28ebf414a0067 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb3ff400640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:54:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb3ff400640 1 -- 172.21.15.71:0/3441233682 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c048070 con 0x564afa0414d0 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb3ff400640 1 -- 172.21.15.71:0/3441233682 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fb40c0ca080 con 0x564afa0414d0 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb41801bb90 con 0x564afa0414d0 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb3ff400640 1 -- 172.21.15.71:0/3441233682 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb40c100670 con 0x564afa0414d0 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb42bd6e740 10 client.26435 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.713+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564afa146620 con 0x564afa0414d0 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb3ff400640 1 -- 172.21.15.71:0/3441233682 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41801bb90 con 0x564afa0414d0 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb3ff400640 1 -- 172.21.15.71:0/3441233682 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fb40c04b060 con 0x564afa0414d0 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb42bd6e740 10 client.26435 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb42bd6e740 10 client.26435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb42bd6e740 20 client.26435 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564afa020d80 0x564afa420de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb42bd6e740 4 client.26435 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:54:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564afa377ae0 con 0x564afa020d80 2024-05-27T09:54:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.714+0000 7fb41de00640 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564afa020d80 0x564afa420de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.715+0000 7fb41de00640 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564afa020d80 0x564afa420de0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=648595ce6a4766e6 server_cookie=bf3a1340fea6a521 in_seq=0 out_seq=0 2024-05-27T09:54:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.715+0000 7fb3ff400640 10 client.26435 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb3ff400640 1 -- 172.21.15.71:0/3441233682 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x564afa377ae0 con 0x564afa020d80 2024-05-27T09:54:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb3ff400640 10 client.26435 handle_command_reply: tid=0 2024-05-27T09:54:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 client.26435 shutdown 2024-05-27T09:54:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0414d0 msgr2=0x564afa40f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0414d0 0x564afa40f170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb40c031440 tx=0x7fb40c03b790 comp rx=0 tx=0).stop 2024-05-27T09:54:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 shutdown_connections 2024-05-27T09:54:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0621b0 0x564afa41aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0414d0 0x564afa40f170 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564afa020d80 0x564afa420de0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/3441233682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0392f0 0x564afa40ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 >> 172.21.15.71:0/3441233682 conn(0x564afa056300 msgr2=0x564afa404890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb3ff400640 0 client.26435 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 shutdown_connections 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.716+0000 7fb42bd6e740 1 -- 172.21.15.71:0/3441233682 wait complete. 2024-05-27T09:54:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.717+0000 7fb42bd6e740 20 client.26435 trim_cache size 0 max 16384 2024-05-27T09:54:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.738+0000 7fb42bd6e740 1 Processor -- start 2024-05-27T09:54:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb42bd6e740 1 -- start start 2024-05-27T09:54:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa40a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa410d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa4112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b8720 con 0x564afa0414d0 2024-05-27T09:54:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b5ff0 con 0x564afa0621b0 2024-05-27T09:54:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b3e40 con 0x564afa0392f0 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb41de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa40a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb41d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa410d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.739+0000 7fb41e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa4112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa410d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48794/0 (socket says 172.21.15.71:48794) 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa4112c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:39974/0 (socket says 172.21.15.71:39974) 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa40a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:35384/0 (socket says 172.21.15.71:35384) 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41d400640 1 -- 172.21.15.71:0/1472904339 learned_addr learned my addr 172.21.15.71:0/1472904339 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41e800640 1 -- 172.21.15.71:0/1472904339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 msgr2=0x564afa40a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41e800640 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa40a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41e800640 1 -- 172.21.15.71:0/1472904339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 msgr2=0x564afa410d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41e800640 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa410d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41e800640 1 -- 172.21.15.71:0/1472904339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564afa405e40 con 0x564afa0621b0 2024-05-27T09:54:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41d400640 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa410d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:54:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.740+0000 7fb41e800640 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa4112c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb418005fd0 tx=0x7fb418014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3067e1b326868bb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.741+0000 7fb40a600640 1 -- 172.21.15.71:0/1472904339 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418034020 con 0x564afa0621b0 2024-05-27T09:54:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.741+0000 7fb40a600640 1 -- 172.21.15.71:0/1472904339 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41801be40 con 0x564afa0621b0 2024-05-27T09:54:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.741+0000 7fb40a600640 1 -- 172.21.15.71:0/1472904339 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41802a040 con 0x564afa0621b0 2024-05-27T09:54:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 -- 172.21.15.71:0/1472904339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 msgr2=0x564afa4112c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa4112c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb418005fd0 tx=0x7fb418014000 comp rx=0 tx=0).stop 2024-05-27T09:54:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 -- 172.21.15.71:0/1472904339 shutdown_connections 2024-05-27T09:54:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa4112c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa410d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/1472904339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa40a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 -- 172.21.15.71:0/1472904339 >> 172.21.15.71:0/1472904339 conn(0x564afa056300 msgr2=0x564afa40ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 -- 172.21.15.71:0/1472904339 shutdown_connections 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.742+0000 7fb42bd6e740 1 -- 172.21.15.71:0/1472904339 wait complete. 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 -- start start 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 Processor -- start 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa4172a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa414610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa414b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b44b0 con 0x564afa0414d0 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b5920 con 0x564afa0621b0 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b4b80 con 0x564afa0392f0 2024-05-27T09:54:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.743+0000 7fb42bd6e740 10 client.0 _ll_register_callbacks cb 0x7fb40c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa4172a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa4172a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:35390/0 (socket says 172.21.15.71:35390) 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 -- 172.21.15.71:0/143105461 learned_addr learned my addr 172.21.15.71:0/143105461 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41d400640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa414610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41e800640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa414b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 -- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 msgr2=0x564afa414b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa414b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 -- 172.21.15.71:0/143105461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 msgr2=0x564afa414610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa414610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 -- 172.21.15.71:0/143105461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564afa415090 con 0x564afa0392f0 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41e800640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa414b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41d400640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa414610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb41de00640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa4172a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x564afa405e10 tx=0x7fb410012e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4946f6aafebe2031 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.744+0000 7fb3ff400640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:54:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb3ff400640 1 -- 172.21.15.71:0/143105461 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410020970 con 0x564afa0392f0 2024-05-27T09:54:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb3ff400640 1 -- 172.21.15.71:0/143105461 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fb410020b10 con 0x564afa0392f0 2024-05-27T09:54:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564afa409220 con 0x564afa0392f0 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb3ff400640 1 -- 172.21.15.71:0/143105461 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb410020d10 con 0x564afa0392f0 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb42bd6e740 10 client.26470 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564afa489180 con 0x564afa0392f0 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb3ff400640 1 -- 172.21.15.71:0/143105461 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564afa409220 con 0x564afa0392f0 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb3ff400640 1 -- 172.21.15.71:0/143105461 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fb410010430 con 0x564afa0392f0 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb42bd6e740 10 client.26470 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb42bd6e740 10 client.26470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.745+0000 7fb42bd6e740 20 client.26470 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.746+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564af9ff61c0 0x564afa48b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.746+0000 7fb42bd6e740 4 client.26470 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:54:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.746+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564afa3712c0 con 0x564af9ff61c0 2024-05-27T09:54:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.746+0000 7fb41d400640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564af9ff61c0 0x564afa48b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.746+0000 7fb41d400640 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564af9ff61c0 0x564afa48b920 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce8ed5ceccb61f34 server_cookie=d3fda72d13e1c3f2 in_seq=0 out_seq=0 2024-05-27T09:54:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.746+0000 7fb3ff400640 10 client.26470 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.762+0000 7fb3ff400640 1 -- 172.21.15.71:0/143105461 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564afa3712c0 con 0x564af9ff61c0 2024-05-27T09:54:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.762+0000 7fb3ff400640 10 client.26470 handle_command_reply: tid=0 2024-05-27T09:54:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.762+0000 7fb42bd6e740 1 client.26470 shutdown 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 msgr2=0x564afa4172a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa4172a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x564afa405e10 tx=0x7fb410012e00 comp rx=0 tx=0).stop 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 shutdown_connections 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564afa0621b0 0x564afa414b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x564af9ff61c0 0x564afa48b920 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564afa0414d0 0x564afa414610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 --2- 172.21.15.71:0/143105461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564afa0392f0 0x564afa4172a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb3ff400640 0 client.26470 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 >> 172.21.15.71:0/143105461 conn(0x564afa056300 msgr2=0x564afa410d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 shutdown_connections 2024-05-27T09:54:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 1 -- 172.21.15.71:0/143105461 wait complete. 2024-05-27T09:54:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.763+0000 7fb42bd6e740 20 client.26470 trim_cache size 0 max 16384 2024-05-27T09:54:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:54:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:54:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb4040b2950 msgr2=0x7fb4040b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb4040b2950 0x7fb4040b4e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb418022000 tx=0x7fb418023000 comp rx=0 tx=0).stop 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42010e8b0 msgr2=0x7fb4201a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42010e8b0 0x7fb4201a1290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb40c02a930 tx=0x7fb40c031a20 comp rx=0 tx=0).stop 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 shutdown_connections 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fb4040b2950 0x7fb4040b4e60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb42010f370 0x7fb4201a5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42010e8b0 0x7fb4201a1290 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 --2- 172.21.15.71:0/2626824886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42010a320 0x7fb4201a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 >> 172.21.15.71:0/2626824886 conn(0x7fb420076070 msgr2=0x7fb420107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.764+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 shutdown_connections 2024-05-27T09:54:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:08.765+0000 7fb41f200640 1 -- 172.21.15.71:0/2626824886 wait complete. 2024-05-27T09:54:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:08 smithi072 ceph-mon[35951]: pgmap v195: 97 pgs: 97 active+clean; 41 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 248 op/s 2024-05-27T09:54:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:08 smithi122 ceph-mon[36436]: pgmap v195: 97 pgs: 97 active+clean; 41 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 248 op/s 2024-05-27T09:54:09.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:08 smithi071 ceph-mon[31451]: pgmap v195: 97 pgs: 97 active+clean; 41 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 248 op/s 2024-05-27T09:54:11.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:10 smithi072 ceph-mon[35951]: pgmap v196: 97 pgs: 97 active+clean; 41 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 972 KiB/s wr, 164 op/s 2024-05-27T09:54:11.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:10 smithi122 ceph-mon[36436]: pgmap v196: 97 pgs: 97 active+clean; 41 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 972 KiB/s wr, 164 op/s 2024-05-27T09:54:11.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:10 smithi071 ceph-mon[31451]: pgmap v196: 97 pgs: 97 active+clean; 41 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 972 KiB/s wr, 164 op/s 2024-05-27T09:54:13.032 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:12 smithi122 ceph-mon[36436]: pgmap v197: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 239 op/s 2024-05-27T09:54:13.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:12 smithi071 ceph-mon[31451]: pgmap v197: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 239 op/s 2024-05-27T09:54:13.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:12 smithi072 ceph-mon[35951]: pgmap v197: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 239 op/s 2024-05-27T09:54:14.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:13 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:54:14.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:13 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:54:14.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:13 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:54:14.716 INFO:tasks.workunit.client.0.smithi071.stdout:50000 copy from 0x898b8 to 0x92015, (0x875d bytes) at 0xb142c 2024-05-27T09:54:14.717 INFO:tasks.workunit.client.0.smithi071.stdout:All 50000 operations completed A-OK! 2024-05-27T09:54:14.722 INFO:tasks.workunit.client.0.smithi071.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-05-27T09:54:14.731 INFO:tasks.workunit.client.0.smithi071.stdout:Seed set to 1 2024-05-27T09:54:14.890 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-05-27T09:54:14.890 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-05-27T09:54:14.893 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-05-27T09:54:14.893 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-05-27T09:54:14.893 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support clone range, disabling! 2024-05-27T09:54:14.898 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support dedupe range, disabling! 2024-05-27T09:54:14.903 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero length punch hole 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support exchange range, disabling! 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero length punch hole 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero length punch hole 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero size read 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero length punch hole 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero size read 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero length punch hole 2024-05-27T09:54:14.904 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x4310e9 2024-05-27T09:54:14.920 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0x954a45 2024-05-27T09:54:14.983 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x9bc582 2024-05-27T09:54:15.040 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x9eecbc 2024-05-27T09:54:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:14 smithi122 ceph-mon[36436]: pgmap v198: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 955 KiB/s wr, 146 op/s 2024-05-27T09:54:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:14 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:54:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:14 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:54:15.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:14 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:54:15.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:14 smithi071 ceph-mon[31451]: pgmap v198: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 955 KiB/s wr, 146 op/s 2024-05-27T09:54:15.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:14 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:54:15.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:14 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:54:15.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:14 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:54:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:14 smithi072 ceph-mon[35951]: pgmap v198: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 955 KiB/s wr, 146 op/s 2024-05-27T09:54:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:14 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:54:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:14 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:54:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:14 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:54:16.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:16 smithi122 ceph-mon[36436]: pgmap v199: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 955 KiB/s wr, 146 op/s 2024-05-27T09:54:16.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:16 smithi071 ceph-mon[31451]: pgmap v199: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 955 KiB/s wr, 146 op/s 2024-05-27T09:54:16.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:16 smithi072 ceph-mon[35951]: pgmap v199: 97 pgs: 97 active+clean; 38 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 955 KiB/s wr, 146 op/s 2024-05-27T09:54:19.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:18 smithi071 ceph-mon[31451]: pgmap v200: 97 pgs: 97 active+clean; 44 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 251 op/s 2024-05-27T09:54:19.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:18 smithi072 ceph-mon[35951]: pgmap v200: 97 pgs: 97 active+clean; 44 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 251 op/s 2024-05-27T09:54:19.236 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:18 smithi122 ceph-mon[36436]: pgmap v200: 97 pgs: 97 active+clean; 44 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 251 op/s 2024-05-27T09:54:19.617 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0x9fdd84 2024-05-27T09:54:21.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:20 smithi071 ceph-mon[31451]: pgmap v201: 97 pgs: 97 active+clean; 44 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 179 op/s 2024-05-27T09:54:21.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:20 smithi072 ceph-mon[35951]: pgmap v201: 97 pgs: 97 active+clean; 44 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 179 op/s 2024-05-27T09:54:21.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:20 smithi122 ceph-mon[36436]: pgmap v201: 97 pgs: 97 active+clean; 44 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 179 op/s 2024-05-27T09:54:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 -- 172.21.15.71:0/3629964817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 msgr2=0x7fdf88112800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3629964817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf88112800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009ca0 tx=0x7fdf8002a8c0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 -- 172.21.15.71:0/3629964817 shutdown_connections 2024-05-27T09:54:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3629964817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf88112800 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3629964817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf8810c180 0x7fdf88105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3629964817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf8810bce0 0x7fdf88105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 -- 172.21.15.71:0/3629964817 >> 172.21.15.71:0/3629964817 conn(0x7fdf88101380 msgr2=0x7fdf881037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.015+0000 7fdf8e800640 1 -- 172.21.15.71:0/3629964817 shutdown_connections 2024-05-27T09:54:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.016+0000 7fdf8e800640 1 -- 172.21.15.71:0/3629964817 wait complete. 2024-05-27T09:54:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.017+0000 7fdf8e800640 1 Processor -- start 2024-05-27T09:54:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.018+0000 7fdf8e800640 1 -- start start 2024-05-27T09:54:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.018+0000 7fdf8e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf881a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.018+0000 7fdf8e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf8810bce0 0x7fdf881a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.018+0000 7fdf8e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf8810c180 0x7fdf8819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.018+0000 7fdf8e800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf88115f40 con 0x7fdf8810bce0 2024-05-27T09:54:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.018+0000 7fdf8e800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdf88115dc0 con 0x7fdf88106430 2024-05-27T09:54:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.018+0000 7fdf8e800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881160c0 con 0x7fdf8810c180 2024-05-27T09:54:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf881a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf8810c180 0x7fdf8819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf881a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37080/0 (socket says 172.21.15.71:37080) 2024-05-27T09:54:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 -- 172.21.15.71:0/3949445472 learned_addr learned my addr 172.21.15.71:0/3949445472 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf8810bce0 0x7fdf881a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf8810c180 0x7fdf8819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40604/0 (socket says 172.21.15.71:40604) 2024-05-27T09:54:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 -- 172.21.15.71:0/3949445472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf8810c180 msgr2=0x7fdf8819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf8810c180 0x7fdf8819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 -- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf8810bce0 msgr2=0x7fdf881a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf8810bce0 0x7fdf881a2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 -- 172.21.15.71:0/3949445472 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8819ce10 con 0x7fdf88106430 2024-05-27T09:54:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf8810bce0 0x7fdf881a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.019+0000 7fdf8d400640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf881a2560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00d770 tx=0x7fdf7c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.020+0000 7fdf86000640 1 -- 172.21.15.71:0/3949445472 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c017070 con 0x7fdf88106430 2024-05-27T09:54:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.020+0000 7fdf86000640 1 -- 172.21.15.71:0/3949445472 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf7c009c30 con 0x7fdf88106430 2024-05-27T09:54:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.020+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8819d0a0 con 0x7fdf88106430 2024-05-27T09:54:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.020+0000 7fdf86000640 1 -- 172.21.15.71:0/3949445472 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00f620 con 0x7fdf88106430 2024-05-27T09:54:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.020+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf881a9300 con 0x7fdf88106430 2024-05-27T09:54:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.023+0000 7fdf96e27740 1 Processor -- start 2024-05-27T09:54:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf96e27740 1 -- start start 2024-05-27T09:54:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf86000640 1 -- 172.21.15.71:0/3949445472 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fdf7c01a070 con 0x7fdf88106430 2024-05-27T09:54:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521ef5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521ef5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521ef64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf96e27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563521e66b90 con 0x563521b2a2f0 2024-05-27T09:54:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf96e27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x563521e56730 con 0x563521b531b0 2024-05-27T09:54:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf96e27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563521e5a770 con 0x563521b324d0 2024-05-27T09:54:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.024+0000 7fdf8d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521ef5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521ef5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521ef64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521ef5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36760/0 (socket says 172.21.15.71:36760) 2024-05-27T09:54:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8d400640 1 -- 172.21.15.71:0/670011814 learned_addr learned my addr 172.21.15.71:0/670011814 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8ca00640 1 -- 172.21.15.71:0/670011814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 msgr2=0x563521ef5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/670011814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521ef5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8ca00640 1 -- 172.21.15.71:0/670011814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 msgr2=0x563521ef5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/670011814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521ef5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8ca00640 1 -- 172.21.15.71:0/670011814 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563521def8b0 con 0x563521b324d0 2024-05-27T09:54:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.025+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/670011814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521ef64e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdf8819df10 tx=0x7fdf740117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e24a437269fe8f34 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.026+0000 7fdf7a600640 1 -- 172.21.15.71:0/670011814 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf74009e40 con 0x563521b324d0 2024-05-27T09:54:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.026+0000 7fdf7a600640 1 -- 172.21.15.71:0/670011814 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf74012900 con 0x563521b324d0 2024-05-27T09:54:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.026+0000 7fdf7a600640 1 -- 172.21.15.71:0/670011814 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400f8b0 con 0x563521b324d0 2024-05-27T09:54:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 -- 172.21.15.71:0/670011814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 msgr2=0x563521ef64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 --2- 172.21.15.71:0/670011814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521ef64e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdf8819df10 tx=0x7fdf740117b0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 -- 172.21.15.71:0/670011814 shutdown_connections 2024-05-27T09:54:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 --2- 172.21.15.71:0/670011814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521ef64e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 --2- 172.21.15.71:0/670011814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521ef5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 --2- 172.21.15.71:0/670011814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521ef5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 -- 172.21.15.71:0/670011814 >> 172.21.15.71:0/670011814 conn(0x563521b47300 msgr2=0x563521ef2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 -- 172.21.15.71:0/670011814 shutdown_connections 2024-05-27T09:54:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf96e27740 1 -- 172.21.15.71:0/670011814 wait complete. 2024-05-27T09:54:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf86000640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdf700b28e0 0x7fdf700b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf86000640 1 -- 172.21.15.71:0/3949445472 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fdf7c0e2230 con 0x7fdf88106430 2024-05-27T09:54:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.027+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdf700b28e0 0x7fdf700b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.028+0000 7fdf96e27740 1 -- start start 2024-05-27T09:54:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.028+0000 7fdf96e27740 1 Processor -- start 2024-05-27T09:54:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521effb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdf700b28e0 0x7fdf700b4df0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf7401c040 tx=0x7fdf74014040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f00610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf96e27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563521b3c790 con 0x563521b2a2f0 2024-05-27T09:54:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf96e27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x563521dfebc0 con 0x563521b531b0 2024-05-27T09:54:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf96e27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563521f02b90 con 0x563521b324d0 2024-05-27T09:54:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf96e27740 10 client.0 _ll_register_callbacks cb 0x563521ddc400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f00610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f00610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37102/0 (socket says 172.21.15.71:37102) 2024-05-27T09:54:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf8de00640 1 -- 172.21.15.71:0/2224568558 learned_addr learned my addr 172.21.15.71:0/2224568558 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.029+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8de00640 1 -- 172.21.15.71:0/2224568558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 msgr2=0x563521f00090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8de00640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8de00640 1 -- 172.21.15.71:0/2224568558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 msgr2=0x563521effb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8d400640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521effb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8de00640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521effb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8de00640 1 -- 172.21.15.71:0/2224568558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563521b6b210 con 0x563521b531b0 2024-05-27T09:54:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8d400640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521effb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:54:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf8de00640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f00610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdf8002aeb0 tx=0x7fdf8002f3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22785a2c8cef7d05 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.030+0000 7fdf6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:54:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.031+0000 7fdf6ea00640 1 -- 172.21.15.71:0/2224568558 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf800316e0 con 0x563521b531b0 2024-05-27T09:54:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.031+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf74012900 con 0x563521b531b0 2024-05-27T09:54:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.031+0000 7fdf6ea00640 1 -- 172.21.15.71:0/2224568558 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fdf80031880 con 0x563521b531b0 2024-05-27T09:54:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.031+0000 7fdf6ea00640 1 -- 172.21.15.71:0/2224568558 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdf80003970 con 0x563521b531b0 2024-05-27T09:54:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.031+0000 7fdf96e27740 10 client.26453 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.031+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563521c37620 con 0x563521b531b0 2024-05-27T09:54:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf6ea00640 1 -- 172.21.15.71:0/2224568558 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf74012900 con 0x563521b531b0 2024-05-27T09:54:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf6ea00640 1 -- 172.21.15.71:0/2224568558 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fdf8002f610 con 0x563521b531b0 2024-05-27T09:54:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf96e27740 10 client.26453 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf96e27740 10 client.26453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf96e27740 20 client.26453 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf96e27740 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521b11d80 0x563521f11e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf96e27740 4 client.26453 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:54:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.032+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563521e68ae0 con 0x563521b11d80 2024-05-27T09:54:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.033+0000 7fdf8d400640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521b11d80 0x563521f11e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.033+0000 7fdf8d400640 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521b11d80 0x563521f11e40 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5080c3fca98435a9 server_cookie=344c1b1a0fe16d0 in_seq=0 out_seq=0 2024-05-27T09:54:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.033+0000 7fdf6ea00640 10 client.26453 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf6ea00640 1 -- 172.21.15.71:0/2224568558 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x563521e68ae0 con 0x563521b11d80 2024-05-27T09:54:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf6ea00640 10 client.26453 handle_command_reply: tid=0 2024-05-27T09:54:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 client.26453 shutdown 2024-05-27T09:54:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 msgr2=0x563521f00610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f00610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdf8002aeb0 tx=0x7fdf8002f3f0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 shutdown_connections 2024-05-27T09:54:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f00610 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521b11d80 0x563521f11e40 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 --2- 172.21.15.71:0/2224568558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521effb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 >> 172.21.15.71:0/2224568558 conn(0x563521b47300 msgr2=0x563521ef7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf6ea00640 0 client.26453 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.034+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 shutdown_connections 2024-05-27T09:54:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.035+0000 7fdf96e27740 1 -- 172.21.15.71:0/2224568558 wait complete. 2024-05-27T09:54:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.035+0000 7fdf96e27740 20 client.26453 trim_cache size 0 max 16384 2024-05-27T09:54:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 Processor -- start 2024-05-27T09:54:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 -- start start 2024-05-27T09:54:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f02280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f17640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881b4390 con 0x563521b2a2f0 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881b1c60 con 0x563521b531b0 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.055+0000 7fdf96e27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881afab0 con 0x563521b324d0 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40624/0 (socket says 172.21.15.71:40624) 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 -- 172.21.15.71:0/932128068 learned_addr learned my addr 172.21.15.71:0/932128068 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8d400640 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f02280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8de00640 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f17640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 -- 172.21.15.71:0/932128068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 msgr2=0x563521f17640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f17640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 -- 172.21.15.71:0/932128068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 msgr2=0x563521f02280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f02280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.056+0000 7fdf8ca00640 1 -- 172.21.15.71:0/932128068 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563521ef0570 con 0x563521b324d0 2024-05-27T09:54:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.057+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009da0 tx=0x7fdf74022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fd1d55c92d8b35d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.057+0000 7fdf79c00640 1 -- 172.21.15.71:0/932128068 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7402c040 con 0x563521b324d0 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.057+0000 7fdf79c00640 1 -- 172.21.15.71:0/932128068 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf74037070 con 0x563521b324d0 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.057+0000 7fdf79c00640 1 -- 172.21.15.71:0/932128068 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400f580 con 0x563521b324d0 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 -- 172.21.15.71:0/932128068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 msgr2=0x563521f00410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009da0 tx=0x7fdf74022000 comp rx=0 tx=0).stop 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 -- 172.21.15.71:0/932128068 shutdown_connections 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b531b0 0x563521f17640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b324d0 0x563521f00410 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 --2- 172.21.15.71:0/932128068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f02280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 -- 172.21.15.71:0/932128068 >> 172.21.15.71:0/932128068 conn(0x563521b47300 msgr2=0x563521ef5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 -- 172.21.15.71:0/932128068 shutdown_connections 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.058+0000 7fdf96e27740 1 -- 172.21.15.71:0/932128068 wait complete. 2024-05-27T09:54:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 -- start start 2024-05-27T09:54:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 Processor -- start 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f03210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b324d0 0x563521f03750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b531b0 0x563521f78500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881b0120 con 0x563521b2a2f0 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881b1590 con 0x563521b324d0 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdf881b07f0 con 0x563521b531b0 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.059+0000 7fdf96e27740 10 client.0 _ll_register_callbacks cb 0x7fdf80009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b531b0 0x563521f78500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8ca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b324d0 0x563521f03750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f03210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b531b0 0x563521f78500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40638/0 (socket says 172.21.15.71:40638) 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8ca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b324d0 0x563521f03750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:37118/0 (socket says 172.21.15.71:37118) 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 -- 172.21.15.71:0/698586432 learned_addr learned my addr 172.21.15.71:0/698586432 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8d400640 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f03210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36796/0 (socket says 172.21.15.71:36796) 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 -- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b324d0 msgr2=0x563521f03750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b324d0 0x563521f03750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 -- 172.21.15.71:0/698586432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 msgr2=0x563521f03210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f03210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8de00640 1 -- 172.21.15.71:0/698586432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563521f78a40 con 0x563521b531b0 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.060+0000 7fdf8ca00640 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b324d0 0x563521f03750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf8de00640 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b531b0 0x563521f78500 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf80002230 tx=0x7fdf8002f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa1b74f858d5fa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:54:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf6ea00640 1 -- 172.21.15.71:0/698586432 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8002fb50 con 0x563521b531b0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf6ea00640 1 -- 172.21.15.71:0/698586432 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fdf8002fcf0 con 0x563521b531b0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf74037070 con 0x563521b531b0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf6ea00640 1 -- 172.21.15.71:0/698586432 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdf800305c0 con 0x563521b531b0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf96e27740 10 client.26488 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.061+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563521f79b70 con 0x563521b531b0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf6ea00640 1 -- 172.21.15.71:0/698586432 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf74037070 con 0x563521b531b0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf6ea00640 1 -- 172.21.15.71:0/698586432 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fdf8004e630 con 0x563521b531b0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf96e27740 10 client.26488 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf96e27740 10 client.26488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf96e27740 20 client.26488 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf96e27740 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521ae71c0 0x563521f7c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf96e27740 4 client.26488 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563521e622c0 con 0x563521ae71c0 2024-05-27T09:54:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.062+0000 7fdf8d400640 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521ae71c0 0x563521f7c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:22.066 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.063+0000 7fdf8d400640 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521ae71c0 0x563521f7c2f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eef57952b00e1098 server_cookie=f02209d6d4e3a59a in_seq=0 out_seq=0 2024-05-27T09:54:22.066 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.063+0000 7fdf6ea00640 10 client.26488 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf6ea00640 1 -- 172.21.15.71:0/698586432 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563521e622c0 con 0x563521ae71c0 2024-05-27T09:54:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf6ea00640 10 client.26488 handle_command_reply: tid=0 2024-05-27T09:54:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 client.26488 shutdown 2024-05-27T09:54:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b531b0 msgr2=0x563521f78500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b531b0 0x563521f78500 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf80002230 tx=0x7fdf8002f8d0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 shutdown_connections 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563521b531b0 0x563521f78500 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x563521b324d0 0x563521f03750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x563521ae71c0 0x563521f7c2f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 --2- 172.21.15.71:0/698586432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563521b2a2f0 0x563521f03210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf6ea00640 0 client.26488 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.087+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 >> 172.21.15.71:0/698586432 conn(0x563521b47300 msgr2=0x563521ef6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.088+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 shutdown_connections 2024-05-27T09:54:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.088+0000 7fdf96e27740 1 -- 172.21.15.71:0/698586432 wait complete. 2024-05-27T09:54:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.089+0000 7fdf96e27740 20 client.26488 trim_cache size 0 max 16384 2024-05-27T09:54:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:54:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:54:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.089+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdf700b28e0 msgr2=0x7fdf700b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.089+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdf700b28e0 0x7fdf700b4df0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf7401c040 tx=0x7fdf74014040 comp rx=0 tx=0).stop 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.089+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 msgr2=0x7fdf881a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.089+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf881a2560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00d770 tx=0x7fdf7c00dc30 comp rx=0 tx=0).stop 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.090+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 shutdown_connections 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.090+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdf700b28e0 0x7fdf700b4df0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.090+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf8810c180 0x7fdf8819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.090+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf8810bce0 0x7fdf881a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.090+0000 7fdf8e800640 1 --2- 172.21.15.71:0/3949445472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88106430 0x7fdf881a2560 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.090+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 >> 172.21.15.71:0/3949445472 conn(0x7fdf88101380 msgr2=0x7fdf88103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.090+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 shutdown_connections 2024-05-27T09:54:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:22.091+0000 7fdf8e800640 1 -- 172.21.15.71:0/3949445472 wait complete. 2024-05-27T09:54:23.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:22 smithi071 ceph-mon[31451]: pgmap v202: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-05-27T09:54:23.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:22 smithi072 ceph-mon[35951]: pgmap v202: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-05-27T09:54:23.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:22 smithi122 ceph-mon[36436]: pgmap v202: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-05-27T09:54:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:24 smithi071 ceph-mon[31451]: pgmap v203: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-05-27T09:54:25.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:24 smithi072 ceph-mon[35951]: pgmap v203: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-05-27T09:54:25.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:24 smithi122 ceph-mon[36436]: pgmap v203: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-05-27T09:54:27.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:26 smithi071 ceph-mon[31451]: pgmap v204: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-05-27T09:54:27.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:26 smithi072 ceph-mon[35951]: pgmap v204: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-05-27T09:54:27.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:26 smithi122 ceph-mon[36436]: pgmap v204: 97 pgs: 97 active+clean; 47 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-05-27T09:54:29.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:28 smithi072 ceph-mon[35951]: pgmap v205: 97 pgs: 97 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 410 op/s 2024-05-27T09:54:29.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:28 smithi122 ceph-mon[36436]: pgmap v205: 97 pgs: 97 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 410 op/s 2024-05-27T09:54:29.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:28 smithi071 ceph-mon[31451]: pgmap v205: 97 pgs: 97 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 410 op/s 2024-05-27T09:54:31.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:30 smithi072 ceph-mon[35951]: pgmap v206: 97 pgs: 97 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 305 op/s 2024-05-27T09:54:31.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:30 smithi122 ceph-mon[36436]: pgmap v206: 97 pgs: 97 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 305 op/s 2024-05-27T09:54:31.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:30 smithi071 ceph-mon[31451]: pgmap v206: 97 pgs: 97 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 305 op/s 2024-05-27T09:54:33.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:32 smithi072 ceph-mon[35951]: pgmap v207: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.6 MiB/s wr, 445 op/s 2024-05-27T09:54:33.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:32 smithi122 ceph-mon[36436]: pgmap v207: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.6 MiB/s wr, 445 op/s 2024-05-27T09:54:33.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:32 smithi071 ceph-mon[31451]: pgmap v207: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.6 MiB/s wr, 445 op/s 2024-05-27T09:54:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:34 smithi072 ceph-mon[35951]: pgmap v208: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.7 MiB/s wr, 293 op/s 2024-05-27T09:54:35.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:34 smithi122 ceph-mon[36436]: pgmap v208: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.7 MiB/s wr, 293 op/s 2024-05-27T09:54:35.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:34 smithi071 ceph-mon[31451]: pgmap v208: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.7 MiB/s wr, 293 op/s 2024-05-27T09:54:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 -- 172.21.15.71:0/1411698594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd980075420 msgr2=0x7fd980075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 --2- 172.21.15.71:0/1411698594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd980075420 0x7fd980075830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd970009900 tx=0x7fd97002a410 comp rx=0 tx=0).stop 2024-05-27T09:54:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 -- 172.21.15.71:0/1411698594 shutdown_connections 2024-05-27T09:54:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 --2- 172.21.15.71:0/1411698594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9801104f0 0x7fd980112910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 --2- 172.21.15.71:0/1411698594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98010db90 0x7fd98010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 --2- 172.21.15.71:0/1411698594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd980075420 0x7fd980075830 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 -- 172.21.15.71:0/1411698594 >> 172.21.15.71:0/1411698594 conn(0x7fd980079390 msgr2=0x7fd9800797d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 -- 172.21.15.71:0/1411698594 shutdown_connections 2024-05-27T09:54:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.322+0000 7fd987c00640 1 -- 172.21.15.71:0/1411698594 wait complete. 2024-05-27T09:54:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.323+0000 7fd987c00640 1 Processor -- start 2024-05-27T09:54:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.323+0000 7fd987c00640 1 -- start start 2024-05-27T09:54:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd987c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd980075420 0x7fd9801a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd987c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98010db90 0x7fd9801a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd987c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9801104f0 0x7fd98019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd987c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd980116050 con 0x7fd9801104f0 2024-05-27T09:54:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd987c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd980115ed0 con 0x7fd98010db90 2024-05-27T09:54:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd987c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801161d0 con 0x7fd980075420 2024-05-27T09:54:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd985200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd980075420 0x7fd9801a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd977e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98010db90 0x7fd9801a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd985200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd980075420 0x7fd9801a26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38526/0 (socket says 172.21.15.71:38526) 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.324+0000 7fd985200640 1 -- 172.21.15.71:0/1946983936 learned_addr learned my addr 172.21.15.71:0/1946983936 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd985c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9801104f0 0x7fd98019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd977e00640 1 -- 172.21.15.71:0/1946983936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd980075420 msgr2=0x7fd9801a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd977e00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd980075420 0x7fd9801a26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd977e00640 1 -- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9801104f0 msgr2=0x7fd98019c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd977e00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9801104f0 0x7fd98019c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd977e00640 1 -- 172.21.15.71:0/1946983936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98019cf70 con 0x7fd98010db90 2024-05-27T09:54:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd985c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9801104f0 0x7fd98019c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.325+0000 7fd977e00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98010db90 0x7fd9801a2c00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd96800e9c0 tx=0x7fd96800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.326+0000 7fd97e000640 1 -- 172.21.15.71:0/1946983936 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800ccc0 con 0x7fd98010db90 2024-05-27T09:54:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.326+0000 7fd97e000640 1 -- 172.21.15.71:0/1946983936 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9680108e0 con 0x7fd98010db90 2024-05-27T09:54:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.326+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98019d260 con 0x7fd98010db90 2024-05-27T09:54:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.326+0000 7fd97e000640 1 -- 172.21.15.71:0/1946983936 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680187c0 con 0x7fd98010db90 2024-05-27T09:54:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.326+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9801a9540 con 0x7fd98010db90 2024-05-27T09:54:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.329+0000 7fd97e000640 1 -- 172.21.15.71:0/1946983936 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd968018960 con 0x7fd98010db90 2024-05-27T09:54:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.330+0000 7fd98ebe9740 1 Processor -- start 2024-05-27T09:54:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.330+0000 7fd98ebe9740 1 -- start start 2024-05-27T09:54:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.330+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.330+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3c103eb90 con 0x55e3c0d022f0 2024-05-27T09:54:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e3c102e730 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e3c1032770 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56408/0 (socket says 172.21.15.71:56408) 2024-05-27T09:54:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38534/0 (socket says 172.21.15.71:38534) 2024-05-27T09:54:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985200640 1 -- 172.21.15.71:0/3095615554 learned_addr learned my addr 172.21.15.71:0/3095615554 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd977e00640 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985c00640 1 -- 172.21.15.71:0/3095615554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d0a4d0 msgr2=0x55e3c10ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985c00640 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985c00640 1 -- 172.21.15.71:0/3095615554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 msgr2=0x55e3c10cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985c00640 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.331+0000 7fd985c00640 1 -- 172.21.15.71:0/3095615554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c0fc78b0 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.332+0000 7fd97e000640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9640b29d0 0x7fd9640b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.332+0000 7fd97e000640 1 -- 172.21.15.71:0/1946983936 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fd9680e29d0 con 0x7fd98010db90 2024-05-27T09:54:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.332+0000 7fd985200640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9640b29d0 0x7fd9640b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.332+0000 7fd985c00640 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10cd860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd978005fd0 tx=0x7fd9780107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e6875f97e929087 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.332+0000 7fd976000640 1 -- 172.21.15.71:0/3095615554 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97801c680 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.332+0000 7fd976000640 1 -- 172.21.15.71:0/3095615554 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd97801ccd0 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.332+0000 7fd976000640 1 -- 172.21.15.71:0/3095615554 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978011d50 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3095615554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 msgr2=0x55e3c10cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10cd860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd978005fd0 tx=0x7fd9780107a0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd985200640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9640b29d0 0x7fd9640b4ee0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e3c10cec10 tx=0x7fd9700058d0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3095615554 shutdown_connections 2024-05-27T09:54:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3095615554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10cd860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3095615554 >> 172.21.15.71:0/3095615554 conn(0x55e3c0d1f300 msgr2=0x55e3c10ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3095615554 shutdown_connections 2024-05-27T09:54:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.334+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3095615554 wait complete. 2024-05-27T09:54:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 -- start start 2024-05-27T09:54:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 Processor -- start 2024-05-27T09:54:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10d7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0d14790 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0fd6bc0 con 0x55e3c0d022f0 2024-05-27T09:54:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e3c10da990 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.335+0000 7fd98ebe9740 10 client.0 _ll_register_callbacks cb 0x55e3c0fb4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10d7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10d7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42284/0 (socket says 172.21.15.71:42284) 2024-05-27T09:54:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38548/0 (socket says 172.21.15.71:38548) 2024-05-27T09:54:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd977e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985200640 1 -- 172.21.15.71:0/1060109115 learned_addr learned my addr 172.21.15.71:0/1060109115 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 -- 172.21.15.71:0/1060109115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 msgr2=0x55e3c10d7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10d7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 -- 172.21.15.71:0/1060109115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 msgr2=0x55e3c10d7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10d7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 -- 172.21.15.71:0/1060109115 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c0d43210 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd985c00640 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd9780118d0 tx=0x7fd978011670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5aa639f143de015 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.336+0000 7fd96ea00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:54:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd96ea00640 1 -- 172.21.15.71:0/1060109115 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978004cd0 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd96ea00640 1 -- 172.21.15.71:0/1060109115 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fd97801c480 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd97801ccd0 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd96ea00640 1 -- 172.21.15.71:0/1060109115 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd97801c680 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd98ebe9740 10 client.26500 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e3c0e0f620 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd96ea00640 1 -- 172.21.15.71:0/1060109115 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd97801ccd0 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.337+0000 7fd96ea00640 1 -- 172.21.15.71:0/1060109115 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fd9780057a0 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd98ebe9740 10 client.26500 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd98ebe9740 10 client.26500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd98ebe9740 20 client.26500 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0ce9d80 0x55e3c10e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd98ebe9740 4 client.26500 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3c1040ae0 con 0x55e3c0ce9d80 2024-05-27T09:54:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd985200640 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0ce9d80 0x55e3c10e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd96ea00640 10 client.26500 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.338+0000 7fd985200640 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0ce9d80 0x55e3c10e9b70 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f31529301835435a server_cookie=dd8c1e373dfa9649 in_seq=0 out_seq=0 2024-05-27T09:54:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd96ea00640 1 -- 172.21.15.71:0/1060109115 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55e3c1040ae0 con 0x55e3c0ce9d80 2024-05-27T09:54:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd96ea00640 10 client.26500 handle_command_reply: tid=0 2024-05-27T09:54:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 client.26500 shutdown 2024-05-27T09:54:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 msgr2=0x55e3c10e3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd9780118d0 tx=0x7fd978011670 comp rx=0 tx=0).stop 2024-05-27T09:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 shutdown_connections 2024-05-27T09:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3cc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0ce9d80 0x55e3c10e9b70 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/1060109115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10d7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 >> 172.21.15.71:0/1060109115 conn(0x55e3c0d1f300 msgr2=0x55e3c10cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd96ea00640 0 client.26500 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 shutdown_connections 2024-05-27T09:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 1 -- 172.21.15.71:0/1060109115 wait complete. 2024-05-27T09:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.340+0000 7fd98ebe9740 20 client.26500 trim_cache size 0 max 16384 2024-05-27T09:54:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.359+0000 7fd98ebe9740 1 Processor -- start 2024-05-27T09:54:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd98ebe9740 1 -- start start 2024-05-27T09:54:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801b45b0 con 0x55e3c0d022f0 2024-05-27T09:54:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801b1e80 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801afcd0 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd977e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd985c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd977e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10e3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38556/0 (socket says 172.21.15.71:38556) 2024-05-27T09:54:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd977e00640 1 -- 172.21.15.71:0/3914845570 learned_addr learned my addr 172.21.15.71:0/3914845570 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.360+0000 7fd985200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd977e00640 1 -- 172.21.15.71:0/3914845570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d2b1b0 msgr2=0x55e3c10e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd977e00640 1 --2- 172.21.15.71:0/3914845570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd977e00640 1 -- 172.21.15.71:0/3914845570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 msgr2=0x55e3c10c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd977e00640 1 --2- 172.21.15.71:0/3914845570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd977e00640 1 -- 172.21.15.71:0/3914845570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c10cec40 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd977e00640 1 --2- 172.21.15.71:0/3914845570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10e3a30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd9680a6ef0 tx=0x7fd96801f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=587047d28536dba9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd975600640 1 -- 172.21.15.71:0/3914845570 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680a9c80 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd975600640 1 -- 172.21.15.71:0/3914845570 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9680ae030 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.361+0000 7fd975600640 1 -- 172.21.15.71:0/3914845570 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680b2650 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3914845570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d0a4d0 msgr2=0x55e3c10e3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3914845570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10e3a30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd9680a6ef0 tx=0x7fd96801f000 comp rx=0 tx=0).stop 2024-05-27T09:54:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3914845570 shutdown_connections 2024-05-27T09:54:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3914845570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d2b1b0 0x55e3c10e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3914845570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10e3a30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/3914845570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d022f0 0x55e3c10c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3914845570 >> 172.21.15.71:0/3914845570 conn(0x55e3c0d1f300 msgr2=0x55e3c10d9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3914845570 shutdown_connections 2024-05-27T09:54:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.362+0000 7fd98ebe9740 1 -- 172.21.15.71:0/3914845570 wait complete. 2024-05-27T09:54:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.363+0000 7fd98ebe9740 1 -- start start 2024-05-27T09:54:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.363+0000 7fd98ebe9740 1 Processor -- start 2024-05-27T09:54:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10db930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd98ebe9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c1149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801b0340 con 0x55e3c0d0a4d0 2024-05-27T09:54:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801b17b0 con 0x55e3c0d022f0 2024-05-27T09:54:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd98ebe9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801b0a10 con 0x55e3c0d2b1b0 2024-05-27T09:54:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd98ebe9740 10 client.0 _ll_register_callbacks cb 0x7fd9780093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10db3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42302/0 (socket says 172.21.15.71:42302) 2024-05-27T09:54:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 -- 172.21.15.71:0/2521067107 learned_addr learned my addr 172.21.15.71:0/2521067107 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985c00640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c1149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd977e00640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10db930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 -- 172.21.15.71:0/2521067107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 msgr2=0x55e3c1149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c1149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 -- 172.21.15.71:0/2521067107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 msgr2=0x55e3c10db930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:35.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10db930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd985200640 1 -- 172.21.15.71:0/2521067107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c10caf30 con 0x55e3c0d022f0 2024-05-27T09:54:35.379 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.364+0000 7fd977e00640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10db930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:35.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd985200640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10db3f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd970009230 tx=0x7fd970009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd0327173fee28f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:35.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd96ea00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:54:35.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd96ea00640 1 -- 172.21.15.71:0/2521067107 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970035040 con 0x55e3c0d022f0 2024-05-27T09:54:35.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd96ea00640 1 -- 172.21.15.71:0/2521067107 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fd9700035f0 con 0x55e3c0d022f0 2024-05-27T09:54:35.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9680ae030 con 0x55e3c0d022f0 2024-05-27T09:54:35.380 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd96ea00640 1 -- 172.21.15.71:0/2521067107 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd9700037f0 con 0x55e3c0d022f0 2024-05-27T09:54:35.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd98ebe9740 10 client.26477 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:35.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e3c1151730 con 0x55e3c0d022f0 2024-05-27T09:54:35.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.365+0000 7fd96ea00640 1 -- 172.21.15.71:0/2521067107 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9680ae030 con 0x55e3c0d022f0 2024-05-27T09:54:35.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd96ea00640 1 -- 172.21.15.71:0/2521067107 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fd970053970 con 0x55e3c0d022f0 2024-05-27T09:54:35.381 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd98ebe9740 10 client.26477 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:35.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd98ebe9740 10 client.26477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:35.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd98ebe9740 20 client.26477 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:35.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0cbf1c0 0x55e3c1153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:35.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd98ebe9740 4 client.26477 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:54:35.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3c10d2060 con 0x55e3c0cbf1c0 2024-05-27T09:54:35.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd977e00640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0cbf1c0 0x55e3c1153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:35.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd977e00640 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0cbf1c0 0x55e3c1153ea0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=732a46f06c875165 server_cookie=bc61978764c2f217 in_seq=0 out_seq=0 2024-05-27T09:54:35.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.366+0000 7fd96ea00640 10 client.26477 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd96ea00640 1 -- 172.21.15.71:0/2521067107 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e3c10d2060 con 0x55e3c0cbf1c0 2024-05-27T09:54:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd96ea00640 10 client.26477 handle_command_reply: tid=0 2024-05-27T09:54:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd98ebe9740 1 client.26477 shutdown 2024-05-27T09:54:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 msgr2=0x55e3c10db3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10db3f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd970009230 tx=0x7fd970009260 comp rx=0 tx=0).stop 2024-05-27T09:54:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 shutdown_connections 2024-05-27T09:54:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3c0d2b1b0 0x55e3c1149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.381+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3c0cbf1c0 0x55e3c1153ea0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.382+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3c0d0a4d0 0x55e3c10db930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.382+0000 7fd98ebe9740 1 --2- 172.21.15.71:0/2521067107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3c0d022f0 0x55e3c10db3f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.382+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 >> 172.21.15.71:0/2521067107 conn(0x55e3c0d1f300 msgr2=0x55e3c10d9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.382+0000 7fd96ea00640 0 client.26477 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.382+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 shutdown_connections 2024-05-27T09:54:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.382+0000 7fd98ebe9740 1 -- 172.21.15.71:0/2521067107 wait complete. 2024-05-27T09:54:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.382+0000 7fd98ebe9740 20 client.26477 trim_cache size 0 max 16384 2024-05-27T09:54:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:54:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:54:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:54:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9640b29d0 msgr2=0x7fd9640b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9640b29d0 0x7fd9640b4ee0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e3c10cec10 tx=0x7fd9700058d0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98010db90 msgr2=0x7fd9801a2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98010db90 0x7fd9801a2c00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd96800e9c0 tx=0x7fd96800ee80 comp rx=0 tx=0).stop 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 shutdown_connections 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9640b29d0 0x7fd9640b4ee0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9801104f0 0x7fd98019c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98010db90 0x7fd9801a2c00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 --2- 172.21.15.71:0/1946983936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd980075420 0x7fd9801a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 >> 172.21.15.71:0/1946983936 conn(0x7fd980079390 msgr2=0x7fd980102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 shutdown_connections 2024-05-27T09:54:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:35.383+0000 7fd987c00640 1 -- 172.21.15.71:0/1946983936 wait complete. 2024-05-27T09:54:35.894 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-27T09:54:35.895 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.95 2024-05-27T09:54:35.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:54:36.378 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:54:36.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:36 smithi071 ceph-mon[31451]: pgmap v209: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.7 MiB/s wr, 293 op/s 2024-05-27T09:54:37.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:36 smithi122 ceph-mon[36436]: pgmap v209: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.7 MiB/s wr, 293 op/s 2024-05-27T09:54:37.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:36 smithi072 ceph-mon[35951]: pgmap v209: 97 pgs: 97 active+clean; 45 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.7 MiB/s wr, 293 op/s 2024-05-27T09:54:38.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.981+0000 7f0cddc00700 1 -- 172.21.15.71:0/2631407956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8115170 msgr2=0x7f0cd8117590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:38.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.981+0000 7f0cddc00700 1 --2- 172.21.15.71:0/2631407956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8115170 0x7f0cd8117590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b0a0 tx=0x7f0cd000b3b0 comp rx=0 tx=0).stop 2024-05-27T09:54:38.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.982+0000 7f0cddc00700 1 -- 172.21.15.71:0/2631407956 shutdown_connections 2024-05-27T09:54:38.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.982+0000 7f0cddc00700 1 --2- 172.21.15.71:0/2631407956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8115170 0x7f0cd8117590 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:38.984 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:38 smithi071 ceph-mon[31451]: pgmap v210: 97 pgs: 97 active+clean; 45 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.8 MiB/s wr, 463 op/s 2024-05-27T09:54:38.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.982+0000 7f0cddc00700 1 --2- 172.21.15.71:0/2631407956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8075b50 0x7f0cd8075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:38.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.982+0000 7f0cddc00700 1 --2- 172.21.15.71:0/2631407956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd80764a0 0x7f0cd8114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:38.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.982+0000 7f0cddc00700 1 -- 172.21.15.71:0/2631407956 >> 172.21.15.71:0/2631407956 conn(0x7f0cd8079d00 msgr2=0x7f0cd807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:38.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.982+0000 7f0cddc00700 1 -- 172.21.15.71:0/2631407956 shutdown_connections 2024-05-27T09:54:38.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.982+0000 7f0cddc00700 1 -- 172.21.15.71:0/2631407956 wait complete. 2024-05-27T09:54:38.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.983+0000 7f0cddc00700 1 Processor -- start 2024-05-27T09:54:38.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.984+0000 7f0cddc00700 1 -- start start 2024-05-27T09:54:38.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.984+0000 7f0cddc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8075b50 0x7f0cd81a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:38.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.984+0000 7f0cddc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd80764a0 0x7f0cd81a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:38.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.984+0000 7f0cddc00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8115170 0x7f0cd81a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:38.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.984+0000 7f0cddc00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd811a8f0 con 0x7f0cd80764a0 2024-05-27T09:54:38.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.984+0000 7f0cddc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd811a770 con 0x7f0cd8075b50 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.984+0000 7f0cddc00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd811aa70 con 0x7f0cd8115170 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8115170 0x7f0cd81a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8115170 0x7f0cd81a5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38584/0 (socket says 172.21.15.71:38584) 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 -- 172.21.15.71:0/4098994759 learned_addr learned my addr 172.21.15.71:0/4098994759 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cd7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8075b50 0x7f0cd81a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cd7400700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd80764a0 0x7f0cd81a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 -- 172.21.15.71:0/4098994759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8075b50 msgr2=0x7f0cd81a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8075b50 0x7f0cd81a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 -- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd80764a0 msgr2=0x7f0cd81a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd80764a0 0x7f0cd81a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 -- 172.21.15.71:0/4098994759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81a6190 con 0x7f0cd8115170 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cd7400700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd80764a0 0x7f0cd81a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:38.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.985+0000 7f0cdd200700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8115170 0x7f0cd81a5af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b070 tx=0x7f0cd0009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:38.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.986+0000 7f0cd4c00700 1 -- 172.21.15.71:0/4098994759 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0021070 con 0x7f0cd8115170 2024-05-27T09:54:38.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.986+0000 7f0cd4c00700 1 -- 172.21.15.71:0/4098994759 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd0007e30 con 0x7f0cd8115170 2024-05-27T09:54:38.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.986+0000 7f0cd4c00700 1 -- 172.21.15.71:0/4098994759 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0004730 con 0x7f0cd8115170 2024-05-27T09:54:38.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.986+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81a6420 con 0x7f0cd8115170 2024-05-27T09:54:38.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.986+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd81a6910 con 0x7f0cd8115170 2024-05-27T09:54:38.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.988+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd8077290 con 0x7f0cd8115170 2024-05-27T09:54:38.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.992+0000 7f0cd4c00700 1 -- 172.21.15.71:0/4098994759 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0cd0003c00 con 0x7f0cd8115170 2024-05-27T09:54:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.994+0000 7f0cd4c00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0cbc0b2af0 0x7f0cbc0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.994+0000 7f0cd4c00700 1 -- 172.21.15.71:0/4098994759 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f0cd000f020 con 0x7f0cd8115170 2024-05-27T09:54:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.995+0000 7f0cd7e00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0cbc0b2af0 0x7f0cbc0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:38.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.996+0000 7f0cd7e00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0cbc0b2af0 0x7f0cbc0b5000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009bf0 tx=0x7f0cc8009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:38.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:38.998+0000 7f0cd4c00700 1 -- 172.21.15.71:0/4098994759 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0cd002a020 con 0x7f0cd8115170 2024-05-27T09:54:39.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:38 smithi122 ceph-mon[36436]: pgmap v210: 97 pgs: 97 active+clean; 45 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.8 MiB/s wr, 463 op/s 2024-05-27T09:54:39.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:38 smithi072 ceph-mon[35951]: pgmap v210: 97 pgs: 97 active+clean; 45 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.8 MiB/s wr, 463 op/s 2024-05-27T09:54:39.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.360+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cd802e5e0 con 0x7f0cd8115170 2024-05-27T09:54:39.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.361+0000 7f0cd4c00700 1 -- 172.21.15.71:0/4098994759 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f0cd00ab510 con 0x7f0cd8115170 2024-05-27T09:54:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:54:39.364 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0cbc0b2af0 msgr2=0x7f0cbc0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0cbc0b2af0 0x7f0cbc0b5000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009bf0 tx=0x7f0cc8009260 comp rx=0 tx=0).stop 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8115170 msgr2=0x7f0cd81a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8115170 0x7f0cd81a5af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b070 tx=0x7f0cd0009c90 comp rx=0 tx=0).stop 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 shutdown_connections 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0cbc0b2af0 0x7f0cbc0b5000 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd8115170 0x7f0cd81a5af0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cd8075b50 0x7f0cd81a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:39.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 --2- 172.21.15.71:0/4098994759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd80764a0 0x7f0cd81a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:39.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 >> 172.21.15.71:0/4098994759 conn(0x7f0cd8079d00 msgr2=0x7f0cd8102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:39.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 shutdown_connections 2024-05-27T09:54:39.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:39.365+0000 7f0cddc00700 1 -- 172.21.15.71:0/4098994759 wait complete. 2024-05-27T09:54:39.367 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:54:40.117 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:39 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4098994759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:54:40.180 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0' 2024-05-27T09:54:40.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0 2024-05-27T09:54:40.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:39 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4098994759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:54:40.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:39 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4098994759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:54:40.671 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:54:41.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:40 smithi071 ceph-mon[31451]: pgmap v211: 97 pgs: 97 active+clean; 45 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 310 op/s 2024-05-27T09:54:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:40 smithi122 ceph-mon[36436]: pgmap v211: 97 pgs: 97 active+clean; 45 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 310 op/s 2024-05-27T09:54:41.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:40 smithi072 ceph-mon[35951]: pgmap v211: 97 pgs: 97 active+clean; 45 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 310 op/s 2024-05-27T09:54:42.956 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0x9ff773 2024-05-27T09:54:43.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:42 smithi071 ceph-mon[31451]: pgmap v212: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.9 MiB/s wr, 480 op/s 2024-05-27T09:54:43.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:42 smithi122 ceph-mon[36436]: pgmap v212: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.9 MiB/s wr, 480 op/s 2024-05-27T09:54:43.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:42 smithi072 ceph-mon[35951]: pgmap v212: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.9 MiB/s wr, 480 op/s 2024-05-27T09:54:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 -- 172.21.15.71:0/157094082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc115040 msgr2=0x7f9efc117460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:43.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 --2- 172.21.15.71:0/157094082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc115040 0x7f9efc117460 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b0a0 tx=0x7f9ef400b3b0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 -- 172.21.15.71:0/157094082 shutdown_connections 2024-05-27T09:54:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 --2- 172.21.15.71:0/157094082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc115040 0x7f9efc117460 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 --2- 172.21.15.71:0/157094082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9efc077ce0 0x7f9efc0780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 --2- 172.21.15.71:0/157094082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc078630 0x7f9efc114b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 -- 172.21.15.71:0/157094082 >> 172.21.15.71:0/157094082 conn(0x7f9efc102020 msgr2=0x7f9efc104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 -- 172.21.15.71:0/157094082 shutdown_connections 2024-05-27T09:54:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.456+0000 7f9efb200700 1 -- 172.21.15.71:0/157094082 wait complete. 2024-05-27T09:54:43.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.458+0000 7f9efb200700 1 Processor -- start 2024-05-27T09:54:43.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.458+0000 7f9efb200700 1 -- start start 2024-05-27T09:54:43.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.458+0000 7f9efb200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc077ce0 0x7f9efc1a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9efb200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc078630 0x7f9efc1a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9efb200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9efc115040 0x7f9efc1a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9efb200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc11a880 con 0x7f9efc078630 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9efb200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc11a700 con 0x7f9efc115040 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9efb200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc11aa00 con 0x7f9efc077ce0 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc077ce0 0x7f9efc1a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc077ce0 0x7f9efc1a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38614/0 (socket says 172.21.15.71:38614) 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9ef9e00700 1 -- 172.21.15.71:0/701820967 learned_addr learned my addr 172.21.15.71:0/701820967 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9ef9400700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc078630 0x7f9efc1a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.459+0000 7f9efa800700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9efc115040 0x7f9efc1a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efa800700 1 -- 172.21.15.71:0/701820967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc077ce0 msgr2=0x7f9efc1a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efa800700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc077ce0 0x7f9efc1a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efa800700 1 -- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc078630 msgr2=0x7f9efc1a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:43.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efa800700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc078630 0x7f9efc1a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efa800700 1 -- 172.21.15.71:0/701820967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9efc1a6040 con 0x7f9efc115040 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9ef9400700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc078630 0x7f9efc1a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efa800700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9efc115040 0x7f9efc1a59a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b070 tx=0x7f9ef4004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9ef2a00700 1 -- 172.21.15.71:0/701820967 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4021070 con 0x7f9efc115040 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9efc1a62d0 con 0x7f9efc115040 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9ef2a00700 1 -- 172.21.15.71:0/701820967 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef4007e30 con 0x7f9efc115040 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9ef2a00700 1 -- 172.21.15.71:0/701820967 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40045d0 con 0x7f9efc115040 2024-05-27T09:54:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.460+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9efc1adc50 con 0x7f9efc115040 2024-05-27T09:54:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.464+0000 7f9ef2a00700 1 -- 172.21.15.71:0/701820967 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f9ef4007980 con 0x7f9efc115040 2024-05-27T09:54:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.465+0000 7f9ef2a00700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ee00b2a70 0x7f9ee00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.465+0000 7f9ef2a00700 1 -- 172.21.15.71:0/701820967 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f9ef400f020 con 0x7f9efc115040 2024-05-27T09:54:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.466+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ee00b2a70 0x7f9ee00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.466+0000 7f9f0f6e2b80 1 Processor -- start 2024-05-27T09:54:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.466+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ee00b2a70 0x7f9ee00b4f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009680 tx=0x7f9eec009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.466+0000 7f9f0f6e2b80 1 -- start start 2024-05-27T09:54:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf2135ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf2136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2142d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bf2063fe0 con 0x561bf21408e0 2024-05-27T09:54:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561bf2053b80 con 0x561bf1fb6fe0 2024-05-27T09:54:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561bf2057bc0 con 0x561bf20a2b90 2024-05-27T09:54:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf2135ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf2135ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38626/0 (socket says 172.21.15.71:38626) 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9ef9e00700 1 -- 172.21.15.71:0/3123783500 learned_addr learned my addr 172.21.15.71:0/3123783500 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.467+0000 7f9efa800700 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ef9400700 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf2136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ef9e00700 1 -- 172.21.15.71:0/3123783500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 msgr2=0x561bf2136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf2136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ef9e00700 1 -- 172.21.15.71:0/3123783500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 msgr2=0x561bf2142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ef9e00700 1 -- 172.21.15.71:0/3123783500 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf201c5c0 con 0x561bf20a2b90 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf2135ce0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9eec01c570 tx=0x7f9eec014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cbe90d4d334424d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.468+0000 7f9ee7400700 1 -- 172.21.15.71:0/3123783500 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec027430 con 0x561bf20a2b90 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.469+0000 7f9ee7400700 1 -- 172.21.15.71:0/3123783500 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eec027a80 con 0x561bf20a2b90 2024-05-27T09:54:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.469+0000 7f9ee7400700 1 -- 172.21.15.71:0/3123783500 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec01dab0 con 0x561bf20a2b90 2024-05-27T09:54:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/3123783500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 msgr2=0x561bf2135ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf2135ce0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9eec01c570 tx=0x7f9eec014000 comp rx=0 tx=0).stop 2024-05-27T09:54:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/3123783500 shutdown_connections 2024-05-27T09:54:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf2135ce0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/3123783500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf2136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/3123783500 >> 172.21.15.71:0/3123783500 conn(0x561bf2050530 msgr2=0x561bf2131bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:43.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/3123783500 shutdown_connections 2024-05-27T09:54:43.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.470+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/3123783500 wait complete. 2024-05-27T09:54:43.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.471+0000 7f9f0f6e2b80 1 -- start start 2024-05-27T09:54:43.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.471+0000 7f9f0f6e2b80 1 Processor -- start 2024-05-27T09:54:43.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.471+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf213d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.471+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf213ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf213e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bf1f5a140 con 0x561bf21408e0 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561bf1ff4900 con 0x561bf1fb6fe0 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561bf21433f0 con 0x561bf20a2b90 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9f0f6e2b80 10 client.0 _ll_register_callbacks cb 0x561bf1ffde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf213d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf213d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42356/0 (socket says 172.21.15.71:42356) 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 -- 172.21.15.71:0/4118368359 learned_addr learned my addr 172.21.15.71:0/4118368359 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9400700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf213ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9efa800700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf213e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 -- 172.21.15.71:0/4118368359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 msgr2=0x561bf213ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf213ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 -- 172.21.15.71:0/4118368359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 msgr2=0x561bf213e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf213e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9e00700 1 -- 172.21.15.71:0/4118368359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf1fa3a70 con 0x561bf1fb6fe0 2024-05-27T09:54:43.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.472+0000 7f9ef9400700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf213ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:54:43.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.473+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf213d870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9eec01d5f0 tx=0x7f9eec027560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7990e517c91f45e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:43.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.473+0000 7f9edbe00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:54:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.473+0000 7f9edbe00700 1 -- 172.21.15.71:0/4118368359 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec01d850 con 0x561bf1fb6fe0 2024-05-27T09:54:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.473+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eec027a80 con 0x561bf1fb6fe0 2024-05-27T09:54:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.473+0000 7f9edbe00700 1 -- 172.21.15.71:0/4118368359 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f9eec01d9f0 con 0x561bf1fb6fe0 2024-05-27T09:54:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9edbe00700 1 -- 172.21.15.71:0/4118368359 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9eec005040 con 0x561bf1fb6fe0 2024-05-27T09:54:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9f0f6e2b80 10 client.26495 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561bf2024200 con 0x561bf1fb6fe0 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9edbe00700 1 -- 172.21.15.71:0/4118368359 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eec027a80 con 0x561bf1fb6fe0 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9edbe00700 1 -- 172.21.15.71:0/4118368359 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f9eec004ce0 con 0x561bf1fb6fe0 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9f0f6e2b80 10 client.26495 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9f0f6e2b80 10 client.26495 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.474+0000 7f9f0f6e2b80 20 client.26495 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.475+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21502e0 0x561bf2152700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.475+0000 7f9f0f6e2b80 4 client.26495 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.475+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bf2065f30 con 0x561bf21502e0 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.475+0000 7f9ef9400700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21502e0 0x561bf2152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.475+0000 7f9edbe00700 10 client.26495 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.476+0000 7f9ef9400700 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21502e0 0x561bf2152700 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=759a6184fe890052 server_cookie=60f43145fbce7a48 in_seq=0 out_seq=0 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.476+0000 7f9edbe00700 1 -- 172.21.15.71:0/4118368359 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x561bf2065f30 con 0x561bf21502e0 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.476+0000 7f9edbe00700 10 client.26495 handle_command_reply: tid=0 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 client.26495 shutdown 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 msgr2=0x561bf213d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf213d870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9eec01d5f0 tx=0x7f9eec027560 comp rx=0 tx=0).stop 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 shutdown_connections 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21502e0 0x561bf2152700 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf213e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf1fb6fe0 0x561bf213d870 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/4118368359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf20a2b90 0x561bf213ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 >> 172.21.15.71:0/4118368359 conn(0x561bf2050530 msgr2=0x561bf2135cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:43.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9edbe00700 0 client.26495 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:43.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 shutdown_connections 2024-05-27T09:54:43.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/4118368359 wait complete. 2024-05-27T09:54:43.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.477+0000 7f9f0f6e2b80 20 client.26495 trim_cache size 0 max 16384 2024-05-27T09:54:43.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 Processor -- start 2024-05-27T09:54:43.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 -- start start 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf213fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf20a2b90 0x561bf213dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf21408e0 0x561bf213e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b7910 con 0x561bf20a2b90 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b51a0 con 0x561bf21408e0 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b3010 con 0x561bf1fb6fe0 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.502+0000 7f9efa800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf21408e0 0x561bf213e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9ef9400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf20a2b90 0x561bf213dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf21408e0 0x561bf213e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42362/0 (socket says 172.21.15.71:42362) 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 -- 172.21.15.71:0/1712841520 learned_addr learned my addr 172.21.15.71:0/1712841520 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf213fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 -- 172.21.15.71:0/1712841520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 msgr2=0x561bf213fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf213fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 -- 172.21.15.71:0/1712841520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf20a2b90 msgr2=0x561bf213dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf20a2b90 0x561bf213dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 -- 172.21.15.71:0/1712841520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf213bde0 con 0x561bf21408e0 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9efa800700 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf21408e0 0x561bf213e2a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef40a6400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e705b060b2b9c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.503+0000 7f9ee6a00700 1 -- 172.21.15.71:0/1712841520 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40aa780 con 0x561bf21408e0 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.504+0000 7f9ee6a00700 1 -- 172.21.15.71:0/1712841520 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef40aac70 con 0x561bf21408e0 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.504+0000 7f9ee6a00700 1 -- 172.21.15.71:0/1712841520 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4003c00 con 0x561bf21408e0 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/1712841520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf21408e0 msgr2=0x561bf213e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf21408e0 0x561bf213e2a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef40a6400 comp rx=0 tx=0).stop 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/1712841520 shutdown_connections 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf21408e0 0x561bf213e2a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf213fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/1712841520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf20a2b90 0x561bf213dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/1712841520 >> 172.21.15.71:0/1712841520 conn(0x561bf2050530 msgr2=0x561bf213d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/1712841520 shutdown_connections 2024-05-27T09:54:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.505+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/1712841520 wait complete. 2024-05-27T09:54:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.506+0000 7f9f0f6e2b80 1 -- start start 2024-05-27T09:54:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.506+0000 7f9f0f6e2b80 1 Processor -- start 2024-05-27T09:54:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf21b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf20a2b90 0x561bf21b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9f0f6e2b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2151940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b3660 con 0x561bf21408e0 2024-05-27T09:54:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b4ad0 con 0x561bf20a2b90 2024-05-27T09:54:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9f0f6e2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b3d30 con 0x561bf1fb6fe0 2024-05-27T09:54:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9f0f6e2b80 10 client.0 _ll_register_callbacks cb 0x561bf1ffde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf21b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9ef9e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf21b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38662/0 (socket says 172.21.15.71:38662) 2024-05-27T09:54:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9ef9e00700 1 -- 172.21.15.71:0/21809713 learned_addr learned my addr 172.21.15.71:0/21809713 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9ef9400700 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf20a2b90 0x561bf21b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.507+0000 7f9efa800700 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.508+0000 7f9ef9400700 1 -- 172.21.15.71:0/21809713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 msgr2=0x561bf21b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.508+0000 7f9ef9400700 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf21b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.508+0000 7f9ef9400700 1 -- 172.21.15.71:0/21809713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 msgr2=0x561bf2151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.508+0000 7f9ef9400700 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.508+0000 7f9ef9400700 1 -- 172.21.15.71:0/21809713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf2151fb0 con 0x561bf20a2b90 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.508+0000 7f9ef9400700 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf20a2b90 0x561bf21b3370 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x561bf2131530 tx=0x7f9ee801f830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=963bb90f7cf8d2a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.508+0000 7f9edbe00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.509+0000 7f9edbe00700 1 -- 172.21.15.71:0/21809713 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8004830 con 0x561bf20a2b90 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.509+0000 7f9edbe00700 1 -- 172.21.15.71:0/21809713 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f9ee80049d0 con 0x561bf20a2b90 2024-05-27T09:54:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.509+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ef40aac70 con 0x561bf20a2b90 2024-05-27T09:54:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.509+0000 7f9edbe00700 1 -- 172.21.15.71:0/21809713 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9ee8004bd0 con 0x561bf20a2b90 2024-05-27T09:54:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.509+0000 7f9f0f6e2b80 10 client.26501 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.509+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561bf21bb650 con 0x561bf20a2b90 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.509+0000 7f9edbe00700 1 -- 172.21.15.71:0/21809713 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef40aac70 con 0x561bf20a2b90 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9edbe00700 1 -- 172.21.15.71:0/21809713 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f9ee8005340 con 0x561bf20a2b90 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9f0f6e2b80 10 client.26501 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9f0f6e2b80 10 client.26501 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9f0f6e2b80 20 client.26501 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21bbd80 0x561bf21be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9f0f6e2b80 4 client.26501 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}] 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}) -- 0x561bf205f710 con 0x561bf21bbd80 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.510+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21bbd80 0x561bf21be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.511+0000 7f9edbe00700 10 client.26501 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:43.511+0000 7f9ef9e00700 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21bbd80 0x561bf21be1a0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600c9f6db93cc8eb server_cookie=43d46b074e2cd132 in_seq=0 out_seq=0 2024-05-27T09:54:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.481+0000 7f9edbe00700 1 -- 172.21.15.71:0/21809713 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561bf205f710 con 0x561bf21bbd80 2024-05-27T09:54:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.481+0000 7f9edbe00700 10 client.26501 handle_command_reply: tid=0 2024-05-27T09:54:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.481+0000 7f9f0f6e2b80 1 client.26501 shutdown 2024-05-27T09:54:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf20a2b90 msgr2=0x561bf21b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf20a2b90 0x561bf21b3370 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x561bf2131530 tx=0x7f9ee801f830 comp rx=0 tx=0).stop 2024-05-27T09:54:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 shutdown_connections 2024-05-27T09:54:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561bf21bbd80 0x561bf21be1a0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bf21408e0 0x561bf2151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561bf1fb6fe0 0x561bf21b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 --2- 172.21.15.71:0/21809713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561bf20a2b90 0x561bf21b3370 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 >> 172.21.15.71:0/21809713 conn(0x561bf2050530 msgr2=0x561bf213e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9edbe00700 0 client.26501 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.482+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 shutdown_connections 2024-05-27T09:54:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.483+0000 7f9f0f6e2b80 1 -- 172.21.15.71:0/21809713 wait complete. 2024-05-27T09:54:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.483+0000 7f9f0f6e2b80 20 client.26501 trim_cache size 0 max 16384 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 18, 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "466f4387": { 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 18, 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:54:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 138.9, 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:54:44.486 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:54:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ee00b2a70 msgr2=0x7f9ee00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ee00b2a70 0x7f9ee00b4f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009680 tx=0x7f9eec009260 comp rx=0 tx=0).stop 2024-05-27T09:54:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9efc115040 msgr2=0x7f9efc1a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9efc115040 0x7f9efc1a59a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b070 tx=0x7f9ef4004d00 comp rx=0 tx=0).stop 2024-05-27T09:54:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 shutdown_connections 2024-05-27T09:54:44.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ee00b2a70 0x7f9ee00b4f80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9efc115040 0x7f9efc1a59a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9efc077ce0 0x7f9efc1a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 --2- 172.21.15.71:0/701820967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc078630 0x7f9efc1a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:44.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.484+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 >> 172.21.15.71:0/701820967 conn(0x7f9efc102020 msgr2=0x7f9efc07ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:44.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.485+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 shutdown_connections 2024-05-27T09:54:44.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:44.485+0000 7f9efb200700 1 -- 172.21.15.71:0/701820967 wait complete. 2024-05-27T09:54:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:44 smithi122 ceph-mon[36436]: pgmap v213: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-27T09:54:45.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:44 smithi071 ceph-mon[31451]: pgmap v213: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-27T09:54:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:44 smithi072 ceph-mon[35951]: pgmap v213: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-27T09:54:45.437 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '466f4387', quiesce took 9.5 seconds. Will release after: 9.45 2024-05-27T09:54:47.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:46 smithi122 ceph-mon[36436]: pgmap v214: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-27T09:54:47.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:46 smithi071 ceph-mon[31451]: pgmap v214: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-27T09:54:47.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:46 smithi072 ceph-mon[35951]: pgmap v214: 97 pgs: 97 active+clean; 47 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-27T09:54:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 -- 172.21.15.71:0/2114701368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3410c180 msgr2=0x7fdd34105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 --2- 172.21.15.71:0/2114701368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3410c180 0x7fdd34105dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009900 tx=0x7fdd2002a3f0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 -- 172.21.15.71:0/2114701368 shutdown_connections 2024-05-27T09:54:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 --2- 172.21.15.71:0/2114701368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdd34106430 0x7fdd34112800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 --2- 172.21.15.71:0/2114701368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3410c180 0x7fdd34105dc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 --2- 172.21.15.71:0/2114701368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3410bce0 0x7fdd34105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 -- 172.21.15.71:0/2114701368 >> 172.21.15.71:0/2114701368 conn(0x7fdd34101380 msgr2=0x7fdd341037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 -- 172.21.15.71:0/2114701368 shutdown_connections 2024-05-27T09:54:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.611+0000 7fdd39000640 1 -- 172.21.15.71:0/2114701368 wait complete. 2024-05-27T09:54:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 Processor -- start 2024-05-27T09:54:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 -- start start 2024-05-27T09:54:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd34106430 0x7fdd341a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3410bce0 0x7fdd341a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdd3410c180 0x7fdd3419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34115f00 con 0x7fdd3410bce0 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34115d80 con 0x7fdd34106430 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.613+0000 7fdd39000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34116080 con 0x7fdd3410c180 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd34106430 0x7fdd341a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd32a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3410bce0 0x7fdd341a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd34106430 0x7fdd341a25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34302/0 (socket says 172.21.15.71:34302) 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 -- 172.21.15.71:0/530646570 learned_addr learned my addr 172.21.15.71:0/530646570 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33e00640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdd3410c180 0x7fdd3419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 -- 172.21.15.71:0/530646570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdd3410c180 msgr2=0x7fdd3419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdd3410c180 0x7fdd3419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 -- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3410bce0 msgr2=0x7fdd341a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3410bce0 0x7fdd341a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 -- 172.21.15.71:0/530646570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3419ce70 con 0x7fdd34106430 2024-05-27T09:54:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.614+0000 7fdd33400640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd34106430 0x7fdd341a25c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400e9c0 tx=0x7fdd2400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.615+0000 7fdd2be00640 1 -- 172.21.15.71:0/530646570 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400cd80 con 0x7fdd34106430 2024-05-27T09:54:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.615+0000 7fdd2be00640 1 -- 172.21.15.71:0/530646570 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd240054d0 con 0x7fdd34106430 2024-05-27T09:54:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.615+0000 7fdd2be00640 1 -- 172.21.15.71:0/530646570 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24010430 con 0x7fdd34106430 2024-05-27T09:54:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.615+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3419d100 con 0x7fdd34106430 2024-05-27T09:54:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.615+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341a9360 con 0x7fdd34106430 2024-05-27T09:54:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.618+0000 7fdd41646740 1 Processor -- start 2024-05-27T09:54:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.618+0000 7fdd41646740 1 -- start start 2024-05-27T09:54:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.618+0000 7fdd41646740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102830ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.618+0000 7fdd41646740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102830cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.618+0000 7fdd41646740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102830d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.618+0000 7fdd41646740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56102827db90 con 0x561027f6a1b0 2024-05-27T09:54:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd41646740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56102826d730 con 0x561027f494d0 2024-05-27T09:54:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd41646740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561028271770 con 0x561027f412f0 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102830ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102830ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40546/0 (socket says 172.21.15.71:40546) 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 -- 172.21.15.71:0/3786379357 learned_addr learned my addr 172.21.15.71:0/3786379357 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd32a00640 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102830d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd2be00640 1 -- 172.21.15.71:0/530646570 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fdd24004fd0 con 0x7fdd34106430 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 -- 172.21.15.71:0/3786379357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 msgr2=0x56102830cfa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102830cfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 -- 172.21.15.71:0/3786379357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 msgr2=0x56102830d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102830d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.619+0000 7fdd33e00640 1 -- 172.21.15.71:0/3786379357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610282068b0 con 0x561027f6a1b0 2024-05-27T09:54:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.620+0000 7fdd33e00640 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102830ca60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009fd0 tx=0x7fdd2c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e5a7c45b3f230f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.620+0000 7fdd28c00640 1 -- 172.21.15.71:0/3786379357 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c004d20 con 0x561027f6a1b0 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.620+0000 7fdd28c00640 1 -- 172.21.15.71:0/3786379357 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd2c004050 con 0x561027f6a1b0 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.620+0000 7fdd28c00640 1 -- 172.21.15.71:0/3786379357 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c005280 con 0x561027f6a1b0 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 -- 172.21.15.71:0/3786379357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 msgr2=0x56102830ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102830ca60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009fd0 tx=0x7fdd2c0118d0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd2be00640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdd180b2950 0x7fdd180b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 -- 172.21.15.71:0/3786379357 shutdown_connections 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102830d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102830cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 --2- 172.21.15.71:0/3786379357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102830ca60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 -- 172.21.15.71:0/3786379357 >> 172.21.15.71:0/3786379357 conn(0x561027f5e300 msgr2=0x561028309210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd2be00640 1 -- 172.21.15.71:0/530646570 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fdd240e2970 con 0x7fdd34106430 2024-05-27T09:54:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 -- 172.21.15.71:0/3786379357 shutdown_connections 2024-05-27T09:54:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd33e00640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdd180b2950 0x7fdd180b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.621+0000 7fdd41646740 1 -- 172.21.15.71:0/3786379357 wait complete. 2024-05-27T09:54:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.622+0000 7fdd41646740 1 -- start start 2024-05-27T09:54:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.622+0000 7fdd33e00640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdd180b2950 0x7fdd180b4e60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c005fd0 tx=0x7fdd2c000f40 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.622+0000 7fdd41646740 1 Processor -- start 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd41646740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f412f0 0x561028316bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd41646740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x561028317100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd41646740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f6a1b0 0x561028322ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd41646740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561027f53790 con 0x561027f412f0 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd41646740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561028215bc0 con 0x561027f494d0 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd41646740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561028319b90 con 0x561027f6a1b0 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd41646740 10 client.0 _ll_register_callbacks cb 0x5610281f3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd33400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f412f0 0x561028316bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd33400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f412f0 0x561028316bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40550/0 (socket says 172.21.15.71:40550) 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd33400640 1 -- 172.21.15.71:0/2630783286 learned_addr learned my addr 172.21.15.71:0/2630783286 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd32a00640 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x561028317100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd33e00640 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f6a1b0 0x561028322ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd33400640 1 -- 172.21.15.71:0/2630783286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f6a1b0 msgr2=0x561028322ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd33400640 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f6a1b0 0x561028322ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.623+0000 7fdd33400640 1 -- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 msgr2=0x561028317100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd33400640 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x561028317100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd33400640 1 -- 172.21.15.71:0/2630783286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561027f82210 con 0x561027f412f0 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd33400640 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f412f0 0x561028316bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400c6a0 tx=0x7fdd240a94b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d261d354df92e4b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd1d600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd1d600640 1 -- 172.21.15.71:0/2630783286 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd240e0580 con 0x561027f412f0 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd1d600640 1 -- 172.21.15.71:0/2630783286 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fdd240a6270 con 0x561027f412f0 2024-05-27T09:54:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd2c004050 con 0x561027f412f0 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd1d600640 1 -- 172.21.15.71:0/2630783286 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd240aa380 con 0x561027f412f0 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd41646740 10 client.16362 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.624+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56102804e620 con 0x561027f412f0 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd1d600640 1 -- 172.21.15.71:0/2630783286 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd2c004050 con 0x561027f412f0 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd1d600640 1 -- 172.21.15.71:0/2630783286 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fdd240a9ee0 con 0x561027f412f0 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd41646740 10 client.16362 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd41646740 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd41646740 20 client.16362 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd41646740 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027f28d80 0x561028328dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd41646740 4 client.16362 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56102827fae0 con 0x561027f28d80 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.625+0000 7fdd32a00640 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027f28d80 0x561028328dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.626+0000 7fdd32a00640 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027f28d80 0x561028328dd0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb4c5d0f17b556d4 server_cookie=4da86c2f220ca8d7 in_seq=0 out_seq=0 2024-05-27T09:54:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.626+0000 7fdd1d600640 10 client.16362 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd1d600640 1 -- 172.21.15.71:0/2630783286 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56102827fae0 con 0x561027f28d80 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd1d600640 10 client.16362 handle_command_reply: tid=0 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 client.16362 shutdown 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f412f0 msgr2=0x561028316bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f412f0 0x561028316bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400c6a0 tx=0x7fdd240a94b0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 shutdown_connections 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f6a1b0 0x561028322ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x561028317100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027f28d80 0x561028328dd0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 --2- 172.21.15.71:0/2630783286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f412f0 0x561028316bc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 >> 172.21.15.71:0/2630783286 conn(0x561027f5e300 msgr2=0x56102830c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd1d600640 0 client.16362 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.627+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 shutdown_connections 2024-05-27T09:54:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.628+0000 7fdd41646740 1 -- 172.21.15.71:0/2630783286 wait complete. 2024-05-27T09:54:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.628+0000 7fdd41646740 20 client.16362 trim_cache size 0 max 16384 2024-05-27T09:54:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 Processor -- start 2024-05-27T09:54:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 -- start start 2024-05-27T09:54:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f412f0 0x5610283123e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f494d0 0x561028322c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x561028323170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd341b4480 con 0x561027f6a1b0 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdd341b1d50 con 0x561027f412f0 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.645+0000 7fdd41646740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdd341afba0 con 0x561027f494d0 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x561028323170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd32a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f494d0 0x561028322c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f412f0 0x5610283123e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x561028323170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40558/0 (socket says 172.21.15.71:40558) 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33e00640 1 -- 172.21.15.71:0/234630669 learned_addr learned my addr 172.21.15.71:0/234630669 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33400640 1 -- 172.21.15.71:0/234630669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f494d0 msgr2=0x561028322c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33400640 1 --2- 172.21.15.71:0/234630669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f494d0 0x561028322c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33400640 1 -- 172.21.15.71:0/234630669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 msgr2=0x561028323170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33400640 1 --2- 172.21.15.71:0/234630669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x561028323170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33400640 1 -- 172.21.15.71:0/234630669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56102830cf00 con 0x561027f412f0 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.646+0000 7fdd33400640 1 --2- 172.21.15.71:0/234630669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f412f0 0x5610283123e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd240a9c10 tx=0x7fdd24009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cca72c5fb40b1484 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd1fe00640 1 -- 172.21.15.71:0/234630669 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd240e0580 con 0x561027f412f0 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd1fe00640 1 -- 172.21.15.71:0/234630669 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd240ae030 con 0x561027f412f0 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd1fe00640 1 -- 172.21.15.71:0/234630669 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd240a9a50 con 0x561027f412f0 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd41646740 1 -- 172.21.15.71:0/234630669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f412f0 msgr2=0x5610283123e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd41646740 1 --2- 172.21.15.71:0/234630669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f412f0 0x5610283123e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd240a9c10 tx=0x7fdd24009770 comp rx=0 tx=0).stop 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd41646740 1 -- 172.21.15.71:0/234630669 shutdown_connections 2024-05-27T09:54:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd41646740 1 --2- 172.21.15.71:0/234630669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x561028323170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd41646740 1 --2- 172.21.15.71:0/234630669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f494d0 0x561028322c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd41646740 1 --2- 172.21.15.71:0/234630669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f412f0 0x5610283123e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.647+0000 7fdd41646740 1 -- 172.21.15.71:0/234630669 >> 172.21.15.71:0/234630669 conn(0x561027f5e300 msgr2=0x56102830c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.648+0000 7fdd41646740 1 -- 172.21.15.71:0/234630669 shutdown_connections 2024-05-27T09:54:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.648+0000 7fdd41646740 1 -- 172.21.15.71:0/234630669 wait complete. 2024-05-27T09:54:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.648+0000 7fdd41646740 1 -- start start 2024-05-27T09:54:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.648+0000 7fdd41646740 1 Processor -- start 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd41646740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102831f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd41646740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102831a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd41646740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102831aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd41646740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd341b0210 con 0x561027f6a1b0 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd41646740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdd341b1680 con 0x561027f494d0 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd41646740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdd341b08e0 con 0x561027f412f0 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd41646740 10 client.0 _ll_register_callbacks cb 0x7fdd2400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102831aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102831aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40572/0 (socket says 172.21.15.71:40572) 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd33e00640 1 -- 172.21.15.71:0/3057398267 learned_addr learned my addr 172.21.15.71:0/3057398267 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd32a00640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102831a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd33400640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102831f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd32a00640 1 -- 172.21.15.71:0/3057398267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 msgr2=0x56102831f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.649+0000 7fdd32a00640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102831f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd32a00640 1 -- 172.21.15.71:0/3057398267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 msgr2=0x56102831aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd32a00640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102831aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd32a00640 1 -- 172.21.15.71:0/3057398267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56102831afa0 con 0x561027f494d0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd33400640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102831f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd32a00640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102831a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009230 tx=0x7fdd20004530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f75ef83b1a7dc1ee server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd1d600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd1d600640 1 -- 172.21.15.71:0/3057398267 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20035040 con 0x561027f494d0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd240ae030 con 0x561027f494d0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.650+0000 7fdd1d600640 1 -- 172.21.15.71:0/3057398267 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fdd20005450 con 0x561027f494d0 2024-05-27T09:54:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd1d600640 1 -- 172.21.15.71:0/3057398267 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd20005650 con 0x561027f494d0 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 10 client.26519 fetch_fsmap learned FSMap version 32 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561028391020 con 0x561027f494d0 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd1d600640 1 -- 172.21.15.71:0/3057398267 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd240ae030 con 0x561027f494d0 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd1d600640 1 -- 172.21.15.71:0/3057398267 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fdd20003a00 con 0x561027f494d0 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 10 client.26519 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 10 client.26519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 20 client.26519 populate_metadata read hostname 'smithi071' 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027efe1c0 0x561028393760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 4 client.26519 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.651+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5610282792c0 con 0x561027efe1c0 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.652+0000 7fdd33400640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027efe1c0 0x561028393760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.652+0000 7fdd33400640 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027efe1c0 0x561028393760 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3392cadb863dae26 server_cookie=6e2962538548dfe1 in_seq=0 out_seq=0 2024-05-27T09:54:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.652+0000 7fdd1d600640 10 client.26519 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd1d600640 1 -- 172.21.15.71:0/3057398267 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5610282792c0 con 0x561027efe1c0 2024-05-27T09:54:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd1d600640 10 client.26519 handle_command_reply: tid=0 2024-05-27T09:54:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 client.26519 shutdown 2024-05-27T09:54:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 msgr2=0x56102831a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102831a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009230 tx=0x7fdd20004530 comp rx=0 tx=0).stop 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 shutdown_connections 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x561027efe1c0 0x561028393760 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561027f6a1b0 0x56102831aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561027f494d0 0x56102831a520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 --2- 172.21.15.71:0/3057398267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561027f412f0 0x56102831f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd1d600640 0 client.26519 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 >> 172.21.15.71:0/3057398267 conn(0x561027f5e300 msgr2=0x56102830c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 shutdown_connections 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 1 -- 172.21.15.71:0/3057398267 wait complete. 2024-05-27T09:54:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.668+0000 7fdd41646740 20 client.26519 trim_cache size 0 max 16384 2024-05-27T09:54:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:54:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:54:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:54:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdd180b2950 msgr2=0x7fdd180b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdd180b2950 0x7fdd180b4e60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c005fd0 tx=0x7fdd2c000f40 comp rx=0 tx=0).stop 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd34106430 msgr2=0x7fdd341a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd34106430 0x7fdd341a25c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400e9c0 tx=0x7fdd2400ee80 comp rx=0 tx=0).stop 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 shutdown_connections 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fdd180b2950 0x7fdd180b4e60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdd3410c180 0x7fdd3419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3410bce0 0x7fdd341a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 --2- 172.21.15.71:0/530646570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd34106430 0x7fdd341a25c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.669+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 >> 172.21.15.71:0/530646570 conn(0x7fdd34101380 msgr2=0x7fdd34111e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.670+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 shutdown_connections 2024-05-27T09:54:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:54:48.670+0000 7fdd39000640 1 -- 172.21.15.71:0/530646570 wait complete. 2024-05-27T09:54:49.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:48 smithi122 ceph-mon[36436]: pgmap v215: 97 pgs: 97 active+clean; 43 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.5 MiB/s wr, 397 op/s 2024-05-27T09:54:49.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:48 smithi071 ceph-mon[31451]: pgmap v215: 97 pgs: 97 active+clean; 43 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.5 MiB/s wr, 397 op/s 2024-05-27T09:54:49.279 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:48 smithi072 ceph-mon[35951]: pgmap v215: 97 pgs: 97 active+clean; 43 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.5 MiB/s wr, 397 op/s 2024-05-27T09:54:51.200 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:50 smithi071 ceph-mon[31451]: pgmap v216: 97 pgs: 97 active+clean; 43 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-05-27T09:54:51.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:50 smithi122 ceph-mon[36436]: pgmap v216: 97 pgs: 97 active+clean; 43 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-05-27T09:54:51.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:50 smithi072 ceph-mon[35951]: pgmap v216: 97 pgs: 97 active+clean; 43 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-05-27T09:54:53.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:52 smithi122 ceph-mon[36436]: pgmap v217: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 234 op/s 2024-05-27T09:54:53.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:52 smithi071 ceph-mon[31451]: pgmap v217: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 234 op/s 2024-05-27T09:54:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:52 smithi072 ceph-mon[35951]: pgmap v217: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 234 op/s 2024-05-27T09:54:54.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:54:55.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:54 smithi122 ceph-mon[36436]: pgmap v218: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 416 KiB/s wr, 63 op/s 2024-05-27T09:54:55.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:54 smithi071 ceph-mon[31451]: pgmap v218: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 416 KiB/s wr, 63 op/s 2024-05-27T09:54:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:54 smithi072 ceph-mon[35951]: pgmap v218: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 416 KiB/s wr, 63 op/s 2024-05-27T09:54:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:54:56.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:55 smithi122 ceph-mon[36436]: pgmap v219: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 416 KiB/s wr, 63 op/s 2024-05-27T09:54:56.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:55 smithi071 ceph-mon[31451]: pgmap v219: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 416 KiB/s wr, 63 op/s 2024-05-27T09:54:56.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:55 smithi072 ceph-mon[35951]: pgmap v219: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 416 KiB/s wr, 63 op/s 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.727+0000 7f53d7c00700 1 -- 172.21.15.71:0/1144953785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 msgr2=0x7f53d01111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.727+0000 7f53d7c00700 1 --2- 172.21.15.71:0/1144953785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 0x7f53d01111a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f53c800b0a0 tx=0x7f53c800b3b0 comp rx=0 tx=0).stop 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.727+0000 7f53d7c00700 1 -- 172.21.15.71:0/1144953785 shutdown_connections 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.727+0000 7f53d7c00700 1 --2- 172.21.15.71:0/1144953785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 0x7f53d01111a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.727+0000 7f53d7c00700 1 --2- 172.21.15.71:0/1144953785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d01045c0 0x7f53d01049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.727+0000 7f53d7c00700 1 --2- 172.21.15.71:0/1144953785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0108ef0 0x7f53d0109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.727+0000 7f53d7c00700 1 -- 172.21.15.71:0/1144953785 >> 172.21.15.71:0/1144953785 conn(0x7f53d00ffe90 msgr2=0x7f53d01022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.728+0000 7f53d7c00700 1 -- 172.21.15.71:0/1144953785 shutdown_connections 2024-05-27T09:54:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.728+0000 7f53d7c00700 1 -- 172.21.15.71:0/1144953785 wait complete. 2024-05-27T09:54:57.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 Processor -- start 2024-05-27T09:54:57.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 -- start start 2024-05-27T09:54:57.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d01045c0 0x7f53d019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:57.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0108ef0 0x7f53d019d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:57.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 0x7f53d01a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:57.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0114470 con 0x7f53d0108ef0 2024-05-27T09:54:57.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f53d01142f0 con 0x7f53d0109840 2024-05-27T09:54:57.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.729+0000 7f53d7c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f53d01145f0 con 0x7f53d01045c0 2024-05-27T09:54:57.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53d5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d01045c0 0x7f53d019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:57.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53cfe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0108ef0 0x7f53d019d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:57.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53d5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d01045c0 0x7f53d019cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40126/0 (socket says 172.21.15.71:40126) 2024-05-27T09:54:57.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53d5200700 1 -- 172.21.15.71:0/2366821525 learned_addr learned my addr 172.21.15.71:0/2366821525 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:54:57.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53d5c00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 0x7f53d01a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:57.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53cfe00700 1 -- 172.21.15.71:0/2366821525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d01045c0 msgr2=0x7f53d019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:57.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53cfe00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d01045c0 0x7f53d019cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53cfe00700 1 -- 172.21.15.71:0/2366821525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 msgr2=0x7f53d01a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53cfe00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 0x7f53d01a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.730+0000 7f53cfe00700 1 -- 172.21.15.71:0/2366821525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d01a1e90 con 0x7f53d0108ef0 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.731+0000 7f53cfe00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0108ef0 0x7f53d019d560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00e9c0 tx=0x7f53bc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.731+0000 7f53cd600700 1 -- 172.21.15.71:0/2366821525 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00c9c0 con 0x7f53d0108ef0 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.731+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d01a2180 con 0x7f53d0108ef0 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.731+0000 7f53cd600700 1 -- 172.21.15.71:0/2366821525 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53bc00cb60 con 0x7f53d0108ef0 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.731+0000 7f53cd600700 1 -- 172.21.15.71:0/2366821525 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc018680 con 0x7f53d0108ef0 2024-05-27T09:54:57.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.731+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d01a9aa0 con 0x7f53d0108ef0 2024-05-27T09:54:57.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.732+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d00512b0 con 0x7f53d0108ef0 2024-05-27T09:54:57.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.735+0000 7f53cd600700 1 -- 172.21.15.71:0/2366821525 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f53bc010430 con 0x7f53d0108ef0 2024-05-27T09:54:57.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.736+0000 7f53cd600700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a70 0x7f53b80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:54:57.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.737+0000 7f53cd600700 1 -- 172.21.15.71:0/2366821525 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f53bc0e2a50 con 0x7f53d0108ef0 2024-05-27T09:54:57.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.737+0000 7f53d5200700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a70 0x7f53b80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:54:57.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.738+0000 7f53d5200700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a70 0x7f53b80b4f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009d20 tx=0x7f53c4009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:54:57.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:57.739+0000 7f53cd600700 1 -- 172.21.15.71:0/2366821525 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f53bc0aa400 con 0x7f53d0108ef0 2024-05-27T09:54:58.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.024+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53d019e320 con 0x7f53d0108ef0 2024-05-27T09:54:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.026+0000 7f53cd600700 1 -- 172.21.15.71:0/2366821525 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f53d019e320 con 0x7f53d0108ef0 2024-05-27T09:54:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:54:58.026 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:54:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a70 msgr2=0x7f53b80b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a70 0x7f53b80b4f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009d20 tx=0x7f53c4009260 comp rx=0 tx=0).stop 2024-05-27T09:54:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0108ef0 msgr2=0x7f53d019d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:54:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0108ef0 0x7f53d019d560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00e9c0 tx=0x7f53bc00ecd0 comp rx=0 tx=0).stop 2024-05-27T09:54:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 shutdown_connections 2024-05-27T09:54:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f53b80b2a70 0x7f53b80b4f80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53d0109840 0x7f53d01a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d01045c0 0x7f53d019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 --2- 172.21.15.71:0/2366821525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0108ef0 0x7f53d019d560 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:54:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 >> 172.21.15.71:0/2366821525 conn(0x7f53d00ffe90 msgr2=0x7f53d010a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:54:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.029+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 shutdown_connections 2024-05-27T09:54:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:54:58.030+0000 7f53d7c00700 1 -- 172.21.15.71:0/2366821525 wait complete. 2024-05-27T09:54:58.031 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:54:58.926 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id 466f4387 --release --await' 2024-05-27T09:54:58.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id 466f4387 --release --await 2024-05-27T09:54:59.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:58 smithi071 ceph-mon[31451]: pgmap v220: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 416 KiB/s wr, 66 op/s 2024-05-27T09:54:59.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:54:58 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2366821525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:54:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:58 smithi072 ceph-mon[35951]: pgmap v220: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 416 KiB/s wr, 66 op/s 2024-05-27T09:54:59.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:54:58 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2366821525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:54:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:58 smithi122 ceph-mon[36436]: pgmap v220: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 416 KiB/s wr, 66 op/s 2024-05-27T09:54:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:54:58 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2366821525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:54:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:55:00.967 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:00 smithi071 ceph-mon[31451]: pgmap v221: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-27T09:55:01.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:00 smithi072 ceph-mon[35951]: pgmap v221: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-27T09:55:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:00 smithi122 ceph-mon[36436]: pgmap v221: 97 pgs: 97 active+clean; 42 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.691+0000 7fc564e00700 1 -- 172.21.15.71:0/40804666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560109680 msgr2=0x7fc560110fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.691+0000 7fc564e00700 1 --2- 172.21.15.71:0/40804666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560109680 0x7fc560110fe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b0d0 tx=0x7fc55800b3e0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.691+0000 7fc564e00700 1 -- 172.21.15.71:0/40804666 shutdown_connections 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.691+0000 7fc564e00700 1 --2- 172.21.15.71:0/40804666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560109680 0x7fc560110fe0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.691+0000 7fc564e00700 1 --2- 172.21.15.71:0/40804666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560104400 0x7fc560104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.691+0000 7fc564e00700 1 --2- 172.21.15.71:0/40804666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc560108d30 0x7fc560109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.691+0000 7fc564e00700 1 -- 172.21.15.71:0/40804666 >> 172.21.15.71:0/40804666 conn(0x7fc560079d40 msgr2=0x7fc56007a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.692+0000 7fc564e00700 1 -- 172.21.15.71:0/40804666 shutdown_connections 2024-05-27T09:55:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.692+0000 7fc564e00700 1 -- 172.21.15.71:0/40804666 wait complete. 2024-05-27T09:55:01.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.693+0000 7fc564e00700 1 Processor -- start 2024-05-27T09:55:01.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.693+0000 7fc564e00700 1 -- start start 2024-05-27T09:55:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc564e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560104400 0x7fc5601a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc564e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc560108d30 0x7fc5601a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc564e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560109680 0x7fc56019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc564e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc560114300 con 0x7fc560104400 2024-05-27T09:55:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc564e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc560114180 con 0x7fc560109680 2024-05-27T09:55:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc564e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc560114480 con 0x7fc560108d30 2024-05-27T09:55:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc55f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560104400 0x7fc5601a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc55f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560104400 0x7fc5601a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60662/0 (socket says 172.21.15.71:60662) 2024-05-27T09:55:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560109680 0x7fc56019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc55f400700 1 -- 172.21.15.71:0/475702442 learned_addr learned my addr 172.21.15.71:0/475702442 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.694+0000 7fc557e00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc560108d30 0x7fc5601a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.695+0000 7fc55f400700 1 -- 172.21.15.71:0/475702442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc560108d30 msgr2=0x7fc5601a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.695+0000 7fc55f400700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc560108d30 0x7fc5601a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.695+0000 7fc55f400700 1 -- 172.21.15.71:0/475702442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560109680 msgr2=0x7fc56019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.695+0000 7fc55f400700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560109680 0x7fc56019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.695+0000 7fc55f400700 1 -- 172.21.15.71:0/475702442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56019b0d0 con 0x7fc560104400 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.695+0000 7fc55f400700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560104400 0x7fc5601a0800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc55000e9a0 tx=0x7fc55000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.695+0000 7fc55cc00700 1 -- 172.21.15.71:0/475702442 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55000ca10 con 0x7fc560104400 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.696+0000 7fc55cc00700 1 -- 172.21.15.71:0/475702442 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc55000cbb0 con 0x7fc560104400 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.696+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56019b3c0 con 0x7fc560104400 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.696+0000 7fc55cc00700 1 -- 172.21.15.71:0/475702442 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550018680 con 0x7fc560104400 2024-05-27T09:55:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.696+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5601a7690 con 0x7fc560104400 2024-05-27T09:55:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.701+0000 7fc55cc00700 1 -- 172.21.15.71:0/475702442 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fc550018820 con 0x7fc560104400 2024-05-27T09:55:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.702+0000 7fc574eecb80 1 Processor -- start 2024-05-27T09:55:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.702+0000 7fc574eecb80 1 -- start start 2024-05-27T09:55:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.702+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae22aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.702+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae22b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.702+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc574eecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d9ae158f40 con 0x55d9ae239c50 2024-05-27T09:55:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc574eecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d9ae148ae0 con 0x55d9ae0abf40 2024-05-27T09:55:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc574eecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9ae14cb20 con 0x55d9ae197af0 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae22aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae22aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40156/0 (socket says 172.21.15.71:40156) 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 -- 172.21.15.71:0/2563133464 learned_addr learned my addr 172.21.15.71:0/2563133464 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55f400700 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae22b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc557e00700 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 -- 172.21.15.71:0/2563133464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 msgr2=0x55d9ae22b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae22b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55cc00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc5440b29f0 0x7fc5440b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 -- 172.21.15.71:0/2563133464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 msgr2=0x55d9ae23c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc55fe00700 1 -- 172.21.15.71:0/2563133464 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ae111520 con 0x55d9ae197af0 2024-05-27T09:55:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.703+0000 7fc557e00700 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.704+0000 7fc55cc00700 1 -- 172.21.15.71:0/475702442 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fc5500e2740 con 0x7fc560104400 2024-05-27T09:55:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.704+0000 7fc55fe00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc5440b29f0 0x7fc5440b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.704+0000 7fc55fe00700 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae22aaf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc5580098c0 tx=0x7fc558009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f7a0fdfef8d341 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.705+0000 7fc554c00700 1 -- 172.21.15.71:0/2563133464 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55802d070 con 0x55d9ae197af0 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.705+0000 7fc554c00700 1 -- 172.21.15.71:0/2563133464 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc558020070 con 0x55d9ae197af0 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.705+0000 7fc554c00700 1 -- 172.21.15.71:0/2563133464 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558005790 con 0x55d9ae197af0 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 -- 172.21.15.71:0/2563133464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 msgr2=0x55d9ae22aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae22aaf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc5580098c0 tx=0x7fc558009b80 comp rx=0 tx=0).stop 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc55fe00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc5440b29f0 0x7fc5440b4f00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc558006280 tx=0x7fc55802b000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 -- 172.21.15.71:0/2563133464 shutdown_connections 2024-05-27T09:55:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae22aaf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 --2- 172.21.15.71:0/2563133464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae22b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 -- 172.21.15.71:0/2563133464 >> 172.21.15.71:0/2563133464 conn(0x55d9ae145490 msgr2=0x55d9ae226b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 -- 172.21.15.71:0/2563133464 shutdown_connections 2024-05-27T09:55:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.706+0000 7fc574eecb80 1 -- 172.21.15.71:0/2563133464 wait complete. 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.707+0000 7fc574eecb80 1 -- start start 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.707+0000 7fc574eecb80 1 Processor -- start 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae0abf40 0x55d9ae236bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae237100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae239c50 0x55d9ae237640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc574eecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d9ae04f0a0 con 0x55d9ae0abf40 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc574eecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d9ae0e9860 con 0x55d9ae239c50 2024-05-27T09:55:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc574eecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9ae23c700 con 0x55d9ae197af0 2024-05-27T09:55:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc574eecb80 10 client.0 _ll_register_callbacks cb 0x55d9ae0f2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae0abf40 0x55d9ae236bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae0abf40 0x55d9ae236bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60666/0 (socket says 172.21.15.71:60666) 2024-05-27T09:55:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 -- 172.21.15.71:0/775154993 learned_addr learned my addr 172.21.15.71:0/775154993 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc557e00700 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae237100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55fe00700 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae239c50 0x55d9ae237640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 -- 172.21.15.71:0/775154993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 msgr2=0x55d9ae237100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae237100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 -- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae239c50 msgr2=0x55d9ae237640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae239c50 0x55d9ae237640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.708+0000 7fc55f400700 1 -- 172.21.15.71:0/775154993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ae0989d0 con 0x55d9ae0abf40 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc55f400700 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae0abf40 0x55d9ae236bc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc5500dfec0 tx=0x7fc5500a9410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a20a974442a02d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc54d600700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc54d600700 1 -- 172.21.15.71:0/775154993 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5500a9500 con 0x55d9ae0abf40 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc54d600700 1 -- 172.21.15.71:0/775154993 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fc5500cc2f0 con 0x55d9ae0abf40 2024-05-27T09:55:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc558020070 con 0x55d9ae0abf40 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc54d600700 1 -- 172.21.15.71:0/775154993 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc5500aa0f0 con 0x55d9ae0abf40 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc574eecb80 10 client.16386 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.709+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d9ae119160 con 0x55d9ae0abf40 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc54d600700 1 -- 172.21.15.71:0/775154993 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc558020070 con 0x55d9ae0abf40 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc54d600700 1 -- 172.21.15.71:0/775154993 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fc5500a9c50 con 0x55d9ae0abf40 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc574eecb80 10 client.16386 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc574eecb80 10 client.16386 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc574eecb80 20 client.16386 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc574eecb80 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae249650 0x55d9ae24ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc574eecb80 4 client.16386 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.710+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9ae15ae90 con 0x55d9ae249650 2024-05-27T09:55:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.711+0000 7fc557e00700 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae249650 0x55d9ae24ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.711+0000 7fc54d600700 10 client.16386 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.711+0000 7fc557e00700 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae249650 0x55d9ae24ba70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db8947153511fe65 server_cookie=9c5365b4dd297137 in_seq=0 out_seq=0 2024-05-27T09:55:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.712+0000 7fc54d600700 1 -- 172.21.15.71:0/775154993 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d9ae15ae90 con 0x55d9ae249650 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.712+0000 7fc54d600700 10 client.16386 handle_command_reply: tid=0 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.712+0000 7fc574eecb80 1 client.16386 shutdown 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae0abf40 msgr2=0x55d9ae236bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae0abf40 0x55d9ae236bc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc5500dfec0 tx=0x7fc5500a9410 comp rx=0 tx=0).stop 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 shutdown_connections 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae249650 0x55d9ae24ba70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae239c50 0x55d9ae237640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc54d600700 0 client.16386 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae0abf40 0x55d9ae236bc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 --2- 172.21.15.71:0/775154993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae197af0 0x55d9ae237100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 >> 172.21.15.71:0/775154993 conn(0x55d9ae145490 msgr2=0x55d9ae22acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 shutdown_connections 2024-05-27T09:55:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 1 -- 172.21.15.71:0/775154993 wait complete. 2024-05-27T09:55:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.713+0000 7fc574eecb80 20 client.16386 trim_cache size 0 max 16384 2024-05-27T09:55:01.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.736+0000 7fc574eecb80 1 Processor -- start 2024-05-27T09:55:01.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc574eecb80 1 -- start start 2024-05-27T09:55:01.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae0abf40 0x55d9ae245830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae197af0 0x55d9ae238980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc574eecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c00fdb0 con 0x55d9ae239c50 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc574eecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c00d640 con 0x55d9ae197af0 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc574eecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c00b470 con 0x55d9ae0abf40 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc557e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae197af0 0x55d9ae238980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60674/0 (socket says 172.21.15.71:60674) 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.737+0000 7fc55fe00700 1 -- 172.21.15.71:0/889025034 learned_addr learned my addr 172.21.15.71:0/889025034 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55f400700 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae0abf40 0x55d9ae245830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55fe00700 1 -- 172.21.15.71:0/889025034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae0abf40 msgr2=0x55d9ae245830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55fe00700 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae0abf40 0x55d9ae245830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55fe00700 1 -- 172.21.15.71:0/889025034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae197af0 msgr2=0x55d9ae238980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55fe00700 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae197af0 0x55d9ae238980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55fe00700 1 -- 172.21.15.71:0/889025034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ae2280c0 con 0x55d9ae239c50 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55f400700 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae0abf40 0x55d9ae245830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.738+0000 7fc55fe00700 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23b070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc558009ca0 tx=0x7fc558030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a263d1040829a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.739+0000 7fc54fe00700 1 -- 172.21.15.71:0/889025034 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55802d040 con 0x55d9ae239c50 2024-05-27T09:55:01.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.739+0000 7fc54fe00700 1 -- 172.21.15.71:0/889025034 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc558020030 con 0x55d9ae239c50 2024-05-27T09:55:01.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.739+0000 7fc54fe00700 1 -- 172.21.15.71:0/889025034 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5580078c0 con 0x55d9ae239c50 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 -- 172.21.15.71:0/889025034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 msgr2=0x55d9ae23b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23b070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc558009ca0 tx=0x7fc558030000 comp rx=0 tx=0).stop 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 -- 172.21.15.71:0/889025034 shutdown_connections 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae239c50 0x55d9ae23b070 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae0abf40 0x55d9ae245830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 --2- 172.21.15.71:0/889025034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae197af0 0x55d9ae238980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 -- 172.21.15.71:0/889025034 >> 172.21.15.71:0/889025034 conn(0x55d9ae145490 msgr2=0x55d9ae238270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 -- 172.21.15.71:0/889025034 shutdown_connections 2024-05-27T09:55:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.740+0000 7fc574eecb80 1 -- 172.21.15.71:0/889025034 wait complete. 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.741+0000 7fc574eecb80 1 -- start start 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.741+0000 7fc574eecb80 1 Processor -- start 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae241f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae197af0 0x55d9ae23c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc574eecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae239c50 0x55d9ae23cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc574eecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c00bb00 con 0x55d9ae197af0 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc574eecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c00cf70 con 0x55d9ae0abf40 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc574eecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c00c1d0 con 0x55d9ae239c50 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc574eecb80 10 client.0 _ll_register_callbacks cb 0x55d9ae0f2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae197af0 0x55d9ae23c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae197af0 0x55d9ae23c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60686/0 (socket says 172.21.15.71:60686) 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 -- 172.21.15.71:0/1501020533 learned_addr learned my addr 172.21.15.71:0/1501020533 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc55fe00700 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae239c50 0x55d9ae23cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc55f400700 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae241f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 -- 172.21.15.71:0/1501020533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae239c50 msgr2=0x55d9ae23cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae239c50 0x55d9ae23cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 -- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 msgr2=0x55d9ae241f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae241f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.742+0000 7fc557e00700 1 -- 172.21.15.71:0/1501020533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ae2379b0 con 0x55d9ae197af0 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc557e00700 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae197af0 0x55d9ae23c9e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc560109480 tx=0x7fc5480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb24241977054d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc54d600700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc54d600700 1 -- 172.21.15.71:0/1501020533 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548004830 con 0x55d9ae197af0 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc54d600700 1 -- 172.21.15.71:0/1501020533 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7fc5480049d0 con 0x55d9ae197af0 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc558020030 con 0x55d9ae197af0 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc54d600700 1 -- 172.21.15.71:0/1501020533 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc548004bd0 con 0x55d9ae197af0 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc574eecb80 10 client.16392 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:01.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.743+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d9ae2b4cc0 con 0x55d9ae197af0 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc54d600700 1 -- 172.21.15.71:0/1501020533 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc558020030 con 0x55d9ae197af0 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc54d600700 1 -- 172.21.15.71:0/1501020533 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fc548005140 con 0x55d9ae197af0 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc574eecb80 10 client.16392 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc574eecb80 10 client.16392 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc574eecb80 20 client.16392 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc574eecb80 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae2b5380 0x55d9ae2b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc574eecb80 4 client.16392 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "466f4387", "release": true, "await": true}] 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.744+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "466f4387", "release": true, "await": true}) -- 0x55d9ae154670 con 0x55d9ae2b5380 2024-05-27T09:55:01.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.745+0000 7fc55f400700 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae2b5380 0x55d9ae2b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.745+0000 7fc55f400700 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae2b5380 0x55d9ae2b77a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6f957a27bf531e server_cookie=4daa1143fa001feb in_seq=0 out_seq=0 2024-05-27T09:55:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.745+0000 7fc54d600700 10 client.16392 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.893+0000 7f3a53e00640 1 -- 172.21.15.71:0/931501032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a54103b90 msgr2=0x7f3a54103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.893+0000 7f3a53e00640 1 --2- 172.21.15.71:0/931501032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a54103b90 0x7f3a54103fa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009900 tx=0x7f3a4002a410 comp rx=0 tx=0).stop 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.894+0000 7f3a53e00640 1 -- 172.21.15.71:0/931501032 shutdown_connections 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.894+0000 7f3a53e00640 1 --2- 172.21.15.71:0/931501032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a5410e510 0x7f3a54110930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.894+0000 7f3a53e00640 1 --2- 172.21.15.71:0/931501032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a54103b90 0x7f3a54103fa0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.894+0000 7f3a53e00640 1 --2- 172.21.15.71:0/931501032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a54109b40 0x7f3a54103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.894+0000 7f3a53e00640 1 -- 172.21.15.71:0/931501032 >> 172.21.15.71:0/931501032 conn(0x7f3a540ff170 msgr2=0x7f3a541015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.894+0000 7f3a53e00640 1 -- 172.21.15.71:0/931501032 shutdown_connections 2024-05-27T09:55:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.894+0000 7f3a53e00640 1 -- 172.21.15.71:0/931501032 wait complete. 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 Processor -- start 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 -- start start 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a54103b90 0x7f3a5419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a54109b40 0x7f3a5419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5410e510 0x7f3a5419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54113cf0 con 0x7f3a54109b40 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54113b70 con 0x7f3a5410e510 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.895+0000 7f3a53e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54113e70 con 0x7f3a54103b90 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a52000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a54109b40 0x7f3a5419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5410e510 0x7f3a5419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a52a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a54103b90 0x7f3a5419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5410e510 0x7f3a5419ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56668/0 (socket says 172.21.15.71:56668) 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 -- 172.21.15.71:0/3503274569 learned_addr learned my addr 172.21.15.71:0/3503274569 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 -- 172.21.15.71:0/3503274569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a54103b90 msgr2=0x7f3a5419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a54103b90 0x7f3a5419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 -- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a54109b40 msgr2=0x7f3a5419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a54109b40 0x7f3a5419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 -- 172.21.15.71:0/3503274569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5419f590 con 0x7f3a5410e510 2024-05-27T09:55:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a52a00640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a54103b90 0x7f3a5419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.896+0000 7f3a53400640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5410e510 0x7f3a5419ef50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00eb40 tx=0x7f3a4c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.897+0000 7f3a4b400640 1 -- 172.21.15.71:0/3503274569 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c004b20 con 0x7f3a5410e510 2024-05-27T09:55:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.897+0000 7f3a4b400640 1 -- 172.21.15.71:0/3503274569 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a4c004cc0 con 0x7f3a5410e510 2024-05-27T09:55:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.897+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5419f880 con 0x7f3a5410e510 2024-05-27T09:55:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.897+0000 7f3a4b400640 1 -- 172.21.15.71:0/3503274569 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c010720 con 0x7f3a5410e510 2024-05-27T09:55:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.897+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a541a7200 con 0x7f3a5410e510 2024-05-27T09:55:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.900+0000 7f3a60c6c740 1 Processor -- start 2024-05-27T09:55:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a4b400640 1 -- 172.21.15.71:0/3503274569 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f3a4c005560 con 0x7f3a5410e510 2024-05-27T09:55:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a60c6c740 1 -- start start 2024-05-27T09:55:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 0x56490b3c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56490b332b90 con 0x56490affe4d0 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56490b322730 con 0x56490b01f1b0 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.901+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56490b326770 con 0x56490aff62f0 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40214/0 (socket says 172.21.15.71:40214) 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 -- 172.21.15.71:0/1361835304 learned_addr learned my addr 172.21.15.71:0/1361835304 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52000640 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 0x56490b3c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52000640 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 -- 172.21.15.71:0/1361835304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 msgr2=0x56490b3c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 0x56490b3c18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 -- 172.21.15.71:0/1361835304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 msgr2=0x56490b3c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 -- 172.21.15.71:0/1361835304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490b2bb8b0 con 0x56490aff62f0 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52000640 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.902+0000 7f3a52a00640 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3c1e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3a440115c0 tx=0x7f3a44011a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c29da65ef07fed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a3fe00640 1 -- 172.21.15.71:0/1361835304 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400f640 con 0x56490aff62f0 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a3fe00640 1 -- 172.21.15.71:0/1361835304 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a4400fc90 con 0x56490aff62f0 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a3fe00640 1 -- 172.21.15.71:0/1361835304 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44019cc0 con 0x56490aff62f0 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a4b400640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3a380b29d0 0x7f3a380b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a4b400640 1 -- 172.21.15.71:0/3503274569 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f3a4c0e2ce0 con 0x7f3a5410e510 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a52000640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3a380b29d0 0x7f3a380b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a60c6c740 1 -- 172.21.15.71:0/1361835304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 msgr2=0x56490b3c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.903+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3c1e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3a440115c0 tx=0x7f3a44011a80 comp rx=0 tx=0).stop 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a60c6c740 1 -- 172.21.15.71:0/1361835304 shutdown_connections 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3c1e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/1361835304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 0x56490b3c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a60c6c740 1 -- 172.21.15.71:0/1361835304 >> 172.21.15.71:0/1361835304 conn(0x56490b013300 msgr2=0x56490b3be210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a60c6c740 1 -- 172.21.15.71:0/1361835304 shutdown_connections 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a60c6c740 1 -- 172.21.15.71:0/1361835304 wait complete. 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.904+0000 7f3a52000640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3a380b29d0 0x7f3a380b4ee0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a4002aa00 tx=0x7f3a40005a20 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.905+0000 7f3a60c6c740 1 -- start start 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.905+0000 7f3a60c6c740 1 Processor -- start 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.905+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56490b008790 con 0x56490b01f1b0 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56490b2cabc0 con 0x56490affe4d0 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56490b3d2fa0 con 0x56490aff62f0 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a60c6c740 10 client.0 _ll_register_callbacks cb 0x56490b2a8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56692/0 (socket says 172.21.15.71:56692) 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52000640 1 -- 172.21.15.71:0/4031824136 learned_addr learned my addr 172.21.15.71:0/4031824136 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a53400640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52a00640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52a00640 1 -- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 msgr2=0x56490b3d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52a00640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52a00640 1 -- 172.21.15.71:0/4031824136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 msgr2=0x56490b3d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52a00640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52a00640 1 -- 172.21.15.71:0/4031824136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490b037210 con 0x56490aff62f0 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.906+0000 7f3a52000640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a52a00640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cff70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a4401b040 tx=0x7f3a44019cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f40fa3fa8d93357 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a3cc00640 1 -- 172.21.15.71:0/4031824136 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44026020 con 0x56490aff62f0 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a3cc00640 1 -- 172.21.15.71:0/4031824136 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f3a4400fe40 con 0x56490aff62f0 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a4400fc90 con 0x56490aff62f0 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a3cc00640 1 -- 172.21.15.71:0/4031824136 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a44031050 con 0x56490aff62f0 2024-05-27T09:55:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a60c6c740 10 client.26581 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.907+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56490b103620 con 0x56490aff62f0 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a3cc00640 1 -- 172.21.15.71:0/4031824136 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a4400fc90 con 0x56490aff62f0 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a3cc00640 1 -- 172.21.15.71:0/4031824136 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f3a44004750 con 0x56490aff62f0 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a60c6c740 10 client.26581 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a60c6c740 10 client.26581 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a60c6c740 20 client.26581 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afddd80 0x56490b3e2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a60c6c740 4 client.26581 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56490b334ae0 con 0x56490afddd80 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.908+0000 7f3a52000640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afddd80 0x56490b3e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.909+0000 7f3a52000640 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afddd80 0x56490b3e2160 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=584eacf449407d5b server_cookie=d27c5325767fa1bc in_seq=0 out_seq=0 2024-05-27T09:55:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.909+0000 7f3a3cc00640 10 client.26581 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:01.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.962+0000 7fc54d600700 1 -- 172.21.15.71:0/1501020533 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d9ae154670 con 0x55d9ae2b5380 2024-05-27T09:55:01.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.962+0000 7fc54d600700 10 client.16392 handle_command_reply: tid=0 2024-05-27T09:55:01.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.962+0000 7fc574eecb80 1 client.16392 shutdown 2024-05-27T09:55:01.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.962+0000 7f3a3cc00640 1 -- 172.21.15.71:0/4031824136 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56490b334ae0 con 0x56490afddd80 2024-05-27T09:55:01.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.962+0000 7f3a3cc00640 10 client.26581 handle_command_reply: tid=0 2024-05-27T09:55:01.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.962+0000 7f3a60c6c740 1 client.26581 shutdown 2024-05-27T09:55:01.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae197af0 msgr2=0x55d9ae23c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae197af0 0x55d9ae23c9e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc560109480 tx=0x7fc5480045e0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.963+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 msgr2=0x56490b3cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.963+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cff70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a4401b040 tx=0x7f3a44019cf0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 shutdown_connections 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afddd80 0x56490b3e2160 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/4031824136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cff70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 >> 172.21.15.71:0/4031824136 conn(0x56490b013300 msgr2=0x56490b3c3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 shutdown_connections 2024-05-27T09:55:01.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d9ae2b5380 0x55d9ae2b77a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9ae239c50 0x55d9ae23cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d9ae0abf40 0x55d9ae241f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 --2- 172.21.15.71:0/1501020533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d9ae197af0 0x55d9ae23c9e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 >> 172.21.15.71:0/1501020533 conn(0x55d9ae145490 msgr2=0x55d9ae22c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc54d600700 0 client.16392 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:01.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.963+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 shutdown_connections 2024-05-27T09:55:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a3cc00640 0 client.26581 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:01.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.964+0000 7fc574eecb80 1 -- 172.21.15.71:0/1501020533 wait complete. 2024-05-27T09:55:01.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.964+0000 7fc574eecb80 20 client.16392 trim_cache size 0 max 16384 2024-05-27T09:55:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.964+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 shutdown_connections 2024-05-27T09:55:01.966 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 20, 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "466f4387": { 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 20, 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:55:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 138.9, 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:01.968 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:55:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.965+0000 7f3a60c6c740 1 -- 172.21.15.71:0/4031824136 wait complete. 2024-05-27T09:55:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.965+0000 7f3a60c6c740 20 client.26581 trim_cache size 0 max 16384 2024-05-27T09:55:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc5440b29f0 msgr2=0x7fc5440b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc5440b29f0 0x7fc5440b4f00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc558006280 tx=0x7fc55802b000 comp rx=0 tx=0).stop 2024-05-27T09:55:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560104400 msgr2=0x7fc5601a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560104400 0x7fc5601a0800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc55000e9a0 tx=0x7fc55000ecb0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 shutdown_connections 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc5440b29f0 0x7fc5440b4f00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560109680 0x7fc56019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc560104400 0x7fc5601a0800 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 --2- 172.21.15.71:0/475702442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc560108d30 0x7fc5601a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 >> 172.21.15.71:0/475702442 conn(0x7fc560079d40 msgr2=0x7fc560101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 shutdown_connections 2024-05-27T09:55:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:01.965+0000 7fc564e00700 1 -- 172.21.15.71:0/475702442 wait complete. 2024-05-27T09:55:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.988+0000 7f3a60c6c740 1 Processor -- start 2024-05-27T09:55:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.988+0000 7f3a60c6c740 1 -- start start 2024-05-27T09:55:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 0x56490b3c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541affe0 con 0x56490affe4d0 2024-05-27T09:55:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541ad8b0 con 0x56490b01f1b0 2024-05-27T09:55:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541ab700 con 0x56490aff62f0 2024-05-27T09:55:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a52000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a52a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a52a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40236/0 (socket says 172.21.15.71:40236) 2024-05-27T09:55:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a52000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60718/0 (socket says 172.21.15.71:60718) 2024-05-27T09:55:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.989+0000 7f3a52a00640 1 -- 172.21.15.71:0/3042453632 learned_addr learned my addr 172.21.15.71:0/3042453632 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.990+0000 7f3a52a00640 1 -- 172.21.15.71:0/3042453632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 msgr2=0x56490b3c1f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.990+0000 7f3a52a00640 1 --2- 172.21.15.71:0/3042453632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 0x56490b3c1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.990+0000 7f3a52a00640 1 -- 172.21.15.71:0/3042453632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 msgr2=0x56490b3d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.990+0000 7f3a52a00640 1 --2- 172.21.15.71:0/3042453632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3d26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.990+0000 7f3a52a00640 1 -- 172.21.15.71:0/3042453632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490afddfb0 con 0x56490aff62f0 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.990+0000 7f3a52a00640 1 --2- 172.21.15.71:0/3042453632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3bd240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a44011510 tx=0x7f3a44009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d074f6881f596f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.990+0000 7f3a3f400640 1 -- 172.21.15.71:0/3042453632 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4403a070 con 0x56490aff62f0 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.991+0000 7f3a3f400640 1 -- 172.21.15.71:0/3042453632 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a4400fd00 con 0x56490aff62f0 2024-05-27T09:55:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.991+0000 7f3a3f400640 1 -- 172.21.15.71:0/3042453632 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44026030 con 0x56490aff62f0 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 -- 172.21.15.71:0/3042453632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 msgr2=0x56490b3bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/3042453632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3bd240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a44011510 tx=0x7f3a44009b30 comp rx=0 tx=0).stop 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 -- 172.21.15.71:0/3042453632 shutdown_connections 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/3042453632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490b01f1b0 0x56490b3c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/3042453632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490affe4d0 0x56490b3d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/3042453632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3bd240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 -- 172.21.15.71:0/3042453632 >> 172.21.15.71:0/3042453632 conn(0x56490b013300 msgr2=0x56490b3c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 -- 172.21.15.71:0/3042453632 shutdown_connections 2024-05-27T09:55:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.992+0000 7f3a60c6c740 1 -- 172.21.15.71:0/3042453632 wait complete. 2024-05-27T09:55:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.993+0000 7f3a60c6c740 1 -- start start 2024-05-27T09:55:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.993+0000 7f3a60c6c740 1 Processor -- start 2024-05-27T09:55:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a60c6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541abd70 con 0x56490b01f1b0 2024-05-27T09:55:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541ad1e0 con 0x56490affe4d0 2024-05-27T09:55:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a60c6c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541ac440 con 0x56490aff62f0 2024-05-27T09:55:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a60c6c740 10 client.0 _ll_register_callbacks cb 0x7f3a44011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a52a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a52a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:40242/0 (socket says 172.21.15.71:40242) 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a52a00640 1 -- 172.21.15.71:0/297420245 learned_addr learned my addr 172.21.15.71:0/297420245 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a52000640 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.994+0000 7f3a53400640 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a52a00640 1 -- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 msgr2=0x56490b3c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a52a00640 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a52a00640 1 -- 172.21.15.71:0/297420245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 msgr2=0x56490b3c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a52a00640 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a52a00640 1 -- 172.21.15.71:0/297420245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490b3ca590 con 0x56490aff62f0 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a52a00640 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cb590 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3a44019d30 tx=0x7f3a44009d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d41757bb40a7b8be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.995+0000 7f3a3cc00640 1 -- 172.21.15.71:0/297420245 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4403a030 con 0x56490aff62f0 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.996+0000 7f3a3cc00640 1 -- 172.21.15.71:0/297420245 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8469+0+0 (secure 0 0 0) 0x7f3a4400f850 con 0x56490aff62f0 2024-05-27T09:55:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.996+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a4400fd00 con 0x56490aff62f0 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.996+0000 7f3a3cc00640 1 -- 172.21.15.71:0/297420245 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a44026040 con 0x56490aff62f0 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.996+0000 7f3a60c6c740 10 client.26587 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.996+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56490b3d8120 con 0x56490aff62f0 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.996+0000 7f3a3cc00640 1 -- 172.21.15.71:0/297420245 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a4400fd00 con 0x56490aff62f0 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a3cc00640 1 -- 172.21.15.71:0/297420245 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f3a44003950 con 0x56490aff62f0 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a60c6c740 10 client.26587 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a60c6c740 10 client.26587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a60c6c740 20 client.26587 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afb31c0 0x56490b3d88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a60c6c740 4 client.26587 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:55:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56490b32e2c0 con 0x56490afb31c0 2024-05-27T09:55:01.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.997+0000 7f3a52000640 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afb31c0 0x56490b3d88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:01.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.998+0000 7f3a52000640 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afb31c0 0x56490b3d88c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31dc8ffa4771d34 server_cookie=b5afd55cff050b70 in_seq=0 out_seq=0 2024-05-27T09:55:01.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:01.998+0000 7f3a3cc00640 10 client.26587 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.015+0000 7f3a3cc00640 1 -- 172.21.15.71:0/297420245 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56490b32e2c0 con 0x56490afb31c0 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.015+0000 7f3a3cc00640 10 client.26587 handle_command_reply: tid=0 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.015+0000 7f3a60c6c740 1 client.26587 shutdown 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 msgr2=0x56490b3cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cb590 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3a44019d30 tx=0x7f3a44009d20 comp rx=0 tx=0).stop 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 shutdown_connections 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56490afb31c0 0x56490b3d88c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56490b01f1b0 0x56490b3c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56490affe4d0 0x56490b3c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 --2- 172.21.15.71:0/297420245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56490aff62f0 0x56490b3cb590 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a3cc00640 0 client.26587 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 >> 172.21.15.71:0/297420245 conn(0x56490b013300 msgr2=0x56490b3bcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 shutdown_connections 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 1 -- 172.21.15.71:0/297420245 wait complete. 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.016+0000 7f3a60c6c740 20 client.26587 trim_cache size 0 max 16384 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:55:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:55:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3a380b29d0 msgr2=0x7f3a380b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3a380b29d0 0x7f3a380b4ee0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a4002aa00 tx=0x7f3a40005a20 comp rx=0 tx=0).stop 2024-05-27T09:55:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5410e510 msgr2=0x7f3a5419ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5410e510 0x7f3a5419ef50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00eb40 tx=0x7f3a4c00c2d0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 shutdown_connections 2024-05-27T09:55:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3a380b29d0 0x7f3a380b4ee0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5410e510 0x7f3a5419ef50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a54109b40 0x7f3a5419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 --2- 172.21.15.71:0/3503274569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a54103b90 0x7f3a5419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 >> 172.21.15.71:0/3503274569 conn(0x7f3a540ff170 msgr2=0x7f3a5410f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 shutdown_connections 2024-05-27T09:55:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:02.017+0000 7f3a53e00640 1 -- 172.21.15.71:0/3503274569 wait complete. 2024-05-27T09:55:02.237 INFO:tasks.workunit.client.0.smithi071.stdout:20000 punch from 0x34ddcb to 0x35324f, (0x5484 bytes) 2024-05-27T09:55:02.985 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '466f4387', total seconds elapsed: 27.1 2024-05-27T09:55:02.986 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.95 2024-05-27T09:55:02.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:55:03.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:02 smithi072 ceph-mon[35951]: pgmap v222: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 29 op/s 2024-05-27T09:55:03.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:02 smithi071 ceph-mon[31451]: pgmap v222: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 29 op/s 2024-05-27T09:55:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:02 smithi122 ceph-mon[36436]: pgmap v222: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 29 op/s 2024-05-27T09:55:03.460 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:55:05.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:04 smithi071 ceph-mon[31451]: pgmap v223: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 22 op/s 2024-05-27T09:55:05.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:04 smithi071 ceph-mon[31451]: osdmap e86: 12 total, 12 up, 12 in 2024-05-27T09:55:05.025 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:04 smithi072 ceph-mon[35951]: pgmap v223: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 22 op/s 2024-05-27T09:55:05.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:04 smithi072 ceph-mon[35951]: osdmap e86: 12 total, 12 up, 12 in 2024-05-27T09:55:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:04 smithi122 ceph-mon[36436]: pgmap v223: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 22 op/s 2024-05-27T09:55:05.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:04 smithi122 ceph-mon[36436]: osdmap e86: 12 total, 12 up, 12 in 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 -- 172.21.15.71:0/3378827371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78401045e0 msgr2=0x7f78401049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 --2- 172.21.15.71:0/3378827371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78401045e0 0x7f78401049f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f78300099c0 tx=0x7f7830009cd0 comp rx=0 tx=0).stop 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 -- 172.21.15.71:0/3378827371 shutdown_connections 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 --2- 172.21.15.71:0/3378827371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7840109860 0x7f78401111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 --2- 172.21.15.71:0/3378827371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78401045e0 0x7f78401049f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 --2- 172.21.15.71:0/3378827371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7840108f10 0x7f7840109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 -- 172.21.15.71:0/3378827371 >> 172.21.15.71:0/3378827371 conn(0x7f7840100030 msgr2=0x7f7840102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 -- 172.21.15.71:0/3378827371 shutdown_connections 2024-05-27T09:55:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.931+0000 7f7846400700 1 -- 172.21.15.71:0/3378827371 wait complete. 2024-05-27T09:55:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.933+0000 7f7846400700 1 Processor -- start 2024-05-27T09:55:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.933+0000 7f7846400700 1 -- start start 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f7846400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78401045e0 0x7f78401999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f7846400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7840108f10 0x7f7840199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f7846400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7840109860 0x7f78401a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f7846400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f78401144e0 con 0x7f78401045e0 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f7846400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7840114360 con 0x7f7840108f10 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f7846400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7840114660 con 0x7f7840109860 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f783fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7840109860 0x7f78401a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f783fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7840109860 0x7f78401a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39698/0 (socket says 172.21.15.71:39698) 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f783fe00700 1 -- 172.21.15.71:0/2707997271 learned_addr learned my addr 172.21.15.71:0/2707997271 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f783ea00700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7840108f10 0x7f7840199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.934+0000 7f783f400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78401045e0 0x7f78401999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.935+0000 7f783fe00700 1 -- 172.21.15.71:0/2707997271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7840108f10 msgr2=0x7f7840199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.935+0000 7f783fe00700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7840108f10 0x7f7840199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.935+0000 7f783fe00700 1 -- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78401045e0 msgr2=0x7f78401999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.935+0000 7f783fe00700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78401045e0 0x7f78401999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.935+0000 7f783fe00700 1 -- 172.21.15.71:0/2707997271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784019a7e0 con 0x7f7840109860 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.935+0000 7f783fe00700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7840109860 0x7f78401a0a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f783800ef30 tx=0x7f783800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.936+0000 7f7837e00700 1 -- 172.21.15.71:0/2707997271 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78380092e0 con 0x7f7840109860 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.936+0000 7f7837e00700 1 -- 172.21.15.71:0/2707997271 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7838004bb0 con 0x7f7840109860 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.936+0000 7f7837e00700 1 -- 172.21.15.71:0/2707997271 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838004020 con 0x7f7840109860 2024-05-27T09:55:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.937+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78401a1010 con 0x7f7840109860 2024-05-27T09:55:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.937+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78401a1500 con 0x7f7840109860 2024-05-27T09:55:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.938+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78400512b0 con 0x7f7840109860 2024-05-27T09:55:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.940+0000 7f7837e00700 1 -- 172.21.15.71:0/2707997271 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f783801b030 con 0x7f7840109860 2024-05-27T09:55:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.942+0000 7f7837e00700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f78240b2b40 0x7f78240b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:05.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.942+0000 7f7837e00700 1 -- 172.21.15.71:0/2707997271 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f78380e1fd0 con 0x7f7840109860 2024-05-27T09:55:05.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.942+0000 7f783f400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f78240b2b40 0x7f78240b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:05.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.943+0000 7f783f400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f78240b2b40 0x7f78240b5050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7830000c00 tx=0x7f783001a040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:05.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:05.947+0000 7f7837e00700 1 -- 172.21.15.71:0/2707997271 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7838022020 con 0x7f7840109860 2024-05-27T09:55:06.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.260+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78401a1f30 con 0x7f7840109860 2024-05-27T09:55:06.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.261+0000 7f7837e00700 1 -- 172.21.15.71:0/2707997271 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f784019a7e0 con 0x7f7840109860 2024-05-27T09:55:06.262 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:55:06.262 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:55:06.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f78240b2b40 msgr2=0x7f78240b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:06.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f78240b2b40 0x7f78240b5050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7830000c00 tx=0x7f783001a040 comp rx=0 tx=0).stop 2024-05-27T09:55:06.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7840109860 msgr2=0x7f78401a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:06.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7840109860 0x7f78401a0a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f783800ef30 tx=0x7f783800c3a0 comp rx=0 tx=0).stop 2024-05-27T09:55:06.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 shutdown_connections 2024-05-27T09:55:06.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f78240b2b40 0x7f78240b5050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:06.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7840109860 0x7f78401a0a10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:06.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78401045e0 0x7f78401999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:06.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 --2- 172.21.15.71:0/2707997271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7840108f10 0x7f7840199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:06.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 >> 172.21.15.71:0/2707997271 conn(0x7f7840100030 msgr2=0x7f78401076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:06.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 shutdown_connections 2024-05-27T09:55:06.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:06.265+0000 7f7846400700 1 -- 172.21.15.71:0/2707997271 wait complete. 2024-05-27T09:55:06.267 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:55:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:06 smithi072 ceph-mon[35951]: pgmap v225: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-27T09:55:07.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:06 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2707997271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:55:07.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:06 smithi122 ceph-mon[36436]: pgmap v225: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-27T09:55:07.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:06 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2707997271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:55:07.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:06 smithi071 ceph-mon[31451]: pgmap v225: 97 pgs: 97 active+clean; 42 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-27T09:55:07.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:06 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2707997271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:55:07.367 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0' 2024-05-27T09:55:07.367 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0 2024-05-27T09:55:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:55:08.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:08 smithi071 ceph-mon[31451]: pgmap v226: 97 pgs: 97 active+clean; 47 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 899 KiB/s wr, 171 op/s 2024-05-27T09:55:09.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:08 smithi072 ceph-mon[35951]: pgmap v226: 97 pgs: 97 active+clean; 47 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 899 KiB/s wr, 171 op/s 2024-05-27T09:55:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:08 smithi122 ceph-mon[36436]: pgmap v226: 97 pgs: 97 active+clean; 47 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 899 KiB/s wr, 171 op/s 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 -- 172.21.15.71:0/859481730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8314108f10 msgr2=0x7f8314109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 --2- 172.21.15.71:0/859481730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8314108f10 0x7f8314109320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8300009990 tx=0x7f8300009ca0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 -- 172.21.15.71:0/859481730 shutdown_connections 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 --2- 172.21.15.71:0/859481730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8314109860 0x7f83141111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 --2- 172.21.15.71:0/859481730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83141045e0 0x7f83141049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 --2- 172.21.15.71:0/859481730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8314108f10 0x7f8314109320 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 -- 172.21.15.71:0/859481730 >> 172.21.15.71:0/859481730 conn(0x7f8314100030 msgr2=0x7f8314102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 -- 172.21.15.71:0/859481730 shutdown_connections 2024-05-27T09:55:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.187+0000 7f831be00700 1 -- 172.21.15.71:0/859481730 wait complete. 2024-05-27T09:55:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.188+0000 7f831be00700 1 Processor -- start 2024-05-27T09:55:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.188+0000 7f831be00700 1 -- start start 2024-05-27T09:55:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f831be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83141045e0 0x7f83140753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f831be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8314108f10 0x7f831406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f831be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8314109860 0x7f831406eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f831be00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8314114470 con 0x7f8314109860 2024-05-27T09:55:10.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f831be00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83141142f0 con 0x7f83141045e0 2024-05-27T09:55:10.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f831be00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f83141145f0 con 0x7f8314108f10 2024-05-27T09:55:10.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83141045e0 0x7f83140753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83141045e0 0x7f83140753b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42328/0 (socket says 172.21.15.71:42328) 2024-05-27T09:55:10.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f8319400700 1 -- 172.21.15.71:0/222107341 learned_addr learned my addr 172.21.15.71:0/222107341 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:10.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f8318a00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8314108f10 0x7f831406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f8319400700 1 -- 172.21.15.71:0/222107341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8314108f10 msgr2=0x7f831406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.189+0000 7f8319400700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8314108f10 0x7f831406e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f8319400700 1 -- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8314109860 msgr2=0x7f831406eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f8319400700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8314109860 0x7f831406eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f8319400700 1 -- 172.21.15.71:0/222107341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8314072ee0 con 0x7f83141045e0 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f8319400700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83141045e0 0x7f83140753b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f830800e9a0 tx=0x7f830800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f8312000700 1 -- 172.21.15.71:0/222107341 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830800cb50 con 0x7f83141045e0 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f8312000700 1 -- 172.21.15.71:0/222107341 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f830800ccf0 con 0x7f83141045e0 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83140731d0 con 0x7f83141045e0 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f8312000700 1 -- 172.21.15.71:0/222107341 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308018680 con 0x7f83141045e0 2024-05-27T09:55:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.190+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8314073730 con 0x7f83141045e0 2024-05-27T09:55:10.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.194+0000 7f8312000700 1 -- 172.21.15.71:0/222107341 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f8308018820 con 0x7f83141045e0 2024-05-27T09:55:10.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.195+0000 7f832a98fb80 1 Processor -- start 2024-05-27T09:55:10.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f8312000700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f82fc0b2a70 0x7f82fc0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f832a98fb80 1 -- start start 2024-05-27T09:55:10.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f8312000700 1 -- 172.21.15.71:0/222107341 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f83080e28d0 con 0x7f83141045e0 2024-05-27T09:55:10.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f8319e00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f82fc0b2a70 0x7f82fc0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85278ab90 0x55e8528245d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e852824b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e85281ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f832a98fb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e85274bfe0 con 0x55e85281e680 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f832a98fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e85273bb80 con 0x55e85278ab90 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.196+0000 7f832a98fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e85273fbc0 con 0x55e85269efe0 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85278ab90 0x55e8528245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85278ab90 0x55e8528245d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42342/0 (socket says 172.21.15.71:42342) 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 -- 172.21.15.71:0/3571502307 learned_addr learned my addr 172.21.15.71:0/3571502307 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319e00700 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e85281ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8318a00700 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e852824b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 -- 172.21.15.71:0/3571502307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 msgr2=0x55e852824b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e852824b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 -- 172.21.15.71:0/3571502307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 msgr2=0x55e85281ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e85281ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 -- 172.21.15.71:0/3571502307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8527045c0 con 0x55e85278ab90 2024-05-27T09:55:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319e00700 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e85281ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:55:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8318a00700 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e852824b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:55:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.197+0000 7f8319400700 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85278ab90 0x55e8528245d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f83080a5bb0 tx=0x7f8308009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad3d83ca8e415ce server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.198+0000 7f8306a00700 1 -- 172.21.15.71:0/3571502307 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83080aae60 con 0x55e85278ab90 2024-05-27T09:55:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.198+0000 7f8306a00700 1 -- 172.21.15.71:0/3571502307 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83080a9640 con 0x55e85278ab90 2024-05-27T09:55:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.198+0000 7f8306a00700 1 -- 172.21.15.71:0/3571502307 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83080a9ff0 con 0x55e85278ab90 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 -- 172.21.15.71:0/3571502307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85278ab90 msgr2=0x55e8528245d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f8319e00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f82fc0b2a70 0x7f82fc0b4f80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f830c009c10 tx=0x7f830c009b80 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85278ab90 0x55e8528245d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f83080a5bb0 tx=0x7f8308009790 comp rx=0 tx=0).stop 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 -- 172.21.15.71:0/3571502307 shutdown_connections 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e85281ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85278ab90 0x55e8528245d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3571502307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e852824b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 -- 172.21.15.71:0/3571502307 >> 172.21.15.71:0/3571502307 conn(0x55e852738530 msgr2=0x55e8528196f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 -- 172.21.15.71:0/3571502307 shutdown_connections 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.199+0000 7f832a98fb80 1 -- 172.21.15.71:0/3571502307 wait complete. 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.200+0000 7f832a98fb80 1 -- start start 2024-05-27T09:55:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.200+0000 7f832a98fb80 1 Processor -- start 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.200+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e852828ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f832a98fb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e852642140 con 0x55e85281e680 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f832a98fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e8526dc900 con 0x55e85269efe0 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f832a98fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e85281f410 con 0x55e85278ab90 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f832a98fb80 10 client.0 _ll_register_callbacks cb 0x55e8526e5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8318a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42354/0 (socket says 172.21.15.71:42354) 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 -- 172.21.15.71:0/2120217661 learned_addr learned my addr 172.21.15.71:0/2120217661 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8318a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39722/0 (socket says 172.21.15.71:39722) 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 -- 172.21.15.71:0/2120217661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 msgr2=0x55e852828980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 -- 172.21.15.71:0/2120217661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 msgr2=0x55e852828ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e852828ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.201+0000 7f8319400700 1 -- 172.21.15.71:0/2120217661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e85268ba70 con 0x55e85269efe0 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f8319400700 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828440 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f83080098c0 tx=0x7f830801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cf6161eec75f9f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f82fb400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f82fb400700 1 -- 172.21.15.71:0/2120217661 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83080aae60 con 0x55e85269efe0 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f82fb400700 1 -- 172.21.15.71:0/2120217661 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f83080a8fa0 con 0x55e85269efe0 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83080a9640 con 0x55e85269efe0 2024-05-27T09:55:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f82fb400700 1 -- 172.21.15.71:0/2120217661 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83080c4200 con 0x55e85269efe0 2024-05-27T09:55:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f832a98fb80 10 client.26576 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e85270c200 con 0x55e85269efe0 2024-05-27T09:55:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f82fb400700 1 -- 172.21.15.71:0/2120217661 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83080a9640 con 0x55e85269efe0 2024-05-27T09:55:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.202+0000 7f82fb400700 1 -- 172.21.15.71:0/2120217661 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f83080a8800 con 0x55e85269efe0 2024-05-27T09:55:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.203+0000 7f832a98fb80 10 client.26576 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.203+0000 7f832a98fb80 10 client.26576 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:55:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.203+0000 7f832a98fb80 20 client.26576 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.203+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e852837eb0 0x55e85283a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.203+0000 7f832a98fb80 4 client.26576 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.203+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e85274df30 con 0x55e852837eb0 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.203+0000 7f8318a00700 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e852837eb0 0x55e85283a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.204+0000 7f82fb400700 10 client.26576 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.204+0000 7f8318a00700 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e852837eb0 0x55e85283a2d0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69518dff2d3e3cfc server_cookie=d708a1f79363e51a in_seq=0 out_seq=0 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.204+0000 7f82fb400700 1 -- 172.21.15.71:0/2120217661 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55e85274df30 con 0x55e852837eb0 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.204+0000 7f82fb400700 10 client.26576 handle_command_reply: tid=0 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.204+0000 7f832a98fb80 1 client.26576 shutdown 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 msgr2=0x55e852828440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828440 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f83080098c0 tx=0x7f830801f000 comp rx=0 tx=0).stop 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 shutdown_connections 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e852837eb0 0x55e85283a2d0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e852828ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828440 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2120217661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f82fb400700 0 client.26576 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:10.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 >> 172.21.15.71:0/2120217661 conn(0x55e852738530 msgr2=0x55e852818a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:10.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 shutdown_connections 2024-05-27T09:55:10.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 1 -- 172.21.15.71:0/2120217661 wait complete. 2024-05-27T09:55:10.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.205+0000 7f832a98fb80 20 client.26576 trim_cache size 0 max 16384 2024-05-27T09:55:10.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 Processor -- start 2024-05-27T09:55:10.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 -- start start 2024-05-27T09:55:10.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e8528258c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83141bc170 con 0x55e85281e680 2024-05-27T09:55:10.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83141b9a00 con 0x55e85269efe0 2024-05-27T09:55:10.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.228+0000 7f832a98fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f83141b7870 con 0x55e85278ab90 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8319e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e8528258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39736/0 (socket says 172.21.15.71:39736) 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 -- 172.21.15.71:0/3380713682 learned_addr learned my addr 172.21.15.71:0/3380713682 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8319400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42360/0 (socket says 172.21.15.71:42360) 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 -- 172.21.15.71:0/3380713682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 msgr2=0x55e852828930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 -- 172.21.15.71:0/3380713682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 msgr2=0x55e8528258c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e8528258c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8318a00700 1 -- 172.21.15.71:0/3380713682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e85270c200 con 0x55e85278ab90 2024-05-27T09:55:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.229+0000 7f8319400700 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.230+0000 7f8318a00700 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8300009990 tx=0x7f8300009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecbfb28007c4ddfb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.230+0000 7f8306000700 1 -- 172.21.15.71:0/3380713682 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830002a020 con 0x55e85278ab90 2024-05-27T09:55:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.230+0000 7f8306000700 1 -- 172.21.15.71:0/3380713682 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8300005580 con 0x55e85278ab90 2024-05-27T09:55:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.230+0000 7f8306000700 1 -- 172.21.15.71:0/3380713682 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83000039f0 con 0x55e85278ab90 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 -- 172.21.15.71:0/3380713682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 msgr2=0x55e852828e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8300009990 tx=0x7f8300009310 comp rx=0 tx=0).stop 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 -- 172.21.15.71:0/3380713682 shutdown_connections 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85281e680 0x55e8528258c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85269efe0 0x55e852828930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 --2- 172.21.15.71:0/3380713682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85278ab90 0x55e852828e70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 -- 172.21.15.71:0/3380713682 >> 172.21.15.71:0/3380713682 conn(0x55e852738530 msgr2=0x55e852828220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 -- 172.21.15.71:0/3380713682 shutdown_connections 2024-05-27T09:55:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.231+0000 7f832a98fb80 1 -- 172.21.15.71:0/3380713682 wait complete. 2024-05-27T09:55:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.232+0000 7f832a98fb80 1 -- start start 2024-05-27T09:55:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.232+0000 7f832a98fb80 1 Processor -- start 2024-05-27T09:55:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e85283b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85278ab90 0x55e85283bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f832a98fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85281e680 0x55e8528a1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f832a98fb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83141b7ec0 con 0x55e85278ab90 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f832a98fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83141b9330 con 0x55e85281e680 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f832a98fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f83141b8590 con 0x55e85269efe0 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f832a98fb80 10 client.0 _ll_register_callbacks cb 0x55e8526e5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e85283b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e85283b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:39752/0 (socket says 172.21.15.71:39752) 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 -- 172.21.15.71:0/2967653695 learned_addr learned my addr 172.21.15.71:0/2967653695 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319e00700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85281e680 0x55e8528a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 -- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85281e680 msgr2=0x55e8528a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85281e680 0x55e8528a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8318a00700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85278ab90 0x55e85283bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 -- 172.21.15.71:0/2967653695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85278ab90 msgr2=0x55e85283bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85278ab90 0x55e85283bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.233+0000 7f8319400700 1 -- 172.21.15.71:0/2967653695 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8528a1c60 con 0x55e85269efe0 2024-05-27T09:55:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f8318a00700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85278ab90 0x55e85283bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f8319400700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e85283b760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83080a6da0 tx=0x7f8308010c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b788e37c1ce5c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f82fb400700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f82fb400700 1 -- 172.21.15.71:0/2967653695 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83080aae60 con 0x55e85269efe0 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f82fb400700 1 -- 172.21.15.71:0/2967653695 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f83080a8fa0 con 0x55e85269efe0 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8300005580 con 0x55e85269efe0 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f82fb400700 1 -- 172.21.15.71:0/2967653695 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83080a9640 con 0x55e85269efe0 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f832a98fb80 10 client.26608 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.234+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e8528a1c60 con 0x55e85269efe0 2024-05-27T09:55:10.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f82fb400700 1 -- 172.21.15.71:0/2967653695 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8300005580 con 0x55e85269efe0 2024-05-27T09:55:10.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f82fb400700 1 -- 172.21.15.71:0/2967653695 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f83080cc2c0 con 0x55e85269efe0 2024-05-27T09:55:10.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f832a98fb80 10 client.26608 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:10.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f832a98fb80 10 client.26608 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:55:10.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f832a98fb80 20 client.26608 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e8528a3170 0x55e8528a5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f832a98fb80 4 client.26608 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}] 2024-05-27T09:55:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}) -- 0x55e8528118b0 con 0x55e8528a3170 2024-05-27T09:55:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.235+0000 7f8318a00700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e8528a3170 0x55e8528a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.236+0000 7f8318a00700 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e8528a3170 0x55e8528a5590 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ac204d2848d7972 server_cookie=f1217f3757cbf605 in_seq=0 out_seq=0 2024-05-27T09:55:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:10.236+0000 7f82fb400700 10 client.26608 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:11.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:10 smithi122 ceph-mon[36436]: pgmap v227: 97 pgs: 97 active+clean; 47 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 899 KiB/s wr, 171 op/s 2024-05-27T09:55:11.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:10 smithi122 ceph-mon[36436]: osdmap e87: 12 total, 12 up, 12 in 2024-05-27T09:55:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.240+0000 7f82fb400700 1 -- 172.21.15.71:0/2967653695 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e8528118b0 con 0x55e8528a3170 2024-05-27T09:55:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.240+0000 7f82fb400700 10 client.26608 handle_command_reply: tid=0 2024-05-27T09:55:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.240+0000 7f832a98fb80 1 client.26608 shutdown 2024-05-27T09:55:11.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:10 smithi071 ceph-mon[31451]: pgmap v227: 97 pgs: 97 active+clean; 47 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 899 KiB/s wr, 171 op/s 2024-05-27T09:55:11.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:10 smithi071 ceph-mon[31451]: osdmap e87: 12 total, 12 up, 12 in 2024-05-27T09:55:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 msgr2=0x55e85283b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e85283b760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83080a6da0 tx=0x7f8308010c10 comp rx=0 tx=0).stop 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 shutdown_connections 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e8528a3170 0x55e8528a5590 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e85281e680 0x55e8528a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e85269efe0 0x55e85283b760 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 --2- 172.21.15.71:0/2967653695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e85278ab90 0x55e85283bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 >> 172.21.15.71:0/2967653695 conn(0x55e852738530 msgr2=0x55e852828c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f82fb400700 0 client.26608 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 shutdown_connections 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.241+0000 7f832a98fb80 1 -- 172.21.15.71:0/2967653695 wait complete. 2024-05-27T09:55:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.242+0000 7f832a98fb80 20 client.26608 trim_cache size 0 max 16384 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 22, 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "49bc009a": { 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 22, 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:55:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 138.9, 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:11.244 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f82fc0b2a70 msgr2=0x7f82fc0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f82fc0b2a70 0x7f82fc0b4f80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f830c009c10 tx=0x7f830c009b80 comp rx=0 tx=0).stop 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83141045e0 msgr2=0x7f83140753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83141045e0 0x7f83140753b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f830800e9a0 tx=0x7f830800ecb0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 shutdown_connections 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f82fc0b2a70 0x7f82fc0b4f80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8314109860 0x7f831406eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83141045e0 0x7f83140753b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 --2- 172.21.15.71:0/222107341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8314108f10 0x7f831406e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 >> 172.21.15.71:0/222107341 conn(0x7f8314100030 msgr2=0x7f8314108650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 shutdown_connections 2024-05-27T09:55:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:11.243+0000 7f831be00700 1 -- 172.21.15.71:0/222107341 wait complete. 2024-05-27T09:55:11.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:10 smithi072 ceph-mon[35951]: pgmap v227: 97 pgs: 97 active+clean; 47 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 899 KiB/s wr, 171 op/s 2024-05-27T09:55:11.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:10 smithi072 ceph-mon[35951]: osdmap e87: 12 total, 12 up, 12 in 2024-05-27T09:55:12.188 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '49bc009a', quiesce took 9.2 seconds. Will release after: 9.75 2024-05-27T09:55:13.032 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:12 smithi122 ceph-mon[36436]: pgmap v229: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.2 MiB/s wr, 381 op/s 2024-05-27T09:55:13.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:12 smithi071 ceph-mon[31451]: pgmap v229: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.2 MiB/s wr, 381 op/s 2024-05-27T09:55:13.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:12 smithi072 ceph-mon[35951]: pgmap v229: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.2 MiB/s wr, 381 op/s 2024-05-27T09:55:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:14 smithi122 ceph-mon[36436]: pgmap v230: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.8 MiB/s wr, 307 op/s 2024-05-27T09:55:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:14 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:55:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 -- 172.21.15.71:0/564489031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 msgr2=0x7f6a5010fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 --2- 172.21.15.71:0/564489031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 0x7f6a5010fdb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009900 tx=0x7f6a3c02a480 comp rx=0 tx=0).stop 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 -- 172.21.15.71:0/564489031 shutdown_connections 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 --2- 172.21.15.71:0/564489031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a501102f0 0x7f6a50112710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 --2- 172.21.15.71:0/564489031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 0x7f6a5010fdb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 --2- 172.21.15.71:0/564489031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 0x7f6a50075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 -- 172.21.15.71:0/564489031 >> 172.21.15.71:0/564489031 conn(0x7f6a50079240 msgr2=0x7f6a50079680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 -- 172.21.15.71:0/564489031 shutdown_connections 2024-05-27T09:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.236+0000 7f6a54c00640 1 -- 172.21.15.71:0/564489031 wait complete. 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 Processor -- start 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 -- start start 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 0x7f6a501a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 0x7f6a501a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a501102f0 0x7f6a5019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50115e80 con 0x7f6a50075480 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50115d00 con 0x7f6a5010d990 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a54c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50116000 con 0x7f6a501102f0 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 0x7f6a501a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.238+0000 7f6a4ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 0x7f6a501a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a501102f0 0x7f6a5019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 0x7f6a501a25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57832/0 (socket says 172.21.15.71:57832) 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4f400640 1 -- 172.21.15.71:0/3935604281 learned_addr learned my addr 172.21.15.71:0/3935604281 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 0x7f6a501a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:48754/0 (socket says 172.21.15.71:48754) 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4fe00640 1 -- 172.21.15.71:0/3935604281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 msgr2=0x7f6a501a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4fe00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 0x7f6a501a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4fe00640 1 -- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 msgr2=0x7f6a501a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4fe00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 0x7f6a501a25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4fe00640 1 -- 172.21.15.71:0/3935604281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5019ce50 con 0x7f6a501102f0 2024-05-27T09:55:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4f400640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 0x7f6a501a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.239+0000 7f6a4fe00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a501102f0 0x7f6a5019c720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009fd0 tx=0x7f6a4800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.240+0000 7f6a47e00640 1 -- 172.21.15.71:0/3935604281 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800ce20 con 0x7f6a501102f0 2024-05-27T09:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.240+0000 7f6a47e00640 1 -- 172.21.15.71:0/3935604281 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a48005020 con 0x7f6a501102f0 2024-05-27T09:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.240+0000 7f6a47e00640 1 -- 172.21.15.71:0/3935604281 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48010690 con 0x7f6a501102f0 2024-05-27T09:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.240+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5019d0e0 con 0x7f6a501102f0 2024-05-27T09:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.240+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501a9340 con 0x7f6a501102f0 2024-05-27T09:55:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.243+0000 7f6a5d26d740 1 Processor -- start 2024-05-27T09:55:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.245+0000 7f6a47e00640 1 -- 172.21.15.71:0/3935604281 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f6a480054d0 con 0x7f6a501102f0 2024-05-27T09:55:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a5d26d740 1 -- start start 2024-05-27T09:55:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653daa9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653daa9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653daaa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55653da1ab90 con 0x55653d6e64d0 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55653da0a730 con 0x55653d6de2f0 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55653da0e770 con 0x55653d7071b0 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653daa9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653daa9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:48766/0 (socket says 172.21.15.71:48766) 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a4f400640 1 -- 172.21.15.71:0/2110212509 learned_addr learned my addr 172.21.15.71:0/2110212509 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.246+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653daa9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653daaa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4f400640 1 -- 172.21.15.71:0/2110212509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 msgr2=0x55653daa9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4f400640 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653daa9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4f400640 1 -- 172.21.15.71:0/2110212509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 msgr2=0x55653daaa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4f400640 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653daaa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4f400640 1 -- 172.21.15.71:0/2110212509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653d9a38b0 con 0x55653d6de2f0 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653daaa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a4f400640 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653daa9fa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6a400115c0 tx=0x7f6a40011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a37cb99d150bb345 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a47e00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6a340b29d0 0x7f6a340b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a3be00640 1 -- 172.21.15.71:0/2110212509 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40005020 con 0x55653d6de2f0 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a3be00640 1 -- 172.21.15.71:0/2110212509 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a400047a0 con 0x55653d6de2f0 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.247+0000 7f6a3be00640 1 -- 172.21.15.71:0/2110212509 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000f970 con 0x55653d6de2f0 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.248+0000 7f6a47e00640 1 -- 172.21.15.71:0/3935604281 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6a480e2c80 con 0x7f6a501102f0 2024-05-27T09:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.248+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6a340b29d0 0x7f6a340b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 -- 172.21.15.71:0/2110212509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 msgr2=0x55653daa9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653daa9fa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6a400115c0 tx=0x7f6a40011a80 comp rx=0 tx=0).stop 2024-05-27T09:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6a340b29d0 0x7f6a340b4ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c000c00 tx=0x7f6a3c031400 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 -- 172.21.15.71:0/2110212509 shutdown_connections 2024-05-27T09:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653daaa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653daa9fa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/2110212509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653daa9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 -- 172.21.15.71:0/2110212509 >> 172.21.15.71:0/2110212509 conn(0x55653d6fb300 msgr2=0x55653daa6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 -- 172.21.15.71:0/2110212509 shutdown_connections 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 -- 172.21.15.71:0/2110212509 wait complete. 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.249+0000 7f6a5d26d740 1 -- start start 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 1 Processor -- start 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653dab4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653dabfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55653d6f0790 con 0x55653d6e64d0 2024-05-27T09:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55653d9b2bc0 con 0x55653d6de2f0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55653dab6b90 con 0x55653d7071b0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a5d26d740 10 client.0 _ll_register_callbacks cb 0x55653d990400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:48774/0 (socket says 172.21.15.71:48774) 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.250+0000 7f6a4f400640 1 -- 172.21.15.71:0/540572769 learned_addr learned my addr 172.21.15.71:0/540572769 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4fe00640 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653dabfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653dab4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4f400640 1 -- 172.21.15.71:0/540572769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 msgr2=0x55653dabfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4f400640 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653dabfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4f400640 1 -- 172.21.15.71:0/540572769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 msgr2=0x55653dab4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4f400640 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653dab4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4f400640 1 -- 172.21.15.71:0/540572769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653d71f210 con 0x55653d6de2f0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a4f400640 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab3be0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009620 tx=0x7f6a40009e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a482d5b28146291 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a38c00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.251+0000 7f6a38c00640 1 -- 172.21.15.71:0/540572769 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40027070 con 0x55653d6de2f0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a400047a0 con 0x55653d6de2f0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a38c00640 1 -- 172.21.15.71:0/540572769 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6a40005230 con 0x55653d6de2f0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a38c00640 1 -- 172.21.15.71:0/540572769 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6a40033050 con 0x55653d6de2f0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a5d26d740 10 client.26594 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55653d7eb620 con 0x55653d6de2f0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a38c00640 1 -- 172.21.15.71:0/540572769 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a400047a0 con 0x55653d6de2f0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a38c00640 1 -- 172.21.15.71:0/540572769 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f6a40022460 con 0x55653d6de2f0 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a5d26d740 10 client.26594 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a5d26d740 10 client.26594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a5d26d740 20 client.26594 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.252+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d6c5d80 0x55653dac5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.253+0000 7f6a5d26d740 4 client.26594 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.253+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55653da1cae0 con 0x55653d6c5d80 2024-05-27T09:55:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.253+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d6c5d80 0x55653dac5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.253+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d6c5d80 0x55653dac5d40 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf68c9221339ef11 server_cookie=b1aff9a0699e0d59 in_seq=0 out_seq=0 2024-05-27T09:55:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.253+0000 7f6a38c00640 10 client.26594 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.254+0000 7f6a38c00640 1 -- 172.21.15.71:0/540572769 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55653da1cae0 con 0x55653d6c5d80 2024-05-27T09:55:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.254+0000 7f6a38c00640 10 client.26594 handle_command_reply: tid=0 2024-05-27T09:55:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.254+0000 7f6a5d26d740 1 client.26594 shutdown 2024-05-27T09:55:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.254+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 msgr2=0x55653dab3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.254+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab3be0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009620 tx=0x7f6a40009e00 comp rx=0 tx=0).stop 2024-05-27T09:55:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 shutdown_connections 2024-05-27T09:55:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d7071b0 0x55653dabfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d6c5d80 0x55653dac5d40 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653dab4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/540572769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab3be0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a38c00640 0 client.26594 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 >> 172.21.15.71:0/540572769 conn(0x55653d6fb300 msgr2=0x55653daa9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 shutdown_connections 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 1 -- 172.21.15.71:0/540572769 wait complete. 2024-05-27T09:55:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.255+0000 7f6a5d26d740 20 client.26594 trim_cache size 0 max 16384 2024-05-27T09:55:15.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:14 smithi071 ceph-mon[31451]: pgmap v230: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.8 MiB/s wr, 307 op/s 2024-05-27T09:55:15.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:14 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:55:15.271 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.271+0000 7f6a5d26d740 1 Processor -- start 2024-05-27T09:55:15.271 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a5d26d740 1 -- start start 2024-05-27T09:55:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6e64d0 0x55653daaedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d7071b0 0x55653daaf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6a501b4500 con 0x55653d7071b0 2024-05-27T09:55:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6a501b1dd0 con 0x55653d6de2f0 2024-05-27T09:55:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a501afc40 con 0x55653d6e64d0 2024-05-27T09:55:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a4ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6e64d0 0x55653daaedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a4ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6e64d0 0x55653daaedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37104/0 (socket says 172.21.15.71:37104) 2024-05-27T09:55:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a4fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d7071b0 0x55653daaf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.272+0000 7f6a4ea00640 1 -- 172.21.15.71:0/3247166352 learned_addr learned my addr 172.21.15.71:0/3247166352 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.273+0000 7f6a4ea00640 1 -- 172.21.15.71:0/3247166352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 msgr2=0x55653dab6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.273+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/3247166352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.273+0000 7f6a4ea00640 1 -- 172.21.15.71:0/3247166352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d7071b0 msgr2=0x55653daaf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.273+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/3247166352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d7071b0 0x55653daaf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.273+0000 7f6a4ea00640 1 -- 172.21.15.71:0/3247166352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653daaa810 con 0x55653d6e64d0 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.273+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/3247166352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6e64d0 0x55653daaedc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009900 tx=0x7f6a3c03f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d7c63e34d12fc38 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.273+0000 7f6a3b400640 1 -- 172.21.15.71:0/3247166352 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c004490 con 0x55653d6e64d0 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.274+0000 7f6a3b400640 1 -- 172.21.15.71:0/3247166352 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a3c031740 con 0x55653d6e64d0 2024-05-27T09:55:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.274+0000 7f6a3b400640 1 -- 172.21.15.71:0/3247166352 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c051650 con 0x55653d6e64d0 2024-05-27T09:55:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:14 smithi072 ceph-mon[35951]: pgmap v230: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.8 MiB/s wr, 307 op/s 2024-05-27T09:55:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:14 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 -- 172.21.15.71:0/3247166352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6e64d0 msgr2=0x55653daaedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/3247166352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6e64d0 0x55653daaedc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009900 tx=0x7f6a3c03f040 comp rx=0 tx=0).stop 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 -- 172.21.15.71:0/3247166352 shutdown_connections 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/3247166352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d7071b0 0x55653daaf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/3247166352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6e64d0 0x55653daaedc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/3247166352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d6de2f0 0x55653dab6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 -- 172.21.15.71:0/3247166352 >> 172.21.15.71:0/3247166352 conn(0x55653d6fb300 msgr2=0x55653dab3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 -- 172.21.15.71:0/3247166352 shutdown_connections 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.275+0000 7f6a5d26d740 1 -- 172.21.15.71:0/3247166352 wait complete. 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.276+0000 7f6a5d26d740 1 -- start start 2024-05-27T09:55:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.276+0000 7f6a5d26d740 1 Processor -- start 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6de2f0 0x55653db265e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653db26b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a5d26d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d7071b0 0x55653dab93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6a501b0290 con 0x55653d6e64d0 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6a501b1700 con 0x55653d7071b0 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a5d26d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a501b0960 con 0x55653d6de2f0 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a5d26d740 10 client.0 _ll_register_callbacks cb 0x7f6a40011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6de2f0 0x55653db265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6de2f0 0x55653db265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37120/0 (socket says 172.21.15.71:37120) 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a4f400640 1 -- 172.21.15.71:0/1195218126 learned_addr learned my addr 172.21.15.71:0/1195218126 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653db26b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.277+0000 7f6a4fe00640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d7071b0 0x55653dab93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a4f400640 1 -- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d7071b0 msgr2=0x55653dab93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a4f400640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d7071b0 0x55653dab93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a4f400640 1 -- 172.21.15.71:0/1195218126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 msgr2=0x55653db26b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a4f400640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653db26b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a4f400640 1 -- 172.21.15.71:0/1195218126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653dab9a20 con 0x55653d6de2f0 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a4fe00640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d7071b0 0x55653dab93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a4f400640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6de2f0 0x55653db265e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009620 tx=0x7f6a40022a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a15d7fc57d752f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a38c00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a38c00640 1 -- 172.21.15.71:0/1195218126 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4003c060 con 0x55653d6de2f0 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a3c031740 con 0x55653d6de2f0 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.278+0000 7f6a38c00640 1 -- 172.21.15.71:0/1195218126 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6a40005230 con 0x55653d6de2f0 2024-05-27T09:55:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a38c00640 1 -- 172.21.15.71:0/1195218126 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6a40027040 con 0x55653d6de2f0 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 10 client.26626 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55653db2dc50 con 0x55653d6de2f0 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a38c00640 1 -- 172.21.15.71:0/1195218126 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a3c031740 con 0x55653d6de2f0 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a38c00640 1 -- 172.21.15.71:0/1195218126 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f6a400044f0 con 0x55653d6de2f0 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 10 client.26626 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 10 client.26626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 20 client.26626 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d69b1c0 0x55653db30410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 4 client.26626 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:55:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.279+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55653da162c0 con 0x55653d69b1c0 2024-05-27T09:55:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.280+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d69b1c0 0x55653db30410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.280+0000 7f6a4ea00640 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d69b1c0 0x55653db30410 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d58f44eb0bb1987a server_cookie=cc8658a3de34edb0 in_seq=0 out_seq=0 2024-05-27T09:55:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:15.280+0000 7f6a38c00640 10 client.26626 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:17.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:16 smithi122 ceph-mon[36436]: pgmap v231: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.8 MiB/s wr, 305 op/s 2024-05-27T09:55:17.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:16 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:55:17.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:16 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:55:17.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:16 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:55:17.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:16 smithi071 ceph-mon[31451]: pgmap v231: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.8 MiB/s wr, 305 op/s 2024-05-27T09:55:17.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:16 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:55:17.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:16 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:55:17.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:16 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:55:17.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:16 smithi072 ceph-mon[35951]: pgmap v231: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.8 MiB/s wr, 305 op/s 2024-05-27T09:55:17.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:16 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:55:17.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:16 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:55:17.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:16 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:55:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.305+0000 7f6a38c00640 1 -- 172.21.15.71:0/1195218126 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55653da162c0 con 0x55653d69b1c0 2024-05-27T09:55:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.305+0000 7f6a38c00640 10 client.26626 handle_command_reply: tid=0 2024-05-27T09:55:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.305+0000 7f6a5d26d740 1 client.26626 shutdown 2024-05-27T09:55:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.305+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6de2f0 msgr2=0x55653db265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.305+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6de2f0 0x55653db265e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009620 tx=0x7f6a40022a50 comp rx=0 tx=0).stop 2024-05-27T09:55:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 shutdown_connections 2024-05-27T09:55:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55653d7071b0 0x55653dab93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55653d69b1c0 0x55653db30410 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55653d6e64d0 0x55653db26b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 --2- 172.21.15.71:0/1195218126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55653d6de2f0 0x55653db265e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 >> 172.21.15.71:0/1195218126 conn(0x55653d6fb300 msgr2=0x55653dab5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a38c00640 0 client.26626 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 shutdown_connections 2024-05-27T09:55:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.306+0000 7f6a5d26d740 1 -- 172.21.15.71:0/1195218126 wait complete. 2024-05-27T09:55:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.307+0000 7f6a5d26d740 20 client.26626 trim_cache size 0 max 16384 2024-05-27T09:55:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:55:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:55:18.309 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:55:18.309 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6a340b29d0 msgr2=0x7f6a340b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:18.309 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6a340b29d0 0x7f6a340b4ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c000c00 tx=0x7f6a3c031400 comp rx=0 tx=0).stop 2024-05-27T09:55:18.309 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a501102f0 msgr2=0x7f6a5019c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:18.309 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a501102f0 0x7f6a5019c720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009fd0 tx=0x7f6a4800ef10 comp rx=0 tx=0).stop 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 shutdown_connections 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6a340b29d0 0x7f6a340b4ee0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a501102f0 0x7f6a5019c720 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5010d990 0x7f6a501a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 --2- 172.21.15.71:0/3935604281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a50075480 0x7f6a501a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.308+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 >> 172.21.15.71:0/3935604281 conn(0x7f6a50079240 msgr2=0x7f6a50102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.309+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 shutdown_connections 2024-05-27T09:55:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:18.309+0000 7f6a54c00640 1 -- 172.21.15.71:0/3935604281 wait complete. 2024-05-27T09:55:19.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:18 smithi122 ceph-mon[36436]: pgmap v232: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 978 KiB/s wr, 161 op/s 2024-05-27T09:55:19.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:18 smithi071 ceph-mon[31451]: pgmap v232: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 978 KiB/s wr, 161 op/s 2024-05-27T09:55:19.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:18 smithi072 ceph-mon[35951]: pgmap v232: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 978 KiB/s wr, 161 op/s 2024-05-27T09:55:21.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:20 smithi122 ceph-mon[36436]: pgmap v233: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 978 KiB/s wr, 161 op/s 2024-05-27T09:55:21.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:20 smithi071 ceph-mon[31451]: pgmap v233: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 978 KiB/s wr, 161 op/s 2024-05-27T09:55:21.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:20 smithi072 ceph-mon[35951]: pgmap v233: 97 pgs: 97 active+clean; 55 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 978 KiB/s wr, 161 op/s 2024-05-27T09:55:21.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:55:22.361 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:55:23.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:22 smithi071 ceph-mon[31451]: pgmap v234: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 873 KiB/s wr, 146 op/s 2024-05-27T09:55:23.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:22 smithi122 ceph-mon[36436]: pgmap v234: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 873 KiB/s wr, 146 op/s 2024-05-27T09:55:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:22 smithi072 ceph-mon[35951]: pgmap v234: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 873 KiB/s wr, 146 op/s 2024-05-27T09:55:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 -- 172.21.15.71:0/3812316039 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee010af40 msgr2=0x7f9ee010b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3812316039 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee010af40 0x7f9ee010b350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009990 tx=0x7f9ec8009ca0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 -- 172.21.15.71:0/3812316039 shutdown_connections 2024-05-27T09:55:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3812316039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ee010b890 0x7f9ee01131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3812316039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0106610 0x7f9ee0106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3812316039 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee010af40 0x7f9ee010b350 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 -- 172.21.15.71:0/3812316039 >> 172.21.15.71:0/3812316039 conn(0x7f9ee0102020 msgr2=0x7f9ee0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 -- 172.21.15.71:0/3812316039 shutdown_connections 2024-05-27T09:55:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.643+0000 7f9ee5400700 1 -- 172.21.15.71:0/3812316039 wait complete. 2024-05-27T09:55:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.644+0000 7f9ee5400700 1 Processor -- start 2024-05-27T09:55:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.644+0000 7f9ee5400700 1 -- start start 2024-05-27T09:55:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ee5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee0106610 0x7f9ee019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ee5400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee010af40 0x7f9ee019d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ee5400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ee010b890 0x7f9ee01a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ee5400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee01164f0 con 0x7f9ee010af40 2024-05-27T09:55:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ee5400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee0116370 con 0x7f9ee0106610 2024-05-27T09:55:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ee5400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee0116670 con 0x7f9ee010b890 2024-05-27T09:55:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9edfe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee0106610 0x7f9ee019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9edfe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee0106610 0x7f9ee019cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58752/0 (socket says 172.21.15.71:58752) 2024-05-27T09:55:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9edfe00700 1 -- 172.21.15.71:0/3487101186 learned_addr learned my addr 172.21.15.71:0/3487101186 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ed7e00700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee010af40 0x7f9ee019d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.645+0000 7f9ee4a00700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ee010b890 0x7f9ee01a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9edfe00700 1 -- 172.21.15.71:0/3487101186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ee010b890 msgr2=0x7f9ee01a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9edfe00700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ee010b890 0x7f9ee01a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9edfe00700 1 -- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee010af40 msgr2=0x7f9ee019d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9edfe00700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee010af40 0x7f9ee019d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9edfe00700 1 -- 172.21.15.71:0/3487101186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee01a1db0 con 0x7f9ee0106610 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9edfe00700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee0106610 0x7f9ee019cee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000e9a0 tx=0x7f9ed000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9edd600700 1 -- 172.21.15.71:0/3487101186 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000ca10 con 0x7f9ee0106610 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.646+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee01a20a0 con 0x7f9ee0106610 2024-05-27T09:55:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.647+0000 7f9edd600700 1 -- 172.21.15.71:0/3487101186 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ed000cbb0 con 0x7f9ee0106610 2024-05-27T09:55:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.647+0000 7f9edd600700 1 -- 172.21.15.71:0/3487101186 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0018680 con 0x7f9ee0106610 2024-05-27T09:55:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.647+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee01a99c0 con 0x7f9ee0106610 2024-05-27T09:55:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.648+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee00512b0 con 0x7f9ee0106610 2024-05-27T09:55:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.650+0000 7f9edd600700 1 -- 172.21.15.71:0/3487101186 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f9ed0010430 con 0x7f9ee0106610 2024-05-27T09:55:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.652+0000 7f9edd600700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ec40b29f0 0x7f9ec40b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.652+0000 7f9edd600700 1 -- 172.21.15.71:0/3487101186 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f9ed00e2b10 con 0x7f9ee0106610 2024-05-27T09:55:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.652+0000 7f9ed7e00700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ec40b29f0 0x7f9ec40b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.653+0000 7f9ed7e00700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ec40b29f0 0x7f9ec40b4f00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0105a40 tx=0x7f9ec8005fd0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.654+0000 7f9edd600700 1 -- 172.21.15.71:0/3487101186 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9ed00aa490 con 0x7f9ee0106610 2024-05-27T09:55:24.940 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:24 smithi071 ceph-mon[31451]: pgmap v235: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:55:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.939+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ee019e240 con 0x7f9ee0106610 2024-05-27T09:55:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.940+0000 7f9edd600700 1 -- 172.21.15.71:0/3487101186 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f9ed00a9d90 con 0x7f9ee0106610 2024-05-27T09:55:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:55:24.942 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:55:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ec40b29f0 msgr2=0x7f9ec40b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ec40b29f0 0x7f9ec40b4f00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0105a40 tx=0x7f9ec8005fd0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee0106610 msgr2=0x7f9ee019cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee0106610 0x7f9ee019cee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000e9a0 tx=0x7f9ed000ecb0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 shutdown_connections 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9ec40b29f0 0x7f9ec40b4f00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ee010b890 0x7f9ee01a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee0106610 0x7f9ee019cee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 --2- 172.21.15.71:0/3487101186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee010af40 0x7f9ee019d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 >> 172.21.15.71:0/3487101186 conn(0x7f9ee0102020 msgr2=0x7f9ee010a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.944+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 shutdown_connections 2024-05-27T09:55:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:24.945+0000 7f9ee5400700 1 -- 172.21.15.71:0/3487101186 wait complete. 2024-05-27T09:55:24.947 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:55:25.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:24 smithi122 ceph-mon[36436]: pgmap v235: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:55:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:24 smithi072 ceph-mon[35951]: pgmap v235: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:55:25.867 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id 49bc009a --release --await' 2024-05-27T09:55:25.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id 49bc009a --release --await 2024-05-27T09:55:26.232 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:25 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3487101186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:55:26.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:25 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3487101186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:55:26.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:25 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3487101186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:55:26.315 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:55:27.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:26 smithi122 ceph-mon[36436]: pgmap v236: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:55:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:26 smithi071 ceph-mon[31451]: pgmap v236: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:55:27.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:26 smithi072 ceph-mon[35951]: pgmap v236: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 -- 172.21.15.71:0/3824850136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c075d20 msgr2=0x7f449c076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 --2- 172.21.15.71:0/3824850136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c075d20 0x7f449c076130 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f448c009990 tx=0x7f448c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 -- 172.21.15.71:0/3824850136 shutdown_connections 2024-05-27T09:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 --2- 172.21.15.71:0/3824850136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f449c1109b0 0x7f449c112e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 --2- 172.21.15.71:0/3824850136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c075d20 0x7f449c076130 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 --2- 172.21.15.71:0/3824850136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c076670 0x7f449c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 -- 172.21.15.71:0/3824850136 >> 172.21.15.71:0/3824850136 conn(0x7f449c079d40 msgr2=0x7f449c07a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 -- 172.21.15.71:0/3824850136 shutdown_connections 2024-05-27T09:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.796+0000 7f449b200700 1 -- 172.21.15.71:0/3824850136 wait complete. 2024-05-27T09:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.798+0000 7f449b200700 1 Processor -- start 2024-05-27T09:55:28.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.798+0000 7f449b200700 1 -- start start 2024-05-27T09:55:28.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.798+0000 7f449b200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f449c075d20 0x7f449c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.798+0000 7f449b200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c076670 0x7f449c19d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.798+0000 7f449b200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c1109b0 0x7f449c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f449b200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1164c0 con 0x7f449c076670 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f449b200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f449c116340 con 0x7f449c1109b0 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f449b200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f449c116640 con 0x7f449c075d20 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c076670 0x7f449c19d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c076670 0x7f449c19d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37606/0 (socket says 172.21.15.71:37606) 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499400700 1 -- 172.21.15.71:0/2347587660 learned_addr learned my addr 172.21.15.71:0/2347587660 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499e00700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f449c075d20 0x7f449c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f449a800700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c1109b0 0x7f449c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499e00700 1 -- 172.21.15.71:0/2347587660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c1109b0 msgr2=0x7f449c1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499e00700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c1109b0 0x7f449c1a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499e00700 1 -- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c076670 msgr2=0x7f449c19d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499e00700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c076670 0x7f449c19d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499e00700 1 -- 172.21.15.71:0/2347587660 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c1a1ce0 con 0x7f449c075d20 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.799+0000 7f4499400700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c076670 0x7f449c19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.800+0000 7f4499e00700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f449c075d20 0x7f449c19ce10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f448c006010 tx=0x7f448c0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.800+0000 7f4492a00700 1 -- 172.21.15.71:0/2347587660 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c027070 con 0x7f449c075d20 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.800+0000 7f4492a00700 1 -- 172.21.15.71:0/2347587660 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c022470 con 0x7f449c075d20 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.800+0000 7f4492a00700 1 -- 172.21.15.71:0/2347587660 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c017650 con 0x7f449c075d20 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.800+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c1a1f70 con 0x7f449c075d20 2024-05-27T09:55:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.800+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c1a98f0 con 0x7f449c075d20 2024-05-27T09:55:28.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.804+0000 7f4492a00700 1 -- 172.21.15.71:0/2347587660 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f448c02a070 con 0x7f449c075d20 2024-05-27T09:55:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.805+0000 7f44af9ecb80 1 Processor -- start 2024-05-27T09:55:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.805+0000 7f44af9ecb80 1 -- start start 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f4492a00700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f44800b2a70 0x7f44800b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d478f40 0x55a70d5f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f89f0 0x55a70d602050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f8e00 0x55a70d6045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a70d525f40 con 0x55a70d478f40 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a70d515ae0 con 0x55a70d5f8e00 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a70d519b20 con 0x55a70d5f89f0 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f4492a00700 1 -- 172.21.15.71:0/2347587660 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f448c0e3240 con 0x7f449c075d20 2024-05-27T09:55:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f4499e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d478f40 0x55a70d5f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f4499e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d478f40 0x55a70d5f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37616/0 (socket says 172.21.15.71:37616) 2024-05-27T09:55:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f4499e00700 1 -- 172.21.15.71:0/2485812307 learned_addr learned my addr 172.21.15.71:0/2485812307 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f449a800700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f44800b2a70 0x7f44800b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.806+0000 7f449a800700 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f8e00 0x55a70d6045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4499400700 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f89f0 0x55a70d602050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4499e00700 1 -- 172.21.15.71:0/2485812307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f89f0 msgr2=0x55a70d602050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4499e00700 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f89f0 0x55a70d602050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4499e00700 1 -- 172.21.15.71:0/2485812307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f8e00 msgr2=0x55a70d6045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4499e00700 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f8e00 0x55a70d6045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4499e00700 1 -- 172.21.15.71:0/2485812307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70d4de520 con 0x55a70d478f40 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f449a800700 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f8e00 0x55a70d6045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4499e00700 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d478f40 0x55a70d5f84b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f448c024000 tx=0x7f448c0a9f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae08810aa8a7253 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f449a800700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f44800b2a70 0x7f44800b4f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a70d5f9290 tx=0x7f4494009920 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4487400700 1 -- 172.21.15.71:0/2485812307 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0c40e0 con 0x55a70d478f40 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4487400700 1 -- 172.21.15.71:0/2485812307 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c0aa060 con 0x55a70d478f40 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.807+0000 7f4487400700 1 -- 172.21.15.71:0/2485812307 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0ae900 con 0x55a70d478f40 2024-05-27T09:55:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.808+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2485812307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d478f40 msgr2=0x55a70d5f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.808+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d478f40 0x55a70d5f84b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f448c024000 tx=0x7f448c0a9f20 comp rx=0 tx=0).stop 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2485812307 shutdown_connections 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f8e00 0x55a70d6045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d478f40 0x55a70d5f84b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2485812307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f89f0 0x55a70d602050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2485812307 >> 172.21.15.71:0/2485812307 conn(0x55a70d4d90c0 msgr2=0x55a70d5f32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2485812307 shutdown_connections 2024-05-27T09:55:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2485812307 wait complete. 2024-05-27T09:55:28.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.809+0000 7f44af9ecb80 1 -- start start 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 1 Processor -- start 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d601a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d601fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d602510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a70d41c0a0 con 0x55a70d5f8e00 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a70d4b6860 con 0x55a70d5f89f0 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a70d604cd0 con 0x55a70d478f40 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.810+0000 7f44af9ecb80 10 client.0 _ll_register_callbacks cb 0x55a70d4bfd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d601fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d601fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58806/0 (socket says 172.21.15.71:58806) 2024-05-27T09:55:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499400700 1 -- 172.21.15.71:0/424962773 learned_addr learned my addr 172.21.15.71:0/424962773 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499e00700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d601a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f449a800700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d602510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499e00700 1 -- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 msgr2=0x55a70d601fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499e00700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d601fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499e00700 1 -- 172.21.15.71:0/424962773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 msgr2=0x55a70d602510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499e00700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d602510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499e00700 1 -- 172.21.15.71:0/424962773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70d4659d0 con 0x55a70d478f40 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f4499400700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d601fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.811+0000 7f449a800700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d602510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f4499e00700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d601a90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f448c024000 tx=0x7f448c0e3170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=960a3a0b9aab0f45 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f447be00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f447be00700 1 -- 172.21.15.71:0/424962773 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0e0dc0 con 0x55a70d478f40 2024-05-27T09:55:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f447be00700 1 -- 172.21.15.71:0/424962773 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f448c0c4050 con 0x55a70d478f40 2024-05-27T09:55:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448c0aa060 con 0x55a70d478f40 2024-05-27T09:55:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f447be00700 1 -- 172.21.15.71:0/424962773 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f448c0aac50 con 0x55a70d478f40 2024-05-27T09:55:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f44af9ecb80 10 client.26644 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.812+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a70d4e6160 con 0x55a70d478f40 2024-05-27T09:55:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f447be00700 1 -- 172.21.15.71:0/424962773 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c0aa060 con 0x55a70d478f40 2024-05-27T09:55:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f447be00700 1 -- 172.21.15.71:0/424962773 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f448c0cb310 con 0x55a70d478f40 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f44af9ecb80 10 client.26644 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f44af9ecb80 10 client.26644 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f44af9ecb80 20 client.26644 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d6119b0 0x55a70d613dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f44af9ecb80 4 client.26644 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.813+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a70d527e90 con 0x55a70d6119b0 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.814+0000 7f4499400700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d6119b0 0x55a70d613dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.814+0000 7f4499400700 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d6119b0 0x55a70d613dd0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2416413551cda0a2 server_cookie=3ccbf2016fcb7a98 in_seq=0 out_seq=0 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.814+0000 7f447be00700 10 client.26644 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:28.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.815+0000 7f447be00700 1 -- 172.21.15.71:0/424962773 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55a70d527e90 con 0x55a70d6119b0 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.815+0000 7f447be00700 10 client.26644 handle_command_reply: tid=0 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.815+0000 7f44af9ecb80 1 client.26644 shutdown 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 msgr2=0x55a70d601a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d601a90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f448c024000 tx=0x7f448c0e3170 comp rx=0 tx=0).stop 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 shutdown_connections 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d6119b0 0x55a70d613dd0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d602510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d601a90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/424962773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d601fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f447be00700 0 client.26644 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:28.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 >> 172.21.15.71:0/424962773 conn(0x55a70d4d90c0 msgr2=0x55a70d5f6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:28.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 shutdown_connections 2024-05-27T09:55:28.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 1 -- 172.21.15.71:0/424962773 wait complete. 2024-05-27T09:55:28.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.816+0000 7f44af9ecb80 20 client.26644 trim_cache size 0 max 16384 2024-05-27T09:55:28.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 Processor -- start 2024-05-27T09:55:28.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 -- start start 2024-05-27T09:55:28.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d5fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d5fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d601f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b3730 con 0x55a70d5f8e00 2024-05-27T09:55:28.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b0fc0 con 0x55a70d5f89f0 2024-05-27T09:55:28.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.839+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1aee30 con 0x55a70d478f40 2024-05-27T09:55:28.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f449a800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d601f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f449a800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d601f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37630/0 (socket says 172.21.15.71:37630) 2024-05-27T09:55:28.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f449a800700 1 -- 172.21.15.71:0/2556988549 learned_addr learned my addr 172.21.15.71:0/2556988549 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:28.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f4499e00700 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d5fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f4499400700 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d5fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f4499e00700 1 -- 172.21.15.71:0/2556988549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 msgr2=0x55a70d5fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f4499e00700 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d5fd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f4499e00700 1 -- 172.21.15.71:0/2556988549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 msgr2=0x55a70d601f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f4499e00700 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d601f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.840+0000 7f4499e00700 1 -- 172.21.15.71:0/2556988549 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70d5f4960 con 0x55a70d478f40 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.841+0000 7f4499e00700 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d5fcda0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f448c0098e0 tx=0x7f448c022ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea2675355d4fd15 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.841+0000 7f4486a00700 1 -- 172.21.15.71:0/2556988549 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0c4050 con 0x55a70d478f40 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.841+0000 7f4486a00700 1 -- 172.21.15.71:0/2556988549 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c0aa060 con 0x55a70d478f40 2024-05-27T09:55:28.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.841+0000 7f4486a00700 1 -- 172.21.15.71:0/2556988549 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c090a70 con 0x55a70d478f40 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2556988549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 msgr2=0x55a70d5fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d5fcda0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f448c0098e0 tx=0x7f448c022ce0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2556988549 shutdown_connections 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f8e00 0x55a70d601f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d478f40 0x55a70d5fcda0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2556988549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d5f89f0 0x55a70d5fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2556988549 >> 172.21.15.71:0/2556988549 conn(0x55a70d4d90c0 msgr2=0x55a70d601870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2556988549 shutdown_connections 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.842+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2556988549 wait complete. 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.843+0000 7f44af9ecb80 1 -- start start 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.843+0000 7f44af9ecb80 1 Processor -- start 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d478f40 0x55a70d606450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f89f0 0x55a70d606990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f44af9ecb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f8e00 0x55a70d67b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1af480 con 0x55a70d5f89f0 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b08f0 con 0x55a70d478f40 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f44af9ecb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1afb50 con 0x55a70d5f8e00 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f44af9ecb80 10 client.0 _ll_register_callbacks cb 0x55a70d601260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f4499400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f89f0 0x55a70d606990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f4499e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d478f40 0x55a70d606450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f4499400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f89f0 0x55a70d606990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37634/0 (socket says 172.21.15.71:37634) 2024-05-27T09:55:28.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f4499e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d478f40 0x55a70d606450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58824/0 (socket says 172.21.15.71:58824) 2024-05-27T09:55:28.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f4499400700 1 -- 172.21.15.71:0/2468187870 learned_addr learned my addr 172.21.15.71:0/2468187870 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:28.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f449a800700 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f8e00 0x55a70d67b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.844+0000 7f4499400700 1 -- 172.21.15.71:0/2468187870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f8e00 msgr2=0x55a70d67b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f4499400700 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f8e00 0x55a70d67b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f4499400700 1 -- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d478f40 msgr2=0x55a70d606450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f4499400700 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d478f40 0x55a70d606450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f4499400700 1 -- 172.21.15.71:0/2468187870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70d67b810 con 0x55a70d5f89f0 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f4499e00700 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d478f40 0x55a70d606450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f4499400700 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f89f0 0x55a70d606990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55a70d6143a0 tx=0x7f448801d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea917e7e41cccd2a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f447be00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f447be00700 1 -- 172.21.15.71:0/2468187870 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448801db10 con 0x55a70d5f89f0 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f447be00700 1 -- 172.21.15.71:0/2468187870 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f448801dcb0 con 0x55a70d5f89f0 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.845+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448c0aa060 con 0x55a70d5f89f0 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f447be00700 1 -- 172.21.15.71:0/2468187870 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4488004030 con 0x55a70d5f89f0 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 10 client.16461 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a70d67caf0 con 0x55a70d5f89f0 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f447be00700 1 -- 172.21.15.71:0/2468187870 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c0aa060 con 0x55a70d5f89f0 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f447be00700 1 -- 172.21.15.71:0/2468187870 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f4488003cc0 con 0x55a70d5f89f0 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 10 client.16461 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 10 client.16461 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 20 client.16461 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d67d230 0x55a70d67f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 4 client.16461 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "49bc009a", "release": true, "await": true}] 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.846+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "49bc009a", "release": true, "await": true}) -- 0x55a70d521670 con 0x55a70d67d230 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.847+0000 7f4499e00700 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d67d230 0x55a70d67f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.847+0000 7f4499e00700 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d67d230 0x55a70d67f650 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7436026a3adaf1bc server_cookie=ed3385466e1b5f53 in_seq=0 out_seq=0 2024-05-27T09:55:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:28.847+0000 7f447be00700 10 client.16461 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:29.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.069+0000 7f447be00700 1 -- 172.21.15.71:0/2468187870 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a70d521670 con 0x55a70d67d230 2024-05-27T09:55:29.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.070+0000 7f447be00700 10 client.16461 handle_command_reply: tid=0 2024-05-27T09:55:29.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.070+0000 7f44af9ecb80 1 client.16461 shutdown 2024-05-27T09:55:29.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:28 smithi071 ceph-mon[31451]: pgmap v237: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 KiB/s wr, 9 op/s 2024-05-27T09:55:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.072+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f89f0 msgr2=0x55a70d606990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.072+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f89f0 0x55a70d606990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55a70d6143a0 tx=0x7f448801d6c0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.072+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 shutdown_connections 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.072+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a70d67d230 0x55a70d67f650 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.072+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a70d5f8e00 0x55a70d67b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.073+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a70d478f40 0x55a70d606450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.073+0000 7f44af9ecb80 1 --2- 172.21.15.71:0/2468187870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a70d5f89f0 0x55a70d606990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.073+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 >> 172.21.15.71:0/2468187870 conn(0x55a70d4d90c0 msgr2=0x55a70d5f3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.073+0000 7f447be00700 0 client.16461 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.073+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 shutdown_connections 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.074+0000 7f44af9ecb80 1 -- 172.21.15.71:0/2468187870 wait complete. 2024-05-27T09:55:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.074+0000 7f44af9ecb80 20 client.16461 trim_cache size 0 max 16384 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 24, 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "49bc009a": { 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 24, 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:55:29.076 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 138.9, 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:29.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:29.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:29.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:55:29.078 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:55:29.079 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:28 smithi072 ceph-mon[35951]: pgmap v237: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 KiB/s wr, 9 op/s 2024-05-27T09:55:29.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f44800b2a70 msgr2=0x7f44800b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:29.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f44800b2a70 0x7f44800b4f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a70d5f9290 tx=0x7f4494009920 comp rx=0 tx=0).stop 2024-05-27T09:55:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f449c075d20 msgr2=0x7f449c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:29.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f449c075d20 0x7f449c19ce10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f448c006010 tx=0x7f448c0057c0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 shutdown_connections 2024-05-27T09:55:29.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f44800b2a70 0x7f44800b4f80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c1109b0 0x7f449c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f449c075d20 0x7f449c19ce10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 --2- 172.21.15.71:0/2347587660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f449c076670 0x7f449c19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.076+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 >> 172.21.15.71:0/2347587660 conn(0x7f449c079d40 msgr2=0x7f449c100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.077+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 shutdown_connections 2024-05-27T09:55:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:55:29.077+0000 7f449b200700 1 -- 172.21.15.71:0/2347587660 wait complete. 2024-05-27T09:55:29.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:28 smithi122 ceph-mon[36436]: pgmap v237: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 KiB/s wr, 9 op/s 2024-05-27T09:55:30.028 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '49bc009a', total seconds elapsed: 27.0 2024-05-27T09:55:31.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:30 smithi122 ceph-mon[36436]: pgmap v238: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.1 KiB/s wr, 6 op/s 2024-05-27T09:55:31.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:30 smithi071 ceph-mon[31451]: pgmap v238: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.1 KiB/s wr, 6 op/s 2024-05-27T09:55:31.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:30 smithi072 ceph-mon[35951]: pgmap v238: 97 pgs: 97 active+clean; 52 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.1 KiB/s wr, 6 op/s 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.552+0000 7fd0a1600640 1 -- 172.21.15.71:0/526091661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c109f50 msgr2=0x7fd09c103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.552+0000 7fd0a1600640 1 --2- 172.21.15.71:0/526091661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c109f50 0x7fd09c103be0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd084009be0 tx=0x7fd08402a6c0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.553+0000 7fd0a1600640 1 -- 172.21.15.71:0/526091661 shutdown_connections 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.553+0000 7fd0a1600640 1 --2- 172.21.15.71:0/526091661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd09c104250 0x7fd09c1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.553+0000 7fd0a1600640 1 --2- 172.21.15.71:0/526091661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c109f50 0x7fd09c103be0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.553+0000 7fd0a1600640 1 --2- 172.21.15.71:0/526091661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd09c109ab0 0x7fd09c1036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.553+0000 7fd0a1600640 1 -- 172.21.15.71:0/526091661 >> 172.21.15.71:0/526091661 conn(0x7fd09c079240 msgr2=0x7fd09c079680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.553+0000 7fd0a1600640 1 -- 172.21.15.71:0/526091661 shutdown_connections 2024-05-27T09:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.553+0000 7fd0a1600640 1 -- 172.21.15.71:0/526091661 wait complete. 2024-05-27T09:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.554+0000 7fd0a1600640 1 Processor -- start 2024-05-27T09:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.554+0000 7fd0a1600640 1 -- start start 2024-05-27T09:55:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd0a1600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c104250 0x7fd09c074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd0a1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd09c109ab0 0x7fd09c075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd0a1600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd09c109f50 0x7fd09c075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd0a1600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c113ca0 con 0x7fd09c109ab0 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd0a1600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c113b20 con 0x7fd09c104250 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd0a1600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c113e20 con 0x7fd09c109f50 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd09be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c104250 0x7fd09c074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd09be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c104250 0x7fd09c074fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58844/0 (socket says 172.21.15.71:58844) 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd09be00640 1 -- 172.21.15.71:0/1698691731 learned_addr learned my addr 172.21.15.71:0/1698691731 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd09c109f50 0x7fd09c075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.555+0000 7fd093400640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd09c109ab0 0x7fd09c075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd09be00640 1 -- 172.21.15.71:0/1698691731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd09c109f50 msgr2=0x7fd09c075a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd09be00640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd09c109f50 0x7fd09c075a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd09be00640 1 -- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd09c109ab0 msgr2=0x7fd09c075500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd09be00640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd09c109ab0 0x7fd09c075500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd09be00640 1 -- 172.21.15.71:0/1698691731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c1a8a60 con 0x7fd09c104250 2024-05-27T09:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd093400640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd09c109ab0 0x7fd09c075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd09be00640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c104250 0x7fd09c074fc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00e9a0 tx=0x7fd08c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd099600640 1 -- 172.21.15.71:0/1698691731 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00cd80 con 0x7fd09c104250 2024-05-27T09:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd099600640 1 -- 172.21.15.71:0/1698691731 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd08c0035f0 con 0x7fd09c104250 2024-05-27T09:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd099600640 1 -- 172.21.15.71:0/1698691731 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c010690 con 0x7fd09c104250 2024-05-27T09:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.556+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c1a8d50 con 0x7fd09c104250 2024-05-27T09:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.557+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c1a9190 con 0x7fd09c104250 2024-05-27T09:55:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.560+0000 7fd0a9bfa740 1 Processor -- start 2024-05-27T09:55:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.560+0000 7fd0a9bfa740 1 -- start start 2024-05-27T09:55:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd099600640 1 -- 172.21.15.71:0/1698691731 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd08c004020 con 0x7fd09c104250 2024-05-27T09:55:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e440fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e40442f0 0x5646e440ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e404c4d0 0x5646e44104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5646e4380b90 con 0x5646e404c4d0 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5646e4370730 con 0x5646e40442f0 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5646e4374770 con 0x5646e406d1b0 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd09be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e40442f0 0x5646e440ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd09be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e40442f0 0x5646e440ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58846/0 (socket says 172.21.15.71:58846) 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd09be00640 1 -- 172.21.15.71:0/2246591501 learned_addr learned my addr 172.21.15.71:0/2246591501 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd093400640 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e404c4d0 0x5646e44104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.561+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e440fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.562+0000 7fd09be00640 1 -- 172.21.15.71:0/2246591501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 msgr2=0x5646e440fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.562+0000 7fd09be00640 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e440fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.562+0000 7fd09be00640 1 -- 172.21.15.71:0/2246591501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e404c4d0 msgr2=0x5646e44104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.562+0000 7fd09be00640 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e404c4d0 0x5646e44104e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.562+0000 7fd09be00640 1 -- 172.21.15.71:0/2246591501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646e43098b0 con 0x5646e40442f0 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.562+0000 7fd09be00640 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e40442f0 0x5646e440ffa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0dff20 tx=0x7fd08c0e8ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46531000d5683f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.562+0000 7fd091200640 1 -- 172.21.15.71:0/2246591501 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0f1070 con 0x5646e40442f0 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.563+0000 7fd091200640 1 -- 172.21.15.71:0/2246591501 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd08c0eae10 con 0x5646e40442f0 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.563+0000 7fd091200640 1 -- 172.21.15.71:0/2246591501 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0e45a0 con 0x5646e40442f0 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.563+0000 7fd099600640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd0800b29d0 0x7fd0800b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.563+0000 7fd099600640 1 -- 172.21.15.71:0/1698691731 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fd08c0e28f0 con 0x7fd09c104250 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.563+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd0800b29d0 0x7fd0800b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2246591501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e40442f0 msgr2=0x5646e440ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e40442f0 0x5646e440ffa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0dff20 tx=0x7fd08c0e8ef0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2246591501 shutdown_connections 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e404c4d0 0x5646e44104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e40442f0 0x5646e440ffa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2246591501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e440fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2246591501 >> 172.21.15.71:0/2246591501 conn(0x5646e4061300 msgr2=0x5646e440c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2246591501 shutdown_connections 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2246591501 wait complete. 2024-05-27T09:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.564+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd0800b29d0 0x7fd0800b4ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5646e440cbd0 tx=0x7fd094005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.565+0000 7fd0a9bfa740 1 -- start start 2024-05-27T09:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.565+0000 7fd0a9bfa740 1 Processor -- start 2024-05-27T09:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.565+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4419c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.565+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e441a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e4425ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5646e4056790 con 0x5646e40442f0 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5646e4318bc0 con 0x5646e404c4d0 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5646e441cb90 con 0x5646e406d1b0 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd0a9bfa740 10 client.0 _ll_register_callbacks cb 0x5646e42f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e441a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e441a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58848/0 (socket says 172.21.15.71:58848) 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 -- 172.21.15.71:0/2953335065 learned_addr learned my addr 172.21.15.71:0/2953335065 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e4425ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd09be00640 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4419c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 -- 172.21.15.71:0/2953335065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 msgr2=0x5646e4425ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e4425ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 -- 172.21.15.71:0/2953335065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 msgr2=0x5646e4419c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4419c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.566+0000 7fd093400640 1 -- 172.21.15.71:0/2953335065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646e4085210 con 0x5646e404c4d0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd093400640 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e441a180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd08402abe0 tx=0x7fd084003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c9d5f818d5da168 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd089600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd089600640 1 -- 172.21.15.71:0/2953335065 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084042070 con 0x5646e404c4d0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd089600640 1 -- 172.21.15.71:0/2953335065 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fd084030b70 con 0x5646e404c4d0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd08c0eae10 con 0x5646e404c4d0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd089600640 1 -- 172.21.15.71:0/2953335065 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd08404e050 con 0x5646e404c4d0 2024-05-27T09:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd0a9bfa740 10 client.26636 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5646e4151620 con 0x5646e404c4d0 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.567+0000 7fd089600640 1 -- 172.21.15.71:0/2953335065 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd08c0eae10 con 0x5646e404c4d0 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd089600640 1 -- 172.21.15.71:0/2953335065 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fd08403c040 con 0x5646e404c4d0 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd0a9bfa740 10 client.26636 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd0a9bfa740 10 client.26636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd0a9bfa740 20 client.26636 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e402bd80 0x5646e442bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd0a9bfa740 4 client.26636 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646e4382ae0 con 0x5646e402bd80 2024-05-27T09:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd09be00640 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e402bd80 0x5646e442bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.568+0000 7fd09be00640 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e402bd80 0x5646e442bea0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ec393d8b96d4b8 server_cookie=2aca115d454c4b12 in_seq=0 out_seq=0 2024-05-27T09:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.569+0000 7fd089600640 10 client.26636 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.569+0000 7fd089600640 1 -- 172.21.15.71:0/2953335065 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5646e4382ae0 con 0x5646e402bd80 2024-05-27T09:55:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.569+0000 7fd089600640 10 client.26636 handle_command_reply: tid=0 2024-05-27T09:55:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.569+0000 7fd0a9bfa740 1 client.26636 shutdown 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 msgr2=0x5646e441a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e441a180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd08402abe0 tx=0x7fd084003ba0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 shutdown_connections 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e406d1b0 0x5646e4425ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e441a180 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e402bd80 0x5646e442bea0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/2953335065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4419c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd089600640 0 client.26636 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 >> 172.21.15.71:0/2953335065 conn(0x5646e4061300 msgr2=0x5646e440f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 shutdown_connections 2024-05-27T09:55:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/2953335065 wait complete. 2024-05-27T09:55:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.570+0000 7fd0a9bfa740 20 client.26636 trim_cache size 0 max 16384 2024-05-27T09:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.588+0000 7fd0a9bfa740 1 Processor -- start 2024-05-27T09:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.588+0000 7fd0a9bfa740 1 -- start start 2024-05-27T09:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e4061300 0x5646e441c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4425c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e44261a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1b44a0 con 0x5646e40442f0 2024-05-27T09:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1b1d70 con 0x5646e404c4d0 2024-05-27T09:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1afbe0 con 0x5646e4061300 2024-05-27T09:55:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd09be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e4061300 0x5646e441c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e44261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e44261a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58860/0 (socket says 172.21.15.71:58860) 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd0a0c00640 1 -- 172.21.15.71:0/11026405 learned_addr learned my addr 172.21.15.71:0/11026405 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd093400640 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4425c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.589+0000 7fd09be00640 1 -- 172.21.15.71:0/11026405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 msgr2=0x5646e44261a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd09be00640 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e44261a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd09be00640 1 -- 172.21.15.71:0/11026405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 msgr2=0x5646e4425c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd09be00640 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4425c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd09be00640 1 -- 172.21.15.71:0/11026405 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646e4410e40 con 0x5646e4061300 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd09be00640 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e4061300 0x5646e441c370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5646e4410e10 tx=0x7fd08c0e8530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b2abdb1f96dab71 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd08be00640 1 -- 172.21.15.71:0/11026405 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0f1030 con 0x5646e4061300 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd08be00640 1 -- 172.21.15.71:0/11026405 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd08c004310 con 0x5646e4061300 2024-05-27T09:55:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.590+0000 7fd08be00640 1 -- 172.21.15.71:0/11026405 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0b2310 con 0x5646e4061300 2024-05-27T09:55:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.591+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/11026405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e4061300 msgr2=0x5646e441c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.591+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e4061300 0x5646e441c370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5646e4410e10 tx=0x7fd08c0e8530 comp rx=0 tx=0).stop 2024-05-27T09:55:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.591+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/11026405 shutdown_connections 2024-05-27T09:55:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.591+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e404c4d0 0x5646e44261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.591+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4425c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.591+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/11026405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e4061300 0x5646e441c370 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.591+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/11026405 >> 172.21.15.71:0/11026405 conn(0x5646e4407020 msgr2=0x5646e4419f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.592+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/11026405 shutdown_connections 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.592+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/11026405 wait complete. 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.592+0000 7fd0a9bfa740 1 -- start start 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.592+0000 7fd0a9bfa740 1 Processor -- start 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4422580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e404c4d0 0x5646e441d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a9bfa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e4061300 0x5646e441deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1b0230 con 0x5646e40442f0 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1b16a0 con 0x5646e4061300 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a9bfa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1b0900 con 0x5646e404c4d0 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a9bfa740 10 client.0 _ll_register_callbacks cb 0x7fd094005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e4061300 0x5646e441deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd093400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e404c4d0 0x5646e441d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd09be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4422580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd093400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e404c4d0 0x5646e441d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:55244/0 (socket says 172.21.15.71:55244) 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd093400640 1 -- 172.21.15.71:0/1078530770 learned_addr learned my addr 172.21.15.71:0/1078530770 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.593+0000 7fd0a0c00640 1 -- 172.21.15.71:0/1078530770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e404c4d0 msgr2=0x5646e441d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e404c4d0 0x5646e441d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a0c00640 1 -- 172.21.15.71:0/1078530770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 msgr2=0x5646e4422580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4422580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a0c00640 1 -- 172.21.15.71:0/1078530770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646e441e620 con 0x5646e4061300 2024-05-27T09:55:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd09be00640 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4422580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a0c00640 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e4061300 0x5646e441deb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd094012cb0 tx=0x7fd094004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d3780ac3906a6d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd089600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd089600640 1 -- 172.21.15.71:0/1078530770 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094005020 con 0x5646e4061300 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd089600640 1 -- 172.21.15.71:0/1078530770 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fd0940051c0 con 0x5646e4061300 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5646e437c2c0 con 0x5646e4061300 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd089600640 1 -- 172.21.15.71:0/1078530770 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd094038050 con 0x5646e4061300 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a9bfa740 10 client.26642 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.594+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5646e4494530 con 0x5646e4061300 2024-05-27T09:55:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd089600640 1 -- 172.21.15.71:0/1078530770 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5646e437c2c0 con 0x5646e4061300 2024-05-27T09:55:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd089600640 1 -- 172.21.15.71:0/1078530770 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fd09402a770 con 0x5646e4061300 2024-05-27T09:55:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd0a9bfa740 10 client.26642 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd0a9bfa740 10 client.26642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd0a9bfa740 20 client.26642 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e406d1b0 0x5646e4496d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd0a9bfa740 4 client.26642 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:55:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5646e42f64b0 con 0x5646e406d1b0 2024-05-27T09:55:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.595+0000 7fd09be00640 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e406d1b0 0x5646e4496d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.596+0000 7fd09be00640 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e406d1b0 0x5646e4496d40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72152675cccd3d60 server_cookie=8ed0fba4b9304916 in_seq=0 out_seq=0 2024-05-27T09:55:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.596+0000 7fd089600640 10 client.26642 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.611+0000 7fd089600640 1 -- 172.21.15.71:0/1078530770 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5646e42f64b0 con 0x5646e406d1b0 2024-05-27T09:55:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.611+0000 7fd089600640 10 client.26642 handle_command_reply: tid=0 2024-05-27T09:55:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 client.26642 shutdown 2024-05-27T09:55:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e4061300 msgr2=0x5646e441deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e4061300 0x5646e441deb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd094012cb0 tx=0x7fd094004730 comp rx=0 tx=0).stop 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 shutdown_connections 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5646e4061300 0x5646e441deb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646e404c4d0 0x5646e441d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5646e406d1b0 0x5646e4496d40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 --2- 172.21.15.71:0/1078530770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646e40442f0 0x5646e4422580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 >> 172.21.15.71:0/1078530770 conn(0x5646e4407020 msgr2=0x5646e440a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd089600640 0 client.26642 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 shutdown_connections 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 1 -- 172.21.15.71:0/1078530770 wait complete. 2024-05-27T09:55:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.612+0000 7fd0a9bfa740 20 client.26642 trim_cache size 0 max 16384 2024-05-27T09:55:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:55:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:55:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd0800b29d0 msgr2=0x7fd0800b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd0800b29d0 0x7fd0800b4ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5646e440cbd0 tx=0x7fd094005f90 comp rx=0 tx=0).stop 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c104250 msgr2=0x7fd09c074fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c104250 0x7fd09c074fc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00e9a0 tx=0x7fd08c00ee60 comp rx=0 tx=0).stop 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 shutdown_connections 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd0800b29d0 0x7fd0800b4ee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd09c109f50 0x7fd09c075a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd09c109ab0 0x7fd09c075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 --2- 172.21.15.71:0/1698691731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd09c104250 0x7fd09c074fc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 >> 172.21.15.71:0/1698691731 conn(0x7fd09c079240 msgr2=0x7fd09c102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 shutdown_connections 2024-05-27T09:55:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:31.613+0000 7fd0a1600640 1 -- 172.21.15.71:0/1698691731 wait complete. 2024-05-27T09:55:32.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:31 smithi122 ceph-mon[36436]: pgmap v239: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 454 KiB/s wr, 85 op/s 2024-05-27T09:55:32.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:31 smithi071 ceph-mon[31451]: pgmap v239: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 454 KiB/s wr, 85 op/s 2024-05-27T09:55:32.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:31 smithi072 ceph-mon[35951]: pgmap v239: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 454 KiB/s wr, 85 op/s 2024-05-27T09:55:35.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:34 smithi072 ceph-mon[35951]: pgmap v240: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 446 KiB/s wr, 81 op/s 2024-05-27T09:55:35.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:34 smithi122 ceph-mon[36436]: pgmap v240: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 446 KiB/s wr, 81 op/s 2024-05-27T09:55:35.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:34 smithi071 ceph-mon[31451]: pgmap v240: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 446 KiB/s wr, 81 op/s 2024-05-27T09:55:36.104 INFO:tasks.workunit.client.0.smithi071.stdout:30000 trunc from 0x7a5444 to 0x143a5 2024-05-27T09:55:37.027 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:36 smithi072 ceph-mon[35951]: pgmap v241: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 446 KiB/s wr, 81 op/s 2024-05-27T09:55:37.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:36 smithi122 ceph-mon[36436]: pgmap v241: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 446 KiB/s wr, 81 op/s 2024-05-27T09:55:37.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:36 smithi071 ceph-mon[31451]: pgmap v241: 97 pgs: 97 active+clean; 49 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 446 KiB/s wr, 81 op/s 2024-05-27T09:55:39.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:38 smithi122 ceph-mon[36436]: pgmap v242: 97 pgs: 97 active+clean; 43 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-05-27T09:55:39.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:38 smithi071 ceph-mon[31451]: pgmap v242: 97 pgs: 97 active+clean; 43 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-05-27T09:55:39.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:38 smithi072 ceph-mon[35951]: pgmap v242: 97 pgs: 97 active+clean; 43 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-05-27T09:55:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:40 smithi122 ceph-mon[36436]: pgmap v243: 97 pgs: 97 active+clean; 43 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.4 MiB/s wr, 226 op/s 2024-05-27T09:55:41.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:40 smithi071 ceph-mon[31451]: pgmap v243: 97 pgs: 97 active+clean; 43 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.4 MiB/s wr, 226 op/s 2024-05-27T09:55:41.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:40 smithi072 ceph-mon[35951]: pgmap v243: 97 pgs: 97 active+clean; 43 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.4 MiB/s wr, 226 op/s 2024-05-27T09:55:43.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:42 smithi122 ceph-mon[36436]: pgmap v244: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-05-27T09:55:43.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:42 smithi071 ceph-mon[31451]: pgmap v244: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-05-27T09:55:43.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:42 smithi072 ceph-mon[35951]: pgmap v244: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-05-27T09:55:44.312 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x9ffb01 2024-05-27T09:55:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 -- 172.21.15.71:0/1555407230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5954109c90 msgr2=0x7f5954103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 --2- 172.21.15.71:0/1555407230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5954109c90 0x7f5954103830 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5944009900 tx=0x7f594402a410 comp rx=0 tx=0).stop 2024-05-27T09:55:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 -- 172.21.15.71:0/1555407230 shutdown_connections 2024-05-27T09:55:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 --2- 172.21.15.71:0/1555407230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59541043e0 0x7f59541107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 --2- 172.21.15.71:0/1555407230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595410a130 0x7f5954103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 --2- 172.21.15.71:0/1555407230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5954109c90 0x7f5954103830 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 -- 172.21.15.71:0/1555407230 >> 172.21.15.71:0/1555407230 conn(0x7f59540ff330 msgr2=0x7f5954101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 -- 172.21.15.71:0/1555407230 shutdown_connections 2024-05-27T09:55:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.846+0000 7f5959200640 1 -- 172.21.15.71:0/1555407230 wait complete. 2024-05-27T09:55:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.847+0000 7f5959200640 1 Processor -- start 2024-05-27T09:55:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5959200640 1 -- start start 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5959200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59541043e0 0x7f595419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5959200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954109c90 0x7f595419dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5959200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595410a130 0x7f59541a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5959200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5954113eb0 con 0x7f595410a130 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5959200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5954113d30 con 0x7f5954109c90 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5959200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5954114030 con 0x7f59541043e0 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5951400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954109c90 0x7f595419dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5951400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954109c90 0x7f595419dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58316/0 (socket says 172.21.15.71:58316) 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5951400640 1 -- 172.21.15.71:0/3559289886 learned_addr learned my addr 172.21.15.71:0/3559289886 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5951e00640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59541043e0 0x7f595419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.848+0000 7f5952800640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595410a130 0x7f59541a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5951400640 1 -- 172.21.15.71:0/3559289886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59541043e0 msgr2=0x7f595419d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5951400640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59541043e0 0x7f595419d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5951400640 1 -- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595410a130 msgr2=0x7f59541a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5951400640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595410a130 0x7f59541a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5951400640 1 -- 172.21.15.71:0/3559289886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59541a8d50 con 0x7f5954109c90 2024-05-27T09:55:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5952800640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595410a130 0x7f59541a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5951400640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954109c90 0x7f595419dcd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f594000e9f0 tx=0x7f594000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f594aa00640 1 -- 172.21.15.71:0/3559289886 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594000ccc0 con 0x7f5954109c90 2024-05-27T09:55:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f594aa00640 1 -- 172.21.15.71:0/3559289886 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59400035f0 con 0x7f5954109c90 2024-05-27T09:55:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59541a8f20 con 0x7f5954109c90 2024-05-27T09:55:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f594aa00640 1 -- 172.21.15.71:0/3559289886 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594000ce60 con 0x7f5954109c90 2024-05-27T09:55:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.849+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59541a93e0 con 0x7f5954109c90 2024-05-27T09:55:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.853+0000 7f594aa00640 1 -- 172.21.15.71:0/3559289886 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5940003aa0 con 0x7f5954109c90 2024-05-27T09:55:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.853+0000 7f59601cc740 1 Processor -- start 2024-05-27T09:55:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f59601cc740 1 -- start start 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f59601cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c61860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f59601cc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c61da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f59601cc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f59601cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a507bd2b90 con 0x55a5078bf1b0 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f59601cc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a507bc2730 con 0x55a5078962f0 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f59601cc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a507bc6770 con 0x55a50789e4d0 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c61da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f5952800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c61860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c61da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58332/0 (socket says 172.21.15.71:58332) 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.854+0000 7f5951e00640 1 -- 172.21.15.71:0/1846477978 learned_addr learned my addr 172.21.15.71:0/1846477978 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5951400640 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5951e00640 1 -- 172.21.15.71:0/1846477978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 msgr2=0x55a507c622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5951e00640 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5951e00640 1 -- 172.21.15.71:0/1846477978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 msgr2=0x55a507c61860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5951e00640 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c61860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5951e00640 1 -- 172.21.15.71:0/1846477978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a507b5b8b0 con 0x55a5078962f0 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5952800640 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c61860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f594aa00640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f59380b29d0 0x7f59380b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f5951e00640 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c61da0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5954104970 tx=0x7f5944004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab47950823f6e931 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.855+0000 7f594aa00640 1 -- 172.21.15.71:0/3559289886 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f59400e28d0 con 0x7f5954109c90 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.856+0000 7f593f400640 1 -- 172.21.15.71:0/1846477978 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944035040 con 0x55a5078962f0 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.856+0000 7f5952800640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f59380b29d0 0x7f59380b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.856+0000 7f593f400640 1 -- 172.21.15.71:0/1846477978 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59440054f0 con 0x55a5078962f0 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.856+0000 7f593f400640 1 -- 172.21.15.71:0/1846477978 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440035f0 con 0x55a5078962f0 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 -- 172.21.15.71:0/1846477978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 msgr2=0x55a507c61da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f5952800640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f59380b29d0 0x7f59380b4ee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55a507c5e9d0 tx=0x7f594c009500 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c61da0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5954104970 tx=0x7f5944004040 comp rx=0 tx=0).stop 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 -- 172.21.15.71:0/1846477978 shutdown_connections 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c61da0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 --2- 172.21.15.71:0/1846477978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c61860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 -- 172.21.15.71:0/1846477978 >> 172.21.15.71:0/1846477978 conn(0x55a5078b3300 msgr2=0x55a507c5e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 -- 172.21.15.71:0/1846477978 shutdown_connections 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 -- 172.21.15.71:0/1846477978 wait complete. 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.857+0000 7f59601cc740 1 -- start start 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 1 Processor -- start 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a50789e4d0 0x55a507c6bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a5078bf1b0 0x55a507c77c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a5078a8790 con 0x55a50789e4d0 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a507b6abc0 con 0x55a5078962f0 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a507c6e930 con 0x55a5078bf1b0 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f59601cc740 10 client.0 _ll_register_callbacks cb 0x55a507b48400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58338/0 (socket says 172.21.15.71:58338) 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.858+0000 7f5951e00640 1 -- 172.21.15.71:0/1963334710 learned_addr learned my addr 172.21.15.71:0/1963334710 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951400640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a50789e4d0 0x55a507c6bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5952800640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a5078bf1b0 0x55a507c77c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951e00640 1 -- 172.21.15.71:0/1963334710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a5078bf1b0 msgr2=0x55a507c77c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951e00640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a5078bf1b0 0x55a507c77c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951e00640 1 -- 172.21.15.71:0/1963334710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a50789e4d0 msgr2=0x55a507c6bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951e00640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a50789e4d0 0x55a507c6bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951e00640 1 -- 172.21.15.71:0/1963334710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5078d7210 con 0x55a5078962f0 2024-05-27T09:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951400640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a50789e4d0 0x55a507c6bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5951e00640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6ba30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5944031440 tx=0x7f5944004520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c545e1764895e8f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.859+0000 7f5933e00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f5933e00640 1 -- 172.21.15.71:0/1963334710 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944051020 con 0x55a5078962f0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f5933e00640 1 -- 172.21.15.71:0/1963334710 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f5944004f10 con 0x55a5078962f0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59440054f0 con 0x55a5078962f0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f5933e00640 1 -- 172.21.15.71:0/1963334710 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5944035040 con 0x55a5078962f0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f59601cc740 10 client.26654 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a5079a3620 con 0x55a5078962f0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f5933e00640 1 -- 172.21.15.71:0/1963334710 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59440054f0 con 0x55a5078962f0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.860+0000 7f5933e00640 1 -- 172.21.15.71:0/1963334710 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f594404c070 con 0x55a5078962f0 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.861+0000 7f59601cc740 10 client.26654 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.861+0000 7f59601cc740 10 client.26654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.861+0000 7f59601cc740 20 client.26654 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.861+0000 7f59601cc740 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a50787dd80 0x55a507c7da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.861+0000 7f59601cc740 4 client.26654 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.861+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a507bd4ae0 con 0x55a50787dd80 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.861+0000 7f5951400640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a50787dd80 0x55a507c7da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.862+0000 7f5933e00640 10 client.26654 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.862+0000 7f5951400640 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a50787dd80 0x55a507c7da80 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f658c11ca087788 server_cookie=cceb8510412f094f in_seq=0 out_seq=0 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f5933e00640 1 -- 172.21.15.71:0/1963334710 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55a507bd4ae0 con 0x55a50787dd80 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f5933e00640 10 client.26654 handle_command_reply: tid=0 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 client.26654 shutdown 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 msgr2=0x55a507c6ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6ba30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5944031440 tx=0x7f5944004520 comp rx=0 tx=0).stop 2024-05-27T09:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 shutdown_connections 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a5078bf1b0 0x55a507c77c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a50787dd80 0x55a507c7da80 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a50789e4d0 0x55a507c6bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 --2- 172.21.15.71:0/1963334710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6ba30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f5933e00640 0 client.26654 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 >> 172.21.15.71:0/1963334710 conn(0x55a5078b3300 msgr2=0x55a507c63580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 shutdown_connections 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 1 -- 172.21.15.71:0/1963334710 wait complete. 2024-05-27T09:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.863+0000 7f59601cc740 20 client.26654 trim_cache size 0 max 16384 2024-05-27T09:55:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 Processor -- start 2024-05-27T09:55:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 -- start start 2024-05-27T09:55:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c77bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c6b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59541b4640 con 0x55a5078bf1b0 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f59541b1f10 con 0x55a5078962f0 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f59601cc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f59541afd80 con 0x55a50789e4d0 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f5951400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c77bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58340/0 (socket says 172.21.15.71:58340) 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.881+0000 7f5951e00640 1 -- 172.21.15.71:0/503477626 learned_addr learned my addr 172.21.15.71:0/503477626 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5952800640 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c6b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5951e00640 1 -- 172.21.15.71:0/503477626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 msgr2=0x55a507c77bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5951e00640 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c77bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5951e00640 1 -- 172.21.15.71:0/503477626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 msgr2=0x55a507c6b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5951e00640 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c6b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5951e00640 1 -- 172.21.15.71:0/503477626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a507c6c7e0 con 0x55a5078962f0 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5952800640 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c6b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f5951e00640 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6db80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5944006010 tx=0x7f5944005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88aebfdc6eb3a2fc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f593ea00640 1 -- 172.21.15.71:0/503477626 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944051070 con 0x55a5078962f0 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f593ea00640 1 -- 172.21.15.71:0/503477626 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5944003db0 con 0x55a5078962f0 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.882+0000 7f593ea00640 1 -- 172.21.15.71:0/503477626 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944031c90 con 0x55a5078962f0 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.883+0000 7f59601cc740 1 -- 172.21.15.71:0/503477626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 msgr2=0x55a507c6db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.883+0000 7f59601cc740 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6db80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5944006010 tx=0x7f5944005a20 comp rx=0 tx=0).stop 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.883+0000 7f59601cc740 1 -- 172.21.15.71:0/503477626 shutdown_connections 2024-05-27T09:55:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.883+0000 7f59601cc740 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507c6b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.883+0000 7f59601cc740 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.883+0000 7f59601cc740 1 --2- 172.21.15.71:0/503477626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c6db80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.883+0000 7f59601cc740 1 -- 172.21.15.71:0/503477626 >> 172.21.15.71:0/503477626 conn(0x55a5078b3300 msgr2=0x55a507c6b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.884+0000 7f59601cc740 1 -- 172.21.15.71:0/503477626 shutdown_connections 2024-05-27T09:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.884+0000 7f59601cc740 1 -- 172.21.15.71:0/503477626 wait complete. 2024-05-27T09:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.884+0000 7f59601cc740 1 -- start start 2024-05-27T09:55:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.884+0000 7f59601cc740 1 Processor -- start 2024-05-27T09:55:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f59601cc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c7db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f59601cc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c7e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f59601cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507ce3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f59601cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59541b03d0 con 0x55a5078bf1b0 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f59601cc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f59541b1840 con 0x55a5078962f0 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f59601cc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f59541b0aa0 con 0x55a50789e4d0 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f59601cc740 10 client.0 _ll_register_callbacks cb 0x7f594c0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c7db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c7e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c7e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36452/0 (socket says 172.21.15.71:36452) 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c7db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:58342/0 (socket says 172.21.15.71:58342) 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 -- 172.21.15.71:0/2648375465 learned_addr learned my addr 172.21.15.71:0/2648375465 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5952800640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507ce3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 -- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 msgr2=0x55a507c7db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c7db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 -- 172.21.15.71:0/2648375465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 msgr2=0x55a507ce3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507ce3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951400640 1 -- 172.21.15.71:0/2648375465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a507c7e840 con 0x55a50789e4d0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.885+0000 7f5951e00640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c7db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f5952800640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507ce3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f5951400640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c7e060 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f59400a9b40 tx=0x7f5940005b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f64d242eabedb49 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f5933e00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f5933e00640 1 -- 172.21.15.71:0/2648375465 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59400cae60 con 0x55a50789e4d0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f5933e00640 1 -- 172.21.15.71:0/2648375465 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f59400e02a0 con 0x55a50789e4d0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5944003db0 con 0x55a50789e4d0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f5933e00640 1 -- 172.21.15.71:0/2648375465 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f59400a5340 con 0x55a50789e4d0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f59601cc740 10 client.26686 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.886+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a507ce53a0 con 0x55a50789e4d0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f5933e00640 1 -- 172.21.15.71:0/2648375465 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5944003db0 con 0x55a50789e4d0 2024-05-27T09:55:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f5933e00640 1 -- 172.21.15.71:0/2648375465 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f59400b2580 con 0x55a50789e4d0 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f59601cc740 10 client.26686 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f59601cc740 10 client.26686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f59601cc740 20 client.26686 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f59601cc740 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a5078531c0 0x55a507ce7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f59601cc740 4 client.26686 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a507bce2c0 con 0x55a5078531c0 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.887+0000 7f5951e00640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a5078531c0 0x55a507ce7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.888+0000 7f5951e00640 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a5078531c0 0x55a507ce7a80 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24b3c79a9b1eba0 server_cookie=cde79c0789ce545d in_seq=0 out_seq=0 2024-05-27T09:55:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.888+0000 7f5933e00640 10 client.26686 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f5933e00640 1 -- 172.21.15.71:0/2648375465 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55a507bce2c0 con 0x55a5078531c0 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f5933e00640 10 client.26686 handle_command_reply: tid=0 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 client.26686 shutdown 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 msgr2=0x55a507c7e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c7e060 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f59400a9b40 tx=0x7f5940005b20 comp rx=0 tx=0).stop 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 shutdown_connections 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a5078531c0 0x55a507ce7a80 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5078bf1b0 0x55a507ce3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a50789e4d0 0x55a507c7e060 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 --2- 172.21.15.71:0/2648375465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a5078962f0 0x55a507c7db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f5933e00640 0 client.26686 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 >> 172.21.15.71:0/2648375465 conn(0x55a5078b3300 msgr2=0x55a507c6d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 shutdown_connections 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.903+0000 7f59601cc740 1 -- 172.21.15.71:0/2648375465 wait complete. 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.904+0000 7f59601cc740 20 client.26686 trim_cache size 0 max 16384 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.904+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f59380b29d0 msgr2=0x7f59380b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.904+0000 7f5959200640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f59380b29d0 0x7f59380b4ee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55a507c5e9d0 tx=0x7f594c009500 comp rx=0 tx=0).stop 2024-05-27T09:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.904+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954109c90 msgr2=0x7f595419dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.904+0000 7f5959200640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954109c90 0x7f595419dcd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f594000e9f0 tx=0x7f594000eeb0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 shutdown_connections 2024-05-27T09:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f59380b29d0 0x7f59380b4ee0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595410a130 0x7f59541a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954109c90 0x7f595419dcd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 --2- 172.21.15.71:0/3559289886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59541043e0 0x7f595419d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 >> 172.21.15.71:0/3559289886 conn(0x7f59540ff330 msgr2=0x7f5954076000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 shutdown_connections 2024-05-27T09:55:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:44.905+0000 7f5959200640 1 -- 172.21.15.71:0/3559289886 wait complete. 2024-05-27T09:55:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:44 smithi122 ceph-mon[36436]: pgmap v245: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 288 op/s 2024-05-27T09:55:45.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:44 smithi071 ceph-mon[31451]: pgmap v245: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 288 op/s 2024-05-27T09:55:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:44 smithi072 ceph-mon[35951]: pgmap v245: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 288 op/s 2024-05-27T09:55:47.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:46 smithi122 ceph-mon[36436]: pgmap v246: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 288 op/s 2024-05-27T09:55:47.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:46 smithi071 ceph-mon[31451]: pgmap v246: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 288 op/s 2024-05-27T09:55:47.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:46 smithi072 ceph-mon[35951]: pgmap v246: 97 pgs: 97 active+clean; 49 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 288 op/s 2024-05-27T09:55:49.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:48 smithi122 ceph-mon[36436]: pgmap v247: 97 pgs: 97 active+clean; 47 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 430 op/s 2024-05-27T09:55:49.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:48 smithi071 ceph-mon[31451]: pgmap v247: 97 pgs: 97 active+clean; 47 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 430 op/s 2024-05-27T09:55:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:48 smithi072 ceph-mon[35951]: pgmap v247: 97 pgs: 97 active+clean; 47 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 430 op/s 2024-05-27T09:55:51.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:50 smithi071 ceph-mon[31451]: pgmap v248: 97 pgs: 97 active+clean; 47 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-05-27T09:55:51.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:50 smithi122 ceph-mon[36436]: pgmap v248: 97 pgs: 97 active+clean; 47 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-05-27T09:55:51.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:50 smithi072 ceph-mon[35951]: pgmap v248: 97 pgs: 97 active+clean; 47 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-05-27T09:55:52.785 INFO:tasks.workunit.client.0.smithi071.stdout:40000 mapwrite 0x1becad thru 0x1c6a92 (0x7de6 bytes) 2024-05-27T09:55:53.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:52 smithi122 ceph-mon[36436]: pgmap v249: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-05-27T09:55:53.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:52 smithi071 ceph-mon[31451]: pgmap v249: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-05-27T09:55:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:52 smithi072 ceph-mon[35951]: pgmap v249: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-05-27T09:55:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:54 smithi122 ceph-mon[36436]: pgmap v250: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 266 op/s 2024-05-27T09:55:55.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:54 smithi071 ceph-mon[31451]: pgmap v250: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 266 op/s 2024-05-27T09:55:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:54 smithi072 ceph-mon[35951]: pgmap v250: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 266 op/s 2024-05-27T09:55:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:56 smithi122 ceph-mon[36436]: pgmap v251: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 266 op/s 2024-05-27T09:55:57.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:56 smithi071 ceph-mon[31451]: pgmap v251: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 266 op/s 2024-05-27T09:55:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:56 smithi072 ceph-mon[35951]: pgmap v251: 97 pgs: 97 active+clean; 50 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 266 op/s 2024-05-27T09:55:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 -- 172.21.15.71:0/3292988480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70181089e0 msgr2=0x7f7018102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 --2- 172.21.15.71:0/3292988480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70181089e0 0x7f7018102570 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7008009900 tx=0x7f700802a3f0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 -- 172.21.15.71:0/3292988480 shutdown_connections 2024-05-27T09:55:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 --2- 172.21.15.71:0/3292988480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f701810d340 0x7f701810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 --2- 172.21.15.71:0/3292988480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7018102ab0 0x7f7018102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 --2- 172.21.15.71:0/3292988480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70181089e0 0x7f7018102570 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 -- 172.21.15.71:0/3292988480 >> 172.21.15.71:0/3292988480 conn(0x7f70180fe210 msgr2=0x7f7018100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 -- 172.21.15.71:0/3292988480 shutdown_connections 2024-05-27T09:55:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.145+0000 7f701d200640 1 -- 172.21.15.71:0/3292988480 wait complete. 2024-05-27T09:55:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.147+0000 7f701d200640 1 Processor -- start 2024-05-27T09:55:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.147+0000 7f701d200640 1 -- start start 2024-05-27T09:55:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.147+0000 7f701d200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7018102ab0 0x7f701819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.147+0000 7f701d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70181089e0 0x7f701819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f701d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701810d340 0x7f701819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f701d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7018112bf0 con 0x7f70181089e0 2024-05-27T09:55:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f701d200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7018112a70 con 0x7f701810d340 2024-05-27T09:55:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f701d200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7018112d70 con 0x7f7018102ab0 2024-05-27T09:55:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7018102ab0 0x7f701819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7018102ab0 0x7f701819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57026/0 (socket says 172.21.15.71:57026) 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7016a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70181089e0 0x7f701819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 -- 172.21.15.71:0/2845947507 learned_addr learned my addr 172.21.15.71:0/2845947507 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017e00640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701810d340 0x7f701819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 -- 172.21.15.71:0/2845947507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701810d340 msgr2=0x7f701819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701810d340 0x7f701819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 -- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70181089e0 msgr2=0x7f701819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70181089e0 0x7f701819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.148+0000 7f7017400640 1 -- 172.21.15.71:0/2845947507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701819f560 con 0x7f7018102ab0 2024-05-27T09:55:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.149+0000 7f7017400640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7018102ab0 0x7f701819a700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7008005ab0 tx=0x7f7008003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.149+0000 7f700fe00640 1 -- 172.21.15.71:0/2845947507 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700803f070 con 0x7f7018102ab0 2024-05-27T09:55:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.149+0000 7f700fe00640 1 -- 172.21.15.71:0/2845947507 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7008031b50 con 0x7f7018102ab0 2024-05-27T09:55:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.149+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701819f7f0 con 0x7f7018102ab0 2024-05-27T09:55:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.149+0000 7f700fe00640 1 -- 172.21.15.71:0/2845947507 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008035030 con 0x7f7018102ab0 2024-05-27T09:55:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.149+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f701819fce0 con 0x7f7018102ab0 2024-05-27T09:55:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.153+0000 7f700fe00640 1 -- 172.21.15.71:0/2845947507 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f7008042070 con 0x7f7018102ab0 2024-05-27T09:55:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.154+0000 7f70257a1740 1 Processor -- start 2024-05-27T09:55:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.154+0000 7f70257a1740 1 -- start start 2024-05-27T09:55:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.154+0000 7f70257a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 0x55db88a38a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.154+0000 7f70257a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a38fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.154+0000 7f70257a1740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f70257a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db889a9b90 con 0x55db886961b0 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f70257a1740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55db88999730 con 0x55db886754d0 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f70257a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db8899d770 con 0x55db8866d2f0 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f7017400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a38fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f7017400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a38fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57032/0 (socket says 172.21.15.71:57032) 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f7017e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 0x55db88a38a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f7017400640 1 -- 172.21.15.71:0/2572378361 learned_addr learned my addr 172.21.15.71:0/2572378361 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f7016a00640 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.155+0000 7f700fe00640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ffc0b2950 0x7f6ffc0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7017400640 1 -- 172.21.15.71:0/2572378361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 msgr2=0x55db88a394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7017400640 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7017400640 1 -- 172.21.15.71:0/2572378361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 msgr2=0x55db88a38a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7017400640 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 0x55db88a38a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7017400640 1 -- 172.21.15.71:0/2572378361 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db889328b0 con 0x55db8866d2f0 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7016a00640 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f700fe00640 1 -- 172.21.15.71:0/2845947507 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f7008102c80 con 0x7f7018102ab0 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7017e00640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ffc0b2950 0x7f6ffc0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f7017400640 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a38fa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f70081002b0 tx=0x7f700808f550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47d425635275c7e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f700cc00640 1 -- 172.21.15.71:0/2572378361 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080c9900 con 0x55db8866d2f0 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f700cc00640 1 -- 172.21.15.71:0/2572378361 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70080c9ac0 con 0x55db8866d2f0 2024-05-27T09:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.156+0000 7f700cc00640 1 -- 172.21.15.71:0/2572378361 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080c9720 con 0x55db8866d2f0 2024-05-27T09:55:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 -- 172.21.15.71:0/2572378361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 msgr2=0x55db88a38fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a38fa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f70081002b0 tx=0x7f700808f550 comp rx=0 tx=0).stop 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f7017e00640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ffc0b2950 0x7f6ffc0b4e60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7010009fd0 tx=0x7f7010004a40 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 -- 172.21.15.71:0/2572378361 shutdown_connections 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a38fa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 --2- 172.21.15.71:0/2572378361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 0x55db88a38a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 -- 172.21.15.71:0/2572378361 >> 172.21.15.71:0/2572378361 conn(0x55db8868a300 msgr2=0x55db88a35210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 -- 172.21.15.71:0/2572378361 shutdown_connections 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 -- 172.21.15.71:0/2572378361 wait complete. 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.158+0000 7f70257a1740 1 -- start start 2024-05-27T09:55:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 1 Processor -- start 2024-05-27T09:55:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db8866d2f0 0x55db88a42bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886754d0 0x55db88a43110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886961b0 0x55db88a530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db8867f790 con 0x55db8866d2f0 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55db88941bc0 con 0x55db886961b0 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db88a49dc0 con 0x55db886754d0 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.159+0000 7f70257a1740 10 client.0 _ll_register_callbacks cb 0x55db8891f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db8866d2f0 0x55db88a42bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886961b0 0x55db88a530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7016a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886754d0 0x55db88a43110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db8866d2f0 0x55db88a42bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32792/0 (socket says 172.21.15.71:32792) 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 -- 172.21.15.71:0/4159368021 learned_addr learned my addr 172.21.15.71:0/4159368021 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 -- 172.21.15.71:0/4159368021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886754d0 msgr2=0x55db88a43110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886754d0 0x55db88a43110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 -- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886961b0 msgr2=0x55db88a530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886961b0 0x55db88a530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 -- 172.21.15.71:0/4159368021 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db886ae210 con 0x55db8866d2f0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017e00640 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886961b0 0x55db88a530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7016a00640 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886754d0 0x55db88a43110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7017400640 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db8866d2f0 0x55db88a42bd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f70080c9cb0 tx=0x7f7008003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad79cd41795fa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.160+0000 7f7001600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f7001600640 1 -- 172.21.15.71:0/4159368021 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008049070 con 0x55db8866d2f0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f7001600640 1 -- 172.21.15.71:0/4159368021 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f70080c5920 con 0x55db8866d2f0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70080c9ac0 con 0x55db8866d2f0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f7001600640 1 -- 172.21.15.71:0/4159368021 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f70080c9720 con 0x55db8866d2f0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f70257a1740 10 client.16506 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55db8877a620 con 0x55db8866d2f0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f7001600640 1 -- 172.21.15.71:0/4159368021 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70080c9ac0 con 0x55db8866d2f0 2024-05-27T09:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f7001600640 1 -- 172.21.15.71:0/4159368021 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f700810a040 con 0x55db8866d2f0 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f70257a1740 10 client.16506 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f70257a1740 10 client.16506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f70257a1740 20 client.16506 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.161+0000 7f70257a1740 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db88654d80 0x55db88a58eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.162+0000 7f70257a1740 4 client.16506 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.162+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db889abae0 con 0x55db88654d80 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.162+0000 7f7016a00640 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db88654d80 0x55db88a58eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.162+0000 7f7001600640 10 client.16506 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.162+0000 7f7016a00640 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db88654d80 0x55db88a58eb0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3b825850e71a32a server_cookie=beb058cadc6c5c78 in_seq=0 out_seq=0 2024-05-27T09:55:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f7001600640 1 -- 172.21.15.71:0/4159368021 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55db889abae0 con 0x55db88654d80 2024-05-27T09:55:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f7001600640 10 client.16506 handle_command_reply: tid=0 2024-05-27T09:55:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 client.16506 shutdown 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db8866d2f0 msgr2=0x55db88a42bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db8866d2f0 0x55db88a42bd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f70080c9cb0 tx=0x7f7008003f90 comp rx=0 tx=0).stop 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 shutdown_connections 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886961b0 0x55db88a530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886754d0 0x55db88a43110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db88654d80 0x55db88a58eb0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 --2- 172.21.15.71:0/4159368021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db8866d2f0 0x55db88a42bd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 >> 172.21.15.71:0/4159368021 conn(0x55db8868a300 msgr2=0x55db88a3a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.163+0000 7f7001600640 0 client.16506 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.164+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 shutdown_connections 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.164+0000 7f70257a1740 1 -- 172.21.15.71:0/4159368021 wait complete. 2024-05-27T09:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.164+0000 7f70257a1740 20 client.16506 trim_cache size 0 max 16384 2024-05-27T09:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 Processor -- start 2024-05-27T09:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 -- start start 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db8866d2f0 0x55db88a3e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886754d0 0x55db88a42b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886961b0 0x55db88a430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70181aff40 con 0x55db886754d0 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f70181ad810 con 0x55db8866d2f0 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.181+0000 7f70257a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70181ab6a0 con 0x55db886961b0 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db8866d2f0 0x55db88a3e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db8866d2f0 0x55db88a3e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53836/0 (socket says 172.21.15.71:53836) 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 -- 172.21.15.71:0/1220111870 learned_addr learned my addr 172.21.15.71:0/1220111870 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017e00640 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886961b0 0x55db88a430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7016a00640 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886754d0 0x55db88a42b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 -- 172.21.15.71:0/1220111870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886961b0 msgr2=0x55db88a430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886961b0 0x55db88a430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 -- 172.21.15.71:0/1220111870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886754d0 msgr2=0x55db88a42b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886754d0 0x55db88a42b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 -- 172.21.15.71:0/1220111870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db88a3d0e0 con 0x55db8866d2f0 2024-05-27T09:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.182+0000 7f7017400640 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db8866d2f0 0x55db88a3e3a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f700802a9b0 tx=0x7f7008009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6f312fb25028bf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.183+0000 7f7003e00640 1 -- 172.21.15.71:0/1220111870 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008049070 con 0x55db8866d2f0 2024-05-27T09:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.183+0000 7f7003e00640 1 -- 172.21.15.71:0/1220111870 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70080c9ac0 con 0x55db8866d2f0 2024-05-27T09:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.183+0000 7f7003e00640 1 -- 172.21.15.71:0/1220111870 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080c9900 con 0x55db8866d2f0 2024-05-27T09:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 -- 172.21.15.71:0/1220111870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db8866d2f0 msgr2=0x55db88a3e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db8866d2f0 0x55db88a3e3a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f700802a9b0 tx=0x7f7008009260 comp rx=0 tx=0).stop 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 -- 172.21.15.71:0/1220111870 shutdown_connections 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db886961b0 0x55db88a430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886754d0 0x55db88a42b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 --2- 172.21.15.71:0/1220111870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db8866d2f0 0x55db88a3e3a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 -- 172.21.15.71:0/1220111870 >> 172.21.15.71:0/1220111870 conn(0x55db8868a300 msgr2=0x55db88a42460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 -- 172.21.15.71:0/1220111870 shutdown_connections 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 -- 172.21.15.71:0/1220111870 wait complete. 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.184+0000 7f70257a1740 1 -- start start 2024-05-27T09:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 1 Processor -- start 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a4a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a4a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 0x55db88a4aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70181abcf0 con 0x55db886961b0 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f70181ad140 con 0x55db886754d0 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70181ac3a0 con 0x55db8866d2f0 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f70257a1740 10 client.0 _ll_register_callbacks cb 0x7f7010009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f7017400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a4a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f7016a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a4a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f7017400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a4a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57046/0 (socket says 172.21.15.71:57046) 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f7016a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a4a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:53838/0 (socket says 172.21.15.71:53838) 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.185+0000 7f7017400640 1 -- 172.21.15.71:0/1910678856 learned_addr learned my addr 172.21.15.71:0/1910678856 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7017400640 1 -- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 msgr2=0x55db88a4a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7017400640 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a4a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7017400640 1 -- 172.21.15.71:0/1910678856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 msgr2=0x55db88a4aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7017400640 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 0x55db88a4aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7017400640 1 -- 172.21.15.71:0/1910678856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db88abf420 con 0x55db8866d2f0 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7016a00640 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a4a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7017400640 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a4a010 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70080c9cb0 tx=0x7f7008005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=728eaedea0bc2591 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.186+0000 7f7001600640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f7001600640 1 -- 172.21.15.71:0/1910678856 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008049070 con 0x55db8866d2f0 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f7001600640 1 -- 172.21.15.71:0/1910678856 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f70080ca210 con 0x55db8866d2f0 2024-05-27T09:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70080c9ac0 con 0x55db8866d2f0 2024-05-27T09:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f7001600640 1 -- 172.21.15.71:0/1910678856 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f70080c9900 con 0x55db8866d2f0 2024-05-27T09:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 10 client.26704 fetch_fsmap learned FSMap version 32 2024-05-27T09:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55db88abf420 con 0x55db8866d2f0 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f7001600640 1 -- 172.21.15.71:0/1910678856 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70080c9ac0 con 0x55db8866d2f0 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f7001600640 1 -- 172.21.15.71:0/1910678856 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f70080d28d0 con 0x55db8866d2f0 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 10 client.26704 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 10 client.26704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 20 client.26704 populate_metadata read hostname 'smithi071' 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db8862a1c0 0x55db88ac2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 4 client.26704 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.187+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db889a52c0 con 0x55db8862a1c0 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.188+0000 7f7016a00640 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db8862a1c0 0x55db88ac2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.188+0000 7f7016a00640 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db8862a1c0 0x55db88ac2900 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f5c37b6412ced43 server_cookie=463fd22df70199f4 in_seq=0 out_seq=0 2024-05-27T09:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.188+0000 7f7001600640 10 client.26704 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f7001600640 1 -- 172.21.15.71:0/1910678856 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55db889a52c0 con 0x55db8862a1c0 2024-05-27T09:55:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f7001600640 10 client.26704 handle_command_reply: tid=0 2024-05-27T09:55:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 client.26704 shutdown 2024-05-27T09:55:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 msgr2=0x55db88a4a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a4a010 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70080c9cb0 tx=0x7f7008005c90 comp rx=0 tx=0).stop 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 shutdown_connections 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55db8862a1c0 0x55db88ac2900 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db886961b0 0x55db88a4aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55db886754d0 0x55db88a4a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 --2- 172.21.15.71:0/1910678856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db8866d2f0 0x55db88a4a010 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f7001600640 0 client.26704 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 >> 172.21.15.71:0/1910678856 conn(0x55db8868a300 msgr2=0x55db88a42d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 shutdown_connections 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.201+0000 7f70257a1740 1 -- 172.21.15.71:0/1910678856 wait complete. 2024-05-27T09:55:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.202+0000 7f70257a1740 20 client.26704 trim_cache size 0 max 16384 2024-05-27T09:55:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:55:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:55:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.202+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ffc0b2950 msgr2=0x7f6ffc0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ffc0b2950 0x7f6ffc0b4e60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7010009fd0 tx=0x7f7010004a40 comp rx=0 tx=0).stop 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7018102ab0 msgr2=0x7f701819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7018102ab0 0x7f701819a700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7008005ab0 tx=0x7f7008003b90 comp rx=0 tx=0).stop 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 shutdown_connections 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6ffc0b2950 0x7f6ffc0b4e60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701810d340 0x7f701819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70181089e0 0x7f701819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 --2- 172.21.15.71:0/2845947507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7018102ab0 0x7f701819a700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 >> 172.21.15.71:0/2845947507 conn(0x7f70180fe210 msgr2=0x7f701806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 shutdown_connections 2024-05-27T09:55:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:55:58.203+0000 7f701d200640 1 -- 172.21.15.71:0/2845947507 wait complete. 2024-05-27T09:55:59.078 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:55:58 smithi072 ceph-mon[35951]: pgmap v252: 97 pgs: 97 active+clean; 49 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.3 MiB/s wr, 384 op/s 2024-05-27T09:55:59.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:55:58 smithi122 ceph-mon[36436]: pgmap v252: 97 pgs: 97 active+clean; 49 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.3 MiB/s wr, 384 op/s 2024-05-27T09:55:59.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:55:58 smithi071 ceph-mon[31451]: pgmap v252: 97 pgs: 97 active+clean; 49 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.3 MiB/s wr, 384 op/s 2024-05-27T09:56:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:00 smithi122 ceph-mon[36436]: pgmap v253: 97 pgs: 97 active+clean; 49 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-05-27T09:56:01.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:00 smithi071 ceph-mon[31451]: pgmap v253: 97 pgs: 97 active+clean; 49 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-05-27T09:56:01.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:00 smithi072 ceph-mon[35951]: pgmap v253: 97 pgs: 97 active+clean; 49 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-05-27T09:56:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:02 smithi122 ceph-mon[36436]: pgmap v254: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.2 MiB/s wr, 377 op/s 2024-05-27T09:56:03.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:02 smithi071 ceph-mon[31451]: pgmap v254: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.2 MiB/s wr, 377 op/s 2024-05-27T09:56:03.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:02 smithi072 ceph-mon[35951]: pgmap v254: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.2 MiB/s wr, 377 op/s 2024-05-27T09:56:04.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:03 smithi122 ceph-mon[36436]: pgmap v255: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.5 MiB/s wr, 252 op/s 2024-05-27T09:56:04.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:03 smithi071 ceph-mon[31451]: pgmap v255: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.5 MiB/s wr, 252 op/s 2024-05-27T09:56:04.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:03 smithi072 ceph-mon[35951]: pgmap v255: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.5 MiB/s wr, 252 op/s 2024-05-27T09:56:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:04 smithi122 ceph-mon[36436]: osdmap e88: 12 total, 12 up, 12 in 2024-05-27T09:56:05.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:04 smithi071 ceph-mon[31451]: osdmap e88: 12 total, 12 up, 12 in 2024-05-27T09:56:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:04 smithi072 ceph-mon[35951]: osdmap e88: 12 total, 12 up, 12 in 2024-05-27T09:56:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:05 smithi122 ceph-mon[36436]: pgmap v257: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.8 MiB/s wr, 302 op/s 2024-05-27T09:56:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:05 smithi071 ceph-mon[31451]: pgmap v257: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.8 MiB/s wr, 302 op/s 2024-05-27T09:56:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:05 smithi072 ceph-mon[35951]: pgmap v257: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.8 MiB/s wr, 302 op/s 2024-05-27T09:56:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:08 smithi122 ceph-mon[36436]: pgmap v258: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 281 op/s 2024-05-27T09:56:09.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:08 smithi071 ceph-mon[31451]: pgmap v258: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 281 op/s 2024-05-27T09:56:09.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:08 smithi072 ceph-mon[35951]: pgmap v258: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 281 op/s 2024-05-27T09:56:11.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:10 smithi122 ceph-mon[36436]: pgmap v259: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 281 op/s 2024-05-27T09:56:11.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:10 smithi122 ceph-mon[36436]: osdmap e89: 12 total, 12 up, 12 in 2024-05-27T09:56:11.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:10 smithi071 ceph-mon[31451]: pgmap v259: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 281 op/s 2024-05-27T09:56:11.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:10 smithi071 ceph-mon[31451]: osdmap e89: 12 total, 12 up, 12 in 2024-05-27T09:56:11.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:10 smithi072 ceph-mon[35951]: pgmap v259: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 281 op/s 2024-05-27T09:56:11.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:10 smithi072 ceph-mon[35951]: osdmap e89: 12 total, 12 up, 12 in 2024-05-27T09:56:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.441+0000 7f529d200640 1 -- 172.21.15.71:0/1942343281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52981043e0 msgr2=0x7f52981107b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.441+0000 7f529d200640 1 --2- 172.21.15.71:0/1942343281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52981043e0 0x7f52981107b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5290009ca0 tx=0x7f529002a8c0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.442+0000 7f529d200640 1 -- 172.21.15.71:0/1942343281 shutdown_connections 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.442+0000 7f529d200640 1 --2- 172.21.15.71:0/1942343281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52981043e0 0x7f52981107b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.442+0000 7f529d200640 1 --2- 172.21.15.71:0/1942343281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f529810a130 0x7f5298103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.442+0000 7f529d200640 1 --2- 172.21.15.71:0/1942343281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5298109c90 0x7f5298103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.442+0000 7f529d200640 1 -- 172.21.15.71:0/1942343281 >> 172.21.15.71:0/1942343281 conn(0x7f5298079390 msgr2=0x7f52980797d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.442+0000 7f529d200640 1 -- 172.21.15.71:0/1942343281 shutdown_connections 2024-05-27T09:56:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.442+0000 7f529d200640 1 -- 172.21.15.71:0/1942343281 wait complete. 2024-05-27T09:56:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.443+0000 7f529d200640 1 Processor -- start 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.443+0000 7f529d200640 1 -- start start 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.443+0000 7f529d200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52981043e0 0x7f52981a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.443+0000 7f529d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5298109c90 0x7f52981a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f529d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f529810a130 0x7f529819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f529d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5298113ef0 con 0x7f5298109c90 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f529d200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5298113d70 con 0x7f529810a130 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f529d200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5298114070 con 0x7f52981043e0 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52981043e0 0x7f52981a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5296800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f529810a130 0x7f529819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52981043e0 0x7f52981a0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:58674/0 (socket says 172.21.15.71:58674) 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 -- 172.21.15.71:0/2356454733 learned_addr learned my addr 172.21.15.71:0/2356454733 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295400640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5298109c90 0x7f52981a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 -- 172.21.15.71:0/2356454733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f529810a130 msgr2=0x7f529819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f529810a130 0x7f529819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 -- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5298109c90 msgr2=0x7f52981a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5298109c90 0x7f52981a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295e00640 1 -- 172.21.15.71:0/2356454733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529819ae00 con 0x7f52981043e0 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5295400640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5298109c90 0x7f52981a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.444+0000 7f5296800640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f529810a130 0x7f529819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.445+0000 7f5295e00640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52981043e0 0x7f52981a0550 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f528800e9c0 tx=0x7f528800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.445+0000 7f528ea00640 1 -- 172.21.15.71:0/2356454733 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528800cd80 con 0x7f52981043e0 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.445+0000 7f528ea00640 1 -- 172.21.15.71:0/2356454733 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52880054d0 con 0x7f52981043e0 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.445+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529819b090 con 0x7f52981043e0 2024-05-27T09:56:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.445+0000 7f528ea00640 1 -- 172.21.15.71:0/2356454733 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288010430 con 0x7f52981043e0 2024-05-27T09:56:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.445+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52981a72f0 con 0x7f52981043e0 2024-05-27T09:56:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.448+0000 7f528ea00640 1 -- 172.21.15.71:0/2356454733 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5288005020 con 0x7f52981043e0 2024-05-27T09:56:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 Processor -- start 2024-05-27T09:56:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 -- start start 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb941b0 0x56402ff366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff36c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb734d0 0x56402ff37170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56402fea7b90 con 0x56402fb6b2f0 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56402fe97730 con 0x56402fb941b0 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.449+0000 7f52a419a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56402fe9b770 con 0x56402fb734d0 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb941b0 0x56402ff366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb941b0 0x56402ff366f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47940/0 (socket says 172.21.15.71:47940) 2024-05-27T09:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5295400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb734d0 0x56402ff37170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 -- 172.21.15.71:0/1722661009 learned_addr learned my addr 172.21.15.71:0/1722661009 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5295e00640 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff36c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 -- 172.21.15.71:0/1722661009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb734d0 msgr2=0x56402ff37170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb734d0 0x56402ff37170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 -- 172.21.15.71:0/1722661009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 msgr2=0x56402ff36c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff36c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 -- 172.21.15.71:0/1722661009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402fe308b0 con 0x56402fb941b0 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5295e00640 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff36c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f528ea00640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f527c0b29d0 0x7f527c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.450+0000 7f5296800640 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb941b0 0x56402ff366f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5290009ca0 tx=0x7f5290009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7118ea30710ed05 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.451+0000 7f528ea00640 1 -- 172.21.15.71:0/2356454733 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f52880e2ad0 con 0x7f52981043e0 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.451+0000 7f5295e00640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f527c0b29d0 0x7f527c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.451+0000 7f5287400640 1 -- 172.21.15.71:0/1722661009 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529002f3d0 con 0x56402fb941b0 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.451+0000 7f5287400640 1 -- 172.21.15.71:0/1722661009 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5290036040 con 0x56402fb941b0 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.451+0000 7f5287400640 1 -- 172.21.15.71:0/1722661009 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52900044b0 con 0x56402fb941b0 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f52a419a740 1 -- 172.21.15.71:0/1722661009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb941b0 msgr2=0x56402ff366f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f52a419a740 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb941b0 0x56402ff366f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5290009ca0 tx=0x7f5290009490 comp rx=0 tx=0).stop 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f5295e00640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f527c0b29d0 0x7f527c0b4ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x56402ff34350 tx=0x7f52880049b0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f52a419a740 1 -- 172.21.15.71:0/1722661009 shutdown_connections 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f52a419a740 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb734d0 0x56402ff37170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f52a419a740 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff36c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f52a419a740 1 --2- 172.21.15.71:0/1722661009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb941b0 0x56402ff366f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.452+0000 7f52a419a740 1 -- 172.21.15.71:0/1722661009 >> 172.21.15.71:0/1722661009 conn(0x56402fb88300 msgr2=0x56402ff33010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.453+0000 7f52a419a740 1 -- 172.21.15.71:0/1722661009 shutdown_connections 2024-05-27T09:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.453+0000 7f52a419a740 1 -- 172.21.15.71:0/1722661009 wait complete. 2024-05-27T09:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.453+0000 7f52a419a740 1 -- start start 2024-05-27T09:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 1 Processor -- start 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff44e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff45370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56402fb7d790 con 0x56402fb6b2f0 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56402fe3fbc0 con 0x56402fb734d0 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56402ff47c20 con 0x56402fb941b0 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f52a419a740 10 client.0 _ll_register_callbacks cb 0x56402fe1d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f5295400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff45370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f5295400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff45370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47952/0 (socket says 172.21.15.71:47952) 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.454+0000 7f5295400640 1 -- 172.21.15.71:0/2857001924 learned_addr learned my addr 172.21.15.71:0/2857001924 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5296800640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff44e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5296800640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5295400640 1 -- 172.21.15.71:0/2857001924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 msgr2=0x56402ff50f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5295400640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5295400640 1 -- 172.21.15.71:0/2857001924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 msgr2=0x56402ff44e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5295400640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff44e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5295400640 1 -- 172.21.15.71:0/2857001924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402fbac210 con 0x56402fb734d0 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5296800640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f5295400640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff45370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5280009c00 tx=0x7f52800039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d29db00992b9354 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f527be00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f527be00640 1 -- 172.21.15.71:0/2857001924 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280012860 con 0x56402fb734d0 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f527be00640 1 -- 172.21.15.71:0/2857001924 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f5280012a00 con 0x56402fb734d0 2024-05-27T09:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.455+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5290036040 con 0x56402fb734d0 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f527be00640 1 -- 172.21.15.71:0/2857001924 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5280012c00 con 0x56402fb734d0 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 10 client.26690 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56402fc78620 con 0x56402fb734d0 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f527be00640 1 -- 172.21.15.71:0/2857001924 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5290036040 con 0x56402fb734d0 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f527be00640 1 -- 172.21.15.71:0/2857001924 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f528001a030 con 0x56402fb734d0 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 10 client.26690 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 10 client.26690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 20 client.26690 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb52d80 0x56402ff56f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 4 client.26690 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.456+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56402fea9ae0 con 0x56402fb52d80 2024-05-27T09:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.457+0000 7f5296800640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb52d80 0x56402ff56f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.457+0000 7f5296800640 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb52d80 0x56402ff56f20 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ef9234ef12c111 server_cookie=62b6166cb61dae5c in_seq=0 out_seq=0 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.457+0000 7f527be00640 10 client.26690 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.458+0000 7f527be00640 1 -- 172.21.15.71:0/2857001924 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56402fea9ae0 con 0x56402fb52d80 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.458+0000 7f527be00640 10 client.26690 handle_command_reply: tid=0 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 client.26690 shutdown 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 msgr2=0x56402ff45370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff45370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5280009c00 tx=0x7f52800039c0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 shutdown_connections 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff45370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb52d80 0x56402ff56f20 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 --2- 172.21.15.71:0/2857001924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff44e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 >> 172.21.15.71:0/2857001924 conn(0x56402fb88300 msgr2=0x56402ff38510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f527be00640 0 client.26690 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 shutdown_connections 2024-05-27T09:56:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 1 -- 172.21.15.71:0/2857001924 wait complete. 2024-05-27T09:56:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.459+0000 7f52a419a740 20 client.26690 trim_cache size 0 max 16384 2024-05-27T09:56:11.478 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.478+0000 7f52a419a740 1 Processor -- start 2024-05-27T09:56:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f52a419a740 1 -- start start 2024-05-27T09:56:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f52a419a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff3eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f52a419a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff3efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f52a419a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f52a419a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f52981b01d0 con 0x56402fb6b2f0 2024-05-27T09:56:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f52a419a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f52981adaa0 con 0x56402fb734d0 2024-05-27T09:56:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f52a419a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f52981ab910 con 0x56402fb941b0 2024-05-27T09:56:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f5296800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff3eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f5295400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff3efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f5295400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff3efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47964/0 (socket says 172.21.15.71:47964) 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f5295400640 1 -- 172.21.15.71:0/2590218928 learned_addr learned my addr 172.21.15.71:0/2590218928 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.479+0000 7f5296800640 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.480+0000 7f5295400640 1 -- 172.21.15.71:0/2590218928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 msgr2=0x56402ff50c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.480+0000 7f5295400640 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.480+0000 7f5295400640 1 -- 172.21.15.71:0/2590218928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 msgr2=0x56402ff3eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.480+0000 7f5295400640 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff3eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.480+0000 7f5295400640 1 -- 172.21.15.71:0/2590218928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402ff2d050 con 0x56402fb734d0 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.480+0000 7f5296800640 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff3eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.480+0000 7f5295400640 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff3efe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5280012010 tx=0x7f5280009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54a33bf6fee017d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.481+0000 7f5286a00640 1 -- 172.21.15.71:0/2590218928 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280028040 con 0x56402fb734d0 2024-05-27T09:56:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.481+0000 7f5286a00640 1 -- 172.21.15.71:0/2590218928 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52800054f0 con 0x56402fb734d0 2024-05-27T09:56:11.482 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.481+0000 7f5286a00640 1 -- 172.21.15.71:0/2590218928 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280004c40 con 0x56402fb734d0 2024-05-27T09:56:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 -- 172.21.15.71:0/2590218928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 msgr2=0x56402ff3efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff3efe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5280012010 tx=0x7f5280009820 comp rx=0 tx=0).stop 2024-05-27T09:56:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 -- 172.21.15.71:0/2590218928 shutdown_connections 2024-05-27T09:56:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff50c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb734d0 0x56402ff3efe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 --2- 172.21.15.71:0/2590218928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb6b2f0 0x56402ff3eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 -- 172.21.15.71:0/2590218928 >> 172.21.15.71:0/2590218928 conn(0x56402fb88300 msgr2=0x56402ff37020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 -- 172.21.15.71:0/2590218928 shutdown_connections 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 -- 172.21.15.71:0/2590218928 wait complete. 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 -- start start 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.482+0000 7f52a419a740 1 Processor -- start 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f52a419a740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb6b2f0 0x56402ff4d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f52a419a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb734d0 0x56402ff48790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f52a419a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff48cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f52a419a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f52981abf60 con 0x56402fb734d0 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f52a419a740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f52981ad3d0 con 0x56402fb6b2f0 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f52a419a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f52981ac630 con 0x56402fb941b0 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f52a419a740 10 client.0 _ll_register_callbacks cb 0x7f5280004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f5295400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb734d0 0x56402ff48790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.484 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f5296800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb6b2f0 0x56402ff4d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f5295400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb734d0 0x56402ff48790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41684/0 (socket says 172.21.15.71:41684) 2024-05-27T09:56:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f5296800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb6b2f0 0x56402ff4d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:47978/0 (socket says 172.21.15.71:47978) 2024-05-27T09:56:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f5295400640 1 -- 172.21.15.71:0/243699975 learned_addr learned my addr 172.21.15.71:0/243699975 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.483+0000 7f5296800640 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff48cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f5296800640 1 -- 172.21.15.71:0/243699975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 msgr2=0x56402ff48cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f5296800640 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff48cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f5296800640 1 -- 172.21.15.71:0/243699975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb734d0 msgr2=0x56402ff48790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f5296800640 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb734d0 0x56402ff48790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f5296800640 1 -- 172.21.15.71:0/243699975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402ff492c0 con 0x56402fb6b2f0 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f5295400640 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb734d0 0x56402ff48790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f5296800640 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb6b2f0 0x56402ff4d440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5290009bf0 tx=0x7f5290009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92323d40f7e0594b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f527be00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:56:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.484+0000 7f527be00640 1 -- 172.21.15.71:0/243699975 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529002f800 con 0x56402fb6b2f0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52800054f0 con 0x56402fb6b2f0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f527be00640 1 -- 172.21.15.71:0/243699975 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f529002f9a0 con 0x56402fb6b2f0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f527be00640 1 -- 172.21.15.71:0/243699975 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5290004b40 con 0x56402fb6b2f0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 10 client.26696 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56402ffbf3b0 con 0x56402fb6b2f0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f527be00640 1 -- 172.21.15.71:0/243699975 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52800054f0 con 0x56402fb6b2f0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f527be00640 1 -- 172.21.15.71:0/243699975 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f5290051040 con 0x56402fb6b2f0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 10 client.26696 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 10 client.26696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 20 client.26696 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb281c0 0x56402ffc1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 4 client.26696 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.485+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56402fea32c0 con 0x56402fb281c0 2024-05-27T09:56:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.486+0000 7f5295400640 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb281c0 0x56402ffc1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.486+0000 7f5295400640 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb281c0 0x56402ffc1770 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fba9239c4c213504 server_cookie=f75ace8377f0cc5f in_seq=0 out_seq=0 2024-05-27T09:56:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.486+0000 7f527be00640 10 client.26696 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f527be00640 1 -- 172.21.15.71:0/243699975 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56402fea32c0 con 0x56402fb281c0 2024-05-27T09:56:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f527be00640 10 client.26696 handle_command_reply: tid=0 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 client.26696 shutdown 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb6b2f0 msgr2=0x56402ff4d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb6b2f0 0x56402ff4d440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5290009bf0 tx=0x7f5290009a20 comp rx=0 tx=0).stop 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 shutdown_connections 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56402fb941b0 0x56402ff48cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56402fb281c0 0x56402ffc1770 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56402fb734d0 0x56402ff48790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 --2- 172.21.15.71:0/243699975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56402fb6b2f0 0x56402ff4d440 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f527be00640 0 client.26696 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 >> 172.21.15.71:0/243699975 conn(0x56402fb88300 msgr2=0x56402ff446c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 shutdown_connections 2024-05-27T09:56:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 1 -- 172.21.15.71:0/243699975 wait complete. 2024-05-27T09:56:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.500+0000 7f52a419a740 20 client.26696 trim_cache size 0 max 16384 2024-05-27T09:56:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:56:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:56:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f527c0b29d0 msgr2=0x7f527c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f527c0b29d0 0x7f527c0b4ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x56402ff34350 tx=0x7f52880049b0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52981043e0 msgr2=0x7f52981a0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52981043e0 0x7f52981a0550 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f528800e9c0 tx=0x7f528800ee80 comp rx=0 tx=0).stop 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 shutdown_connections 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f527c0b29d0 0x7f527c0b4ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f529810a130 0x7f529819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5298109c90 0x7f52981a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 --2- 172.21.15.71:0/2356454733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52981043e0 0x7f52981a0550 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.501+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 >> 172.21.15.71:0/2356454733 conn(0x7f5298079390 msgr2=0x7f5298100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.502+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 shutdown_connections 2024-05-27T09:56:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:11.502+0000 7f529d200640 1 -- 172.21.15.71:0/2356454733 wait complete. 2024-05-27T09:56:13.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:12 smithi122 ceph-mon[36436]: pgmap v261: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.3 MiB/s wr, 334 op/s 2024-05-27T09:56:13.256 INFO:tasks.workunit.client.0.smithi071.stdout:50000 write 0x5304f4 thru 0x53fa11 (0xf51e bytes) 2024-05-27T09:56:13.256 INFO:tasks.workunit.client.0.smithi071.stdout:All 50000 operations completed A-OK! 2024-05-27T09:56:13.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:12 smithi071 ceph-mon[31451]: pgmap v261: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.3 MiB/s wr, 334 op/s 2024-05-27T09:56:13.268 INFO:tasks.workunit.client.0.smithi071.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-05-27T09:56:13.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:12 smithi072 ceph-mon[35951]: pgmap v261: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.3 MiB/s wr, 334 op/s 2024-05-27T09:56:13.276 INFO:tasks.workunit.client.0.smithi071.stdout:Seed set to 1 2024-05-27T09:56:14.614 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-05-27T09:56:14.614 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-05-27T09:56:14.616 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-05-27T09:56:14.616 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-05-27T09:56:14.616 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support clone range, disabling! 2024-05-27T09:56:14.619 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support dedupe range, disabling! 2024-05-27T09:56:14.623 INFO:tasks.workunit.client.0.smithi071.stderr:main: filesystem does not support exchange range, disabling! 2024-05-27T09:56:14.623 INFO:tasks.workunit.client.0.smithi071.stdout:skipping zero size read 2024-05-27T09:56:14.642 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x1c37b90 2024-05-27T09:56:14.656 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x5bd330d 2024-05-27T09:56:14.685 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0x637bf99 2024-05-27T09:56:15.128 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0x63d9b9c 2024-05-27T09:56:15.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:14 smithi122 ceph-mon[36436]: pgmap v262: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.8 MiB/s wr, 270 op/s 2024-05-27T09:56:15.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:14 smithi071 ceph-mon[31451]: pgmap v262: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.8 MiB/s wr, 270 op/s 2024-05-27T09:56:15.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:14 smithi072 ceph-mon[35951]: pgmap v262: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.8 MiB/s wr, 270 op/s 2024-05-27T09:56:16.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:16 smithi122 ceph-mon[36436]: pgmap v263: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.8 MiB/s wr, 267 op/s 2024-05-27T09:56:16.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:16 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:56:16.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:16 smithi071 ceph-mon[31451]: pgmap v263: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.8 MiB/s wr, 267 op/s 2024-05-27T09:56:16.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:16 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:56:16.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:16 smithi072 ceph-mon[35951]: pgmap v263: 97 pgs: 97 active+clean; 53 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.8 MiB/s wr, 267 op/s 2024-05-27T09:56:16.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:16 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:56:18.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:18 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:18.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:18 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:18.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:18 smithi122 ceph-mon[36436]: pgmap v264: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-05-27T09:56:18.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:18 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:18.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:18 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:18.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:18 smithi071 ceph-mon[31451]: pgmap v264: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-05-27T09:56:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:18 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:18 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:18 smithi072 ceph-mon[35951]: pgmap v264: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-05-27T09:56:19.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:19 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:56:19.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:19 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:56:19.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:19 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:19.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:19 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:56:19.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:19 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:56:19.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:19 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:19 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:56:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:19 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:56:19.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:19 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:56:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:20 smithi071 ceph-mon[31451]: pgmap v265: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-05-27T09:56:20.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:20 smithi072 ceph-mon[35951]: pgmap v265: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-05-27T09:56:20.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:20 smithi122 ceph-mon[36436]: pgmap v265: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 266 op/s 2024-05-27T09:56:23.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:22 smithi071 ceph-mon[31451]: pgmap v266: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1.9 MiB/s wr, 441 op/s 2024-05-27T09:56:23.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:22 smithi122 ceph-mon[36436]: pgmap v266: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1.9 MiB/s wr, 441 op/s 2024-05-27T09:56:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:22 smithi072 ceph-mon[35951]: pgmap v266: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1.9 MiB/s wr, 441 op/s 2024-05-27T09:56:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 -- 172.21.15.71:0/672472403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 msgr2=0x7f4dc41106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/672472403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 0x7f4dc41106d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009ca0 tx=0x7f4dbc02a8c0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 -- 172.21.15.71:0/672472403 shutdown_connections 2024-05-27T09:56:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/672472403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 0x7f4dc41106d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/672472403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc410b7f0 0x7f4dc410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/672472403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dc4104d90 0x7f4dc41051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 -- 172.21.15.71:0/672472403 >> 172.21.15.71:0/672472403 conn(0x7f4dc40782d0 msgr2=0x7f4dc4078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 -- 172.21.15.71:0/672472403 shutdown_connections 2024-05-27T09:56:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.738+0000 7f4dcaa00640 1 -- 172.21.15.71:0/672472403 wait complete. 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.739+0000 7f4dcaa00640 1 Processor -- start 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.739+0000 7f4dcaa00640 1 -- start start 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dcaa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc4104d90 0x7f4dc41a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dcaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dc410b7f0 0x7f4dc41a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dcaa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 0x7f4dc419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dcaa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4113e90 con 0x7f4dc410b7f0 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dcaa00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4113d10 con 0x7f4dc4104d90 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dcaa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4114010 con 0x7f4dc410e1e0 2024-05-27T09:56:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dc3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc4104d90 0x7f4dc41a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dc3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc4104d90 0x7f4dc41a25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:33146/0 (socket says 172.21.15.71:33146) 2024-05-27T09:56:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dc3e00640 1 -- 172.21.15.71:0/2009261579 learned_addr learned my addr 172.21.15.71:0/2009261579 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.740+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 0x7f4dc419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.741+0000 7f4dc3e00640 1 -- 172.21.15.71:0/2009261579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 msgr2=0x7f4dc419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.741+0000 7f4dc3e00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 0x7f4dc419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.741+0000 7f4dc3e00640 1 -- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dc410b7f0 msgr2=0x7f4dc41a2b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.741+0000 7f4dc3e00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dc410b7f0 0x7f4dc41a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.741+0000 7f4dc3e00640 1 -- 172.21.15.71:0/2009261579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc419cef0 con 0x7f4dc4104d90 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.741+0000 7f4dc3e00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc4104d90 0x7f4dc41a25e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4db400ea60 tx=0x7f4db400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.741+0000 7f4dc0c00640 1 -- 172.21.15.71:0/2009261579 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db400cde0 con 0x7f4dc4104d90 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.742+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc419d1e0 con 0x7f4dc4104d90 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.742+0000 7f4dc0c00640 1 -- 172.21.15.71:0/2009261579 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4db40035f0 con 0x7f4dc4104d90 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.742+0000 7f4dc0c00640 1 -- 172.21.15.71:0/2009261579 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4010690 con 0x7f4dc4104d90 2024-05-27T09:56:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.742+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc41a9430 con 0x7f4dc4104d90 2024-05-27T09:56:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.745+0000 7f4dd1a27740 1 Processor -- start 2024-05-27T09:56:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.745+0000 7f4dd1a27740 1 -- start start 2024-05-27T09:56:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d0567860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0567da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d05682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c6d04d8b90 con 0x55c6d01a44d0 2024-05-27T09:56:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c6d04c8730 con 0x55c6d019c2f0 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c6d04cc770 con 0x55c6d01c51b0 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d0567860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d0567860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:49382/0 (socket says 172.21.15.71:49382) 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dc8a00640 1 -- 172.21.15.71:0/3361754778 learned_addr learned my addr 172.21.15.71:0/3361754778 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dc3400640 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d05682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.746+0000 7f4dc8a00640 1 -- 172.21.15.71:0/3361754778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 msgr2=0x55c6d0567da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0567da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4dc8a00640 1 -- 172.21.15.71:0/3361754778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 msgr2=0x55c6d05682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d05682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4dc8a00640 1 -- 172.21.15.71:0/3361754778 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6d04618b0 con 0x55c6d01c51b0 2024-05-27T09:56:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4dc3400640 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d05682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d0567860 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009ca0 tx=0x7f4dbc009430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c73c4741721336 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4dc0c00640 1 -- 172.21.15.71:0/2009261579 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4db40037a0 con 0x7f4dc4104d90 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4db9200640 1 -- 172.21.15.71:0/3361754778 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc031cf0 con 0x55c6d01c51b0 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4db9200640 1 -- 172.21.15.71:0/3361754778 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dbc036030 con 0x55c6d01c51b0 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.747+0000 7f4db9200640 1 -- 172.21.15.71:0/3361754778 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc004280 con 0x55c6d01c51b0 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 -- 172.21.15.71:0/3361754778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 msgr2=0x55c6d0567860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d0567860 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009ca0 tx=0x7f4dbc009430 comp rx=0 tx=0).stop 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dc0c00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4da80b2950 0x7f4da80b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 -- 172.21.15.71:0/3361754778 shutdown_connections 2024-05-27T09:56:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d05682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0567da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/3361754778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d0567860 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 -- 172.21.15.71:0/3361754778 >> 172.21.15.71:0/3361754778 conn(0x55c6d01b9300 msgr2=0x55c6d0564010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dc0c00640 1 -- 172.21.15.71:0/2009261579 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f4db40e29b0 con 0x7f4dc4104d90 2024-05-27T09:56:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 -- 172.21.15.71:0/3361754778 shutdown_connections 2024-05-27T09:56:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dc3e00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4da80b2950 0x7f4da80b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.749+0000 7f4dd1a27740 1 -- 172.21.15.71:0/3361754778 wait complete. 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.750+0000 7f4dd1a27740 1 -- start start 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.750+0000 7f4dc3e00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4da80b2950 0x7f4da80b4e60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c6d0565350 tx=0x7f4db4009520 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.750+0000 7f4dd1a27740 1 Processor -- start 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.750+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d05719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.750+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d0571f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d057dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c6d01ae790 con 0x55c6d01a44d0 2024-05-27T09:56:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c6d0470bc0 con 0x55c6d019c2f0 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c6d05747b0 con 0x55c6d01c51b0 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dd1a27740 10 client.0 _ll_register_callbacks cb 0x55c6d044e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dc3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d0571f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d05719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dc3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d0571f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54586/0 (socket says 172.21.15.71:54586) 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dc3400640 1 -- 172.21.15.71:0/2864568212 learned_addr learned my addr 172.21.15.71:0/2864568212 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d057dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dc3400640 1 -- 172.21.15.71:0/2864568212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 msgr2=0x55c6d057dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.751+0000 7f4dc3400640 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d057dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dc3400640 1 -- 172.21.15.71:0/2864568212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 msgr2=0x55c6d05719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dc3400640 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d05719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dc3400640 1 -- 172.21.15.71:0/2864568212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6d01dd210 con 0x55c6d01a44d0 2024-05-27T09:56:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d057dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dc3400640 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d0571f10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4db0011460 tx=0x7f4db0011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a36e63ccbe91f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dad600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:56:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dad600640 1 -- 172.21.15.71:0/2864568212 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db001f060 con 0x55c6d01a44d0 2024-05-27T09:56:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dad600640 1 -- 172.21.15.71:0/2864568212 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f4db0012980 con 0x55c6d01a44d0 2024-05-27T09:56:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.752+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dbc036030 con 0x55c6d01a44d0 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dad600640 1 -- 172.21.15.71:0/2864568212 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4db0012b80 con 0x55c6d01a44d0 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dd1a27740 10 client.16536 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c6d02a9620 con 0x55c6d01a44d0 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dad600640 1 -- 172.21.15.71:0/2864568212 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dbc036030 con 0x55c6d01a44d0 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dad600640 1 -- 172.21.15.71:0/2864568212 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f4db00223b0 con 0x55c6d01a44d0 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dd1a27740 10 client.16536 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dd1a27740 10 client.16536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.753+0000 7f4dd1a27740 20 client.16536 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.754+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d0183d80 0x55c6d0583a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.754+0000 7f4dd1a27740 4 client.16536 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.754+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6d04daae0 con 0x55c6d0183d80 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.754+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d0183d80 0x55c6d0583a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.754+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d0183d80 0x55c6d0583a70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c160213c96cee7d5 server_cookie=2d932ae07b7bf871 in_seq=0 out_seq=0 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.754+0000 7f4dad600640 10 client.16536 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.755+0000 7f4dad600640 1 -- 172.21.15.71:0/2864568212 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55c6d04daae0 con 0x55c6d0183d80 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.755+0000 7f4dad600640 10 client.16536 handle_command_reply: tid=0 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.755+0000 7f4dd1a27740 1 client.16536 shutdown 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 msgr2=0x55c6d0571f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d0571f10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4db0011460 tx=0x7f4db0011920 comp rx=0 tx=0).stop 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 shutdown_connections 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01c51b0 0x55c6d057dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d0183d80 0x55c6d0583a70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d0571f10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/2864568212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d05719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 >> 172.21.15.71:0/2864568212 conn(0x55c6d01b9300 msgr2=0x55c6d0567630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dad600640 0 client.16536 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 shutdown_connections 2024-05-27T09:56:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 1 -- 172.21.15.71:0/2864568212 wait complete. 2024-05-27T09:56:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.756+0000 7f4dd1a27740 20 client.16536 trim_cache size 0 max 16384 2024-05-27T09:56:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.774+0000 7f4dd1a27740 1 Processor -- start 2024-05-27T09:56:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.774+0000 7f4dd1a27740 1 -- start start 2024-05-27T09:56:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.774+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d019c2f0 0x55c6d056d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d057d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d01c51b0 0x55c6d057dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41b4560 con 0x55c6d01a44d0 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41b1e30 con 0x55c6d01c51b0 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41afca0 con 0x55c6d019c2f0 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d019c2f0 0x55c6d056d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d019c2f0 0x55c6d056d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:49392/0 (socket says 172.21.15.71:49392) 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dc8a00640 1 -- 172.21.15.71:0/1097566616 learned_addr learned my addr 172.21.15.71:0/1097566616 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d01c51b0 0x55c6d057dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.775+0000 7f4dc3400640 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d057d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dc8a00640 1 -- 172.21.15.71:0/1097566616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d01c51b0 msgr2=0x55c6d057dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d01c51b0 0x55c6d057dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dc8a00640 1 -- 172.21.15.71:0/1097566616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 msgr2=0x55c6d057d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d057d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dc8a00640 1 -- 172.21.15.71:0/1097566616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6d0564c00 con 0x55c6d019c2f0 2024-05-27T09:56:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dc3400640 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d057d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d019c2f0 0x55c6d056d240 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc003d50 tx=0x7f4dbc005d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17cc34e260178b09 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dafe00640 1 -- 172.21.15.71:0/1097566616 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc031bb0 con 0x55c6d019c2f0 2024-05-27T09:56:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dafe00640 1 -- 172.21.15.71:0/1097566616 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dbc036070 con 0x55c6d019c2f0 2024-05-27T09:56:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.776+0000 7f4dafe00640 1 -- 172.21.15.71:0/1097566616 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc004000 con 0x55c6d019c2f0 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.777+0000 7f4dd1a27740 1 -- 172.21.15.71:0/1097566616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d019c2f0 msgr2=0x55c6d056d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.777+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d019c2f0 0x55c6d056d240 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc003d50 tx=0x7f4dbc005d80 comp rx=0 tx=0).stop 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.777+0000 7f4dd1a27740 1 -- 172.21.15.71:0/1097566616 shutdown_connections 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.777+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d01c51b0 0x55c6d057dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.777+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01a44d0 0x55c6d057d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.777+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/1097566616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d019c2f0 0x55c6d056d240 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.777+0000 7f4dd1a27740 1 -- 172.21.15.71:0/1097566616 >> 172.21.15.71:0/1097566616 conn(0x55c6d01b9300 msgr2=0x55c6d0571c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.778+0000 7f4dd1a27740 1 -- 172.21.15.71:0/1097566616 shutdown_connections 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.778+0000 7f4dd1a27740 1 -- 172.21.15.71:0/1097566616 wait complete. 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.778+0000 7f4dd1a27740 1 -- start start 2024-05-27T09:56:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.778+0000 7f4dd1a27740 1 Processor -- start 2024-05-27T09:56:24.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0576b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01a44d0 0x55c6d05770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dd1a27740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01c51b0 0x55c6d05ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.781 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41b02f0 con 0x55c6d01c51b0 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41b1760 con 0x55c6d019c2f0 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dd1a27740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41b09c0 con 0x55c6d01a44d0 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dd1a27740 10 client.0 _ll_register_callbacks cb 0x7f4db0009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dc3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01a44d0 0x55c6d05770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0576b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dc3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01a44d0 0x55c6d05770b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:49406/0 (socket says 172.21.15.71:49406) 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01c51b0 0x55c6d05ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.779+0000 7f4dc3400640 1 -- 172.21.15.71:0/480939834 learned_addr learned my addr 172.21.15.71:0/480939834 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dc8a00640 1 -- 172.21.15.71:0/480939834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01a44d0 msgr2=0x55c6d05770b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01a44d0 0x55c6d05770b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dc8a00640 1 -- 172.21.15.71:0/480939834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01c51b0 msgr2=0x55c6d05ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01c51b0 0x55c6d05ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dc8a00640 1 -- 172.21.15.71:0/480939834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6d0577950 con 0x55c6d019c2f0 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dc3400640 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01a44d0 0x55c6d05770b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dc8a00640 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0576b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc02a900 tx=0x7f4dbc02b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdcaee5fb4a7de37 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dad600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dad600640 1 -- 172.21.15.71:0/480939834 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0317d0 con 0x55c6d019c2f0 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dad600640 1 -- 172.21.15.71:0/480939834 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f4dbc031bb0 con 0x55c6d019c2f0 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.780+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dbc036070 con 0x55c6d019c2f0 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dad600640 1 -- 172.21.15.71:0/480939834 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4dbc031dd0 con 0x55c6d019c2f0 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 10 client.26711 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c6d05eb6a0 con 0x55c6d019c2f0 2024-05-27T09:56:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dad600640 1 -- 172.21.15.71:0/480939834 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dbc036070 con 0x55c6d019c2f0 2024-05-27T09:56:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dad600640 1 -- 172.21.15.71:0/480939834 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f4dbc043070 con 0x55c6d019c2f0 2024-05-27T09:56:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 10 client.26711 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 10 client.26711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 20 client.26711 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d01591c0 0x55c6d05ed930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 4 client.26711 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:56:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.781+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c6d0568130 con 0x55c6d01591c0 2024-05-27T09:56:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.782+0000 7f4dc3400640 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d01591c0 0x55c6d05ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.782+0000 7f4dc3400640 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d01591c0 0x55c6d05ed930 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb88bdbaaea15d34 server_cookie=8bd45b739630e4dc in_seq=0 out_seq=0 2024-05-27T09:56:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.782+0000 7f4dad600640 10 client.26711 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dad600640 1 -- 172.21.15.71:0/480939834 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c6d0568130 con 0x55c6d01591c0 2024-05-27T09:56:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dad600640 10 client.26711 handle_command_reply: tid=0 2024-05-27T09:56:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 client.26711 shutdown 2024-05-27T09:56:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 msgr2=0x55c6d0576b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0576b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc02a900 tx=0x7f4dbc02b040 comp rx=0 tx=0).stop 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 shutdown_connections 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55c6d01591c0 0x55c6d05ed930 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c6d01c51b0 0x55c6d05ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c6d01a44d0 0x55c6d05770b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 --2- 172.21.15.71:0/480939834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c6d019c2f0 0x55c6d0576b70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dad600640 0 client.26711 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 >> 172.21.15.71:0/480939834 conn(0x55c6d01b9300 msgr2=0x55c6d056c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 shutdown_connections 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.797+0000 7f4dd1a27740 1 -- 172.21.15.71:0/480939834 wait complete. 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.798+0000 7f4dd1a27740 20 client.26711 trim_cache size 0 max 16384 2024-05-27T09:56:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:56:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:56:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:56:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.798+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4da80b2950 msgr2=0x7f4da80b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.798+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4da80b2950 0x7f4da80b4e60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c6d0565350 tx=0x7f4db4009520 comp rx=0 tx=0).stop 2024-05-27T09:56:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.798+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc4104d90 msgr2=0x7f4dc41a25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.798+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc4104d90 0x7f4dc41a25e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4db400ea60 tx=0x7f4db400ef20 comp rx=0 tx=0).stop 2024-05-27T09:56:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 shutdown_connections 2024-05-27T09:56:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f4da80b2950 0x7f4da80b4e60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dc410e1e0 0x7f4dc419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dc410b7f0 0x7f4dc41a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 --2- 172.21.15.71:0/2009261579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dc4104d90 0x7f4dc41a25e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 >> 172.21.15.71:0/2009261579 conn(0x7f4dc40782d0 msgr2=0x7f4dc410f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 shutdown_connections 2024-05-27T09:56:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:24.799+0000 7f4dcaa00640 1 -- 172.21.15.71:0/2009261579 wait complete. 2024-05-27T09:56:25.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:24 smithi071 ceph-mon[31451]: pgmap v267: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.0 MiB/s wr, 293 op/s 2024-05-27T09:56:25.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:24 smithi122 ceph-mon[36436]: pgmap v267: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.0 MiB/s wr, 293 op/s 2024-05-27T09:56:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:24 smithi072 ceph-mon[35951]: pgmap v267: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.0 MiB/s wr, 293 op/s 2024-05-27T09:56:27.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:26 smithi122 ceph-mon[36436]: pgmap v268: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.0 MiB/s wr, 293 op/s 2024-05-27T09:56:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:26 smithi071 ceph-mon[31451]: pgmap v268: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.0 MiB/s wr, 293 op/s 2024-05-27T09:56:27.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:26 smithi072 ceph-mon[35951]: pgmap v268: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.0 MiB/s wr, 293 op/s 2024-05-27T09:56:29.078 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:28 smithi072 ceph-mon[35951]: pgmap v269: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-05-27T09:56:29.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:28 smithi122 ceph-mon[36436]: pgmap v269: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-05-27T09:56:29.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:28 smithi071 ceph-mon[31451]: pgmap v269: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-05-27T09:56:31.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:30 smithi122 ceph-mon[36436]: pgmap v270: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 388 op/s 2024-05-27T09:56:31.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:30 smithi071 ceph-mon[31451]: pgmap v270: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 388 op/s 2024-05-27T09:56:31.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:30 smithi072 ceph-mon[35951]: pgmap v270: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 388 op/s 2024-05-27T09:56:33.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:32 smithi122 ceph-mon[36436]: pgmap v271: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 562 op/s 2024-05-27T09:56:33.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:32 smithi071 ceph-mon[31451]: pgmap v271: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 562 op/s 2024-05-27T09:56:33.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:32 smithi072 ceph-mon[35951]: pgmap v271: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 562 op/s 2024-05-27T09:56:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:34 smithi071 ceph-mon[31451]: pgmap v272: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.0 MiB/s wr, 368 op/s 2024-05-27T09:56:35.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:34 smithi122 ceph-mon[36436]: pgmap v272: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.0 MiB/s wr, 368 op/s 2024-05-27T09:56:35.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:34 smithi072 ceph-mon[35951]: pgmap v272: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.0 MiB/s wr, 368 op/s 2024-05-27T09:56:37.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:36 smithi122 ceph-mon[36436]: pgmap v273: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.0 MiB/s wr, 368 op/s 2024-05-27T09:56:37.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:36 smithi071 ceph-mon[31451]: pgmap v273: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.0 MiB/s wr, 368 op/s 2024-05-27T09:56:37.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:36 smithi072 ceph-mon[35951]: pgmap v273: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.0 MiB/s wr, 368 op/s 2024-05-27T09:56:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 -- 172.21.15.71:0/888580339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 msgr2=0x7f2350105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 --2- 172.21.15.71:0/888580339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f2350105190 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2344009900 tx=0x7f234402a3f0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 -- 172.21.15.71:0/888580339 shutdown_connections 2024-05-27T09:56:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 --2- 172.21.15.71:0/888580339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f235010e1d0 0x7f23501106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 --2- 172.21.15.71:0/888580339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235010b7e0 0x7f235010dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 --2- 172.21.15.71:0/888580339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f2350105190 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 -- 172.21.15.71:0/888580339 >> 172.21.15.71:0/888580339 conn(0x7f23500fe380 msgr2=0x7f23501007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.033+0000 7f2357400640 1 -- 172.21.15.71:0/888580339 shutdown_connections 2024-05-27T09:56:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.034+0000 7f2357400640 1 -- 172.21.15.71:0/888580339 wait complete. 2024-05-27T09:56:38.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.035+0000 7f2357400640 1 Processor -- start 2024-05-27T09:56:38.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.035+0000 7f2357400640 1 -- start start 2024-05-27T09:56:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.035+0000 7f2357400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f23501a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2357400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235010b7e0 0x7f23501a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2357400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f235010e1d0 0x7f235019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2357400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2350113e80 con 0x7f235010e1d0 2024-05-27T09:56:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2357400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2350113d00 con 0x7f2350104d80 2024-05-27T09:56:38.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2357400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2350114000 con 0x7f235010b7e0 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f23501a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f234fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235010b7e0 0x7f23501a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f23501a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46764/0 (socket says 172.21.15.71:46764) 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 -- 172.21.15.71:0/26171427 learned_addr learned my addr 172.21.15.71:0/26171427 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f234fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235010b7e0 0x7f23501a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59614/0 (socket says 172.21.15.71:59614) 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2355400640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f235010e1d0 0x7f235019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 -- 172.21.15.71:0/26171427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235010b7e0 msgr2=0x7f23501a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235010b7e0 0x7f23501a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 -- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f235010e1d0 msgr2=0x7f235019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f235010e1d0 0x7f235019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.036+0000 7f2354a00640 1 -- 172.21.15.71:0/26171427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235019ae70 con 0x7f2350104d80 2024-05-27T09:56:38.038 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.037+0000 7f2354a00640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f23501a0520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2344005ab0 tx=0x7f2344003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.037+0000 7f234d600640 1 -- 172.21.15.71:0/26171427 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234403f070 con 0x7f2350104d80 2024-05-27T09:56:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.037+0000 7f234d600640 1 -- 172.21.15.71:0/26171427 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2344031d60 con 0x7f2350104d80 2024-05-27T09:56:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.037+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235019b0a0 con 0x7f2350104d80 2024-05-27T09:56:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.037+0000 7f234d600640 1 -- 172.21.15.71:0/26171427 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344035030 con 0x7f2350104d80 2024-05-27T09:56:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.037+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235019b590 con 0x7f2350104d80 2024-05-27T09:56:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.040+0000 7f235e3f4740 1 Processor -- start 2024-05-27T09:56:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f234d600640 1 -- 172.21.15.71:0/26171427 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2344042070 con 0x7f2350104d80 2024-05-27T09:56:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f235e3f4740 1 -- start start 2024-05-27T09:56:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f235e3f4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555ce152cb90 con 0x555ce11f02f0 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f235e3f4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555ce151c730 con 0x555ce11f84d0 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.041+0000 7f235e3f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555ce1520770 con 0x555ce12191b0 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15bfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59626/0 (socket says 172.21.15.71:59626) 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 -- 172.21.15.71:0/1438884866 learned_addr learned my addr 172.21.15.71:0/1438884866 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2354a00640 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f234fe00640 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 -- 172.21.15.71:0/1438884866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 msgr2=0x555ce15c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 -- 172.21.15.71:0/1438884866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 msgr2=0x555ce15c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 -- 172.21.15.71:0/1438884866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ce14b58b0 con 0x555ce12191b0 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.042+0000 7f2355400640 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15bfc70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2348009f90 tx=0x7f2348010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=121c72f84b0eb990 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.043+0000 7f2341c00640 1 -- 172.21.15.71:0/1438884866 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348011700 con 0x555ce12191b0 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.043+0000 7f2341c00640 1 -- 172.21.15.71:0/1438884866 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2348011d50 con 0x555ce12191b0 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.043+0000 7f2341c00640 1 -- 172.21.15.71:0/1438884866 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348019da0 con 0x555ce12191b0 2024-05-27T09:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.043+0000 7f234d600640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23380b2950 0x7f23380b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 -- 172.21.15.71:0/1438884866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 msgr2=0x555ce15bfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15bfc70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2348009f90 tx=0x7f2348010860 comp rx=0 tx=0).stop 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f234d600640 1 -- 172.21.15.71:0/26171427 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2344102e90 con 0x7f2350104d80 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f2354a00640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23380b2950 0x7f23380b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 -- 172.21.15.71:0/1438884866 shutdown_connections 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 --2- 172.21.15.71:0/1438884866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15bfc70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 -- 172.21.15.71:0/1438884866 >> 172.21.15.71:0/1438884866 conn(0x555ce120d300 msgr2=0x555ce15bc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 -- 172.21.15.71:0/1438884866 shutdown_connections 2024-05-27T09:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f235e3f4740 1 -- 172.21.15.71:0/1438884866 wait complete. 2024-05-27T09:56:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.044+0000 7f2354a00640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23380b2950 0x7f23380b4e60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2344100690 tx=0x7f2344031400 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.045+0000 7f235e3f4740 1 -- start start 2024-05-27T09:56:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.045+0000 7f235e3f4740 1 Processor -- start 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.045+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.045+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f84d0 0x555ce15ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.045+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.045+0000 7f235e3f4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555ce1202790 con 0x555ce11f02f0 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f235e3f4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555ce14c4bc0 con 0x555ce12191b0 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f235e3f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555ce15ccda0 con 0x555ce11f84d0 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f235e3f4740 10 client.0 _ll_register_callbacks cb 0x555ce14a2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f234fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f84d0 0x555ce15ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f2355400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f2355400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52516/0 (socket says 172.21.15.71:52516) 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f234fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f84d0 0x555ce15ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59630/0 (socket says 172.21.15.71:59630) 2024-05-27T09:56:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f2355400640 1 -- 172.21.15.71:0/423081557 learned_addr learned my addr 172.21.15.71:0/423081557 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f2355400640 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f234fe00640 1 -- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 msgr2=0x555ce15d60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f234fe00640 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f234fe00640 1 -- 172.21.15.71:0/423081557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 msgr2=0x555ce15c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f234fe00640 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.046+0000 7f234fe00640 1 -- 172.21.15.71:0/423081557 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ce1231210 con 0x555ce11f84d0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f234fe00640 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f84d0 0x555ce15ca340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f235019be40 tx=0x7f233c00be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524e30a14d7e0e35 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f2336000640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f2336000640 1 -- 172.21.15.71:0/423081557 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c005020 con 0x555ce11f84d0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2348011d50 con 0x555ce11f84d0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f2336000640 1 -- 172.21.15.71:0/423081557 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f233c0051c0 con 0x555ce11f84d0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f2336000640 1 -- 172.21.15.71:0/423081557 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f233c0053c0 con 0x555ce11f84d0 2024-05-27T09:56:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f235e3f4740 10 client.26752 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555ce12fd620 con 0x555ce11f84d0 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f2336000640 1 -- 172.21.15.71:0/423081557 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2348011d50 con 0x555ce11f84d0 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.047+0000 7f2336000640 1 -- 172.21.15.71:0/423081557 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f233c019030 con 0x555ce11f84d0 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f235e3f4740 10 client.26752 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f235e3f4740 10 client.26752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f235e3f4740 20 client.26752 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f235e3f4740 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce11d7d80 0x555ce15dc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f235e3f4740 4 client.26752 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ce152eae0 con 0x555ce11d7d80 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f2355400640 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce11d7d80 0x555ce15dc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f2355400640 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce11d7d80 0x555ce15dc0f0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6803250dad0c6ce server_cookie=377ea3c6d86ae8bf in_seq=0 out_seq=0 2024-05-27T09:56:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.048+0000 7f2336000640 10 client.26752 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.049+0000 7f2336000640 1 -- 172.21.15.71:0/423081557 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x555ce152eae0 con 0x555ce11d7d80 2024-05-27T09:56:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.049+0000 7f2336000640 10 client.26752 handle_command_reply: tid=0 2024-05-27T09:56:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.049+0000 7f235e3f4740 1 client.26752 shutdown 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f84d0 msgr2=0x555ce15ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f84d0 0x555ce15ca340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f235019be40 tx=0x7f233c00be80 comp rx=0 tx=0).stop 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 shutdown_connections 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f84d0 0x555ce15ca340 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce11d7d80 0x555ce15dc0f0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 --2- 172.21.15.71:0/423081557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f2336000640 0 client.26752 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 >> 172.21.15.71:0/423081557 conn(0x555ce120d300 msgr2=0x555ce15bfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 shutdown_connections 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 1 -- 172.21.15.71:0/423081557 wait complete. 2024-05-27T09:56:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.050+0000 7f235e3f4740 20 client.26752 trim_cache size 0 max 16384 2024-05-27T09:56:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.071+0000 7f235e3f4740 1 Processor -- start 2024-05-27T09:56:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.071+0000 7f235e3f4740 1 -- start start 2024-05-27T09:56:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15b7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15d5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15d6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f235e3f4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23501b01b0 con 0x555ce11f02f0 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f235e3f4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23501ada80 con 0x555ce11f84d0 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f235e3f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23501ab8f0 con 0x555ce12191b0 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f234fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15d5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f234fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15d5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46786/0 (socket says 172.21.15.71:46786) 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f234fe00640 1 -- 172.21.15.71:0/888488522 learned_addr learned my addr 172.21.15.71:0/888488522 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.072+0000 7f2355400640 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.073+0000 7f234fe00640 1 -- 172.21.15.71:0/888488522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 msgr2=0x555ce15d6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.073+0000 7f234fe00640 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15d6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.073+0000 7f234fe00640 1 -- 172.21.15.71:0/888488522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 msgr2=0x555ce15b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.073+0000 7f234fe00640 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.073+0000 7f234fe00640 1 -- 172.21.15.71:0/888488522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ce15bcd20 con 0x555ce11f84d0 2024-05-27T09:56:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.073+0000 7f234fe00640 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15d5e40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f233c011640 tx=0x7f233c005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba5bbdb25099f972 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.074+0000 7f2341200640 1 -- 172.21.15.71:0/888488522 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c027040 con 0x555ce11f84d0 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.074+0000 7f2341200640 1 -- 172.21.15.71:0/888488522 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f233c005870 con 0x555ce11f84d0 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.074+0000 7f2341200640 1 -- 172.21.15.71:0/888488522 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c02bd10 con 0x555ce11f84d0 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.075+0000 7f235e3f4740 1 -- 172.21.15.71:0/888488522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 msgr2=0x555ce15d5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.075+0000 7f235e3f4740 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15d5e40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f233c011640 tx=0x7f233c005b90 comp rx=0 tx=0).stop 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.075+0000 7f235e3f4740 1 -- 172.21.15.71:0/888488522 shutdown_connections 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.075+0000 7f235e3f4740 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce12191b0 0x555ce15d6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.075+0000 7f235e3f4740 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce11f84d0 0x555ce15d5e40 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f233c011640 tx=0x7f233c005b90 comp rx=0 tx=0).stop 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.075+0000 7f235e3f4740 1 --2- 172.21.15.71:0/888488522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11f02f0 0x555ce15b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.075+0000 7f235e3f4740 1 -- 172.21.15.71:0/888488522 >> 172.21.15.71:0/888488522 conn(0x555ce120d300 msgr2=0x555ce15c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.076+0000 7f235e3f4740 1 -- 172.21.15.71:0/888488522 shutdown_connections 2024-05-27T09:56:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.076+0000 7f235e3f4740 1 -- 172.21.15.71:0/888488522 wait complete. 2024-05-27T09:56:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 -- start start 2024-05-27T09:56:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 Processor -- start 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f02f0 0x555ce15d2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11ad1c0 0x555ce15cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23501abf40 con 0x555ce11ad1c0 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23501ad3b0 con 0x555ce12191b0 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.077+0000 7f235e3f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23501ac610 con 0x555ce11f02f0 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f235e3f4740 10 client.0 _ll_register_callbacks cb 0x7f233c005cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f2355400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f02f0 0x555ce15d2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f234fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f2355400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f02f0 0x555ce15d2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59640/0 (socket says 172.21.15.71:59640) 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f2355400640 1 -- 172.21.15.71:0/2272080334 learned_addr learned my addr 172.21.15.71:0/2272080334 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f2355400640 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11ad1c0 0x555ce15cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f234fe00640 1 -- 172.21.15.71:0/2272080334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f02f0 msgr2=0x555ce15d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f234fe00640 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f02f0 0x555ce15d2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f234fe00640 1 -- 172.21.15.71:0/2272080334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11ad1c0 msgr2=0x555ce15cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f234fe00640 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11ad1c0 0x555ce15cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.078+0000 7f234fe00640 1 -- 172.21.15.71:0/2272080334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ce15cde70 con 0x555ce12191b0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f234fe00640 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d2840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x555ce15dc740 tx=0x7f233c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=884eabe428b5b344 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f2336000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f2336000640 1 -- 172.21.15.71:0/2272080334 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c038020 con 0x555ce12191b0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f2336000640 1 -- 172.21.15.71:0/2272080334 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f233c02bb90 con 0x555ce12191b0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f233c005870 con 0x555ce12191b0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f2336000640 1 -- 172.21.15.71:0/2272080334 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f233c043050 con 0x555ce12191b0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f235e3f4740 10 client.26729 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.079+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555ce1644280 con 0x555ce12191b0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f2336000640 1 -- 172.21.15.71:0/2272080334 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f233c005870 con 0x555ce12191b0 2024-05-27T09:56:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f2336000640 1 -- 172.21.15.71:0/2272080334 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f233c02a070 con 0x555ce12191b0 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f235e3f4740 10 client.26729 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f235e3f4740 10 client.26729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f235e3f4740 20 client.26729 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f235e3f4740 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce16448d0 0x555ce1646cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f235e3f4740 4 client.26729 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ce15282c0 con 0x555ce16448d0 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.080+0000 7f2355400640 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce16448d0 0x555ce1646cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.081+0000 7f2336000640 10 client.26729 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.081+0000 7f2355400640 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce16448d0 0x555ce1646cf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e53de610f0b41fb server_cookie=9e49d1578778f959 in_seq=0 out_seq=0 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.096+0000 7f2336000640 1 -- 172.21.15.71:0/2272080334 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x555ce15282c0 con 0x555ce16448d0 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.096+0000 7f2336000640 10 client.26729 handle_command_reply: tid=0 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.096+0000 7f235e3f4740 1 client.26729 shutdown 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 msgr2=0x555ce15d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d2840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x555ce15dc740 tx=0x7f233c02ba20 comp rx=0 tx=0).stop 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 shutdown_connections 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x555ce16448d0 0x555ce1646cf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555ce11ad1c0 0x555ce15cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555ce12191b0 0x555ce15d2840 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 --2- 172.21.15.71:0/2272080334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555ce11f02f0 0x555ce15d2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f2336000640 0 client.26729 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 >> 172.21.15.71:0/2272080334 conn(0x555ce120d300 msgr2=0x555ce15ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 shutdown_connections 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 1 -- 172.21.15.71:0/2272080334 wait complete. 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.097+0000 7f235e3f4740 20 client.26729 trim_cache size 0 max 16384 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:56:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:56:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23380b2950 msgr2=0x7f23380b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23380b2950 0x7f23380b4e60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2344100690 tx=0x7f2344031400 comp rx=0 tx=0).stop 2024-05-27T09:56:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 msgr2=0x7f23501a0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f23501a0520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2344005ab0 tx=0x7f2344003cd0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 shutdown_connections 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23380b2950 0x7f23380b4e60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f235010e1d0 0x7f235019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235010b7e0 0x7f23501a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 --2- 172.21.15.71:0/26171427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2350104d80 0x7f23501a0520 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 >> 172.21.15.71:0/26171427 conn(0x7f23500fe380 msgr2=0x7f235010e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 shutdown_connections 2024-05-27T09:56:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:38.098+0000 7f2357400640 1 -- 172.21.15.71:0/26171427 wait complete. 2024-05-27T09:56:39.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:38 smithi122 ceph-mon[36436]: pgmap v274: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 530 op/s 2024-05-27T09:56:39.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:38 smithi071 ceph-mon[31451]: pgmap v274: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 530 op/s 2024-05-27T09:56:39.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:38 smithi072 ceph-mon[35951]: pgmap v274: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 530 op/s 2024-05-27T09:56:40.415 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-27T09:56:40.415 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.3 2024-05-27T09:56:40.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:56:40.913 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:56:41.116 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:40 smithi071 ceph-mon[31451]: pgmap v275: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-05-27T09:56:41.149 INFO:tasks.workunit.client.0.smithi071.stdout:10000 mapread 0x33cc4e3 thru 0x33cec16 (0x2734 bytes) 2024-05-27T09:56:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:40 smithi122 ceph-mon[36436]: pgmap v275: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-05-27T09:56:41.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:40 smithi072 ceph-mon[35951]: pgmap v275: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-05-27T09:56:43.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:42 smithi071 ceph-mon[31451]: pgmap v276: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 522 op/s 2024-05-27T09:56:43.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:42 smithi122 ceph-mon[36436]: pgmap v276: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 522 op/s 2024-05-27T09:56:43.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:42 smithi072 ceph-mon[35951]: pgmap v276: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 522 op/s 2024-05-27T09:56:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.348+0000 7f8ca0200700 1 -- 172.21.15.71:0/3424699802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98076420 msgr2=0x7f8c981106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.348+0000 7f8ca0200700 1 --2- 172.21.15.71:0/3424699802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98076420 0x7f8c981106d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8c840098f0 tx=0x7f8c84009c00 comp rx=0 tx=0).stop 2024-05-27T09:56:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.348+0000 7f8ca0200700 1 -- 172.21.15.71:0/3424699802 shutdown_connections 2024-05-27T09:56:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.349+0000 7f8ca0200700 1 --2- 172.21.15.71:0/3424699802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98110c10 0x7f8c98113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.349+0000 7f8ca0200700 1 --2- 172.21.15.71:0/3424699802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c98075ad0 0x7f8c98075ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.349+0000 7f8ca0200700 1 --2- 172.21.15.71:0/3424699802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98076420 0x7f8c981106d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.349+0000 7f8ca0200700 1 -- 172.21.15.71:0/3424699802 >> 172.21.15.71:0/3424699802 conn(0x7f8c98100030 msgr2=0x7f8c98102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.349+0000 7f8ca0200700 1 -- 172.21.15.71:0/3424699802 shutdown_connections 2024-05-27T09:56:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.349+0000 7f8ca0200700 1 -- 172.21.15.71:0/3424699802 wait complete. 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.350+0000 7f8ca0200700 1 Processor -- start 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.350+0000 7f8ca0200700 1 -- start start 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8ca0200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c98075ad0 0x7f8c9819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8ca0200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98076420 0x7f8c9819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8ca0200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98110c10 0x7f8c981a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8ca0200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c98116690 con 0x7f8c98075ad0 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8ca0200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8c98116510 con 0x7f8c98110c10 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8ca0200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c98116810 con 0x7f8c98076420 2024-05-27T09:56:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8c9ce00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98076420 0x7f8c9819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8c9e200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98110c10 0x7f8c981a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8c9ce00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98076420 0x7f8c9819d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:59662/0 (socket says 172.21.15.71:59662) 2024-05-27T09:56:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8c9e200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98110c10 0x7f8c981a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46820/0 (socket says 172.21.15.71:46820) 2024-05-27T09:56:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8c9ce00700 1 -- 172.21.15.71:0/1622259139 learned_addr learned my addr 172.21.15.71:0/1622259139 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.351+0000 7f8c9d800700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c98075ad0 0x7f8c9819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c9ce00700 1 -- 172.21.15.71:0/1622259139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98110c10 msgr2=0x7f8c981a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c9ce00700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98110c10 0x7f8c981a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c9ce00700 1 -- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c98075ad0 msgr2=0x7f8c9819d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c9ce00700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c98075ad0 0x7f8c9819d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c9ce00700 1 -- 172.21.15.71:0/1622259139 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c981a1f30 con 0x7f8c98076420 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c9e200700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98110c10 0x7f8c981a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c9ce00700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98076420 0x7f8c9819d600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009230 tx=0x7f8c8400f990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c96000700 1 -- 172.21.15.71:0/1622259139 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c840050c0 con 0x7f8c98076420 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c96000700 1 -- 172.21.15.71:0/1622259139 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c8400b560 con 0x7f8c98076420 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c981a21c0 con 0x7f8c98076420 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.352+0000 7f8c96000700 1 -- 172.21.15.71:0/1622259139 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84003a40 con 0x7f8c98076420 2024-05-27T09:56:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.353+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c981a9b40 con 0x7f8c98076420 2024-05-27T09:56:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.355+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c98077210 con 0x7f8c98076420 2024-05-27T09:56:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.359+0000 7f8c96000700 1 -- 172.21.15.71:0/1622259139 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f8c8400ba10 con 0x7f8c98076420 2024-05-27T09:56:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.360+0000 7f8c96000700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8c800b2a70 0x7f8c800b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.361+0000 7f8c96000700 1 -- 172.21.15.71:0/1622259139 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f8c840e34d0 con 0x7f8c98076420 2024-05-27T09:56:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.361+0000 7f8c9d800700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8c800b2a70 0x7f8c800b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.361+0000 7f8c9d800700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8c800b2a70 0x7f8c800b4f80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009750 tx=0x7f8c8c009310 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.365+0000 7f8c96000700 1 -- 172.21.15.71:0/1622259139 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8c84013030 con 0x7f8c98076420 2024-05-27T09:56:43.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.687+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c9802e5e0 con 0x7f8c98076420 2024-05-27T09:56:43.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.688+0000 7f8c96000700 1 -- 172.21.15.71:0/1622259139 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f8c840aaf40 con 0x7f8c98076420 2024-05-27T09:56:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:56:43.690 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:56:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8c800b2a70 msgr2=0x7f8c800b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8c800b2a70 0x7f8c800b4f80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009750 tx=0x7f8c8c009310 comp rx=0 tx=0).stop 2024-05-27T09:56:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98076420 msgr2=0x7f8c9819d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98076420 0x7f8c9819d600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009230 tx=0x7f8c8400f990 comp rx=0 tx=0).stop 2024-05-27T09:56:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 shutdown_connections 2024-05-27T09:56:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8c800b2a70 0x7f8c800b4f80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c98110c10 0x7f8c981a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c98075ad0 0x7f8c9819d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 --2- 172.21.15.71:0/1622259139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c98076420 0x7f8c9819d600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 >> 172.21.15.71:0/1622259139 conn(0x7f8c98100030 msgr2=0x7f8c98101ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 shutdown_connections 2024-05-27T09:56:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:43.693+0000 7f8ca0200700 1 -- 172.21.15.71:0/1622259139 wait complete. 2024-05-27T09:56:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:56:43.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:43 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1622259139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:56:44.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:43 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1622259139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:56:44.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:43 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1622259139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:56:44.568 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 142.3 --await-for 45.0' 2024-05-27T09:56:44.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 142.3 --await-for 45.0 2024-05-27T09:56:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:56:45.183 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:44 smithi071 ceph-mon[31451]: pgmap v277: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-05-27T09:56:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:44 smithi122 ceph-mon[36436]: pgmap v277: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-05-27T09:56:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:44 smithi072 ceph-mon[35951]: pgmap v277: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-05-27T09:56:46.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:45 smithi071 ceph-mon[31451]: pgmap v278: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-05-27T09:56:46.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:45 smithi122 ceph-mon[36436]: pgmap v278: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-05-27T09:56:46.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:45 smithi072 ceph-mon[35951]: pgmap v278: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 -- 172.21.15.71:0/165099611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 msgr2=0x7f99c4103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 --2- 172.21.15.71:0/165099611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 0x7f99c4103570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009990 tx=0x7f99b4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 -- 172.21.15.71:0/165099611 shutdown_connections 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 --2- 172.21.15.71:0/165099611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 0x7f99c4113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 --2- 172.21.15.71:0/165099611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 0x7f99c4103570 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 --2- 172.21.15.71:0/165099611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c4103ab0 0x7f99c41107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 -- 172.21.15.71:0/165099611 >> 172.21.15.71:0/165099611 conn(0x7f99c4078df0 msgr2=0x7f99c4079230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 -- 172.21.15.71:0/165099611 shutdown_connections 2024-05-27T09:56:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.554+0000 7f99c9200700 1 -- 172.21.15.71:0/165099611 wait complete. 2024-05-27T09:56:47.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 Processor -- start 2024-05-27T09:56:47.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 -- start start 2024-05-27T09:56:47.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 0x7f99c419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c4103ab0 0x7f99c419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 0x7f99c41a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4116700 con 0x7f99c4103ab0 2024-05-27T09:56:47.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4116580 con 0x7f99c4103160 2024-05-27T09:56:47.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.556+0000 7f99c9200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4116880 con 0x7f99c4110d10 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 0x7f99c41a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 0x7f99c41a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37950/0 (socket says 172.21.15.71:37950) 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 -- 172.21.15.71:0/2642044247 learned_addr learned my addr 172.21.15.71:0/2642044247 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c1400700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c4103ab0 0x7f99c419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c1e00700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 0x7f99c419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 -- 172.21.15.71:0/2642044247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 msgr2=0x7f99c419d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 0x7f99c419d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 -- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c4103ab0 msgr2=0x7f99c419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c4103ab0 0x7f99c419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c2800700 1 -- 172.21.15.71:0/2642044247 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c41a1fa0 con 0x7f99c4110d10 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.557+0000 7f99c1400700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c4103ab0 0x7f99c419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:47.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.558+0000 7f99c2800700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 0x7f99c41a1900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00ef30 tx=0x7f99bc00c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:47.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.558+0000 7f99baa00700 1 -- 172.21.15.71:0/2642044247 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0092e0 con 0x7f99c4110d10 2024-05-27T09:56:47.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.558+0000 7f99baa00700 1 -- 172.21.15.71:0/2642044247 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99bc004bb0 con 0x7f99c4110d10 2024-05-27T09:56:47.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c41a2230 con 0x7f99c4110d10 2024-05-27T09:56:47.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c41a9bb0 con 0x7f99c4110d10 2024-05-27T09:56:47.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.558+0000 7f99baa00700 1 -- 172.21.15.71:0/2642044247 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004280 con 0x7f99c4110d10 2024-05-27T09:56:47.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.561+0000 7f99baa00700 1 -- 172.21.15.71:0/2642044247 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f99bc01b030 con 0x7f99c4110d10 2024-05-27T09:56:47.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.563+0000 7f99baa00700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99a80b2a70 0x7f99a80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.563+0000 7f99baa00700 1 -- 172.21.15.71:0/2642044247 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f99bc0e20f0 con 0x7f99c4110d10 2024-05-27T09:56:47.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.564+0000 7f99c1e00700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99a80b2a70 0x7f99a80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.564+0000 7f99c1e00700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99a80b2a70 0x7f99a80b4f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f99b400b2e0 tx=0x7f99b4005fb0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.565+0000 7f99d7cc1b80 1 Processor -- start 2024-05-27T09:56:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.565+0000 7f99d7cc1b80 1 -- start start 2024-05-27T09:56:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbe8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbe2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560ebbb0ffd0 con 0x560ebba62fd0 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560ebbaffb70 con 0x560ebbb4eb80 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560ebbb03bb0 con 0x560ebbbe2670 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99c1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99c1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:41630/0 (socket says 172.21.15.71:41630) 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99c1e00700 1 -- 172.21.15.71:0/3111523643 learned_addr learned my addr 172.21.15.71:0/3111523643 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99c2800700 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbe2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.566+0000 7f99c1400700 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbe8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99c1e00700 1 -- 172.21.15.71:0/3111523643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 msgr2=0x560ebbbe2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99c1e00700 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbe2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99c1e00700 1 -- 172.21.15.71:0/3111523643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 msgr2=0x560ebbbe8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99c1e00700 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbe8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99c1e00700 1 -- 172.21.15.71:0/3111523643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ebbac85b0 con 0x560ebbb4eb80 2024-05-27T09:56:47.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99c2800700 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbe2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:47.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99c1e00700 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe85c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f99b40056b0 tx=0x7f99b401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e42f2710173c56 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99af400700 1 -- 172.21.15.71:0/3111523643 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40056e0 con 0x560ebbb4eb80 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.567+0000 7f99af400700 1 -- 172.21.15.71:0/3111523643 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b402f930 con 0x560ebbb4eb80 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.568+0000 7f99af400700 1 -- 172.21.15.71:0/3111523643 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b400f8f0 con 0x560ebbb4eb80 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.568+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/3111523643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 msgr2=0x560ebbbe85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.568+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe85c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f99b40056b0 tx=0x7f99b401d000 comp rx=0 tx=0).stop 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/3111523643 shutdown_connections 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbe2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe85c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/3111523643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbe8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/3111523643 >> 172.21.15.71:0/3111523643 conn(0x560ebbafc520 msgr2=0x560ebbbdd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/3111523643 shutdown_connections 2024-05-27T09:56:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/3111523643 wait complete. 2024-05-27T09:56:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.569+0000 7f99d7cc1b80 1 -- start start 2024-05-27T09:56:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.570+0000 7f99d7cc1b80 1 Processor -- start 2024-05-27T09:56:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbec350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbb4eb80 0x560ebbbec890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbbe2670 0x560ebbbecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560ebba06130 con 0x560ebba62fd0 2024-05-27T09:56:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560ebbaa08f0 con 0x560ebbbe2670 2024-05-27T09:56:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560ebbbe3400 con 0x560ebbb4eb80 2024-05-27T09:56:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99d7cc1b80 10 client.0 _ll_register_callbacks cb 0x560ebbaa9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99c1e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99c1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbb4eb80 0x560ebbbec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99c1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbb4eb80 0x560ebbbec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37970/0 (socket says 172.21.15.71:37970) 2024-05-27T09:56:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99c1400700 1 -- 172.21.15.71:0/591133314 learned_addr learned my addr 172.21.15.71:0/591133314 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.571+0000 7f99c2800700 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbbe2670 0x560ebbbecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99c1400700 1 -- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbbe2670 msgr2=0x560ebbbecdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99c1400700 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbbe2670 0x560ebbbecdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99c1400700 1 -- 172.21.15.71:0/591133314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 msgr2=0x560ebbbec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99c1400700 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99c1400700 1 -- 172.21.15.71:0/591133314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ebba4fa60 con 0x560ebbb4eb80 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99c1e00700 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99c1400700 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbb4eb80 0x560ebbbec890 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99b0013790 tx=0x7f99b0013aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66e0483301c8a983 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.572+0000 7f99a3e00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.573+0000 7f99a3e00700 1 -- 172.21.15.71:0/591133314 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0004230 con 0x560ebbb4eb80 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.573+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b402f930 con 0x560ebbb4eb80 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.573+0000 7f99a3e00700 1 -- 172.21.15.71:0/591133314 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f99b00043d0 con 0x560ebbb4eb80 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.573+0000 7f99a3e00700 1 -- 172.21.15.71:0/591133314 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f99b0004830 con 0x560ebbb4eb80 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.573+0000 7f99d7cc1b80 10 client.26773 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.573+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560ebbad01f0 con 0x560ebbb4eb80 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99a3e00700 1 -- 172.21.15.71:0/591133314 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b402f930 con 0x560ebbb4eb80 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99a3e00700 1 -- 172.21.15.71:0/591133314 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f99b0003680 con 0x560ebbb4eb80 2024-05-27T09:56:47.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99d7cc1b80 10 client.26773 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99d7cc1b80 10 client.26773 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99d7cc1b80 20 client.26773 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbbfe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99d7cc1b80 4 client.26773 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ebbb11f20 con 0x560ebbbfc060 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.574+0000 7f99c1e00700 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbbfe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.575+0000 7f99c1e00700 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbbfe480 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc8a22fdcfdc0a4 server_cookie=353ef0dc99732f27 in_seq=0 out_seq=0 2024-05-27T09:56:47.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.575+0000 7f99a3e00700 10 client.26773 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99a3e00700 1 -- 172.21.15.71:0/591133314 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x560ebbb11f20 con 0x560ebbbfc060 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99a3e00700 10 client.26773 handle_command_reply: tid=0 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 client.26773 shutdown 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbb4eb80 msgr2=0x560ebbbec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbb4eb80 0x560ebbbec890 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99b0013790 tx=0x7f99b0013aa0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 shutdown_connections 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbbfe480 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99a3e00700 0 client.26773 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbbe2670 0x560ebbbecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/591133314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbb4eb80 0x560ebbbec890 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.576+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 >> 172.21.15.71:0/591133314 conn(0x560ebbafc520 msgr2=0x560ebbbdca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:47.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.577+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 shutdown_connections 2024-05-27T09:56:47.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.577+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/591133314 wait complete. 2024-05-27T09:56:47.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.577+0000 7f99d7cc1b80 20 client.26773 trim_cache size 0 max 16384 2024-05-27T09:56:47.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.601+0000 7f99d7cc1b80 1 Processor -- start 2024-05-27T09:56:47.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.601+0000 7f99d7cc1b80 1 -- start start 2024-05-27T09:56:47.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.602+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebba62fd0 0x560ebbbe1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.602+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.602+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebbbe2670 0x560ebbbe69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.602+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99a400fe50 con 0x560ebbbe2670 2024-05-27T09:56:47.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.602+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99a400d6e0 con 0x560ebbb4eb80 2024-05-27T09:56:47.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.602+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99a400b550 con 0x560ebba62fd0 2024-05-27T09:56:47.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c1e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebba62fd0 0x560ebbbe1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c1e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebba62fd0 0x560ebbbe1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:37976/0 (socket says 172.21.15.71:37976) 2024-05-27T09:56:47.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c1e00700 1 -- 172.21.15.71:0/1447354806 learned_addr learned my addr 172.21.15.71:0/1447354806 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:47.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c1400700 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c2800700 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebbbe2670 0x560ebbbe69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c1e00700 1 -- 172.21.15.71:0/1447354806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 msgr2=0x560ebbbe7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c1e00700 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.603+0000 7f99c1e00700 1 -- 172.21.15.71:0/1447354806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebbbe2670 msgr2=0x560ebbbe69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.604+0000 7f99c1e00700 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebbbe2670 0x560ebbbe69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.604+0000 7f99c1e00700 1 -- 172.21.15.71:0/1447354806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ebbbd99d0 con 0x560ebba62fd0 2024-05-27T09:56:47.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.604+0000 7f99c2800700 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebbbe2670 0x560ebbbe69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:47.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.604+0000 7f99c1e00700 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebba62fd0 0x560ebbbe1cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99b40096a0 tx=0x7f99b4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4cb959a706a14cd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:47.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.605+0000 7f99aea00700 1 -- 172.21.15.71:0/1447354806 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b400f520 con 0x560ebba62fd0 2024-05-27T09:56:47.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.605+0000 7f99aea00700 1 -- 172.21.15.71:0/1447354806 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b400f6c0 con 0x560ebba62fd0 2024-05-27T09:56:47.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.605+0000 7f99aea00700 1 -- 172.21.15.71:0/1447354806 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b402f760 con 0x560ebba62fd0 2024-05-27T09:56:47.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.606+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/1447354806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebba62fd0 msgr2=0x560ebbbe1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:47.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.606+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebba62fd0 0x560ebbbe1cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99b40096a0 tx=0x7f99b4009310 comp rx=0 tx=0).stop 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.606+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/1447354806 shutdown_connections 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.606+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebbbe2670 0x560ebbbe69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.606+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebba62fd0 0x560ebbbe1cd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.607+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/1447354806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbe7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.607+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/1447354806 >> 172.21.15.71:0/1447354806 conn(0x560ebbafc520 msgr2=0x560ebbbe9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.607+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/1447354806 shutdown_connections 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.607+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/1447354806 wait complete. 2024-05-27T09:56:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.607+0000 7f99d7cc1b80 1 -- start start 2024-05-27T09:56:47.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 1 Processor -- start 2024-05-27T09:56:47.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbf4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbf4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbf1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99a400bba0 con 0x560ebba62fd0 2024-05-27T09:56:47.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99a400d010 con 0x560ebbb4eb80 2024-05-27T09:56:47.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99a400c270 con 0x560ebbbe2670 2024-05-27T09:56:47.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99d7cc1b80 10 client.0 _ll_register_callbacks cb 0x560ebbaa9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:47.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99c1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbf4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99c2800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbf1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99c1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbf4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:41662/0 (socket says 172.21.15.71:41662) 2024-05-27T09:56:47.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.608+0000 7f99c1400700 1 -- 172.21.15.71:0/2162406871 learned_addr learned my addr 172.21.15.71:0/2162406871 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:47.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1e00700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbf4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1400700 1 -- 172.21.15.71:0/2162406871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 msgr2=0x560ebbbf1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1400700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbf1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1400700 1 -- 172.21.15.71:0/2162406871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 msgr2=0x560ebbbf4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1400700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbf4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1400700 1 -- 172.21.15.71:0/2162406871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ebbbf1ad0 con 0x560ebbb4eb80 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c2800700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbf1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1e00700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbf4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99c1400700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbf4bd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f99b0003aa0 tx=0x7f99b0004b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=239f5cc9588c54f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.609+0000 7f99a3e00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99a3e00700 1 -- 172.21.15.71:0/2162406871 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b002a040 con 0x560ebbb4eb80 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99a3e00700 1 -- 172.21.15.71:0/2162406871 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f99b0005410 con 0x560ebbb4eb80 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b400f6c0 con 0x560ebbb4eb80 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99a3e00700 1 -- 172.21.15.71:0/2162406871 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f99b003d050 con 0x560ebbb4eb80 2024-05-27T09:56:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99d7cc1b80 10 client.26753 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560ebbc6fbd0 con 0x560ebbb4eb80 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99a3e00700 1 -- 172.21.15.71:0/2162406871 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b400f6c0 con 0x560ebbb4eb80 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.610+0000 7f99a3e00700 1 -- 172.21.15.71:0/2162406871 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f99b0003d10 con 0x560ebbb4eb80 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.611+0000 7f99d7cc1b80 10 client.26753 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.611+0000 7f99d7cc1b80 10 client.26753 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.611+0000 7f99d7cc1b80 20 client.26753 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.611+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbc723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.611+0000 7f99d7cc1b80 4 client.26753 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.3, "await_for": 45.0}] 2024-05-27T09:56:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.611+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.3, "await_for": 45.0}) -- 0x560ebbbd58a0 con 0x560ebbbfc060 2024-05-27T09:56:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.611+0000 7f99c1e00700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbc723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.612+0000 7f99c1e00700 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbc723b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b601f0c11ac522ac server_cookie=92c11a463c460df5 in_seq=0 out_seq=0 2024-05-27T09:56:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:47.612+0000 7f99a3e00700 10 client.26753 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.555+0000 7f99a3e00700 1 -- 172.21.15.71:0/2162406871 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560ebbbd58a0 con 0x560ebbbfc060 2024-05-27T09:56:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.555+0000 7f99a3e00700 10 client.26753 handle_command_reply: tid=0 2024-05-27T09:56:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.555+0000 7f99d7cc1b80 1 client.26753 shutdown 2024-05-27T09:56:48.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 msgr2=0x560ebbbf4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:48.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbf4bd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f99b0003aa0 tx=0x7f99b0004b70 comp rx=0 tx=0).stop 2024-05-27T09:56:48.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 shutdown_connections 2024-05-27T09:56:48.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x560ebbbfc060 0x560ebbc723b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ebbbe2670 0x560ebbbf1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560ebba62fd0 0x560ebbbf4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 --2- 172.21.15.71:0/2162406871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560ebbb4eb80 0x560ebbbf4bd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99a3e00700 0 client.26753 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 >> 172.21.15.71:0/2162406871 conn(0x560ebbafc520 msgr2=0x560ebbbe6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 shutdown_connections 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.556+0000 7f99d7cc1b80 1 -- 172.21.15.71:0/2162406871 wait complete. 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.557+0000 7f99d7cc1b80 20 client.26753 trim_cache size 0 max 16384 2024-05-27T09:56:48.557 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 26, 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "b0a00f7b": { 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 26, 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:56:48.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 142.3, 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:56:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:56:48.560 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:56:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99a80b2a70 msgr2=0x7f99a80b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99a80b2a70 0x7f99a80b4f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f99b400b2e0 tx=0x7f99b4005fb0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 msgr2=0x7f99c41a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 0x7f99c41a1900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00ef30 tx=0x7f99bc00c450 comp rx=0 tx=0).stop 2024-05-27T09:56:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 shutdown_connections 2024-05-27T09:56:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f99a80b2a70 0x7f99a80b4f80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4110d10 0x7f99c41a1900 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99c4103160 0x7f99c419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 --2- 172.21.15.71:0/2642044247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99c4103ab0 0x7f99c419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 >> 172.21.15.71:0/2642044247 conn(0x7f99c4078df0 msgr2=0x7f99c4112230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 shutdown_connections 2024-05-27T09:56:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:56:48.558+0000 7f99c9200700 1 -- 172.21.15.71:0/2642044247 wait complete. 2024-05-27T09:56:49.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:48 smithi122 ceph-mon[36436]: pgmap v279: 97 pgs: 97 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 569 op/s 2024-05-27T09:56:49.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:48 smithi071 ceph-mon[31451]: pgmap v279: 97 pgs: 97 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 569 op/s 2024-05-27T09:56:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:48 smithi072 ceph-mon[35951]: pgmap v279: 97 pgs: 97 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 569 op/s 2024-05-27T09:56:49.428 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b0a00f7b', quiesce took 9.0 seconds. Will release after: 13.3 2024-05-27T09:56:51.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:50 smithi122 ceph-mon[36436]: pgmap v280: 97 pgs: 97 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.2 MiB/s wr, 408 op/s 2024-05-27T09:56:51.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:50 smithi071 ceph-mon[31451]: pgmap v280: 97 pgs: 97 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.2 MiB/s wr, 408 op/s 2024-05-27T09:56:51.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:50 smithi072 ceph-mon[35951]: pgmap v280: 97 pgs: 97 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.2 MiB/s wr, 408 op/s 2024-05-27T09:56:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 -- 172.21.15.71:0/3034173779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 msgr2=0x7f7ae4103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/3034173779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 0x7f7ae4103640 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009860 tx=0x7f7ad402a340 comp rx=0 tx=0).stop 2024-05-27T09:56:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 -- 172.21.15.71:0/3034173779 shutdown_connections 2024-05-27T09:56:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/3034173779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae41041f0 0x7f7ae41105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/3034173779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 0x7f7ae4103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/3034173779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 0x7f7ae4103640 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 -- 172.21.15.71:0/3034173779 >> 172.21.15.71:0/3034173779 conn(0x7f7ae40ff350 msgr2=0x7f7ae4101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 -- 172.21.15.71:0/3034173779 shutdown_connections 2024-05-27T09:56:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.325+0000 7f7ae9e00640 1 -- 172.21.15.71:0/3034173779 wait complete. 2024-05-27T09:56:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.326+0000 7f7ae9e00640 1 Processor -- start 2024-05-27T09:56:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9e00640 1 -- start start 2024-05-27T09:56:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae41041f0 0x7f7ae419d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 0x7f7ae419dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 0x7f7ae41a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113c90 con 0x7f7ae4109f40 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113b10 con 0x7f7ae4109aa0 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113e10 con 0x7f7ae41041f0 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 0x7f7ae41a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 0x7f7ae419dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 0x7f7ae41a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44692/0 (socket says 172.21.15.71:44692) 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.327+0000 7f7ae9400640 1 -- 172.21.15.71:0/1165947710 learned_addr learned my addr 172.21.15.71:0/1165947710 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae41041f0 0x7f7ae419d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae3e00640 1 -- 172.21.15.71:0/1165947710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae41041f0 msgr2=0x7f7ae419d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae41041f0 0x7f7ae419d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae3e00640 1 -- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 msgr2=0x7f7ae41a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 0x7f7ae41a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae3e00640 1 -- 172.21.15.71:0/1165947710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae41a8b10 con 0x7f7ae4109aa0 2024-05-27T09:56:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae9400640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 0x7f7ae41a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 0x7f7ae419dab0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7ae406b2b0 tx=0x7f7acc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.328+0000 7f7ae1600640 1 -- 172.21.15.71:0/1165947710 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc003970 con 0x7f7ae4109aa0 2024-05-27T09:56:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.329+0000 7f7ae1600640 1 -- 172.21.15.71:0/1165947710 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7acc004020 con 0x7f7ae4109aa0 2024-05-27T09:56:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.329+0000 7f7ae1600640 1 -- 172.21.15.71:0/1165947710 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00b860 con 0x7f7ae4109aa0 2024-05-27T09:56:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.329+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae41a8d40 con 0x7f7ae4109aa0 2024-05-27T09:56:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.329+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae41a91b0 con 0x7f7ae4109aa0 2024-05-27T09:56:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.332+0000 7f7af23ad740 1 Processor -- start 2024-05-27T09:56:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.332+0000 7f7af23ad740 1 -- start start 2024-05-27T09:56:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3911041b0 0x55e3914a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914a6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3910e34d0 0x55e3914a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7af23ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e391417b90 con 0x55e3910e34d0 2024-05-27T09:56:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7af23ad740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e391407730 con 0x55e3911041b0 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7af23ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e39140b770 con 0x55e3910db2f0 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae1600640 1 -- 172.21.15.71:0/1165947710 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f7acc01d020 con 0x7f7ae4109aa0 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914a6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3911041b0 0x55e3914a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914a6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:38024/0 (socket says 172.21.15.71:38024) 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae8a00640 1 -- 172.21.15.71:0/2849897782 learned_addr learned my addr 172.21.15.71:0/2849897782 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3910e34d0 0x55e3914a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae8a00640 1 -- 172.21.15.71:0/2849897782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3911041b0 msgr2=0x55e3914a6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3911041b0 0x55e3914a6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.333+0000 7f7ae8a00640 1 -- 172.21.15.71:0/2849897782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3910e34d0 msgr2=0x55e3914a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.334+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3910e34d0 0x55e3914a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.334+0000 7f7ae8a00640 1 -- 172.21.15.71:0/2849897782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3913a08b0 con 0x55e3910db2f0 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.334+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914a6fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009830 tx=0x7f7ad4005d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f9829d35f64a9e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.334+0000 7f7ad9c00640 1 -- 172.21.15.71:0/2849897782 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4041020 con 0x55e3910db2f0 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.334+0000 7f7ad9c00640 1 -- 172.21.15.71:0/2849897782 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad4030450 con 0x55e3910db2f0 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.334+0000 7f7ad9c00640 1 -- 172.21.15.71:0/2849897782 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4037040 con 0x55e3910db2f0 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7ae1600640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ac40b2950 0x7f7ac40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 -- 172.21.15.71:0/2849897782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 msgr2=0x55e3914a6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914a6fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009830 tx=0x7f7ad4005d10 comp rx=0 tx=0).stop 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7ae1600640 1 -- 172.21.15.71:0/1165947710 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f7acc0e2690 con 0x7f7ae4109aa0 2024-05-27T09:56:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7ae9400640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ac40b2950 0x7f7ac40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 -- 172.21.15.71:0/2849897782 shutdown_connections 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3910e34d0 0x55e3914a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914a6fa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2849897782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3911041b0 0x55e3914a6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 -- 172.21.15.71:0/2849897782 >> 172.21.15.71:0/2849897782 conn(0x55e3910f8300 msgr2=0x55e3914a3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.335+0000 7f7af23ad740 1 -- 172.21.15.71:0/2849897782 shutdown_connections 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.336+0000 7f7af23ad740 1 -- 172.21.15.71:0/2849897782 wait complete. 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.336+0000 7f7ae9400640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ac40b2950 0x7f7ac40b4e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55e3914a3bd0 tx=0x7f7adc005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.336+0000 7f7af23ad740 1 -- start start 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.336+0000 7f7af23ad740 1 Processor -- start 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7af23ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3910ed790 con 0x55e3911041b0 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7af23ad740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e3913afbc0 con 0x55e3910db2f0 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7af23ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e3914b3b30 con 0x55e3910e34d0 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7af23ad740 10 client.0 _ll_register_callbacks cb 0x55e39138d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:41700/0 (socket says 172.21.15.71:41700) 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 -- 172.21.15.71:0/981272757 learned_addr learned my addr 172.21.15.71:0/981272757 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 -- 172.21.15.71:0/981272757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 msgr2=0x55e3914b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 -- 172.21.15.71:0/981272757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 msgr2=0x55e3914bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.337+0000 7f7ae8a00640 1 -- 172.21.15.71:0/981272757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39111c210 con 0x55e3910db2f0 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.338+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914b0c10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7ad402a930 tx=0x7f7ad402aac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68ef0a1d27477743 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.338+0000 7f7ad2000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.338+0000 7f7ad2000640 1 -- 172.21.15.71:0/981272757 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad404c070 con 0x55e3910db2f0 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.338+0000 7f7ad2000640 1 -- 172.21.15.71:0/981272757 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f7ad403d680 con 0x55e3910db2f0 2024-05-27T09:56:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.338+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad4030450 con 0x55e3910db2f0 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7ad2000640 1 -- 172.21.15.71:0/981272757 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7ad4058050 con 0x55e3910db2f0 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 10 client.26765 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e3911e8620 con 0x55e3910db2f0 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7ad2000640 1 -- 172.21.15.71:0/981272757 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad4030450 con 0x55e3910db2f0 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7ad2000640 1 -- 172.21.15.71:0/981272757 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f7ad4046ae0 con 0x55e3910db2f0 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 10 client.26765 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 10 client.26765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 20 client.26765 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910c2d80 0x55e3914c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 4 client.26765 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:56:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.339+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e391419ae0 con 0x55e3910c2d80 2024-05-27T09:56:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.340+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910c2d80 0x55e3914c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.341+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910c2d80 0x55e3914c2c50 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8655cd5dbce68add server_cookie=5d226aaf888c0b5c in_seq=0 out_seq=0 2024-05-27T09:56:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.341+0000 7f7ad2000640 10 client.26765 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7ad2000640 1 -- 172.21.15.71:0/981272757 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55e391419ae0 con 0x55e3910c2d80 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7ad2000640 10 client.26765 handle_command_reply: tid=0 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 client.26765 shutdown 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 msgr2=0x55e3914b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914b0c10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7ad402a930 tx=0x7f7ad402aac0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 shutdown_connections 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910c2d80 0x55e3914c2c50 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 --2- 172.21.15.71:0/981272757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914b0c10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7ad2000640 0 client.26765 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 >> 172.21.15.71:0/981272757 conn(0x55e3910f8300 msgr2=0x55e3914a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 shutdown_connections 2024-05-27T09:56:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 1 -- 172.21.15.71:0/981272757 wait complete. 2024-05-27T09:56:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.342+0000 7f7af23ad740 20 client.26765 trim_cache size 0 max 16384 2024-05-27T09:56:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 Processor -- start 2024-05-27T09:56:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 -- start start 2024-05-27T09:56:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910e34d0 0x55e3914bcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b44c0 con 0x55e3911041b0 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b1d90 con 0x55e3910e34d0 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7af23ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41afc00 con 0x55e3910db2f0 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.359+0000 7f7ae8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44712/0 (socket says 172.21.15.71:44712) 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae9400640 1 -- 172.21.15.71:0/2535236761 learned_addr learned my addr 172.21.15.71:0/2535236761 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910e34d0 0x55e3914bcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae8a00640 1 -- 172.21.15.71:0/2535236761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910e34d0 msgr2=0x55e3914bcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910e34d0 0x55e3914bcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae8a00640 1 -- 172.21.15.71:0/2535236761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 msgr2=0x55e3914ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae8a00640 1 -- 172.21.15.71:0/2535236761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3914a7980 con 0x55e3910db2f0 2024-05-27T09:56:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910e34d0 0x55e3914bcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae9400640 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.360+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914b3340 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7ad402a860 tx=0x7f7ad40309b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf15a45bef5ffb80 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7ad9200640 1 -- 172.21.15.71:0/2535236761 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4061070 con 0x55e3910db2f0 2024-05-27T09:56:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7ad9200640 1 -- 172.21.15.71:0/2535236761 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad4030450 con 0x55e3910db2f0 2024-05-27T09:56:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7ad9200640 1 -- 172.21.15.71:0/2535236761 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad404c050 con 0x55e3910db2f0 2024-05-27T09:56:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7af23ad740 1 -- 172.21.15.71:0/2535236761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 msgr2=0x55e3914b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914b3340 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7ad402a860 tx=0x7f7ad40309b0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7af23ad740 1 -- 172.21.15.71:0/2535236761 shutdown_connections 2024-05-27T09:56:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3914ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910e34d0 0x55e3914bcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7af23ad740 1 --2- 172.21.15.71:0/2535236761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910db2f0 0x55e3914b3340 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.361+0000 7f7af23ad740 1 -- 172.21.15.71:0/2535236761 >> 172.21.15.71:0/2535236761 conn(0x55e3910f8300 msgr2=0x55e3914b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.362+0000 7f7af23ad740 1 -- 172.21.15.71:0/2535236761 shutdown_connections 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.362+0000 7f7af23ad740 1 -- 172.21.15.71:0/2535236761 wait complete. 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.362+0000 7f7af23ad740 1 -- start start 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.362+0000 7f7af23ad740 1 Processor -- start 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914c5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7af23ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3915290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7af23ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b0250 con 0x55e3911041b0 2024-05-27T09:56:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7af23ad740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b16c0 con 0x55e3910db2f0 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7af23ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b0920 con 0x55e3910e34d0 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7af23ad740 10 client.0 _ll_register_callbacks cb 0x7f7adc009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7ae8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7ae8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:41710/0 (socket says 172.21.15.71:41710) 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7ae8a00640 1 -- 172.21.15.71:0/268192373 learned_addr learned my addr 172.21.15.71:0/268192373 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.363+0000 7f7ae9400640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3915290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ae8a00640 1 -- 172.21.15.71:0/268192373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 msgr2=0x55e3914c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ae8a00640 1 -- 172.21.15.71:0/268192373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 msgr2=0x55e3915290a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3915290a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ae8a00640 1 -- 172.21.15.71:0/268192373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3915295e0 con 0x55e3910db2f0 2024-05-27T09:56:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ae8a00640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914c4df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40303f0 tx=0x7f7ad4030fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a80d8b49823a029 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ad2000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ad2000640 1 -- 172.21.15.71:0/268192373 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4061030 con 0x55e3910db2f0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7ad2000640 1 -- 172.21.15.71:0/268192373 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f7ad40329f0 con 0x55e3910db2f0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.364+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad4030450 con 0x55e3910db2f0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7ad2000640 1 -- 172.21.15.71:0/268192373 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7ad404c040 con 0x55e3910db2f0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 10 client.26771 fetch_fsmap learned FSMap version 32 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e39152a6d0 con 0x55e3910db2f0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7ad2000640 1 -- 172.21.15.71:0/268192373 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad4030450 con 0x55e3910db2f0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7ad2000640 1 -- 172.21.15.71:0/268192373 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f7ad4070480 con 0x55e3910db2f0 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 10 client.26771 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 10 client.26771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 20 client.26771 populate_metadata read hostname 'smithi071' 2024-05-27T09:56:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910981c0 0x55e39152cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:56:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 4 client.26771 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:56:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.365+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3914132c0 con 0x55e3910981c0 2024-05-27T09:56:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.366+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910981c0 0x55e39152cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:56:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.366+0000 7f7ad2000640 10 client.26771 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.366+0000 7f7ae3e00640 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910981c0 0x55e39152cd50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b877c60ca04c89 server_cookie=6d1da770b742b030 in_seq=0 out_seq=0 2024-05-27T09:56:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.382+0000 7f7ad2000640 1 -- 172.21.15.71:0/268192373 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e3914132c0 con 0x55e3910981c0 2024-05-27T09:56:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.382+0000 7f7ad2000640 10 client.26771 handle_command_reply: tid=0 2024-05-27T09:56:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.382+0000 7f7af23ad740 1 client.26771 shutdown 2024-05-27T09:56:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.382+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 msgr2=0x55e3914c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.382+0000 7f7af23ad740 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914c4df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40303f0 tx=0x7f7ad4030fc0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.382+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 shutdown_connections 2024-05-27T09:56:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.382+0000 7f7af23ad740 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e3910981c0 0x55e39152cd50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7af23ad740 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3911041b0 0x55e3915290a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7af23ad740 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3910e34d0 0x55e3914c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7af23ad740 1 --2- 172.21.15.71:0/268192373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e3910db2f0 0x55e3914c4df0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7ad2000640 0 client.26771 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:56:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 >> 172.21.15.71:0/268192373 conn(0x55e3910f8300 msgr2=0x55e3914ab330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 shutdown_connections 2024-05-27T09:56:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7af23ad740 1 -- 172.21.15.71:0/268192373 wait complete. 2024-05-27T09:56:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.383+0000 7f7af23ad740 20 client.26771 trim_cache size 0 max 16384 2024-05-27T09:56:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:56:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:56:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ac40b2950 msgr2=0x7f7ac40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ac40b2950 0x7f7ac40b4e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55e3914a3bd0 tx=0x7f7adc005f90 comp rx=0 tx=0).stop 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 msgr2=0x7f7ae419dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 0x7f7ae419dab0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7ae406b2b0 tx=0x7f7acc00c800 comp rx=0 tx=0).stop 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 shutdown_connections 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7ac40b2950 0x7f7ac40b4e60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ae4109f40 0x7f7ae41a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4109aa0 0x7f7ae419dab0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 --2- 172.21.15.71:0/1165947710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae41041f0 0x7f7ae419d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.384+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 >> 172.21.15.71:0/1165947710 conn(0x7f7ae40ff350 msgr2=0x7f7ae40ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:56:51.385 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.385+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 shutdown_connections 2024-05-27T09:56:51.386 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:56:51.385+0000 7f7ae9e00640 1 -- 172.21.15.71:0/1165947710 wait complete. 2024-05-27T09:56:53.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:52 smithi071 ceph-mon[31451]: pgmap v281: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 461 op/s 2024-05-27T09:56:53.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:52 smithi122 ceph-mon[36436]: pgmap v281: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 461 op/s 2024-05-27T09:56:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:52 smithi072 ceph-mon[35951]: pgmap v281: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 461 op/s 2024-05-27T09:56:55.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:54 smithi071 ceph-mon[31451]: pgmap v282: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 274 op/s 2024-05-27T09:56:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:54 smithi122 ceph-mon[36436]: pgmap v282: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 274 op/s 2024-05-27T09:56:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:54 smithi072 ceph-mon[35951]: pgmap v282: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 274 op/s 2024-05-27T09:56:57.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:56 smithi122 ceph-mon[36436]: pgmap v283: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 274 op/s 2024-05-27T09:56:57.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:56 smithi071 ceph-mon[31451]: pgmap v283: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 274 op/s 2024-05-27T09:56:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:56 smithi072 ceph-mon[35951]: pgmap v283: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 274 op/s 2024-05-27T09:56:59.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:56:58 smithi122 ceph-mon[36436]: pgmap v284: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 277 op/s 2024-05-27T09:56:59.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:56:58 smithi071 ceph-mon[31451]: pgmap v284: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 277 op/s 2024-05-27T09:56:59.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:56:58 smithi072 ceph-mon[35951]: pgmap v284: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 782 KiB/s wr, 277 op/s 2024-05-27T09:57:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:00 smithi122 ceph-mon[36436]: pgmap v285: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 149 KiB/s wr, 56 op/s 2024-05-27T09:57:01.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:00 smithi071 ceph-mon[31451]: pgmap v285: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 149 KiB/s wr, 56 op/s 2024-05-27T09:57:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:00 smithi072 ceph-mon[35951]: pgmap v285: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 149 KiB/s wr, 56 op/s 2024-05-27T09:57:02.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:57:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:57:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:02 smithi122 ceph-mon[36436]: pgmap v286: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 196 KiB/s wr, 76 op/s 2024-05-27T09:57:03.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:02 smithi071 ceph-mon[31451]: pgmap v286: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 196 KiB/s wr, 76 op/s 2024-05-27T09:57:03.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:02 smithi072 ceph-mon[35951]: pgmap v286: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 196 KiB/s wr, 76 op/s 2024-05-27T09:57:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 -- 172.21.15.71:0/4074549454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c10db40 msgr2=0x7f3f8c10ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 --2- 172.21.15.71:0/4074549454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c10db40 0x7f3f8c10ff60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009900 tx=0x7f3f7402a490 comp rx=0 tx=0).stop 2024-05-27T09:57:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 -- 172.21.15.71:0/4074549454 shutdown_connections 2024-05-27T09:57:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 --2- 172.21.15.71:0/4074549454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c1104a0 0x7f3f8c112900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 --2- 172.21.15.71:0/4074549454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c10db40 0x7f3f8c10ff60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 --2- 172.21.15.71:0/4074549454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c075660 0x7f3f8c075a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 -- 172.21.15.71:0/4074549454 >> 172.21.15.71:0/4074549454 conn(0x7f3f8c0ff480 msgr2=0x7f3f8c1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 -- 172.21.15.71:0/4074549454 shutdown_connections 2024-05-27T09:57:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.613+0000 7f3f93200640 1 -- 172.21.15.71:0/4074549454 wait complete. 2024-05-27T09:57:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.614+0000 7f3f93200640 1 Processor -- start 2024-05-27T09:57:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.614+0000 7f3f93200640 1 -- start start 2024-05-27T09:57:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.614+0000 7f3f93200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c075660 0x7f3f8c1a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.614+0000 7f3f93200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c10db40 0x7f3f8c1a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f93200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c1104a0 0x7f3f8c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f93200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c1160a0 con 0x7f3f8c1104a0 2024-05-27T09:57:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f93200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c115f20 con 0x7f3f8c075660 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f93200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c116220 con 0x7f3f8c10db40 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c1104a0 0x7f3f8c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c1104a0 0x7f3f8c19c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36066/0 (socket says 172.21.15.71:36066) 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c075660 0x7f3f8c1a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 -- 172.21.15.71:0/2028135399 learned_addr learned my addr 172.21.15.71:0/2028135399 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f8b400640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c10db40 0x7f3f8c1a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 -- 172.21.15.71:0/2028135399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c10db40 msgr2=0x7f3f8c1a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c10db40 0x7f3f8c1a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 -- 172.21.15.71:0/2028135399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c075660 msgr2=0x7f3f8c1a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c075660 0x7f3f8c1a26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.615+0000 7f3f91200640 1 -- 172.21.15.71:0/2028135399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c19cf80 con 0x7f3f8c1104a0 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.616+0000 7f3f91200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c1104a0 0x7f3f8c19c8e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400e970 tx=0x7f3f8400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.616+0000 7f3f88c00640 1 -- 172.21.15.71:0/2028135399 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400ccc0 con 0x7f3f8c1104a0 2024-05-27T09:57:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.616+0000 7f3f88c00640 1 -- 172.21.15.71:0/2028135399 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f8400ce60 con 0x7f3f8c1104a0 2024-05-27T09:57:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.616+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8c19d270 con 0x7f3f8c1104a0 2024-05-27T09:57:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.616+0000 7f3f88c00640 1 -- 172.21.15.71:0/2028135399 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84010430 con 0x7f3f8c1104a0 2024-05-27T09:57:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.616+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8c1a9550 con 0x7f3f8c1104a0 2024-05-27T09:57:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.620+0000 7f3f9a379740 1 Processor -- start 2024-05-27T09:57:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f88c00640 1 -- 172.21.15.71:0/2028135399 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f3f84004ff0 con 0x7f3f8c1104a0 2024-05-27T09:57:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f9a379740 1 -- start start 2024-05-27T09:57:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be879860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be879da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be87a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f9a379740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d1be7eab90 con 0x55d1be4b64d0 2024-05-27T09:57:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f9a379740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d1be7da730 con 0x55d1be4d71b0 2024-05-27T09:57:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f9a379740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d1be7de770 con 0x55d1be4ae2f0 2024-05-27T09:57:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.621+0000 7f3f8b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be87a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be879da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be87a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36080/0 (socket says 172.21.15.71:36080) 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8b400640 1 -- 172.21.15.71:0/1557580162 learned_addr learned my addr 172.21.15.71:0/1557580162 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8b400640 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be879860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8be00640 1 -- 172.21.15.71:0/1557580162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 msgr2=0x55d1be879860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8be00640 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be879860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8be00640 1 -- 172.21.15.71:0/1557580162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 msgr2=0x55d1be87a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8be00640 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be87a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8be00640 1 -- 172.21.15.71:0/1557580162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1be7738b0 con 0x55d1be4ae2f0 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f8be00640 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be879da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c005fd0 tx=0x7f3f7c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb676a7c97a1cff server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.622+0000 7f3f88c00640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3f700b2950 0x7f3f700b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.623+0000 7f3f81600640 1 -- 172.21.15.71:0/1557580162 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c003c30 con 0x55d1be4ae2f0 2024-05-27T09:57:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.623+0000 7f3f88c00640 1 -- 172.21.15.71:0/2028135399 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f3f840e29d0 con 0x7f3f8c1104a0 2024-05-27T09:57:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.623+0000 7f3f8b400640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3f700b2950 0x7f3f700b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.623+0000 7f3f81600640 1 -- 172.21.15.71:0/1557580162 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c003dd0 con 0x55d1be4ae2f0 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.623+0000 7f3f81600640 1 -- 172.21.15.71:0/1557580162 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00f940 con 0x55d1be4ae2f0 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 -- 172.21.15.71:0/1557580162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 msgr2=0x55d1be879da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f8b400640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3f700b2950 0x7f3f700b4e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f74000c00 tx=0x7f3f74041040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be879da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c005fd0 tx=0x7f3f7c0118d0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 -- 172.21.15.71:0/1557580162 shutdown_connections 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be87a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be879da0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1557580162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be879860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 -- 172.21.15.71:0/1557580162 >> 172.21.15.71:0/1557580162 conn(0x55d1be4cb300 msgr2=0x55d1be876010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 -- 172.21.15.71:0/1557580162 shutdown_connections 2024-05-27T09:57:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.624+0000 7f3f9a379740 1 -- 172.21.15.71:0/1557580162 wait complete. 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 -- start start 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 Processor -- start 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be8839a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be883ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d1be4c0790 con 0x55d1be4b64d0 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d1be782bc0 con 0x55d1be4d71b0 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d1be886990 con 0x55d1be4ae2f0 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.625+0000 7f3f9a379740 10 client.0 _ll_register_callbacks cb 0x55d1be760400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f8b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be883ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be8839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f91200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be8839a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41106/0 (socket says 172.21.15.71:41106) 2024-05-27T09:57:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f8be00640 1 -- 172.21.15.71:0/3428562514 learned_addr learned my addr 172.21.15.71:0/3428562514 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f91200640 1 -- 172.21.15.71:0/3428562514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 msgr2=0x55d1be8839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f91200640 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be8839a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f91200640 1 -- 172.21.15.71:0/3428562514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 msgr2=0x55d1be883ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f91200640 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be883ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f91200640 1 -- 172.21.15.71:0/3428562514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1be4ef210 con 0x55d1be4d71b0 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f8be00640 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be8839a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f91200640 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88fd20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3f840e00c0 tx=0x7f3f84005560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b7368fb1e168004 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.626+0000 7f3f7a000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.627+0000 7f3f7a000640 1 -- 172.21.15.71:0/3428562514 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84091040 con 0x55d1be4d71b0 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.627+0000 7f3f7a000640 1 -- 172.21.15.71:0/3428562514 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f3f840c42e0 con 0x55d1be4d71b0 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.627+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f7c003dd0 con 0x55d1be4d71b0 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.627+0000 7f3f7a000640 1 -- 172.21.15.71:0/3428562514 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3f840aa350 con 0x55d1be4d71b0 2024-05-27T09:57:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.627+0000 7f3f9a379740 10 client.26783 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.627+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d1be5bb620 con 0x55d1be4d71b0 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.627+0000 7f3f7a000640 1 -- 172.21.15.71:0/3428562514 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c003dd0 con 0x55d1be4d71b0 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f7a000640 1 -- 172.21.15.71:0/3428562514 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f3f840b26b0 con 0x55d1be4d71b0 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f9a379740 10 client.26783 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f9a379740 10 client.26783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f9a379740 20 client.26783 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f9a379740 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be495d80 0x55d1be895ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f9a379740 4 client.26783 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1be7ecae0 con 0x55d1be495d80 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.628+0000 7f3f8be00640 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be495d80 0x55d1be895ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.629+0000 7f3f8be00640 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be495d80 0x55d1be895ce0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ab121d45bac667 server_cookie=d04c05c99cf32ee5 in_seq=0 out_seq=0 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.629+0000 7f3f7a000640 10 client.26783 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.629+0000 7f3f7a000640 1 -- 172.21.15.71:0/3428562514 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d1be7ecae0 con 0x55d1be495d80 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.629+0000 7f3f7a000640 10 client.26783 handle_command_reply: tid=0 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 client.26783 shutdown 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 msgr2=0x55d1be88fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88fd20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3f840e00c0 tx=0x7f3f84005560 comp rx=0 tx=0).stop 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 shutdown_connections 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88fd20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be495d80 0x55d1be895ce0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4b64d0 0x55d1be883ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 --2- 172.21.15.71:0/3428562514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4ae2f0 0x55d1be8839a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 >> 172.21.15.71:0/3428562514 conn(0x55d1be4cb300 msgr2=0x55d1be879690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f7a000640 0 client.26783 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 shutdown_connections 2024-05-27T09:57:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 1 -- 172.21.15.71:0/3428562514 wait complete. 2024-05-27T09:57:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.630+0000 7f3f9a379740 20 client.26783 trim_cache size 0 max 16384 2024-05-27T09:57:04.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 Processor -- start 2024-05-27T09:57:04.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 -- start start 2024-05-27T09:57:04.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.647 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4b64d0 0x55d1be88fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c1b4600 con 0x55d1be4ae2f0 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c1b1ed0 con 0x55d1be4d71b0 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f9a379740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c1afd40 con 0x55d1be4b64d0 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8857d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36096/0 (socket says 172.21.15.71:36096) 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.647+0000 7f3f8be00640 1 -- 172.21.15.71:0/1905232885 learned_addr learned my addr 172.21.15.71:0/1905232885 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f8b400640 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4b64d0 0x55d1be88fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f91200640 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f8be00640 1 -- 172.21.15.71:0/1905232885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4b64d0 msgr2=0x55d1be88fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f8be00640 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4b64d0 0x55d1be88fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f8be00640 1 -- 172.21.15.71:0/1905232885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 msgr2=0x55d1be88ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f8be00640 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f8be00640 1 -- 172.21.15.71:0/1905232885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1be870050 con 0x55d1be4ae2f0 2024-05-27T09:57:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.648+0000 7f3f8be00640 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8857d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c006010 tx=0x7f3f7c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fd2b5ffc6417ca server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.650+0000 7f3f80c00640 1 -- 172.21.15.71:0/1905232885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c01f040 con 0x55d1be4ae2f0 2024-05-27T09:57:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.650+0000 7f3f80c00640 1 -- 172.21.15.71:0/1905232885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c02c070 con 0x55d1be4ae2f0 2024-05-27T09:57:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.650+0000 7f3f80c00640 1 -- 172.21.15.71:0/1905232885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00f650 con 0x55d1be4ae2f0 2024-05-27T09:57:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 -- 172.21.15.71:0/1905232885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 msgr2=0x55d1be8857d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8857d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c006010 tx=0x7f3f7c009500 comp rx=0 tx=0).stop 2024-05-27T09:57:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 -- 172.21.15.71:0/1905232885 shutdown_connections 2024-05-27T09:57:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4d71b0 0x55d1be88ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4b64d0 0x55d1be88fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 --2- 172.21.15.71:0/1905232885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8857d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 -- 172.21.15.71:0/1905232885 >> 172.21.15.71:0/1905232885 conn(0x55d1be4cb300 msgr2=0x55d1be8850c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:04.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 -- 172.21.15.71:0/1905232885 shutdown_connections 2024-05-27T09:57:04.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.651+0000 7f3f9a379740 1 -- 172.21.15.71:0/1905232885 wait complete. 2024-05-27T09:57:04.652 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.652+0000 7f3f9a379740 1 -- start start 2024-05-27T09:57:04.653 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.652+0000 7f3f9a379740 1 Processor -- start 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4b64d0 0x55d1be888ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f9a379740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4d71b0 0x55d1be889430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f9a379740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c1b0390 con 0x55d1be4ae2f0 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f9a379740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c1b1800 con 0x55d1be4b64d0 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f9a379740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c1b0a60 con 0x55d1be4d71b0 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f9a379740 10 client.0 _ll_register_callbacks cb 0x7f3f840a5b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8889b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36102/0 (socket says 172.21.15.71:36102) 2024-05-27T09:57:04.654 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8be00640 1 -- 172.21.15.71:0/224263687 learned_addr learned my addr 172.21.15.71:0/224263687 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8b400640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4b64d0 0x55d1be888ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f91200640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4d71b0 0x55d1be889430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8b400640 1 -- 172.21.15.71:0/224263687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4d71b0 msgr2=0x55d1be889430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8b400640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4d71b0 0x55d1be889430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8b400640 1 -- 172.21.15.71:0/224263687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 msgr2=0x55d1be8889b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.653+0000 7f3f8b400640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8889b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f8b400640 1 -- 172.21.15.71:0/224263687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1be8fc3b0 con 0x55d1be4b64d0 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f8be00640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f8b400640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4b64d0 0x55d1be888ef0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3f74005f70 tx=0x7f3f7402a490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21f84612dda05efd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f7a000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f7a000640 1 -- 172.21.15.71:0/224263687 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74046070 con 0x55d1be4b64d0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f7a000640 1 -- 172.21.15.71:0/224263687 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f3f74031bb0 con 0x55d1be4b64d0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f7c02c070 con 0x55d1be4b64d0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f7a000640 1 -- 172.21.15.71:0/224263687 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3f74031db0 con 0x55d1be4b64d0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f9a379740 10 client.26789 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.654+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d1be8fd510 con 0x55d1be4b64d0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f7a000640 1 -- 172.21.15.71:0/224263687 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c02c070 con 0x55d1be4b64d0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f7a000640 1 -- 172.21.15.71:0/224263687 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f3f74055020 con 0x55d1be4b64d0 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f9a379740 10 client.26789 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f9a379740 10 client.26789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f9a379740 20 client.26789 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f9a379740 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be46b1c0 0x55d1be8ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f9a379740 4 client.26789 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:57:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.655+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1be7e62c0 con 0x55d1be46b1c0 2024-05-27T09:57:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.656+0000 7f3f8be00640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be46b1c0 0x55d1be8ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.656+0000 7f3f7a000640 10 client.26789 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.656+0000 7f3f8be00640 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be46b1c0 0x55d1be8ffca0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b13024d0ddf352 server_cookie=d85914571f2c1634 in_seq=0 out_seq=0 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.670+0000 7f3f7a000640 1 -- 172.21.15.71:0/224263687 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d1be7e62c0 con 0x55d1be46b1c0 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.670+0000 7f3f7a000640 10 client.26789 handle_command_reply: tid=0 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.670+0000 7f3f9a379740 1 client.26789 shutdown 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4b64d0 msgr2=0x55d1be888ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4b64d0 0x55d1be888ef0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3f74005f70 tx=0x7f3f7402a490 comp rx=0 tx=0).stop 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 shutdown_connections 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d1be4d71b0 0x55d1be889430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d1be4b64d0 0x55d1be888ef0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.671 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55d1be46b1c0 0x55d1be8ffca0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 --2- 172.21.15.71:0/224263687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1be4ae2f0 0x55d1be8889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f7a000640 0 client.26789 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 >> 172.21.15.71:0/224263687 conn(0x55d1be4cb300 msgr2=0x55d1be883b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 shutdown_connections 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 1 -- 172.21.15.71:0/224263687 wait complete. 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.671+0000 7f3f9a379740 20 client.26789 trim_cache size 0 max 16384 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:57:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:57:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:57:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3f700b2950 msgr2=0x7f3f700b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3f700b2950 0x7f3f700b4e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f74000c00 tx=0x7f3f74041040 comp rx=0 tx=0).stop 2024-05-27T09:57:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c1104a0 msgr2=0x7f3f8c19c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c1104a0 0x7f3f8c19c8e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400e970 tx=0x7f3f8400ed70 comp rx=0 tx=0).stop 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 shutdown_connections 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3f700b2950 0x7f3f700b4e60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c1104a0 0x7f3f8c19c8e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c10db40 0x7f3f8c1a2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 --2- 172.21.15.71:0/2028135399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8c075660 0x7f3f8c1a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 >> 172.21.15.71:0/2028135399 conn(0x7f3f8c0ff480 msgr2=0x7f3f8c1108f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 shutdown_connections 2024-05-27T09:57:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:04.672+0000 7f3f93200640 1 -- 172.21.15.71:0/2028135399 wait complete. 2024-05-27T09:57:04.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:04 smithi071 ceph-mon[31451]: pgmap v287: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-27T09:57:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:04 smithi122 ceph-mon[36436]: pgmap v287: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-27T09:57:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:04 smithi072 ceph-mon[35951]: pgmap v287: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-27T09:57:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 -- 172.21.15.71:0/1778519706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc164103260 msgr2=0x7fc164103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 --2- 172.21.15.71:0/1778519706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc164103260 0x7fc164103670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc154009990 tx=0x7fc154009ca0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 -- 172.21.15.71:0/1778519706 shutdown_connections 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 --2- 172.21.15.71:0/1778519706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1641086b0 0x7fc164108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 --2- 172.21.15.71:0/1778519706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc164103260 0x7fc164103670 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 --2- 172.21.15.71:0/1778519706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc164103bb0 0x7fc1641080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 -- 172.21.15.71:0/1778519706 >> 172.21.15.71:0/1778519706 conn(0x7fc1640fef20 msgr2=0x7fc164101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.547+0000 7fc16a600700 1 -- 172.21.15.71:0/1778519706 shutdown_connections 2024-05-27T09:57:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.548+0000 7fc16a600700 1 -- 172.21.15.71:0/1778519706 wait complete. 2024-05-27T09:57:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 Processor -- start 2024-05-27T09:57:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 -- start start 2024-05-27T09:57:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc164103260 0x7fc1641a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc164103bb0 0x7fc1641a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1641086b0 0x7fc1641a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc16411aa80 con 0x7fc1641086b0 2024-05-27T09:57:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc16411a900 con 0x7fc164103bb0 2024-05-27T09:57:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.549+0000 7fc16a600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc16411ac00 con 0x7fc164103260 2024-05-27T09:57:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc164103260 0x7fc1641a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc164103260 0x7fc1641a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41144/0 (socket says 172.21.15.71:41144) 2024-05-27T09:57:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 -- 172.21.15.71:0/318398682 learned_addr learned my addr 172.21.15.71:0/318398682 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163e00700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1641086b0 0x7fc1641a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc15aa00700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc164103bb0 0x7fc1641a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 -- 172.21.15.71:0/318398682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc164103bb0 msgr2=0x7fc1641a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc164103bb0 0x7fc1641a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 -- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1641086b0 msgr2=0x7fc1641a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1641086b0 0x7fc1641a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 -- 172.21.15.71:0/318398682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1641a62d0 con 0x7fc164103260 2024-05-27T09:57:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.550+0000 7fc163400700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc164103260 0x7fc1641a1450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc154005910 tx=0x7fc15400b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.551+0000 7fc160c00700 1 -- 172.21.15.71:0/318398682 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154027070 con 0x7fc164103260 2024-05-27T09:57:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.551+0000 7fc160c00700 1 -- 172.21.15.71:0/318398682 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc154022470 con 0x7fc164103260 2024-05-27T09:57:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.551+0000 7fc160c00700 1 -- 172.21.15.71:0/318398682 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154017650 con 0x7fc164103260 2024-05-27T09:57:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.551+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1641a6560 con 0x7fc164103260 2024-05-27T09:57:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.551+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1641adee0 con 0x7fc164103260 2024-05-27T09:57:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.552+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16406c910 con 0x7fc164103260 2024-05-27T09:57:05.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.555+0000 7fc160c00700 1 -- 172.21.15.71:0/318398682 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fc15402a070 con 0x7fc164103260 2024-05-27T09:57:05.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.556+0000 7fc160c00700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc1480b2a70 0x7fc1480b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:05.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.557+0000 7fc160c00700 1 -- 172.21.15.71:0/318398682 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fc1540e3510 con 0x7fc164103260 2024-05-27T09:57:05.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.557+0000 7fc15aa00700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc1480b2a70 0x7fc1480b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:05.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.558+0000 7fc15aa00700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc1480b2a70 0x7fc1480b4f80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc164101760 tx=0x7fc14c009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:05.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.559+0000 7fc160c00700 1 -- 172.21.15.71:0/318398682 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc154013070 con 0x7fc164103260 2024-05-27T09:57:05.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.837+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1641a2760 con 0x7fc164103260 2024-05-27T09:57:05.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.838+0000 7fc160c00700 1 -- 172.21.15.71:0/318398682 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7fc1540aaf20 con 0x7fc164103260 2024-05-27T09:57:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:57:05.839 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:57:05.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.841+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc1480b2a70 msgr2=0x7fc1480b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:05.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.841+0000 7fc16a600700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc1480b2a70 0x7fc1480b4f80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc164101760 tx=0x7fc14c009260 comp rx=0 tx=0).stop 2024-05-27T09:57:05.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.841+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc164103260 msgr2=0x7fc1641a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:05.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.841+0000 7fc16a600700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc164103260 0x7fc1641a1450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc154005910 tx=0x7fc15400b670 comp rx=0 tx=0).stop 2024-05-27T09:57:05.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 shutdown_connections 2024-05-27T09:57:05.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc1480b2a70 0x7fc1480b4f80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1641086b0 0x7fc1641a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc164103260 0x7fc1641a1450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 --2- 172.21.15.71:0/318398682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc164103bb0 0x7fc1641a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:05.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 >> 172.21.15.71:0/318398682 conn(0x7fc1640fef20 msgr2=0x7fc1641060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:05.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 shutdown_connections 2024-05-27T09:57:05.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:05.842+0000 7fc16a600700 1 -- 172.21.15.71:0/318398682 wait complete. 2024-05-27T09:57:05.843 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:57:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:05 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/318398682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:05 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/318398682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:05 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/318398682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id b0a00f7b --release --await' 2024-05-27T09:57:06.951 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id b0a00f7b --release --await 2024-05-27T09:57:07.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:06 smithi122 ceph-mon[36436]: pgmap v288: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-27T09:57:07.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:06 smithi071 ceph-mon[31451]: pgmap v288: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-27T09:57:07.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:06 smithi072 ceph-mon[35951]: pgmap v288: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-27T09:57:07.388 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:57:08.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:07 smithi122 ceph-mon[36436]: pgmap v289: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-27T09:57:08.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:07 smithi071 ceph-mon[31451]: pgmap v289: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-27T09:57:08.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:07 smithi072 ceph-mon[35951]: pgmap v289: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-27T09:57:09.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 -- 172.21.15.71:0/2572029504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106560 msgr2=0x7ff1bc106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 --2- 172.21.15.71:0/2572029504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106560 0x7ff1bc106970 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009990 tx=0x7ff1a8009ca0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 -- 172.21.15.71:0/2572029504 shutdown_connections 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 --2- 172.21.15.71:0/2572029504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106eb0 0x7ff1bc113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 --2- 172.21.15.71:0/2572029504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1bc10c5a0 0x7ff1bc10c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 --2- 172.21.15.71:0/2572029504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106560 0x7ff1bc106970 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 -- 172.21.15.71:0/2572029504 >> 172.21.15.71:0/2572029504 conn(0x7ff1bc102040 msgr2=0x7ff1bc104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 -- 172.21.15.71:0/2572029504 shutdown_connections 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.688+0000 7ff1c3000700 1 -- 172.21.15.71:0/2572029504 wait complete. 2024-05-27T09:57:09.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 Processor -- start 2024-05-27T09:57:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 -- start start 2024-05-27T09:57:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106560 0x7ff1bc077cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106eb0 0x7ff1bc078200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1bc10c5a0 0x7ff1bc078740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1166d0 con 0x7ff1bc10c5a0 2024-05-27T09:57:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc116550 con 0x7ff1bc106eb0 2024-05-27T09:57:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.690+0000 7ff1c3000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc116850 con 0x7ff1bc106560 2024-05-27T09:57:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106560 0x7ff1bc077cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106560 0x7ff1bc077cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41166/0 (socket says 172.21.15.71:41166) 2024-05-27T09:57:09.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1415838513 learned_addr learned my addr 172.21.15.71:0/1415838513 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1c1000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1bc10c5a0 0x7ff1bc078740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bb400700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106eb0 0x7ff1bc078200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1415838513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106eb0 msgr2=0x7ff1bc078200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106eb0 0x7ff1bc078200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1bc10c5a0 msgr2=0x7ff1bc078740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1bc10c5a0 0x7ff1bc078740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.691+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1415838513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc1ad600 con 0x7ff1bc106560 2024-05-27T09:57:09.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.692+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106560 0x7ff1bc077cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e970 tx=0x7ff1ac00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:09.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.692+0000 7ff1b8c00700 1 -- 172.21.15.71:0/1415838513 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac004a30 con 0x7ff1bc106560 2024-05-27T09:57:09.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.692+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1bc1ad890 con 0x7ff1bc106560 2024-05-27T09:57:09.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.692+0000 7ff1b8c00700 1 -- 172.21.15.71:0/1415838513 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1ac00cc90 con 0x7ff1bc106560 2024-05-27T09:57:09.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.692+0000 7ff1b8c00700 1 -- 172.21.15.71:0/1415838513 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac005610 con 0x7ff1bc106560 2024-05-27T09:57:09.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.692+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1bc1addf0 con 0x7ff1bc106560 2024-05-27T09:57:09.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.696+0000 7ff1b8c00700 1 -- 172.21.15.71:0/1415838513 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7ff1ac00c7e0 con 0x7ff1bc106560 2024-05-27T09:57:09.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.697+0000 7ff1d1aedb80 1 Processor -- start 2024-05-27T09:57:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.697+0000 7ff1d1aedb80 1 -- start start 2024-05-27T09:57:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc63db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc5df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc5e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a62bb8bf40 con 0x55a62bc5e440 2024-05-27T09:57:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a62bb7bae0 con 0x55a62badef40 2024-05-27T09:57:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a62bb7fb20 con 0x55a62bc642f0 2024-05-27T09:57:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1b8c00700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1a00b29f0 0x7ff1a00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc5e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc5e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36156/0 (socket says 172.21.15.71:36156) 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1bb400700 1 -- 172.21.15.71:0/99005269 learned_addr learned my addr 172.21.15.71:0/99005269 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc5df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1c1000700 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc63db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1c1000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1a00b29f0 0x7ff1a00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.698+0000 7ff1b8c00700 1 -- 172.21.15.71:0/1415838513 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7ff1ac0e2790 con 0x7ff1bc106560 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.699+0000 7ff1c1000700 1 -- 172.21.15.71:0/99005269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 msgr2=0x55a62bc5df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.699+0000 7ff1c1000700 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc5df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.699+0000 7ff1c1000700 1 -- 172.21.15.71:0/99005269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 msgr2=0x55a62bc5e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.699+0000 7ff1c1000700 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc5e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.699+0000 7ff1c1000700 1 -- 172.21.15.71:0/99005269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a62bb44520 con 0x55a62badef40 2024-05-27T09:57:09.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.699+0000 7ff1bb400700 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc5e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:09.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.699+0000 7ff1c1000700 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc63db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007850 tx=0x7ff1b4007b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3794a8f2a36deb8e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:09.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.700+0000 7ff1c1000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1a00b29f0 0x7ff1a00b4f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4010000 tx=0x7ff1b401c000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:09.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.700+0000 7ff1b1600700 1 -- 172.21.15.71:0/99005269 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4017ce0 con 0x55a62badef40 2024-05-27T09:57:09.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.700+0000 7ff1b1600700 1 -- 172.21.15.71:0/99005269 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b401e070 con 0x55a62badef40 2024-05-27T09:57:09.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.700+0000 7ff1b1600700 1 -- 172.21.15.71:0/99005269 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b401adc0 con 0x55a62badef40 2024-05-27T09:57:09.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/99005269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 msgr2=0x55a62bc63db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc63db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007850 tx=0x7ff1b4007b60 comp rx=0 tx=0).stop 2024-05-27T09:57:09.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/99005269 shutdown_connections 2024-05-27T09:57:09.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc5e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc63db0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/99005269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc5df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/99005269 >> 172.21.15.71:0/99005269 conn(0x55a62bb3f0c0 msgr2=0x55a62bc59100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:09.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/99005269 shutdown_connections 2024-05-27T09:57:09.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/99005269 wait complete. 2024-05-27T09:57:09.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.701+0000 7ff1d1aedb80 1 -- start start 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 1 Processor -- start 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62badef40 0x55a62bc67b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc5e440 0x55a62bc68070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc642f0 0x55a62bc685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a62ba820a0 con 0x55a62bc642f0 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a62bb1c860 con 0x55a62bc5e440 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a62bc6ad60 con 0x55a62badef40 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.702+0000 7ff1d1aedb80 10 client.0 _ll_register_callbacks cb 0x55a62bb25d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62badef40 0x55a62bc67b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1c1000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc642f0 0x55a62bc685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62badef40 0x55a62bc67b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41182/0 (socket says 172.21.15.71:41182) 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1264533310 learned_addr learned my addr 172.21.15.71:0/1264533310 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bb400700 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc5e440 0x55a62bc68070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc5e440 msgr2=0x55a62bc68070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc5e440 0x55a62bc68070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1264533310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc642f0 msgr2=0x55a62bc685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc642f0 0x55a62bc685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1264533310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a62bacb9d0 con 0x55a62badef40 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1c1000700 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc642f0 0x55a62bc685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.703+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62badef40 0x55a62bc67b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0a9980 tx=0x7ff1ac01dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e7325b119b6f12 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1a6000700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1a6000700 1 -- 172.21.15.71:0/1264533310 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0a9160 con 0x55a62badef40 2024-05-27T09:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1a6000700 1 -- 172.21.15.71:0/1264533310 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7ff1ac0a9c50 con 0x55a62badef40 2024-05-27T09:57:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b401e070 con 0x55a62badef40 2024-05-27T09:57:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1a6000700 1 -- 172.21.15.71:0/1264533310 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1ac0e02f0 con 0x55a62badef40 2024-05-27T09:57:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1d1aedb80 10 client.26833 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a62bb4c160 con 0x55a62badef40 2024-05-27T09:57:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.704+0000 7ff1a6000700 1 -- 172.21.15.71:0/1264533310 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b401e070 con 0x55a62badef40 2024-05-27T09:57:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1a6000700 1 -- 172.21.15.71:0/1264533310 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7ff1ac0cc0c0 con 0x55a62badef40 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1d1aedb80 10 client.26833 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1d1aedb80 10 client.26833 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1d1aedb80 20 client.26833 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bc77c20 0x55a62bc7a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1d1aedb80 4 client.26833 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a62bb8de90 con 0x55a62bc77c20 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.705+0000 7ff1bb400700 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bc77c20 0x55a62bc7a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.706+0000 7ff1bb400700 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bc77c20 0x55a62bc7a060 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd77e5939f25e852 server_cookie=1ec92b2fd7406d1b in_seq=0 out_seq=0 2024-05-27T09:57:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.706+0000 7ff1a6000700 10 client.26833 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.706+0000 7ff1a6000700 1 -- 172.21.15.71:0/1264533310 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55a62bb8de90 con 0x55a62bc77c20 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.706+0000 7ff1a6000700 10 client.26833 handle_command_reply: tid=0 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 client.26833 shutdown 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62badef40 msgr2=0x55a62bc67b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62badef40 0x55a62bc67b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0a9980 tx=0x7ff1ac01dc90 comp rx=0 tx=0).stop 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 shutdown_connections 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bc77c20 0x55a62bc7a060 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc642f0 0x55a62bc685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62badef40 0x55a62bc67b30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1264533310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc5e440 0x55a62bc68070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1a6000700 0 client.26833 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 >> 172.21.15.71:0/1264533310 conn(0x55a62bb3f0c0 msgr2=0x55a62bc5cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 shutdown_connections 2024-05-27T09:57:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1264533310 wait complete. 2024-05-27T09:57:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.707+0000 7ff1d1aedb80 20 client.26833 trim_cache size 0 max 16384 2024-05-27T09:57:09.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.729+0000 7ff1d1aedb80 1 Processor -- start 2024-05-27T09:57:09.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.729+0000 7ff1d1aedb80 1 -- start start 2024-05-27T09:57:09.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62badef40 0x55a62bc69f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc5e440 0x55a62bc73e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc642f0 0x55a62bc5d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b7f00 con 0x55a62badef40 2024-05-27T09:57:09.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b5790 con 0x55a62bc642f0 2024-05-27T09:57:09.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b3600 con 0x55a62bc5e440 2024-05-27T09:57:09.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62badef40 0x55a62bc69f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62badef40 0x55a62bc69f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36186/0 (socket says 172.21.15.71:36186) 2024-05-27T09:57:09.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1c1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc642f0 0x55a62bc5d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1bbe00700 1 -- 172.21.15.71:0/3329517326 learned_addr learned my addr 172.21.15.71:0/3329517326 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:09.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.730+0000 7ff1bb400700 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc5e440 0x55a62bc73e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1c1000700 1 -- 172.21.15.71:0/3329517326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc5e440 msgr2=0x55a62bc73e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1c1000700 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc5e440 0x55a62bc73e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1c1000700 1 -- 172.21.15.71:0/3329517326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62badef40 msgr2=0x55a62bc69f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1c1000700 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62badef40 0x55a62bc69f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1c1000700 1 -- 172.21.15.71:0/3329517326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a62bc536f0 con 0x55a62bc642f0 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1c1000700 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc642f0 0x55a62bc5d380 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004fd0 tx=0x7ff1b4004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944a7e19fc12252b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1b0c00700 1 -- 172.21.15.71:0/3329517326 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b402e070 con 0x55a62bc642f0 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1b0c00700 1 -- 172.21.15.71:0/3329517326 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b401e050 con 0x55a62bc642f0 2024-05-27T09:57:09.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.731+0000 7ff1b0c00700 1 -- 172.21.15.71:0/3329517326 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4022420 con 0x55a62bc642f0 2024-05-27T09:57:09.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.732+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/3329517326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc642f0 msgr2=0x55a62bc5d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.732+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc642f0 0x55a62bc5d380 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004fd0 tx=0x7ff1b4004a30 comp rx=0 tx=0).stop 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.732+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/3329517326 shutdown_connections 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.732+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62bc642f0 0x55a62bc5d380 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.732+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62badef40 0x55a62bc69f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.732+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/3329517326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc5e440 0x55a62bc73e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.732+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/3329517326 >> 172.21.15.71:0/3329517326 conn(0x55a62bb3f0c0 msgr2=0x55a62bc62130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.733+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/3329517326 shutdown_connections 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.733+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/3329517326 wait complete. 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.733+0000 7ff1d1aedb80 1 -- start start 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.733+0000 7ff1d1aedb80 1 Processor -- start 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc70260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1d1aedb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc6d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b3c50 con 0x55a62bc5e440 2024-05-27T09:57:09.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b50c0 con 0x55a62badef40 2024-05-27T09:57:09.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1d1aedb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b4320 con 0x55a62bc642f0 2024-05-27T09:57:09.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1d1aedb80 10 client.0 _ll_register_callbacks cb 0x55a62bb25d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc70260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc70260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57046/0 (socket says 172.21.15.71:57046) 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1238965420 learned_addr learned my addr 172.21.15.71:0/1238965420 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1c1000700 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc6d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.734+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1238965420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 msgr2=0x55a62bc6d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc6d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1238965420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 msgr2=0x55a62bc707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1bbe00700 1 -- 172.21.15.71:0/1238965420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a62bc68920 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1bbe00700 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc70260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac004bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=186be10c4358cdd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1a6000700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1a6000700 1 -- 172.21.15.71:0/1238965420 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac06d020 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1a6000700 1 -- 172.21.15.71:0/1238965420 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7ff1ac0a5fe0 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b401e050 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1a6000700 1 -- 172.21.15.71:0/1238965420 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1ac0a5180 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1d1aedb80 10 client.26813 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.735+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a62bc599f0 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1a6000700 1 -- 172.21.15.71:0/1238965420 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b401e050 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1a6000700 1 -- 172.21.15.71:0/1238965420 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7ff1ac0a5360 con 0x55a62badef40 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1d1aedb80 10 client.26813 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1d1aedb80 10 client.26813 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:57:09.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1d1aedb80 20 client.26813 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:09.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bce32c0 0x55a62bce56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:09.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1d1aedb80 4 client.26813 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b0a00f7b", "release": true, "await": true}] 2024-05-27T09:57:09.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b0a00f7b", "release": true, "await": true}) -- 0x55a62bb87670 con 0x55a62bce32c0 2024-05-27T09:57:09.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.736+0000 7ff1bb400700 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bce32c0 0x55a62bce56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:09.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.737+0000 7ff1bb400700 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bce32c0 0x55a62bce56e0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99848499302b49e3 server_cookie=66b6ee354cc7abec in_seq=0 out_seq=0 2024-05-27T09:57:09.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.737+0000 7ff1a6000700 10 client.26813 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.951+0000 7ff1a6000700 1 -- 172.21.15.71:0/1238965420 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a62bb87670 con 0x55a62bce32c0 2024-05-27T09:57:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.951+0000 7ff1a6000700 10 client.26813 handle_command_reply: tid=0 2024-05-27T09:57:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.951+0000 7ff1d1aedb80 1 client.26813 shutdown 2024-05-27T09:57:09.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:09 smithi071 ceph-mon[31451]: osdmap e90: 12 total, 12 up, 12 in 2024-05-27T09:57:09.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:09 smithi071 ceph-mon[31451]: pgmap v291: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-27T09:57:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.953+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 msgr2=0x55a62bc70260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.953+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc70260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac004bd0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 shutdown_connections 2024-05-27T09:57:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55a62bce32c0 0x55a62bce56e0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a62bc642f0 0x55a62bc6d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a62badef40 0x55a62bc70260 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1d1aedb80 1 --2- 172.21.15.71:0/1238965420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a62bc5e440 0x55a62bc707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1a6000700 0 client.26813 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 >> 172.21.15.71:0/1238965420 conn(0x55a62bb3f0c0 msgr2=0x55a62bc61700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.954+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 shutdown_connections 2024-05-27T09:57:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.955+0000 7ff1d1aedb80 1 -- 172.21.15.71:0/1238965420 wait complete. 2024-05-27T09:57:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.955+0000 7ff1d1aedb80 20 client.26813 trim_cache size 0 max 16384 2024-05-27T09:57:09.955 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 28, 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "b0a00f7b": { 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 28, 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:57:09.956 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 142.3, 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:57:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.956+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1a00b29f0 msgr2=0x7ff1a00b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.956+0000 7ff1c3000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1a00b29f0 0x7ff1a00b4f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4010000 tx=0x7ff1b401c000 comp rx=0 tx=0).stop 2024-05-27T09:57:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.956+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106560 msgr2=0x7ff1bc077cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.956+0000 7ff1c3000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106560 0x7ff1bc077cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e970 tx=0x7ff1ac00ec80 comp rx=0 tx=0).stop 2024-05-27T09:57:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 shutdown_connections 2024-05-27T09:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff1a00b29f0 0x7ff1a00b4f00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1bc10c5a0 0x7ff1bc078740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1bc106560 0x7ff1bc077cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 --2- 172.21.15.71:0/1415838513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1bc106eb0 0x7ff1bc078200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 >> 172.21.15.71:0/1415838513 conn(0x7ff1bc102040 msgr2=0x7ff1bc10a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 shutdown_connections 2024-05-27T09:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:09.957+0000 7ff1c3000700 1 -- 172.21.15.71:0/1415838513 wait complete. 2024-05-27T09:57:10.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:09 smithi122 ceph-mon[36436]: osdmap e90: 12 total, 12 up, 12 in 2024-05-27T09:57:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:09 smithi122 ceph-mon[36436]: pgmap v291: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-27T09:57:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:09 smithi072 ceph-mon[35951]: osdmap e90: 12 total, 12 up, 12 in 2024-05-27T09:57:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:09 smithi072 ceph-mon[35951]: pgmap v291: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-27T09:57:10.937 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b0a00f7b', total seconds elapsed: 30.5 2024-05-27T09:57:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.3 2024-05-27T09:57:10.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:57:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:57:13.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:12 smithi071 ceph-mon[31451]: pgmap v292: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 280 KiB/s wr, 83 op/s 2024-05-27T09:57:13.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:12 smithi122 ceph-mon[36436]: pgmap v292: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 280 KiB/s wr, 83 op/s 2024-05-27T09:57:13.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:12 smithi072 ceph-mon[35951]: pgmap v292: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 280 KiB/s wr, 83 op/s 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.850+0000 7fd3e7400700 1 -- 172.21.15.71:0/4215051123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 msgr2=0x7fd3e01111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.850+0000 7fd3e7400700 1 --2- 172.21.15.71:0/4215051123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 0x7fd3e01111c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800b0a0 tx=0x7fd3d800b3b0 comp rx=0 tx=0).stop 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.851+0000 7fd3e7400700 1 -- 172.21.15.71:0/4215051123 shutdown_connections 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.851+0000 7fd3e7400700 1 --2- 172.21.15.71:0/4215051123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 0x7fd3e01111c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.851+0000 7fd3e7400700 1 --2- 172.21.15.71:0/4215051123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3e01045e0 0x7fd3e01049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.851+0000 7fd3e7400700 1 --2- 172.21.15.71:0/4215051123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e0108f10 0x7fd3e0109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.851+0000 7fd3e7400700 1 -- 172.21.15.71:0/4215051123 >> 172.21.15.71:0/4215051123 conn(0x7fd3e0100030 msgr2=0x7fd3e0102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.852+0000 7fd3e7400700 1 -- 172.21.15.71:0/4215051123 shutdown_connections 2024-05-27T09:57:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.852+0000 7fd3e7400700 1 -- 172.21.15.71:0/4215051123 wait complete. 2024-05-27T09:57:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.853+0000 7fd3e7400700 1 Processor -- start 2024-05-27T09:57:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.853+0000 7fd3e7400700 1 -- start start 2024-05-27T09:57:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.854+0000 7fd3e7400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e01045e0 0x7fd3e0075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.854+0000 7fd3e7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3e0108f10 0x7fd3e0075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.854+0000 7fd3e7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 0x7fd3e0076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.854+0000 7fd3e7400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e01144e0 con 0x7fd3e0108f10 2024-05-27T09:57:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.854+0000 7fd3e7400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0114360 con 0x7fd3e0109860 2024-05-27T09:57:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.854+0000 7fd3e7400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0114660 con 0x7fd3e01045e0 2024-05-27T09:57:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e4a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e01045e0 0x7fd3e0075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 0x7fd3e0076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e4a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e01045e0 0x7fd3e0075ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41226/0 (socket says 172.21.15.71:41226) 2024-05-27T09:57:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e4a00700 1 -- 172.21.15.71:0/1280191594 learned_addr learned my addr 172.21.15.71:0/1280191594 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3dfe00700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3e0108f10 0x7fd3e0075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e5400700 1 -- 172.21.15.71:0/1280191594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e01045e0 msgr2=0x7fd3e0075ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e5400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e01045e0 0x7fd3e0075ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e5400700 1 -- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3e0108f10 msgr2=0x7fd3e0075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e5400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3e0108f10 0x7fd3e0075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.855+0000 7fd3e5400700 1 -- 172.21.15.71:0/1280191594 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e01a91f0 con 0x7fd3e0109860 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.856+0000 7fd3e4a00700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e01045e0 0x7fd3e0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.856+0000 7fd3e5400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 0x7fd3e0076530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800b0a0 tx=0x7fd3d8004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.856+0000 7fd3dd600700 1 -- 172.21.15.71:0/1280191594 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8021070 con 0x7fd3e0109860 2024-05-27T09:57:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.856+0000 7fd3dd600700 1 -- 172.21.15.71:0/1280191594 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3d8007b80 con 0x7fd3e0109860 2024-05-27T09:57:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.856+0000 7fd3dd600700 1 -- 172.21.15.71:0/1280191594 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8005040 con 0x7fd3e0109860 2024-05-27T09:57:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.856+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e01a9480 con 0x7fd3e0109860 2024-05-27T09:57:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.857+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e01a98e0 con 0x7fd3e0109860 2024-05-27T09:57:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.858+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e00512b0 con 0x7fd3e0109860 2024-05-27T09:57:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.862+0000 7fd3dd600700 1 -- 172.21.15.71:0/1280191594 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd3d8024070 con 0x7fd3e0109860 2024-05-27T09:57:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.863+0000 7fd3dd600700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3c80b2aa0 0x7fd3c80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.864+0000 7fd3dd600700 1 -- 172.21.15.71:0/1280191594 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fd3d800f020 con 0x7fd3e0109860 2024-05-27T09:57:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.864+0000 7fd3e4a00700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3c80b2aa0 0x7fd3c80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.865+0000 7fd3e4a00700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3c80b2aa0 0x7fd3c80b4fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4011550 tx=0x7fd3d4009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:13.868+0000 7fd3dd600700 1 -- 172.21.15.71:0/1280191594 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd3d802b020 con 0x7fd3e0109860 2024-05-27T09:57:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.201+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3e002e7a0 con 0x7fd3e0109860 2024-05-27T09:57:14.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.202+0000 7fd3dd600700 1 -- 172.21.15.71:0/1280191594 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7fd3d80ab310 con 0x7fd3e0109860 2024-05-27T09:57:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:57:14.203 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:57:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3c80b2aa0 msgr2=0x7fd3c80b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3c80b2aa0 0x7fd3c80b4fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4011550 tx=0x7fd3d4009260 comp rx=0 tx=0).stop 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 msgr2=0x7fd3e0076530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 0x7fd3e0076530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800b0a0 tx=0x7fd3d8004c80 comp rx=0 tx=0).stop 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 shutdown_connections 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd3c80b2aa0 0x7fd3c80b4fb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0109860 0x7fd3e0076530 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3e01045e0 0x7fd3e0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 --2- 172.21.15.71:0/1280191594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3e0108f10 0x7fd3e0075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.206+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 >> 172.21.15.71:0/1280191594 conn(0x7fd3e0100030 msgr2=0x7fd3e0108680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.207+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 shutdown_connections 2024-05-27T09:57:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:14.207+0000 7fd3e7400700 1 -- 172.21.15.71:0/1280191594 wait complete. 2024-05-27T09:57:14.209 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:57:15.044 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 142.3 --await-for 45.0' 2024-05-27T09:57:15.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 142.3 --await-for 45.0 2024-05-27T09:57:15.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:14 smithi071 ceph-mon[31451]: pgmap v293: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 280 KiB/s wr, 83 op/s 2024-05-27T09:57:15.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:14 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1280191594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:15.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:14 smithi122 ceph-mon[36436]: pgmap v293: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 280 KiB/s wr, 83 op/s 2024-05-27T09:57:15.363 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:14 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1280191594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:15.364 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:14 smithi072 ceph-mon[35951]: pgmap v293: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 280 KiB/s wr, 83 op/s 2024-05-27T09:57:15.364 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:14 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1280191594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:15.519 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:57:16.707 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:16 smithi071 ceph-mon[31451]: osdmap e91: 12 total, 12 up, 12 in 2024-05-27T09:57:16.707 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:16 smithi071 ceph-mon[31451]: pgmap v295: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 340 KiB/s wr, 97 op/s 2024-05-27T09:57:16.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:16 smithi122 ceph-mon[36436]: osdmap e91: 12 total, 12 up, 12 in 2024-05-27T09:57:16.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:16 smithi122 ceph-mon[36436]: pgmap v295: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 340 KiB/s wr, 97 op/s 2024-05-27T09:57:16.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:16 smithi072 ceph-mon[35951]: osdmap e91: 12 total, 12 up, 12 in 2024-05-27T09:57:16.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:16 smithi072 ceph-mon[35951]: pgmap v295: 97 pgs: 97 active+clean; 107 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 340 KiB/s wr, 97 op/s 2024-05-27T09:57:17.173 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x63e5d2a 2024-05-27T09:57:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 -- 172.21.15.71:0/3247840673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f410a140 msgr2=0x7f96f4103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 --2- 172.21.15.71:0/3247840673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f410a140 0x7f96f4103d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009900 tx=0x7f96e002a410 comp rx=0 tx=0).stop 2024-05-27T09:57:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 -- 172.21.15.71:0/3247840673 shutdown_connections 2024-05-27T09:57:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 --2- 172.21.15.71:0/3247840673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 0x7f96f41107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 --2- 172.21.15.71:0/3247840673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f410a140 0x7f96f4103d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 --2- 172.21.15.71:0/3247840673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96f4109ca0 0x7f96f4103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 -- 172.21.15.71:0/3247840673 >> 172.21.15.71:0/3247840673 conn(0x7f96f4079390 msgr2=0x7f96f40797d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 -- 172.21.15.71:0/3247840673 shutdown_connections 2024-05-27T09:57:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.941+0000 7f96fa400640 1 -- 172.21.15.71:0/3247840673 wait complete. 2024-05-27T09:57:17.944 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.943+0000 7f96fa400640 1 Processor -- start 2024-05-27T09:57:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.943+0000 7f96fa400640 1 -- start start 2024-05-27T09:57:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96fa400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 0x7f96f4076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96fa400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f4109ca0 0x7f96f4074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96fa400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96f410a140 0x7f96f40755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96fa400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96f4113ee0 con 0x7f96f410a140 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96fa400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96f4113d60 con 0x7f96f4109ca0 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96fa400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96f4114060 con 0x7f96f41043f0 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96f3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 0x7f96f4076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96f2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f4109ca0 0x7f96f4074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96f3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 0x7f96f4076b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:56984/0 (socket says 172.21.15.71:56984) 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96f2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f4109ca0 0x7f96f4074fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56486/0 (socket says 172.21.15.71:56486) 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.944+0000 7f96f3400640 1 -- 172.21.15.71:0/2395423479 learned_addr learned my addr 172.21.15.71:0/2395423479 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96f410a140 0x7f96f40755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f3400640 1 -- 172.21.15.71:0/2395423479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f4109ca0 msgr2=0x7f96f4074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f3400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f4109ca0 0x7f96f4074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f3400640 1 -- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96f410a140 msgr2=0x7f96f40755c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f3400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96f410a140 0x7f96f40755c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f3400640 1 -- 172.21.15.71:0/2395423479 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f4075db0 con 0x7f96f41043f0 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f2a00640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f4109ca0 0x7f96f4074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96f3400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 0x7f96f4076b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96e400e9c0 tx=0x7f96e400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96ebe00640 1 -- 172.21.15.71:0/2395423479 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e400cd80 con 0x7f96f41043f0 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96ebe00640 1 -- 172.21.15.71:0/2395423479 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e40054d0 con 0x7f96f41043f0 2024-05-27T09:57:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96ebe00640 1 -- 172.21.15.71:0/2395423479 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4010430 con 0x7f96f41043f0 2024-05-27T09:57:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.945+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f41ad3c0 con 0x7f96f41043f0 2024-05-27T09:57:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.946+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f41ad890 con 0x7f96f41043f0 2024-05-27T09:57:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.949+0000 7f97013d6740 1 Processor -- start 2024-05-27T09:57:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.949+0000 7f97013d6740 1 -- start start 2024-05-27T09:57:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f96ebe00640 1 -- 172.21.15.71:0/2395423479 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f96e40105d0 con 0x7f96f41043f0 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f97013d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fde31b0 0x561530185860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f97013d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdba2f0 0x561530185da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f97013d6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x5615301862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f97013d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5615300f6b90 con 0x56152fdba2f0 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f97013d6740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5615300e6730 con 0x56152fdc24d0 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f97013d6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615300ea770 con 0x56152fde31b0 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f96f2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x5615301862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f96f3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fde31b0 0x561530185860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f96f3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdba2f0 0x561530185da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f96f2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x5615301862e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56496/0 (socket says 172.21.15.71:56496) 2024-05-27T09:57:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.950+0000 7f96f2a00640 1 -- 172.21.15.71:0/3553395832 learned_addr learned my addr 172.21.15.71:0/3553395832 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.951+0000 7f96f2a00640 1 -- 172.21.15.71:0/3553395832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fde31b0 msgr2=0x561530185860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.951+0000 7f96f2a00640 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fde31b0 0x561530185860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.951+0000 7f96f2a00640 1 -- 172.21.15.71:0/3553395832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdba2f0 msgr2=0x561530185da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.951+0000 7f96f2a00640 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdba2f0 0x561530185da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.951+0000 7f96f2a00640 1 -- 172.21.15.71:0/3553395832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56153007f8b0 con 0x56152fdc24d0 2024-05-27T09:57:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.951+0000 7f96f3400640 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdba2f0 0x561530185da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.951+0000 7f96f2a00640 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x5615301862e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f96e0031440 tx=0x7f96e0004470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb9e2f508df3a297 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.952+0000 7f96e8c00640 1 -- 172.21.15.71:0/3553395832 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0035040 con 0x56152fdc24d0 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.952+0000 7f96e8c00640 1 -- 172.21.15.71:0/3553395832 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e0004770 con 0x56152fdc24d0 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.952+0000 7f96e8c00640 1 -- 172.21.15.71:0/3553395832 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0003950 con 0x56152fdc24d0 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.952+0000 7f96ebe00640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f96d80b2a50 0x7f96d80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.952+0000 7f96ebe00640 1 -- 172.21.15.71:0/2395423479 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f96e40e2a60 con 0x7f96f41043f0 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f96d80b2a50 0x7f96d80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f97013d6740 1 -- 172.21.15.71:0/3553395832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 msgr2=0x5615301862e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f97013d6740 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x5615301862e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f96e0031440 tx=0x7f96e0004470 comp rx=0 tx=0).stop 2024-05-27T09:57:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f97013d6740 1 -- 172.21.15.71:0/3553395832 shutdown_connections 2024-05-27T09:57:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f97013d6740 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x5615301862e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f97013d6740 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdba2f0 0x561530185da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f97013d6740 1 --2- 172.21.15.71:0/3553395832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fde31b0 0x561530185860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.953+0000 7f97013d6740 1 -- 172.21.15.71:0/3553395832 >> 172.21.15.71:0/3553395832 conn(0x56152fdd7300 msgr2=0x561530182010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.954+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f96d80b2a50 0x7f96d80b4f60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5615301829d0 tx=0x7f96ec009500 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.955+0000 7f97013d6740 1 -- 172.21.15.71:0/3553395832 shutdown_connections 2024-05-27T09:57:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.955+0000 7f97013d6740 1 -- 172.21.15.71:0/3553395832 wait complete. 2024-05-27T09:57:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.955+0000 7f97013d6740 1 -- start start 2024-05-27T09:57:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.956+0000 7f97013d6740 1 Processor -- start 2024-05-27T09:57:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.957+0000 7f97013d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdba2f0 0x56153018f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.957+0000 7f97013d6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x56153018fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.957+0000 7f97013d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fde31b0 0x56153019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.957+0000 7f96f3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdba2f0 0x56153018f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.957+0000 7f96f3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdba2f0 0x56153018f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:56994/0 (socket says 172.21.15.71:56994) 2024-05-27T09:57:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.958+0000 7f96f3400640 1 -- 172.21.15.71:0/2176769992 learned_addr learned my addr 172.21.15.71:0/2176769992 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.959+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56152fdcc790 con 0x56152fde31b0 2024-05-27T09:57:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.959+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56153008ebc0 con 0x56152fdc24d0 2024-05-27T09:57:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.959+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561530192930 con 0x56152fdba2f0 2024-05-27T09:57:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.959+0000 7f97013d6740 10 client.0 _ll_register_callbacks cb 0x56153006c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.959+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fde31b0 0x56153019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.960+0000 7f96f2a00640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x56153018fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.960+0000 7f96f3e00640 1 -- 172.21.15.71:0/2176769992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdba2f0 msgr2=0x56153018f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.960+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdba2f0 0x56153018f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.960+0000 7f96f3e00640 1 -- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 msgr2=0x56153018fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.960+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x56153018fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.960+0000 7f96f3e00640 1 -- 172.21.15.71:0/2176769992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56152fdfb210 con 0x56152fde31b0 2024-05-27T09:57:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.961+0000 7f96f3400640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdba2f0 0x56153018f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:57:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.961+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fde31b0 0x56153019bc60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005fd0 tx=0x7f96ec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5818d805adbae4b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.961+0000 7f96dd600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:57:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.962+0000 7f96dd600640 1 -- 172.21.15.71:0/2176769992 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec02c060 con 0x56152fde31b0 2024-05-27T09:57:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.962+0000 7f96dd600640 1 -- 172.21.15.71:0/2176769992 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f96ec017030 con 0x56152fde31b0 2024-05-27T09:57:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.963+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96e0004770 con 0x56152fde31b0 2024-05-27T09:57:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.963+0000 7f96dd600640 1 -- 172.21.15.71:0/2176769992 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f96ec011940 con 0x56152fde31b0 2024-05-27T09:57:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.963+0000 7f97013d6740 10 client.16662 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.963+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56152fec7620 con 0x56152fde31b0 2024-05-27T09:57:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.964+0000 7f96dd600640 1 -- 172.21.15.71:0/2176769992 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e0004770 con 0x56152fde31b0 2024-05-27T09:57:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.965+0000 7f96dd600640 1 -- 172.21.15.71:0/2176769992 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f96ec027b70 con 0x56152fde31b0 2024-05-27T09:57:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.965+0000 7f97013d6740 10 client.16662 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.965+0000 7f97013d6740 10 client.16662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.965+0000 7f97013d6740 20 client.16662 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.965+0000 7f97013d6740 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fda1d80 0x5615301a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.965+0000 7f97013d6740 4 client.16662 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.965+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615300f8ae0 con 0x56152fda1d80 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.966+0000 7f96f3400640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fda1d80 0x5615301a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.966+0000 7f96f3400640 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fda1d80 0x5615301a1bc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2fe9289e296f69 server_cookie=20664df137757f32 in_seq=0 out_seq=0 2024-05-27T09:57:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.966+0000 7f96dd600640 10 client.16662 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.967+0000 7f96dd600640 1 -- 172.21.15.71:0/2176769992 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5615300f8ae0 con 0x56152fda1d80 2024-05-27T09:57:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.967+0000 7f96dd600640 10 client.16662 handle_command_reply: tid=0 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.967+0000 7f97013d6740 1 client.16662 shutdown 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fde31b0 msgr2=0x56153019bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fde31b0 0x56153019bc60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005fd0 tx=0x7f96ec004ab0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 shutdown_connections 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fda1d80 0x5615301a1bc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fde31b0 0x56153019bc60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdc24d0 0x56153018fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 --2- 172.21.15.71:0/2176769992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdba2f0 0x56153018f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 >> 172.21.15.71:0/2176769992 conn(0x56152fdd7300 msgr2=0x561530187580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:17.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f96dd600640 0 client.16662 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:17.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 shutdown_connections 2024-05-27T09:57:17.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 1 -- 172.21.15.71:0/2176769992 wait complete. 2024-05-27T09:57:17.970 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.968+0000 7f97013d6740 20 client.16662 trim_cache size 0 max 16384 2024-05-27T09:57:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 Processor -- start 2024-05-27T09:57:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 -- start start 2024-05-27T09:57:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x5615301910d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x56153019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x56153019bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96f41b8a10 con 0x56152fdc24d0 2024-05-27T09:57:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96f41b62e0 con 0x56152fdba2f0 2024-05-27T09:57:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f97013d6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96f41b4150 con 0x56152fdd7300 2024-05-27T09:57:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f96f2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x56153019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.988+0000 7f96f3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x56153019bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x56153019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56510/0 (socket says 172.21.15.71:56510) 2024-05-27T09:57:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x5615301910d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 -- 172.21.15.71:0/3518500046 learned_addr learned my addr 172.21.15.71:0/3518500046 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 -- 172.21.15.71:0/3518500046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 msgr2=0x5615301910d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x5615301910d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 -- 172.21.15.71:0/3518500046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 msgr2=0x56153019bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x56153019bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 -- 172.21.15.71:0/3518500046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561530191f80 con 0x56152fdba2f0 2024-05-27T09:57:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f3400640 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x5615301910d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f3e00640 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x56153019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.989+0000 7f96f2a00640 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x56153019b9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f96e0031440 tx=0x7f96e0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327ee0870592b31e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.990+0000 7f96dfe00640 1 -- 172.21.15.71:0/3518500046 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0035040 con 0x56152fdba2f0 2024-05-27T09:57:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.990+0000 7f96dfe00640 1 -- 172.21.15.71:0/3518500046 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e00054f0 con 0x56152fdba2f0 2024-05-27T09:57:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.990+0000 7f96dfe00640 1 -- 172.21.15.71:0/3518500046 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0003850 con 0x56152fdba2f0 2024-05-27T09:57:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 -- 172.21.15.71:0/3518500046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 msgr2=0x56153019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x56153019b9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f96e0031440 tx=0x7f96e0005fd0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 -- 172.21.15.71:0/3518500046 shutdown_connections 2024-05-27T09:57:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x56153019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x56153019b9d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 --2- 172.21.15.71:0/3518500046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x5615301910d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 -- 172.21.15.71:0/3518500046 >> 172.21.15.71:0/3518500046 conn(0x561530187e20 msgr2=0x561530186170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 -- 172.21.15.71:0/3518500046 shutdown_connections 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 -- 172.21.15.71:0/3518500046 wait complete. 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.991+0000 7f97013d6740 1 -- start start 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 1 Processor -- start 2024-05-27T09:57:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x561530193390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x5615301938d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x561530202260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96f41b47a0 con 0x56152fdc24d0 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96f41b5c10 con 0x56152fdba2f0 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96f41b4e70 con 0x56152fdd7300 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f97013d6740 10 client.0 _ll_register_callbacks cb 0x7f96ec009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f96f3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x561530193390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f96f3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x561530193390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56516/0 (socket says 172.21.15.71:56516) 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f96f3400640 1 -- 172.21.15.71:0/2037539957 learned_addr learned my addr 172.21.15.71:0/2037539957 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.992+0000 7f96f2a00640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x5615301938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x561530202260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3400640 1 -- 172.21.15.71:0/2037539957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 msgr2=0x561530202260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3400640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x561530202260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3400640 1 -- 172.21.15.71:0/2037539957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 msgr2=0x5615301938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3400640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x5615301938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3400640 1 -- 172.21.15.71:0/2037539957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615302027f0 con 0x56152fdba2f0 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3e00640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x561530202260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96f3400640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x561530193390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f96e40a5e40 tx=0x7f96e40caf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e6b18f6d8e35a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96dd600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96dd600640 1 -- 172.21.15.71:0/2037539957 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e40c43c0 con 0x56152fdba2f0 2024-05-27T09:57:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f96dd600640 1 -- 172.21.15.71:0/2037539957 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f96e40a63b0 con 0x56152fdba2f0 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.993+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96e00054f0 con 0x56152fdba2f0 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f96dd600640 1 -- 172.21.15.71:0/2037539957 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f96e40a98d0 con 0x56152fdba2f0 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 10 client.26837 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561530209b20 con 0x56152fdba2f0 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f96dd600640 1 -- 172.21.15.71:0/2037539957 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e00054f0 con 0x56152fdba2f0 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f96dd600640 1 -- 172.21.15.71:0/2037539957 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f96e40a5730 con 0x56152fdba2f0 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 10 client.26837 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 10 client.26837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 20 client.26837 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fde31b0 0x56153020c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 4 client.26837 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.994+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615300f22c0 con 0x56152fde31b0 2024-05-27T09:57:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.995+0000 7f96f2a00640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fde31b0 0x56153020c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.995+0000 7f96dd600640 10 client.26837 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:17.995+0000 7f96f2a00640 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fde31b0 0x56153020c260 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c91af9deefb4eb0 server_cookie=9a4081e4992024f7 in_seq=0 out_seq=0 2024-05-27T09:57:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f96dd600640 1 -- 172.21.15.71:0/2037539957 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5615300f22c0 con 0x56152fde31b0 2024-05-27T09:57:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f96dd600640 10 client.26837 handle_command_reply: tid=0 2024-05-27T09:57:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 client.26837 shutdown 2024-05-27T09:57:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 msgr2=0x561530193390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x561530193390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f96e40a5e40 tx=0x7f96e40caf90 comp rx=0 tx=0).stop 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 shutdown_connections 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56152fdd7300 0x561530202260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x56152fde31b0 0x56153020c260 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56152fdc24d0 0x5615301938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 --2- 172.21.15.71:0/2037539957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56152fdba2f0 0x561530193390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 >> 172.21.15.71:0/2037539957 conn(0x561530187e20 msgr2=0x561530186170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f96dd600640 0 client.26837 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 shutdown_connections 2024-05-27T09:57:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.009+0000 7f97013d6740 1 -- 172.21.15.71:0/2037539957 wait complete. 2024-05-27T09:57:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.010+0000 7f97013d6740 20 client.26837 trim_cache size 0 max 16384 2024-05-27T09:57:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:57:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:57:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f96d80b2a50 msgr2=0x7f96d80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f96d80b2a50 0x7f96d80b4f60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5615301829d0 tx=0x7f96ec009500 comp rx=0 tx=0).stop 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 msgr2=0x7f96f4076b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 0x7f96f4076b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96e400e9c0 tx=0x7f96e400ee80 comp rx=0 tx=0).stop 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 shutdown_connections 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f96d80b2a50 0x7f96d80b4f60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96f410a140 0x7f96f40755c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f4109ca0 0x7f96f4074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 --2- 172.21.15.71:0/2395423479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f41043f0 0x7f96f4076b70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 >> 172.21.15.71:0/2395423479 conn(0x7f96f4079390 msgr2=0x7f96f4105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 shutdown_connections 2024-05-27T09:57:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:18.011+0000 7f96fa400640 1 -- 172.21.15.71:0/2395423479 wait complete. 2024-05-27T09:57:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 -- 172.21.15.71:0/2175478324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 msgr2=0x7f0e4c10e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 --2- 172.21.15.71:0/2175478324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 0x7f0e4c10e370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009990 tx=0x7f0e38009ca0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 -- 172.21.15.71:0/2175478324 shutdown_connections 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 --2- 172.21.15.71:0/2175478324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c10e900 0x7f0e4c110de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 --2- 172.21.15.71:0/2175478324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e4c1054d0 0x7f0e4c1058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 --2- 172.21.15.71:0/2175478324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 0x7f0e4c10e370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 -- 172.21.15.71:0/2175478324 >> 172.21.15.71:0/2175478324 conn(0x7f0e4c0fedb0 msgr2=0x7f0e4c1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 -- 172.21.15.71:0/2175478324 shutdown_connections 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.193+0000 7f0e51200700 1 -- 172.21.15.71:0/2175478324 wait complete. 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.195+0000 7f0e51200700 1 Processor -- start 2024-05-27T09:57:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.195+0000 7f0e51200700 1 -- start start 2024-05-27T09:57:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.195+0000 7f0e51200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c1054d0 0x7f0e4c19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e51200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 0x7f0e4c19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e51200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e4c10e900 0x7f0e4c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e51200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c114480 con 0x7f0e4c1054d0 2024-05-27T09:57:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e51200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c114300 con 0x7f0e4c10e900 2024-05-27T09:57:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e51200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c114600 con 0x7f0e4c105e20 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c1054d0 0x7f0e4c19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 0x7f0e4c19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c1054d0 0x7f0e4c19add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55046/0 (socket says 172.21.15.71:55046) 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49e00700 1 -- 172.21.15.71:0/1289029327 learned_addr learned my addr 172.21.15.71:0/1289029327 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e4a800700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e4c10e900 0x7f0e4c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49400700 1 -- 172.21.15.71:0/1289029327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e4c10e900 msgr2=0x7f0e4c19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49400700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e4c10e900 0x7f0e4c19f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49400700 1 -- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c1054d0 msgr2=0x7f0e4c19add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.196+0000 7f0e49400700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c1054d0 0x7f0e4c19add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e49400700 1 -- 172.21.15.71:0/1289029327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c19fca0 con 0x7f0e4c105e20 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e49e00700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c1054d0 0x7f0e4c19add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e4a800700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e4c10e900 0x7f0e4c19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e49400700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 0x7f0e4c19b370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e380098e0 tx=0x7f0e380057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e42a00700 1 -- 172.21.15.71:0/1289029327 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38027070 con 0x7f0e4c105e20 2024-05-27T09:57:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e42a00700 1 -- 172.21.15.71:0/1289029327 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e38022470 con 0x7f0e4c105e20 2024-05-27T09:57:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e42a00700 1 -- 172.21.15.71:0/1289029327 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38017650 con 0x7f0e4c105e20 2024-05-27T09:57:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4c19ff30 con 0x7f0e4c105e20 2024-05-27T09:57:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.197+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e4c1a03c0 con 0x7f0e4c105e20 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.202+0000 7f0e42a00700 1 -- 172.21.15.71:0/1289029327 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0e38009d10 con 0x7f0e4c105e20 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.202+0000 7f0e5fc82b80 1 Processor -- start 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.203+0000 7f0e5fc82b80 1 -- start start 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.203+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.203+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313163b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.203+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f31315da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.203+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f31308afd0 con 0x55f312fddfd0 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.203+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f31307ab70 con 0x55f31315d670 2024-05-27T09:57:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.203+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f31307ebb0 con 0x55f3130c9b80 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e49400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f31315da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131635c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57034/0 (socket says 172.21.15.71:57034) 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 -- 172.21.15.71:0/299324286 learned_addr learned my addr 172.21.15.71:0/299324286 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e49e00700 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313163b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 -- 172.21.15.71:0/299324286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 msgr2=0x55f31315da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f31315da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 -- 172.21.15.71:0/299324286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 msgr2=0x55f313163b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313163b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 -- 172.21.15.71:0/299324286 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3130435b0 con 0x55f3130c9b80 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e49e00700 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313163b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e4a800700 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131635c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0e44011540 tx=0x7f0e44011850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52d3a9b74109511a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.204+0000 7f0e42a00700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0e300b2a70 0x7f0e300b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.205+0000 7f0e37400700 1 -- 172.21.15.71:0/299324286 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4401e070 con 0x55f3130c9b80 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.205+0000 7f0e42a00700 1 -- 172.21.15.71:0/1289029327 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f0e380e2ea0 con 0x7f0e4c105e20 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.205+0000 7f0e37400700 1 -- 172.21.15.71:0/299324286 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e44019ae0 con 0x55f3130c9b80 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.205+0000 7f0e37400700 1 -- 172.21.15.71:0/299324286 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400ebe0 con 0x55f3130c9b80 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/299324286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 msgr2=0x55f3131635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131635c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0e44011540 tx=0x7f0e44011850 comp rx=0 tx=0).stop 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e49e00700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0e300b2a70 0x7f0e300b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/299324286 shutdown_connections 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f31315da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131635c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/299324286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313163b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/299324286 >> 172.21.15.71:0/299324286 conn(0x55f313077520 msgr2=0x55f3131586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/299324286 shutdown_connections 2024-05-27T09:57:18.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.206+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/299324286 wait complete. 2024-05-27T09:57:18.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.207+0000 7f0e49e00700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0e300b2a70 0x7f0e300b4f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55f313159da0 tx=0x7f0e3c009040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.207+0000 7f0e5fc82b80 1 -- start start 2024-05-27T09:57:18.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.207+0000 7f0e5fc82b80 1 Processor -- start 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313167390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f313167e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f312f81130 con 0x55f312fddfd0 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f31301b8f0 con 0x55f31315d670 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f31315e460 con 0x55f3130c9b80 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e5fc82b80 10 client.0 _ll_register_callbacks cb 0x55f313024e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e49400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e49400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:57042/0 (socket says 172.21.15.71:57042) 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e49e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e49400700 1 -- 172.21.15.71:0/1639346874 learned_addr learned my addr 172.21.15.71:0/1639346874 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.208+0000 7f0e4a800700 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f313167e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e49400700 1 -- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 msgr2=0x55f313167e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e49400700 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f313167e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e49400700 1 -- 172.21.15.71:0/1639346874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 msgr2=0x55f313167390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e49400700 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313167390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e49400700 1 -- 172.21.15.71:0/1639346874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f312fcaa60 con 0x55f3130c9b80 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e49400700 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131678d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0e380e0bf0 tx=0x7f0e380096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a972559efcdfd7f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e2be00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e2be00700 1 -- 172.21.15.71:0/1639346874 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e380a9b60 con 0x55f3130c9b80 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e2be00700 1 -- 172.21.15.71:0/1639346874 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f0e380aa680 con 0x55f3130c9b80 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e44019ae0 con 0x55f3130c9b80 2024-05-27T09:57:18.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e2be00700 1 -- 172.21.15.71:0/1639346874 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e380a9980 con 0x55f3130c9b80 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e5fc82b80 10 client.26875 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.209+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f31304b1f0 con 0x55f3130c9b80 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e2be00700 1 -- 172.21.15.71:0/1639346874 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e44019ae0 con 0x55f3130c9b80 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e2be00700 1 -- 172.21.15.71:0/1639346874 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f0e3802a030 con 0x55f3130c9b80 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e5fc82b80 10 client.26875 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e5fc82b80 10 client.26875 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e5fc82b80 20 client.26875 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f313177010 0x55f313179490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e5fc82b80 4 client.26875 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f31308cf20 con 0x55f313177010 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.210+0000 7f0e49e00700 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f313177010 0x55f313179490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.211+0000 7f0e49e00700 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f313177010 0x55f313179490 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=845a526e7a4cb2bf server_cookie=19b78e08dcbe05a2 in_seq=0 out_seq=0 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.211+0000 7f0e2be00700 10 client.26875 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e2be00700 1 -- 172.21.15.71:0/1639346874 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f31308cf20 con 0x55f313177010 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e2be00700 10 client.26875 handle_command_reply: tid=0 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 client.26875 shutdown 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 msgr2=0x55f3131678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131678d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0e380e0bf0 tx=0x7f0e380096e0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 shutdown_connections 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f313177010 0x55f313179490 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f31315d670 0x55f313167e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f312fddfd0 0x55f313167390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/1639346874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3130c9b80 0x55f3131678d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 >> 172.21.15.71:0/1639346874 conn(0x55f313077520 msgr2=0x55f31315c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e2be00700 0 client.26875 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 shutdown_connections 2024-05-27T09:57:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.212+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/1639346874 wait complete. 2024-05-27T09:57:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.213+0000 7f0e5fc82b80 20 client.26875 trim_cache size 0 max 16384 2024-05-27T09:57:18.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.236+0000 7f0e5fc82b80 1 Processor -- start 2024-05-27T09:57:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.236+0000 7f0e5fc82b80 1 -- start start 2024-05-27T09:57:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f312fddfd0 0x55f313169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f3130c9b80 0x55f313167d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f31315d670 0x55f31315d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1af460 con 0x55f31315d670 2024-05-27T09:57:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1accf0 con 0x55f3130c9b80 2024-05-27T09:57:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1aab60 con 0x55f312fddfd0 2024-05-27T09:57:18.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e49400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f3130c9b80 0x55f313167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e49400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f3130c9b80 0x55f313167d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56566/0 (socket says 172.21.15.71:56566) 2024-05-27T09:57:18.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e49400700 1 -- 172.21.15.71:0/3344532429 learned_addr learned my addr 172.21.15.71:0/3344532429 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:18.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e49e00700 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f312fddfd0 0x55f313169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.237+0000 7f0e4a800700 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f31315d670 0x55f31315d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e49400700 1 -- 172.21.15.71:0/3344532429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f312fddfd0 msgr2=0x55f313169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e49400700 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f312fddfd0 0x55f313169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e49400700 1 -- 172.21.15.71:0/3344532429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f31315d670 msgr2=0x55f31315d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e49400700 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f31315d670 0x55f31315d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e49400700 1 -- 172.21.15.71:0/3344532429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3131549d0 con 0x55f3130c9b80 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e49400700 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f3130c9b80 0x55f313167d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0e380aa1a0 tx=0x7f0e38022bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=792bcb0bef919a01 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e36a00700 1 -- 172.21.15.71:0/3344532429 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e380a9b60 con 0x55f3130c9b80 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e36a00700 1 -- 172.21.15.71:0/3344532429 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e380aa910 con 0x55f3130c9b80 2024-05-27T09:57:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.238+0000 7f0e36a00700 1 -- 172.21.15.71:0/3344532429 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e380050d0 con 0x55f3130c9b80 2024-05-27T09:57:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/3344532429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f3130c9b80 msgr2=0x55f313167d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f3130c9b80 0x55f313167d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0e380aa1a0 tx=0x7f0e38022bc0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/3344532429 shutdown_connections 2024-05-27T09:57:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f31315d670 0x55f31315d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f312fddfd0 0x55f313169830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/3344532429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f3130c9b80 0x55f313167d80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/3344532429 >> 172.21.15.71:0/3344532429 conn(0x55f313077520 msgr2=0x55f313160f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:18.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/3344532429 shutdown_connections 2024-05-27T09:57:18.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.239+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/3344532429 wait complete. 2024-05-27T09:57:18.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.240+0000 7f0e5fc82b80 1 -- start start 2024-05-27T09:57:18.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.240+0000 7f0e5fc82b80 1 Processor -- start 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f312fddfd0 0x55f31316f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3130c9b80 0x55f31316f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e5fc82b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f31315d670 0x55f31316c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1ab1b0 con 0x55f3130c9b80 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1ac620 con 0x55f312fddfd0 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e5fc82b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1ab880 con 0x55f31315d670 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e5fc82b80 10 client.0 _ll_register_callbacks cb 0x55f313024e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e49e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f312fddfd0 0x55f31316f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e49e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f312fddfd0 0x55f31316f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56576/0 (socket says 172.21.15.71:56576) 2024-05-27T09:57:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e4a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f31315d670 0x55f31316c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e49e00700 1 -- 172.21.15.71:0/156015032 learned_addr learned my addr 172.21.15.71:0/156015032 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.241+0000 7f0e49400700 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3130c9b80 0x55f31316f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e49e00700 1 -- 172.21.15.71:0/156015032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f31315d670 msgr2=0x55f31316c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e49e00700 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f31315d670 0x55f31316c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e49e00700 1 -- 172.21.15.71:0/156015032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3130c9b80 msgr2=0x55f31316f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e49e00700 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3130c9b80 0x55f31316f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e49e00700 1 -- 172.21.15.71:0/156015032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f313170010 con 0x55f312fddfd0 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e49e00700 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f312fddfd0 0x55f31316f490 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009fd0 tx=0x7f0e3c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e4a58d02d1b3fc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:18.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e2be00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:18.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e2be00700 1 -- 172.21.15.71:0/156015032 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c018c60 con 0x55f312fddfd0 2024-05-27T09:57:18.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e380aa910 con 0x55f312fddfd0 2024-05-27T09:57:18.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.242+0000 7f0e2be00700 1 -- 172.21.15.71:0/156015032 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f0e3c018e00 con 0x55f312fddfd0 2024-05-27T09:57:18.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.243+0000 7f0e2be00700 1 -- 172.21.15.71:0/156015032 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e3c00ee30 con 0x55f312fddfd0 2024-05-27T09:57:18.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 10 client.26855 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f3131e20a0 con 0x55f312fddfd0 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e2be00700 1 -- 172.21.15.71:0/156015032 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e380aa910 con 0x55f312fddfd0 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e2be00700 1 -- 172.21.15.71:0/156015032 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f0e3c016540 con 0x55f312fddfd0 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 10 client.26855 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 10 client.26855 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 20 client.26855 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f3131e2830 0x55f3131e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 4 client.26855 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.3, "await_for": 45.0}] 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.244+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.3, "await_for": 45.0}) -- 0x55f313162fe0 con 0x55f3131e2830 2024-05-27T09:57:18.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.245+0000 7f0e49400700 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f3131e2830 0x55f3131e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:18.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.245+0000 7f0e2be00700 10 client.26855 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:18.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:18.245+0000 7f0e49400700 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f3131e2830 0x55f3131e4c50 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb94f38151adef1 server_cookie=8c3ed9b7b39630f1 in_seq=0 out_seq=0 2024-05-27T09:57:19.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:18 smithi122 ceph-mon[36436]: pgmap v296: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-05-27T09:57:19.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:18 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:57:19.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:18 smithi071 ceph-mon[31451]: pgmap v296: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-05-27T09:57:19.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:18 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:57:19.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:18 smithi072 ceph-mon[35951]: pgmap v296: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-05-27T09:57:19.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:18 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.353+0000 7f0e2be00700 1 -- 172.21.15.71:0/156015032 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f313162fe0 con 0x55f3131e2830 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.353+0000 7f0e2be00700 10 client.26855 handle_command_reply: tid=0 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.353+0000 7f0e5fc82b80 1 client.26855 shutdown 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f312fddfd0 msgr2=0x55f31316f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f312fddfd0 0x55f31316f490 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009fd0 tx=0x7f0e3c00b040 comp rx=0 tx=0).stop 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 shutdown_connections 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f3131e2830 0x55f3131e4c50 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f31315d670 0x55f31316c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f312fddfd0 0x55f31316f490 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 --2- 172.21.15.71:0/156015032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3130c9b80 0x55f31316f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 >> 172.21.15.71:0/156015032 conn(0x55f313077520 msgr2=0x55f313167ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:19.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.354+0000 7f0e2be00700 0 client.26855 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:19.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.355+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 shutdown_connections 2024-05-27T09:57:19.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.355+0000 7f0e5fc82b80 1 -- 172.21.15.71:0/156015032 wait complete. 2024-05-27T09:57:19.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.355+0000 7f0e5fc82b80 20 client.26855 trim_cache size 0 max 16384 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 30, 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "831d3f7d": { 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 30, 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:57:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 142.3, 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:19.359 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:57:19.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0e300b2a70 msgr2=0x7f0e300b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:19.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0e300b2a70 0x7f0e300b4f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55f313159da0 tx=0x7f0e3c009040 comp rx=0 tx=0).stop 2024-05-27T09:57:19.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 msgr2=0x7f0e4c19b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:19.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 0x7f0e4c19b370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e380098e0 tx=0x7f0e380057c0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 shutdown_connections 2024-05-27T09:57:19.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0e300b2a70 0x7f0e300b4f80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e4c10e900 0x7f0e4c19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e4c1054d0 0x7f0e4c19add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 --2- 172.21.15.71:0/1289029327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e4c105e20 0x7f0e4c19b370 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:19.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 >> 172.21.15.71:0/1289029327 conn(0x7f0e4c0fedb0 msgr2=0x7f0e4c0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:19.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 shutdown_connections 2024-05-27T09:57:19.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:19.356+0000 7f0e51200700 1 -- 172.21.15.71:0/1289029327 wait complete. 2024-05-27T09:57:20.220 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '831d3f7d', quiesce took 9.3 seconds. Will release after: 13.0 2024-05-27T09:57:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: pgmap v297: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1015 KiB/s wr, 314 op/s 2024-05-27T09:57:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:57:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:57:20.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: pgmap v297: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1015 KiB/s wr, 314 op/s 2024-05-27T09:57:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:57:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:57:20.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:20.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: pgmap v297: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1015 KiB/s wr, 314 op/s 2024-05-27T09:57:20.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:57:20.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:57:20.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:57:23.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:22 smithi071 ceph-mon[31451]: pgmap v298: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 955 KiB/s wr, 316 op/s 2024-05-27T09:57:23.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:22 smithi122 ceph-mon[36436]: pgmap v298: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 955 KiB/s wr, 316 op/s 2024-05-27T09:57:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:22 smithi072 ceph-mon[35951]: pgmap v298: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 955 KiB/s wr, 316 op/s 2024-05-27T09:57:25.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:24 smithi122 ceph-mon[36436]: pgmap v299: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 955 KiB/s wr, 316 op/s 2024-05-27T09:57:25.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:24 smithi071 ceph-mon[31451]: pgmap v299: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 955 KiB/s wr, 316 op/s 2024-05-27T09:57:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:24 smithi072 ceph-mon[35951]: pgmap v299: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 955 KiB/s wr, 316 op/s 2024-05-27T09:57:27.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:26 smithi122 ceph-mon[36436]: pgmap v300: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 926 KiB/s wr, 306 op/s 2024-05-27T09:57:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:26 smithi071 ceph-mon[31451]: pgmap v300: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 926 KiB/s wr, 306 op/s 2024-05-27T09:57:27.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:26 smithi072 ceph-mon[35951]: pgmap v300: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 926 KiB/s wr, 306 op/s 2024-05-27T09:57:29.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:28 smithi122 ceph-mon[36436]: pgmap v301: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 798 KiB/s wr, 266 op/s 2024-05-27T09:57:29.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:28 smithi071 ceph-mon[31451]: pgmap v301: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 798 KiB/s wr, 266 op/s 2024-05-27T09:57:29.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:28 smithi072 ceph-mon[35951]: pgmap v301: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 798 KiB/s wr, 266 op/s 2024-05-27T09:57:31.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:30 smithi122 ceph-mon[36436]: pgmap v302: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 179 KiB/s wr, 69 op/s 2024-05-27T09:57:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 -- 172.21.15.71:0/213893833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 msgr2=0x7f122c10a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 --2- 172.21.15.71:0/213893833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 0x7f122c10a200 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1218009900 tx=0x7f121802a480 comp rx=0 tx=0).stop 2024-05-27T09:57:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 -- 172.21.15.71:0/213893833 shutdown_connections 2024-05-27T09:57:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 --2- 172.21.15.71:0/213893833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c10a890 0x7f122c116b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 --2- 172.21.15.71:0/213893833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 0x7f122c10a200 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 --2- 172.21.15.71:0/213893833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c110110 0x7f122c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 -- 172.21.15.71:0/213893833 >> 172.21.15.71:0/213893833 conn(0x7f122c076070 msgr2=0x7f122c078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.242+0000 7f1232800640 1 -- 172.21.15.71:0/213893833 shutdown_connections 2024-05-27T09:57:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.243+0000 7f1232800640 1 -- 172.21.15.71:0/213893833 wait complete. 2024-05-27T09:57:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.244+0000 7f1232800640 1 Processor -- start 2024-05-27T09:57:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.244+0000 7f1232800640 1 -- start start 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1232800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c110110 0x7f122c1a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1232800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 0x7f122c1a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1232800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c1a06c0 0x7f122c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1232800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f122c11a300 con 0x7f122c110110 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1232800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f122c11a180 con 0x7f122c1a06c0 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1232800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f122c11a480 con 0x7f122c110520 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1231400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c110110 0x7f122c1a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1231400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c110110 0x7f122c1a6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59414/0 (socket says 172.21.15.71:59414) 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1231400640 1 -- 172.21.15.71:0/2288924866 learned_addr learned my addr 172.21.15.71:0/2288924866 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1230a00640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 0x7f122c1a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.246 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1231e00640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c1a06c0 0x7f122c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.247 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.245+0000 7f1231400640 1 -- 172.21.15.71:0/2288924866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 msgr2=0x7f122c1a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1231400640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 0x7f122c1a6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1231400640 1 -- 172.21.15.71:0/2288924866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c1a06c0 msgr2=0x7f122c1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1231400640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c1a06c0 0x7f122c1a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1231400640 1 -- 172.21.15.71:0/2288924866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c1a11b0 con 0x7f122c110110 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1231e00640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c1a06c0 0x7f122c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1231400640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c110110 0x7f122c1a6540 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f122000e9c0 tx=0x7f122000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f122a000640 1 -- 172.21.15.71:0/2288924866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122000ccc0 con 0x7f122c110110 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122c1a14a0 con 0x7f122c110110 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f122a000640 1 -- 172.21.15.71:0/2288924866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12200035f0 con 0x7f122c110110 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f122a000640 1 -- 172.21.15.71:0/2288924866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122000ce60 con 0x7f122c110110 2024-05-27T09:57:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.246+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122c1ad580 con 0x7f122c110110 2024-05-27T09:57:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.251+0000 7f123ad99740 1 Processor -- start 2024-05-27T09:57:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.251+0000 7f123ad99740 1 -- start start 2024-05-27T09:57:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.251+0000 7f123ad99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c6fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.251+0000 7f123ad99740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08a42f0 0x55e7e0c6ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.251+0000 7f123ad99740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f123ad99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e7e0be0b90 con 0x55e7e08cd1b0 2024-05-27T09:57:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f123ad99740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e7e0bd0730 con 0x55e7e08a42f0 2024-05-27T09:57:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f123ad99740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e7e0bd4770 con 0x55e7e08ac4d0 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f122a000640 1 -- 172.21.15.71:0/2288924866 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f1220004000 con 0x7f122c110110 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41338/0 (socket says 172.21.15.71:41338) 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 -- 172.21.15.71:0/2239262895 learned_addr learned my addr 172.21.15.71:0/2239262895 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1231e00640 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c6fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1231400640 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08a42f0 0x55e7e0c6ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 -- 172.21.15.71:0/2239262895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08a42f0 msgr2=0x55e7e0c6ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08a42f0 0x55e7e0c6ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 -- 172.21.15.71:0/2239262895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 msgr2=0x55e7e0c6fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c6fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1230a00640 1 -- 172.21.15.71:0/2239262895 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e0b698b0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.252+0000 7f1231400640 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08a42f0 0x55e7e0c6ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.253+0000 7f1230a00640 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c704e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f122c06c590 tx=0x7f1218004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3acef570e76c8549 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.253+0000 7f121e600640 1 -- 172.21.15.71:0/2239262895 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218035040 con 0x55e7e08ac4d0 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.253+0000 7f121e600640 1 -- 172.21.15.71:0/2239262895 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12180054f0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.253+0000 7f121e600640 1 -- 172.21.15.71:0/2239262895 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12180035f0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f122a000640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f12140b2950 0x7f12140b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f122a000640 1 -- 172.21.15.71:0/2288924866 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f12200e2b60 con 0x7f122c110110 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f1231e00640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f12140b2950 0x7f12140b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 -- 172.21.15.71:0/2239262895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 msgr2=0x55e7e0c704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c704e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f122c06c590 tx=0x7f1218004040 comp rx=0 tx=0).stop 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 -- 172.21.15.71:0/2239262895 shutdown_connections 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c704e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08a42f0 0x55e7e0c6ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 --2- 172.21.15.71:0/2239262895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c6fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 -- 172.21.15.71:0/2239262895 >> 172.21.15.71:0/2239262895 conn(0x55e7e08c1300 msgr2=0x55e7e0c6c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 -- 172.21.15.71:0/2239262895 shutdown_connections 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.254+0000 7f123ad99740 1 -- 172.21.15.71:0/2239262895 wait complete. 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.255+0000 7f1231e00640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f12140b2950 0x7f12140b4e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55e7e0c6cbd0 tx=0x7f1224009500 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.255+0000 7f123ad99740 1 -- start start 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.255+0000 7f123ad99740 1 Processor -- start 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f123ad99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c79c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f123ad99740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c7a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f123ad99740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f123ad99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e7e08b6790 con 0x55e7e08a42f0 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f123ad99740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e7e0b78bc0 con 0x55e7e08cd1b0 2024-05-27T09:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f123ad99740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e7e0c7cb30 con 0x55e7e08ac4d0 2024-05-27T09:57:31.259 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f123ad99740 10 client.0 _ll_register_callbacks cb 0x55e7e0b56400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:31.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:30 smithi071 ceph-mon[31451]: pgmap v302: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 179 KiB/s wr, 69 op/s 2024-05-27T09:57:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f1230a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c7a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f1230a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c7a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41350/0 (socket says 172.21.15.71:41350) 2024-05-27T09:57:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f1230a00640 1 -- 172.21.15.71:0/60490293 learned_addr learned my addr 172.21.15.71:0/60490293 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f1231e00640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.256+0000 7f1231400640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c79c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1230a00640 1 -- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08cd1b0 msgr2=0x55e7e0c85e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1230a00640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1230a00640 1 -- 172.21.15.71:0/60490293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 msgr2=0x55e7e0c79c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1230a00640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c79c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1230a00640 1 -- 172.21.15.71:0/60490293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e08e5210 con 0x55e7e08ac4d0 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1231e00640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1230a00640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c7a140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f121802a9a0 tx=0x7f1218004520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f43f40f1788826fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1212a00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1212a00640 1 -- 172.21.15.71:0/60490293 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218052060 con 0x55e7e08ac4d0 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f1212a00640 1 -- 172.21.15.71:0/60490293 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f1218004cf0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.257+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12180054f0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f1212a00640 1 -- 172.21.15.71:0/60490293 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1218035070 con 0x55e7e08ac4d0 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 10 client.26893 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e7e09b1620 con 0x55e7e08ac4d0 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f1212a00640 1 -- 172.21.15.71:0/60490293 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12180054f0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f1212a00640 1 -- 172.21.15.71:0/60490293 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f1218003a10 con 0x55e7e08ac4d0 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 10 client.26893 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 10 client.26893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 20 client.26893 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e088bd80 0x55e7e0c8bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 4 client.26893 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.258+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7e0be2ae0 con 0x55e7e088bd80 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.259+0000 7f1231400640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e088bd80 0x55e7e0c8bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.259+0000 7f1231400640 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e088bd80 0x55e7e0c8bba0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2104ceff0150f7e1 server_cookie=a35960cdf4652e2 in_seq=0 out_seq=0 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.259+0000 7f1212a00640 10 client.26893 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f1212a00640 1 -- 172.21.15.71:0/60490293 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55e7e0be2ae0 con 0x55e7e088bd80 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f1212a00640 10 client.26893 handle_command_reply: tid=0 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 client.26893 shutdown 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 msgr2=0x55e7e0c7a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c7a140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f121802a9a0 tx=0x7f1218004520 comp rx=0 tx=0).stop 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 shutdown_connections 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c7a140 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e088bd80 0x55e7e0c8bba0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 --2- 172.21.15.71:0/60490293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c79c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 >> 172.21.15.71:0/60490293 conn(0x55e7e08c1300 msgr2=0x55e7e0c71780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f1212a00640 0 client.26893 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 shutdown_connections 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 1 -- 172.21.15.71:0/60490293 wait complete. 2024-05-27T09:57:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.260+0000 7f123ad99740 20 client.26893 trim_cache size 0 max 16384 2024-05-27T09:57:31.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:30 smithi072 ceph-mon[35951]: pgmap v302: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 179 KiB/s wr, 69 op/s 2024-05-27T09:57:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 Processor -- start 2024-05-27T09:57:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 -- start start 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08a42f0 0x55e7e0c753e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1b8760 con 0x55e7e08cd1b0 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1b6030 con 0x55e7e08ac4d0 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.277+0000 7f123ad99740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1b3ea0 con 0x55e7e08a42f0 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1231e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1231400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08a42f0 0x55e7e0c753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60196/0 (socket says 172.21.15.71:60196) 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 -- 172.21.15.71:0/1618048310 learned_addr learned my addr 172.21.15.71:0/1618048310 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 -- 172.21.15.71:0/1618048310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08a42f0 msgr2=0x55e7e0c753e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08a42f0 0x55e7e0c753e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 -- 172.21.15.71:0/1618048310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 msgr2=0x55e7e0c85dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1230a00640 1 -- 172.21.15.71:0/1618048310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e0c72170 con 0x55e7e08ac4d0 2024-05-27T09:57:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.278+0000 7f1231e00640 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:31.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.279+0000 7f1230a00640 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c703d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1218003e10 tx=0x7f12180097c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e02019b5368c289 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:31.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.279+0000 7f121dc00640 1 -- 172.21.15.71:0/1618048310 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218052040 con 0x55e7e08ac4d0 2024-05-27T09:57:31.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.279+0000 7f121dc00640 1 -- 172.21.15.71:0/1618048310 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1218004960 con 0x55e7e08ac4d0 2024-05-27T09:57:31.281 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.279+0000 7f121dc00640 1 -- 172.21.15.71:0/1618048310 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218031a30 con 0x55e7e08ac4d0 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 -- 172.21.15.71:0/1618048310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 msgr2=0x55e7e0c703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c703d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1218003e10 tx=0x7f12180097c0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 -- 172.21.15.71:0/1618048310 shutdown_connections 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c85dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c703d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 --2- 172.21.15.71:0/1618048310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08a42f0 0x55e7e0c753e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 -- 172.21.15.71:0/1618048310 >> 172.21.15.71:0/1618048310 conn(0x55e7e08c1300 msgr2=0x55e7e0c7b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 -- 172.21.15.71:0/1618048310 shutdown_connections 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 -- 172.21.15.71:0/1618048310 wait complete. 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.280+0000 7f123ad99740 1 -- start start 2024-05-27T09:57:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 1 Processor -- start 2024-05-27T09:57:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c89b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c8a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c8a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1b44f0 con 0x55e7e08a42f0 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1b5960 con 0x55e7e08ac4d0 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1b4bc0 con 0x55e7e08cd1b0 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f123ad99740 10 client.0 _ll_register_callbacks cb 0x7f1224009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.281+0000 7f1231400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c89b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1231400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c89b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59448/0 (socket says 172.21.15.71:59448) 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1230a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c8a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1231400640 1 -- 172.21.15.71:0/2728590948 learned_addr learned my addr 172.21.15.71:0/2728590948 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1231e00640 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c8a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1230a00640 1 -- 172.21.15.71:0/2728590948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08cd1b0 msgr2=0x55e7e0c8a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1230a00640 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c8a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1230a00640 1 -- 172.21.15.71:0/2728590948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 msgr2=0x55e7e0c89b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1230a00640 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c89b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1230a00640 1 -- 172.21.15.71:0/2728590948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e0cf2180 con 0x55e7e08ac4d0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1231400640 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c89b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1230a00640 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c8a0d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55e7e0c7b060 tx=0x7f12180038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50bc23e79cc330d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1212a00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.282+0000 7f1212a00640 1 -- 172.21.15.71:0/2728590948 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218063020 con 0x55e7e08ac4d0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f1212a00640 1 -- 172.21.15.71:0/2728590948 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f12180317b0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1218004960 con 0x55e7e08ac4d0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f1212a00640 1 -- 172.21.15.71:0/2728590948 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1218052070 con 0x55e7e08ac4d0 2024-05-27T09:57:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f123ad99740 10 client.26870 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e7e0cf33d0 con 0x55e7e08ac4d0 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f1212a00640 1 -- 172.21.15.71:0/2728590948 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1218004960 con 0x55e7e08ac4d0 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f1212a00640 1 -- 172.21.15.71:0/2728590948 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f1218004e10 con 0x55e7e08ac4d0 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.283+0000 7f123ad99740 10 client.26870 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f123ad99740 10 client.26870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f123ad99740 20 client.26870 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f123ad99740 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e08611c0 0x55e7e0cf58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f123ad99740 4 client.26870 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7e0bdc2c0 con 0x55e7e08611c0 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f1231400640 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e08611c0 0x55e7e0cf58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f1231400640 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e08611c0 0x55e7e0cf58a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f39f31abe2732bc0 server_cookie=39a9a6127b08863 in_seq=0 out_seq=0 2024-05-27T09:57:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.284+0000 7f1212a00640 10 client.26870 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f1212a00640 1 -- 172.21.15.71:0/2728590948 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e7e0bdc2c0 con 0x55e7e08611c0 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f1212a00640 10 client.26870 handle_command_reply: tid=0 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 client.26870 shutdown 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 msgr2=0x55e7e0c8a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c8a0d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55e7e0c7b060 tx=0x7f12180038a0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 shutdown_connections 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e08cd1b0 0x55e7e0c8a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e7e08ac4d0 0x55e7e0c8a0d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55e7e08611c0 0x55e7e0cf58a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 --2- 172.21.15.71:0/2728590948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e7e08a42f0 0x55e7e0c89b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 >> 172.21.15.71:0/2728590948 conn(0x55e7e08c1300 msgr2=0x55e7e0c700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.298+0000 7f1212a00640 0 client.26870 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.299+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 shutdown_connections 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.299+0000 7f123ad99740 1 -- 172.21.15.71:0/2728590948 wait complete. 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.299+0000 7f123ad99740 20 client.26870 trim_cache size 0 max 16384 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:57:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:57:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.299+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f12140b2950 msgr2=0x7f12140b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.299+0000 7f1232800640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f12140b2950 0x7f12140b4e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55e7e0c6cbd0 tx=0x7f1224009500 comp rx=0 tx=0).stop 2024-05-27T09:57:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.299+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c110110 msgr2=0x7f122c1a6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.299+0000 7f1232800640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c110110 0x7f122c1a6540 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f122000e9c0 tx=0x7f122000edc0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 shutdown_connections 2024-05-27T09:57:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f12140b2950 0x7f12140b4e60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c1a06c0 0x7f122c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f122c110520 0x7f122c1a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 --2- 172.21.15.71:0/2288924866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f122c110110 0x7f122c1a6540 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 >> 172.21.15.71:0/2288924866 conn(0x7f122c076070 msgr2=0x7f122c10b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 shutdown_connections 2024-05-27T09:57:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:31.300+0000 7f1232800640 1 -- 172.21.15.71:0/2288924866 wait complete. 2024-05-27T09:57:33.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:57:33.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:32 smithi122 ceph-mon[36436]: pgmap v303: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 186 KiB/s wr, 74 op/s 2024-05-27T09:57:33.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:32 smithi071 ceph-mon[31451]: pgmap v303: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 186 KiB/s wr, 74 op/s 2024-05-27T09:57:33.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:32 smithi072 ceph-mon[35951]: pgmap v303: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 186 KiB/s wr, 74 op/s 2024-05-27T09:57:33.671 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:57:34.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:34 smithi071 ceph-mon[31451]: pgmap v304: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:57:35.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:34 smithi122 ceph-mon[36436]: pgmap v304: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:57:35.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:34 smithi072 ceph-mon[35951]: pgmap v304: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:57:35.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.916+0000 7f2d1ce00700 1 -- 172.21.15.71:0/2084707002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 msgr2=0x7f2d18075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:35.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.916+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/2084707002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d18075f60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009990 tx=0x7f2d08009ca0 comp rx=0 tx=0).stop 2024-05-27T09:57:35.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.917+0000 7f2d1ce00700 1 -- 172.21.15.71:0/2084707002 shutdown_connections 2024-05-27T09:57:35.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.917+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/2084707002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d18115360 0x7f2d18117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:35.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.917+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/2084707002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d18075f60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:35.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.917+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/2084707002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d180764a0 0x7f2d18114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:35.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.917+0000 7f2d1ce00700 1 -- 172.21.15.71:0/2084707002 >> 172.21.15.71:0/2084707002 conn(0x7f2d18100030 msgr2=0x7f2d18102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:35.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.917+0000 7f2d1ce00700 1 -- 172.21.15.71:0/2084707002 shutdown_connections 2024-05-27T09:57:35.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.917+0000 7f2d1ce00700 1 -- 172.21.15.71:0/2084707002 wait complete. 2024-05-27T09:57:35.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.918+0000 7f2d1ce00700 1 Processor -- start 2024-05-27T09:57:35.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.918+0000 7f2d1ce00700 1 -- start start 2024-05-27T09:57:35.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d1ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d181a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:35.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d1ce00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d180764a0 0x7f2d181a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:35.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d1ce00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d18115360 0x7f2d181a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:35.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d1ce00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1811aab0 con 0x7f2d180764a0 2024-05-27T09:57:35.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d1ce00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1811a930 con 0x7f2d18075b50 2024-05-27T09:57:35.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d1ce00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1811ac30 con 0x7f2d18115360 2024-05-27T09:57:35.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d181a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:35.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d15400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d180764a0 0x7f2d181a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:35.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d181a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40338/0 (socket says 172.21.15.71:40338) 2024-05-27T09:57:35.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d15e00700 1 -- 172.21.15.71:0/1276404047 learned_addr learned my addr 172.21.15.71:0/1276404047 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:35.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.919+0000 7f2d16800700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d18115360 0x7f2d181a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:35.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d15400700 1 -- 172.21.15.71:0/1276404047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d18115360 msgr2=0x7f2d181a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:35.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d15400700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d18115360 0x7f2d181a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:35.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d15400700 1 -- 172.21.15.71:0/1276404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 msgr2=0x7f2d181a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:35.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d15400700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d181a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d15400700 1 -- 172.21.15.71:0/1276404047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d181a6330 con 0x7f2d180764a0 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d15e00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d181a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d15400700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d180764a0 0x7f2d181a1a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e9f0 tx=0x7f2d0400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d0ea00700 1 -- 172.21.15.71:0/1276404047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400c9c0 con 0x7f2d180764a0 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.920+0000 7f2d0ea00700 1 -- 172.21.15.71:0/1276404047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d0400cb60 con 0x7f2d180764a0 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.921+0000 7f2d0ea00700 1 -- 172.21.15.71:0/1276404047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04018680 con 0x7f2d180764a0 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.921+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d181a6620 con 0x7f2d180764a0 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.921+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d181adf40 con 0x7f2d180764a0 2024-05-27T09:57:35.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.922+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d18077290 con 0x7f2d180764a0 2024-05-27T09:57:35.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.925+0000 7f2d0ea00700 1 -- 172.21.15.71:0/1276404047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2d04010430 con 0x7f2d180764a0 2024-05-27T09:57:35.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.926+0000 7f2d0ea00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2cfc0b29f0 0x7f2cfc0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:35.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.927+0000 7f2d0ea00700 1 -- 172.21.15.71:0/1276404047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f2d040e2b60 con 0x7f2d180764a0 2024-05-27T09:57:35.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.927+0000 7f2d15e00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2cfc0b29f0 0x7f2cfc0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:35.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.928+0000 7f2d15e00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2cfc0b29f0 0x7f2cfc0b4f00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006010 tx=0x7f2d0800b280 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:35.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:35.930+0000 7f2d0ea00700 1 -- 172.21.15.71:0/1276404047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2d040aa4e0 con 0x7f2d180764a0 2024-05-27T09:57:36.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.205+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d181a27c0 con 0x7f2d180764a0 2024-05-27T09:57:36.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.207+0000 7f2d0ea00700 1 -- 172.21.15.71:0/1276404047 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f2d040a9de0 con 0x7f2d180764a0 2024-05-27T09:57:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:57:36.209 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:57:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2cfc0b29f0 msgr2=0x7f2cfc0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2cfc0b29f0 0x7f2cfc0b4f00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006010 tx=0x7f2d0800b280 comp rx=0 tx=0).stop 2024-05-27T09:57:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d180764a0 msgr2=0x7f2d181a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d180764a0 0x7f2d181a1a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e9f0 tx=0x7f2d0400ed00 comp rx=0 tx=0).stop 2024-05-27T09:57:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 shutdown_connections 2024-05-27T09:57:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2cfc0b29f0 0x7f2cfc0b4f00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d18115360 0x7f2d181a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d18075b50 0x7f2d181a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 --2- 172.21.15.71:0/1276404047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d180764a0 0x7f2d181a1a00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 >> 172.21.15.71:0/1276404047 conn(0x7f2d18100030 msgr2=0x7f2d18100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 shutdown_connections 2024-05-27T09:57:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:36.211+0000 7f2d1ce00700 1 -- 172.21.15.71:0/1276404047 wait complete. 2024-05-27T09:57:36.214 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:57:37.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:36 smithi071 ceph-mon[31451]: pgmap v305: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:57:37.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:36 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1276404047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:37.139 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id 831d3f7d --release --await' 2024-05-27T09:57:37.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id 831d3f7d --release --await 2024-05-27T09:57:37.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:36 smithi122 ceph-mon[36436]: pgmap v305: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:57:37.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:36 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1276404047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:37.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:36 smithi072 ceph-mon[35951]: pgmap v305: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2024-05-27T09:57:37.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:36 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1276404047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:57:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:57:38.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:37 smithi071 ceph-mon[31451]: pgmap v306: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-05-27T09:57:38.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:37 smithi122 ceph-mon[36436]: pgmap v306: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-05-27T09:57:38.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:37 smithi072 ceph-mon[35951]: pgmap v306: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-05-27T09:57:39.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 -- 172.21.15.71:0/3939929886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105310 msgr2=0x7fec24105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:39.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 --2- 172.21.15.71:0/3939929886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105310 0x7fec24105720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fec14009990 tx=0x7fec14009ca0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 -- 172.21.15.71:0/3939929886 shutdown_connections 2024-05-27T09:57:39.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 --2- 172.21.15.71:0/3939929886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec2410e740 0x7fec24110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 --2- 172.21.15.71:0/3939929886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105310 0x7fec24105720 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 --2- 172.21.15.71:0/3939929886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105c60 0x7fec2410e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 -- 172.21.15.71:0/3939929886 >> 172.21.15.71:0/3939929886 conn(0x7fec24078be0 msgr2=0x7fec24079020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:39.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 -- 172.21.15.71:0/3939929886 shutdown_connections 2024-05-27T09:57:39.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.858+0000 7fec23e00700 1 -- 172.21.15.71:0/3939929886 wait complete. 2024-05-27T09:57:39.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.860+0000 7fec23e00700 1 Processor -- start 2024-05-27T09:57:39.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.860+0000 7fec23e00700 1 -- start start 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.860+0000 7fec23e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105310 0x7fec2419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.860+0000 7fec23e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105c60 0x7fec2419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec23e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec2410e740 0x7fec241a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec23e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec241142e0 con 0x7fec24105310 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec23e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fec24114160 con 0x7fec24105c60 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec23e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec24114460 con 0x7fec2410e740 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105310 0x7fec2419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105310 0x7fec2419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45676/0 (socket says 172.21.15.71:45676) 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec1be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105c60 0x7fec2419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 -- 172.21.15.71:0/1819316759 learned_addr learned my addr 172.21.15.71:0/1819316759 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec23400700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec2410e740 0x7fec241a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 -- 172.21.15.71:0/1819316759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec2410e740 msgr2=0x7fec241a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec2410e740 0x7fec241a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 -- 172.21.15.71:0/1819316759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105c60 msgr2=0x7fec2419d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:39.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105c60 0x7fec2419d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec22a00700 1 -- 172.21.15.71:0/1819316759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec241a1ce0 con 0x7fec24105310 2024-05-27T09:57:39.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.861+0000 7fec1be00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105c60 0x7fec2419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:39.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.862+0000 7fec22a00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105310 0x7fec2419ce10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fec14000c00 tx=0x7fec140057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:39.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.862+0000 7fec1b400700 1 -- 172.21.15.71:0/1819316759 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14027070 con 0x7fec24105310 2024-05-27T09:57:39.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.862+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec241a1f70 con 0x7fec24105310 2024-05-27T09:57:39.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.862+0000 7fec1b400700 1 -- 172.21.15.71:0/1819316759 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec14022470 con 0x7fec24105310 2024-05-27T09:57:39.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.862+0000 7fec1b400700 1 -- 172.21.15.71:0/1819316759 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14017650 con 0x7fec24105310 2024-05-27T09:57:39.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.862+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec241a2450 con 0x7fec24105310 2024-05-27T09:57:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.866+0000 7fec1b400700 1 -- 172.21.15.71:0/1819316759 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fec1402a070 con 0x7fec24105310 2024-05-27T09:57:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.867+0000 7fec381a3b80 1 Processor -- start 2024-05-27T09:57:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec1b400700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fec080b29f0 0x7fec080b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec381a3b80 1 -- start start 2024-05-27T09:57:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec1b400700 1 -- 172.21.15.71:0/1819316759 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fec140e34f0 con 0x7fec24105310 2024-05-27T09:57:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec23400700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fec080b29f0 0x7fec080b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07a55f40 0x558f07bd54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07bdf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07be15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec381a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558f07b02f40 con 0x558f07bd59f0 2024-05-27T09:57:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec381a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558f07af2ae0 con 0x558f07bd5e00 2024-05-27T09:57:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.868+0000 7fec381a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558f07af6b20 con 0x558f07a55f40 2024-05-27T09:57:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec1be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07bdf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec23400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07be15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec1be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07bdf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45690/0 (socket says 172.21.15.71:45690) 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec22a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07a55f40 0x558f07bd54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec1be00700 1 -- 172.21.15.71:0/3388970878 learned_addr learned my addr 172.21.15.71:0/3388970878 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec22a00700 1 -- 172.21.15.71:0/3388970878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 msgr2=0x558f07be15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec22a00700 1 --2- 172.21.15.71:0/3388970878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07be15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec22a00700 1 -- 172.21.15.71:0/3388970878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 msgr2=0x558f07bdf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec22a00700 1 --2- 172.21.15.71:0/3388970878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07bdf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec22a00700 1 -- 172.21.15.71:0/3388970878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f07abb520 con 0x558f07a55f40 2024-05-27T09:57:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec23400700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fec080b29f0 0x7fec080b4f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0076f0 tx=0x7fec1c007ab0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.869+0000 7fec22a00700 1 --2- 172.21.15.71:0/3388970878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07a55f40 0x558f07bd54b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fec140e0be0 tx=0x7fec140aa140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6214d5170347a31 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.870+0000 7fec13e00700 1 -- 172.21.15.71:0/3388970878 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec140aa280 con 0x558f07a55f40 2024-05-27T09:57:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.870+0000 7fec13e00700 1 -- 172.21.15.71:0/3388970878 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec140aae70 con 0x558f07a55f40 2024-05-27T09:57:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.870+0000 7fec13e00700 1 -- 172.21.15.71:0/3388970878 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec140922f0 con 0x558f07a55f40 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 -- 172.21.15.71:0/3388970878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07a55f40 msgr2=0x558f07bd54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3388970878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07a55f40 0x558f07bd54b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fec140e0be0 tx=0x7fec140aa140 comp rx=0 tx=0).stop 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 -- 172.21.15.71:0/3388970878 shutdown_connections 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3388970878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07be15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3388970878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07a55f40 0x558f07bd54b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3388970878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07bdf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 -- 172.21.15.71:0/3388970878 >> 172.21.15.71:0/3388970878 conn(0x558f07ab60c0 msgr2=0x558f07bd02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 -- 172.21.15.71:0/3388970878 shutdown_connections 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 -- 172.21.15.71:0/3388970878 wait complete. 2024-05-27T09:57:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.871+0000 7fec381a3b80 1 -- start start 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 1 Processor -- start 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07bdeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd59f0 0x558f07bdf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07bdf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558f079f90a0 con 0x558f07a55f40 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558f07a93860 con 0x558f07bd59f0 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558f07be1cd0 con 0x558f07bd5e00 2024-05-27T09:57:39.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.872+0000 7fec381a3b80 10 client.0 _ll_register_callbacks cb 0x558f07a9cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd59f0 0x558f07bdf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd59f0 0x558f07bdf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40380/0 (socket says 172.21.15.71:40380) 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 -- 172.21.15.71:0/3537212041 learned_addr learned my addr 172.21.15.71:0/3537212041 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec22a00700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07bdeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec23400700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07bdf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 -- 172.21.15.71:0/3537212041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 msgr2=0x558f07bdf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07bdf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 -- 172.21.15.71:0/3537212041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 msgr2=0x558f07bdeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07bdeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 -- 172.21.15.71:0/3537212041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f07a429d0 con 0x558f07bd59f0 2024-05-27T09:57:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec23400700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07bdf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:57:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec1be00700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd59f0 0x558f07bdf0e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec0c011d10 tx=0x7fec0c00f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b4917b2ca4981e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.873+0000 7fec10c00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec10c00700 1 -- 172.21.15.71:0/3537212041 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01f060 con 0x558f07bd59f0 2024-05-27T09:57:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec10c00700 1 -- 172.21.15.71:0/3537212041 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fec0c004030 con 0x558f07bd59f0 2024-05-27T09:57:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec140aae70 con 0x558f07bd59f0 2024-05-27T09:57:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec10c00700 1 -- 172.21.15.71:0/3537212041 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fec0c004270 con 0x558f07bd59f0 2024-05-27T09:57:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec381a3b80 10 client.26888 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558f07ac3160 con 0x558f07bd59f0 2024-05-27T09:57:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec10c00700 1 -- 172.21.15.71:0/3537212041 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec140aae70 con 0x558f07bd59f0 2024-05-27T09:57:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec10c00700 1 -- 172.21.15.71:0/3537212041 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fec0c019030 con 0x558f07bd59f0 2024-05-27T09:57:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec381a3b80 10 client.26888 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.874+0000 7fec381a3b80 10 client.26888 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:57:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.875+0000 7fec381a3b80 20 client.26888 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.875+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07beeca0 0x558f07bf10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.875+0000 7fec381a3b80 4 client.26888 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.875+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f07b04e90 con 0x558f07beeca0 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.875+0000 7fec22a00700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07beeca0 0x558f07bf10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.876+0000 7fec22a00700 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07beeca0 0x558f07bf10c0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ac9d50d865ddb88 server_cookie=5c31fe523b992084 in_seq=0 out_seq=0 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.876+0000 7fec10c00700 10 client.26888 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec10c00700 1 -- 172.21.15.71:0/3537212041 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x558f07b04e90 con 0x558f07beeca0 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec10c00700 10 client.26888 handle_command_reply: tid=0 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 client.26888 shutdown 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd59f0 msgr2=0x558f07bdf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd59f0 0x558f07bdf0e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec0c011d10 tx=0x7fec0c00f6a0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 shutdown_connections 2024-05-27T09:57:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07beeca0 0x558f07bf10c0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07bdf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07bdeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec10c00700 0 client.26888 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 --2- 172.21.15.71:0/3537212041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd59f0 0x558f07bdf0e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 >> 172.21.15.71:0/3537212041 conn(0x558f07ab60c0 msgr2=0x558f07bd3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 shutdown_connections 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 1 -- 172.21.15.71:0/3537212041 wait complete. 2024-05-27T09:57:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.877+0000 7fec381a3b80 20 client.26888 trim_cache size 0 max 16384 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.900+0000 7fec381a3b80 1 Processor -- start 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.900+0000 7fec381a3b80 1 -- start start 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07be0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd59f0 0x558f07bd0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07bd9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec381a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec241b36b0 con 0x558f07a55f40 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec381a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fec241b0f40 con 0x558f07bd5e00 2024-05-27T09:57:39.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec381a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec241aedb0 con 0x558f07bd59f0 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec22a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07be0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec23400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07bd9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec22a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07be0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45708/0 (socket says 172.21.15.71:45708) 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec23400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07bd9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:40396/0 (socket says 172.21.15.71:40396) 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec22a00700 1 -- 172.21.15.71:0/1337278510 learned_addr learned my addr 172.21.15.71:0/1337278510 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.901+0000 7fec1be00700 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd59f0 0x558f07bd0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.902+0000 7fec23400700 1 -- 172.21.15.71:0/1337278510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd59f0 msgr2=0x558f07bd0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.902+0000 7fec23400700 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd59f0 0x558f07bd0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.902+0000 7fec23400700 1 -- 172.21.15.71:0/1337278510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 msgr2=0x558f07be0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.902+0000 7fec23400700 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07be0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.902+0000 7fec23400700 1 -- 172.21.15.71:0/1337278510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f07be1440 con 0x558f07bd5e00 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.902+0000 7fec22a00700 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07be0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.902+0000 7fec23400700 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07bd9df0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009280 tx=0x7fec1c01d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee55385d007da87d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.903+0000 7fec13400700 1 -- 172.21.15.71:0/1337278510 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c028070 con 0x558f07bd5e00 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.903+0000 7fec13400700 1 -- 172.21.15.71:0/1337278510 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec1c023ab0 con 0x558f07bd5e00 2024-05-27T09:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.903+0000 7fec13400700 1 -- 172.21.15.71:0/1337278510 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c019a90 con 0x558f07bd5e00 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 -- 172.21.15.71:0/1337278510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 msgr2=0x558f07bd9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07bd9df0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009280 tx=0x7fec1c01d000 comp rx=0 tx=0).stop 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 -- 172.21.15.71:0/1337278510 shutdown_connections 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07bd5e00 0x558f07bd9df0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07a55f40 0x558f07be0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 --2- 172.21.15.71:0/1337278510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd59f0 0x558f07bd0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 -- 172.21.15.71:0/1337278510 >> 172.21.15.71:0/1337278510 conn(0x558f07ab60c0 msgr2=0x558f07bdf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 -- 172.21.15.71:0/1337278510 shutdown_connections 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 -- 172.21.15.71:0/1337278510 wait complete. 2024-05-27T09:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.904+0000 7fec381a3b80 1 -- start start 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 1 Processor -- start 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07a55f40 0x558f07be71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07be7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07be3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec241af400 con 0x558f07bd59f0 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fec241b0870 con 0x558f07a55f40 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec241afad0 con 0x558f07bd5e00 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec381a3b80 10 client.0 _ll_register_callbacks cb 0x558f07a9cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.905+0000 7fec1be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07be7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07be7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45724/0 (socket says 172.21.15.71:45724) 2024-05-27T09:57:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 -- 172.21.15.71:0/4218990588 learned_addr learned my addr 172.21.15.71:0/4218990588 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec22a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07a55f40 0x558f07be71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec23400700 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07be3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 -- 172.21.15.71:0/4218990588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 msgr2=0x558f07be3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07be3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 -- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07a55f40 msgr2=0x558f07be71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07a55f40 0x558f07be71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 -- 172.21.15.71:0/4218990588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f07be3df0 con 0x558f07bd59f0 2024-05-27T09:57:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec22a00700 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07a55f40 0x558f07be71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec1be00700 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07be7730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fec0c005950 tx=0x7fec0c00faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854f619e27e865f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.906+0000 7fec10c00700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:57:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec10c00700 1 -- 172.21.15.71:0/4218990588 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c022e20 con 0x558f07bd59f0 2024-05-27T09:57:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec10c00700 1 -- 172.21.15.71:0/4218990588 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fec0c005040 con 0x558f07bd59f0 2024-05-27T09:57:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec1c023ab0 con 0x558f07bd59f0 2024-05-27T09:57:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec10c00700 1 -- 172.21.15.71:0/4218990588 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fec0c039050 con 0x558f07bd59f0 2024-05-27T09:57:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec381a3b80 10 client.16725 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558f07c5a260 con 0x558f07bd59f0 2024-05-27T09:57:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec10c00700 1 -- 172.21.15.71:0/4218990588 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec1c023ab0 con 0x558f07bd59f0 2024-05-27T09:57:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.907+0000 7fec10c00700 1 -- 172.21.15.71:0/4218990588 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fec0c034030 con 0x558f07bd59f0 2024-05-27T09:57:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.908+0000 7fec381a3b80 10 client.16725 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.908+0000 7fec381a3b80 10 client.16725 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:57:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.908+0000 7fec381a3b80 20 client.16725 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.908+0000 7fec381a3b80 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07c5a9f0 0x558f07c5ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.908+0000 7fec381a3b80 4 client.16725 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "831d3f7d", "release": true, "await": true}] 2024-05-27T09:57:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.908+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "831d3f7d", "release": true, "await": true}) -- 0x558f07afe670 con 0x558f07c5a9f0 2024-05-27T09:57:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.908+0000 7fec22a00700 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07c5a9f0 0x558f07c5ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.909+0000 7fec22a00700 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07c5a9f0 0x558f07c5ce10 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136cd4dd4e63361b server_cookie=4152a6572d03e3c0 in_seq=0 out_seq=0 2024-05-27T09:57:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:39.909+0000 7fec10c00700 10 client.16725 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.117+0000 7fec10c00700 1 -- 172.21.15.71:0/4218990588 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558f07afe670 con 0x558f07c5a9f0 2024-05-27T09:57:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.117+0000 7fec10c00700 10 client.16725 handle_command_reply: tid=0 2024-05-27T09:57:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.117+0000 7fec381a3b80 1 client.16725 shutdown 2024-05-27T09:57:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.117+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 msgr2=0x558f07be7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:40.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.117+0000 7fec381a3b80 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07be7730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fec0c005950 tx=0x7fec0c00faa0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 shutdown_connections 2024-05-27T09:57:40.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x558f07c5a9f0 0x558f07c5ce10 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558f07bd5e00 0x558f07be3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f07a55f40 0x558f07be71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 --2- 172.21.15.71:0/4218990588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f07bd59f0 0x558f07be7730 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 >> 172.21.15.71:0/4218990588 conn(0x558f07ab60c0 msgr2=0x558f07bd0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec10c00700 0 client.16725 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 shutdown_connections 2024-05-27T09:57:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.118+0000 7fec381a3b80 1 -- 172.21.15.71:0/4218990588 wait complete. 2024-05-27T09:57:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.119+0000 7fec381a3b80 20 client.16725 trim_cache size 0 max 16384 2024-05-27T09:57:40.121 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:57:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:57:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:57:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 32, 2024-05-27T09:57:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:57:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "831d3f7d": { 2024-05-27T09:57:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 32, 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 142.3, 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:57:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:57:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:57:40.123 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.120+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fec080b29f0 msgr2=0x7fec080b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.120+0000 7fec23e00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fec080b29f0 0x7fec080b4f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0076f0 tx=0x7fec1c007ab0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.120+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105310 msgr2=0x7fec2419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.120+0000 7fec23e00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105310 0x7fec2419ce10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fec14000c00 tx=0x7fec140057c0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 shutdown_connections 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fec080b29f0 0x7fec080b4f00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec2410e740 0x7fec241a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec24105310 0x7fec2419ce10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 --2- 172.21.15.71:0/1819316759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec24105c60 0x7fec2419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 >> 172.21.15.71:0/1819316759 conn(0x7fec24078be0 msgr2=0x7fec24101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 shutdown_connections 2024-05-27T09:57:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:57:40.121+0000 7fec23e00700 1 -- 172.21.15.71:0/1819316759 wait complete. 2024-05-27T09:57:41.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:40 smithi071 ceph-mon[31451]: pgmap v307: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-27T09:57:41.128 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '831d3f7d', total seconds elapsed: 30.2 2024-05-27T09:57:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:40 smithi122 ceph-mon[36436]: pgmap v307: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-27T09:57:41.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:40 smithi072 ceph-mon[35951]: pgmap v307: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-27T09:57:43.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:42 smithi122 ceph-mon[36436]: pgmap v308: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 192 KiB/s wr, 68 op/s 2024-05-27T09:57:43.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:42 smithi071 ceph-mon[31451]: pgmap v308: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 192 KiB/s wr, 68 op/s 2024-05-27T09:57:43.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:42 smithi072 ceph-mon[35951]: pgmap v308: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 192 KiB/s wr, 68 op/s 2024-05-27T09:57:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 -- 172.21.15.71:0/4200478284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc1104c0 msgr2=0x7fe9fc1128e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 --2- 172.21.15.71:0/4200478284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc1104c0 0x7fe9fc1128e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009ca0 tx=0x7fe9f402a950 comp rx=0 tx=0).stop 2024-05-27T09:57:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 -- 172.21.15.71:0/4200478284 shutdown_connections 2024-05-27T09:57:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 --2- 172.21.15.71:0/4200478284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc1104c0 0x7fe9fc1128e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 --2- 172.21.15.71:0/4200478284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9fc102280 0x7fe9fc102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 --2- 172.21.15.71:0/4200478284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9fc104b10 0x7fe9fc101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 -- 172.21.15.71:0/4200478284 >> 172.21.15.71:0/4200478284 conn(0x7fe9fc0fd9d0 msgr2=0x7fe9fc0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 -- 172.21.15.71:0/4200478284 shutdown_connections 2024-05-27T09:57:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.547+0000 7fea03c00640 1 -- 172.21.15.71:0/4200478284 wait complete. 2024-05-27T09:57:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.549+0000 7fea03c00640 1 Processor -- start 2024-05-27T09:57:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.549+0000 7fea03c00640 1 -- start start 2024-05-27T09:57:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea03c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9fc102280 0x7fe9fc105130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea03c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc104b10 0x7fe9fc105670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea03c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9fc1104c0 0x7fe9fc105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea03c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc116090 con 0x7fe9fc1104c0 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea03c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc115f10 con 0x7fe9fc104b10 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea03c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc116210 con 0x7fe9fc102280 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc104b10 0x7fe9fc105670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc104b10 0x7fe9fc105670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51942/0 (socket says 172.21.15.71:51942) 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fe9fbe00640 1 -- 172.21.15.71:0/4054973795 learned_addr learned my addr 172.21.15.71:0/4054973795 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea01200640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9fc102280 0x7fe9fc105130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.550+0000 7fea01c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9fc1104c0 0x7fe9fc105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fea01200640 1 -- 172.21.15.71:0/4054973795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc104b10 msgr2=0x7fe9fc105670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fea01200640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc104b10 0x7fe9fc105670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fea01200640 1 -- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9fc1104c0 msgr2=0x7fe9fc105bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fea01200640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9fc1104c0 0x7fe9fc105bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fea01200640 1 -- 172.21.15.71:0/4054973795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc1acfa0 con 0x7fe9fc102280 2024-05-27T09:57:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fea01200640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9fc102280 0x7fe9fc105130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000e9f0 tx=0x7fe9f000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fe9f9600640 1 -- 172.21.15.71:0/4054973795 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000ccc0 con 0x7fe9fc102280 2024-05-27T09:57:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fe9f9600640 1 -- 172.21.15.71:0/4054973795 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9f0005020 con 0x7fe9fc102280 2024-05-27T09:57:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fe9f9600640 1 -- 172.21.15.71:0/4054973795 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0004a00 con 0x7fe9fc102280 2024-05-27T09:57:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.551+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc1ad230 con 0x7fe9fc102280 2024-05-27T09:57:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.552+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc1ad730 con 0x7fe9fc102280 2024-05-27T09:57:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.555+0000 7fea0ac1d740 1 Processor -- start 2024-05-27T09:57:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.555+0000 7fea0ac1d740 1 -- start start 2024-05-27T09:57:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fe9f9600640 1 -- 172.21.15.71:0/4054973795 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fe9f0004ba0 con 0x7fe9fc102280 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbee0e1b0 0x557bbf1b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbeded4d0 0x557bbf1b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557bbf121b90 con 0x557bbede52f0 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557bbf111730 con 0x557bbeded4d0 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557bbf115770 con 0x557bbee0e1b0 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbeded4d0 0x557bbf1b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea01200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbeded4d0 0x557bbf1b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:51946/0 (socket says 172.21.15.71:51946) 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fe9fbe00640 1 -- 172.21.15.71:0/1369730296 learned_addr learned my addr 172.21.15.71:0/1369730296 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.556+0000 7fea01c00640 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbee0e1b0 0x557bbf1b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.557+0000 7fe9fbe00640 1 -- 172.21.15.71:0/1369730296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbee0e1b0 msgr2=0x557bbf1b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.557+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbee0e1b0 0x557bbf1b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.557+0000 7fe9fbe00640 1 -- 172.21.15.71:0/1369730296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 msgr2=0x557bbf1b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.557+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.557+0000 7fe9fbe00640 1 -- 172.21.15.71:0/1369730296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbf0aa8b0 con 0x557bbeded4d0 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.557+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbeded4d0 0x557bbf1b12e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8004600 tx=0x7fe9e800bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e770ba7d9610986 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.557+0000 7fe9ee000640 1 -- 172.21.15.71:0/1369730296 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8003dd0 con 0x557bbeded4d0 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.558+0000 7fe9ee000640 1 -- 172.21.15.71:0/1369730296 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9e8015070 con 0x557bbeded4d0 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.558+0000 7fe9ee000640 1 -- 172.21.15.71:0/1369730296 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8019660 con 0x557bbeded4d0 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.558+0000 7fe9f9600640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe9e40b2950 0x7fe9e40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.558+0000 7fe9f9600640 1 -- 172.21.15.71:0/4054973795 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fe9f00e2570 con 0x7fe9fc102280 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.558+0000 7fea01c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe9e40b2950 0x7fe9e40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 -- 172.21.15.71:0/1369730296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbeded4d0 msgr2=0x557bbf1b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbeded4d0 0x557bbf1b12e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8004600 tx=0x7fe9e800bc70 comp rx=0 tx=0).stop 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 -- 172.21.15.71:0/1369730296 shutdown_connections 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbeded4d0 0x557bbf1b12e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/1369730296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbee0e1b0 0x557bbf1b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 -- 172.21.15.71:0/1369730296 >> 172.21.15.71:0/1369730296 conn(0x557bbee02300 msgr2=0x557bbf1ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea01c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe9e40b2950 0x7fe9e40b4e60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0fe4a0 tx=0x7fe9f4005d80 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 -- 172.21.15.71:0/1369730296 shutdown_connections 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.559+0000 7fea0ac1d740 1 -- 172.21.15.71:0/1369730296 wait complete. 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.560+0000 7fea0ac1d740 1 -- start start 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.560+0000 7fea0ac1d740 1 Processor -- start 2024-05-27T09:57:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.560+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1ba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.560+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.560+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee0e1b0 0x557bbf1c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557bbedf7790 con 0x557bbee0e1b0 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557bbf0b9bc0 con 0x557bbede52f0 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557bbf1bd990 con 0x557bbeded4d0 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea0ac1d740 10 client.0 _ll_register_callbacks cb 0x557bbf097400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee0e1b0 0x557bbf1c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee0e1b0 0x557bbf1c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43444/0 (socket says 172.21.15.71:43444) 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 -- 172.21.15.71:0/109314919 learned_addr learned my addr 172.21.15.71:0/109314919 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01200640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1ba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 -- 172.21.15.71:0/109314919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 msgr2=0x557bbf1baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1baef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 -- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 msgr2=0x557bbf1ba9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1ba9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01c00640 1 -- 172.21.15.71:0/109314919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bbee26210 con 0x557bbee0e1b0 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fea01200640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1ba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.561+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fea01c00640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee0e1b0 0x557bbf1c6cc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4035000 tx=0x7fe9f40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267d8a29ddfdd746 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fe9e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fe9e2a00640 1 -- 172.21.15.71:0/109314919 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4056060 con 0x557bbee0e1b0 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9e8015070 con 0x557bbee0e1b0 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fe9e2a00640 1 -- 172.21.15.71:0/109314919 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fe9f4004250 con 0x557bbee0e1b0 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fe9e2a00640 1 -- 172.21.15.71:0/109314919 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe9f4034040 con 0x557bbee0e1b0 2024-05-27T09:57:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fea0ac1d740 10 client.16737 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.562+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557bbeef2620 con 0x557bbee0e1b0 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fe9e2a00640 1 -- 172.21.15.71:0/109314919 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9e8015070 con 0x557bbee0e1b0 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fe9e2a00640 1 -- 172.21.15.71:0/109314919 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fe9f40309b0 con 0x557bbee0e1b0 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fea0ac1d740 10 client.16737 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fea0ac1d740 10 client.16737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fea0ac1d740 20 client.16737 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbedccd80 0x557bbf1ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fea0ac1d740 4 client.16737 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bbf123ae0 con 0x557bbedccd80 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.563+0000 7fea01200640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbedccd80 0x557bbf1ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.564+0000 7fea01200640 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbedccd80 0x557bbf1ccc00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d1a98cc6609a43 server_cookie=a1cd868ef14683d9 in_seq=0 out_seq=0 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.564+0000 7fe9e2a00640 10 client.16737 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fe9e2a00640 1 -- 172.21.15.71:0/109314919 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x557bbf123ae0 con 0x557bbedccd80 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fe9e2a00640 10 client.16737 handle_command_reply: tid=0 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 client.16737 shutdown 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee0e1b0 msgr2=0x557bbf1c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee0e1b0 0x557bbf1c6cc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4035000 tx=0x7fe9f40095c0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 shutdown_connections 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbedccd80 0x557bbf1ccc00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee0e1b0 0x557bbf1c6cc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/109314919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1ba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 >> 172.21.15.71:0/109314919 conn(0x557bbee02300 msgr2=0x557bbf1b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fe9e2a00640 0 client.16737 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.565+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 shutdown_connections 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.566+0000 7fea0ac1d740 1 -- 172.21.15.71:0/109314919 wait complete. 2024-05-27T09:57:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.566+0000 7fea0ac1d740 20 client.16737 trim_cache size 0 max 16384 2024-05-27T09:57:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 Processor -- start 2024-05-27T09:57:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 -- start start 2024-05-27T09:57:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbee02300 0x557bbf1bc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1b89c0 con 0x557bbede52f0 2024-05-27T09:57:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1b6290 con 0x557bbee02300 2024-05-27T09:57:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.586+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1b4100 con 0x557bbeded4d0 2024-05-27T09:57:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbee02300 0x557bbf1bc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:47926/0 (socket says 172.21.15.71:47926) 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 -- 172.21.15.71:0/76591597 learned_addr learned my addr 172.21.15.71:0/76591597 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 -- 172.21.15.71:0/76591597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbee02300 msgr2=0x557bbf1bc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbee02300 0x557bbf1bc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 -- 172.21.15.71:0/76591597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 msgr2=0x557bbf1c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 -- 172.21.15.71:0/76591597 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbf1bcf80 con 0x557bbeded4d0 2024-05-27T09:57:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fea01c00640 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1c6f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009890 tx=0x7fe9f402fc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a528a8148bc5ca07 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.587+0000 7fe9ed600640 1 -- 172.21.15.71:0/76591597 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4056040 con 0x557bbeded4d0 2024-05-27T09:57:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.588+0000 7fe9ed600640 1 -- 172.21.15.71:0/76591597 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9f4004700 con 0x557bbeded4d0 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.588+0000 7fe9ed600640 1 -- 172.21.15.71:0/76591597 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f403a430 con 0x557bbeded4d0 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.588+0000 7fea0ac1d740 1 -- 172.21.15.71:0/76591597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 msgr2=0x557bbf1c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.588+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1c6f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009890 tx=0x7fe9f402fc40 comp rx=0 tx=0).stop 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 -- 172.21.15.71:0/76591597 shutdown_connections 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1c6f70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbede52f0 0x557bbf1c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/76591597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbee02300 0x557bbf1bc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 -- 172.21.15.71:0/76591597 >> 172.21.15.71:0/76591597 conn(0x557bbf1b2e20 msgr2=0x557bbf1b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 -- 172.21.15.71:0/76591597 shutdown_connections 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 -- 172.21.15.71:0/76591597 wait complete. 2024-05-27T09:57:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 -- start start 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.589+0000 7fea0ac1d740 1 Processor -- start 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1be720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea0ac1d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee02300 0x557bbf22d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1b4750 con 0x557bbee02300 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1b5bc0 con 0x557bbede52f0 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea0ac1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1b4e20 con 0x557bbeded4d0 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea0ac1d740 10 client.0 _ll_register_callbacks cb 0x7fe9f40099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1be720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:47934/0 (socket says 172.21.15.71:47934) 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fe9fbe00640 1 -- 172.21.15.71:0/3281718466 learned_addr learned my addr 172.21.15.71:0/3281718466 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea01200640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fea01c00640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee02300 0x557bbf22d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.590+0000 7fe9fbe00640 1 -- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 msgr2=0x557bbf1be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9fbe00640 1 -- 172.21.15.71:0/3281718466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee02300 msgr2=0x557bbf22d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee02300 0x557bbf22d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9fbe00640 1 -- 172.21.15.71:0/3281718466 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bbf1ccf70 con 0x557bbeded4d0 2024-05-27T09:57:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fea01c00640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee02300 0x557bbf22d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9fbe00640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1be720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80039c0 tx=0x7fe9e80040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb47573324415cae server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9e2a00640 1 -- 172.21.15.71:0/3281718466 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e802b060 con 0x557bbeded4d0 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9e2a00640 1 -- 172.21.15.71:0/3281718466 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fe9e80041c0 con 0x557bbeded4d0 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9f4004700 con 0x557bbeded4d0 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fe9e2a00640 1 -- 172.21.15.71:0/3281718466 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe9e8005240 con 0x557bbeded4d0 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fea0ac1d740 10 client.26938 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.591+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557bbf234920 con 0x557bbeded4d0 2024-05-27T09:57:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fe9e2a00640 1 -- 172.21.15.71:0/3281718466 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9f4004700 con 0x557bbeded4d0 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fe9e2a00640 1 -- 172.21.15.71:0/3281718466 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7fe9e80274b0 con 0x557bbeded4d0 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fea0ac1d740 10 client.26938 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fea0ac1d740 10 client.26938 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fea0ac1d740 20 client.26938 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbee0e1b0 0x557bbf236f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fea0ac1d740 4 client.26938 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557bbf11d2c0 con 0x557bbee0e1b0 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.592+0000 7fea01200640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbee0e1b0 0x557bbf236f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.593+0000 7fe9e2a00640 10 client.26938 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.593+0000 7fea01200640 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbee0e1b0 0x557bbf236f30 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f9b95e0e0d67a3 server_cookie=9a9d536d332d904b in_seq=0 out_seq=0 2024-05-27T09:57:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fe9e2a00640 1 -- 172.21.15.71:0/3281718466 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557bbf11d2c0 con 0x557bbee0e1b0 2024-05-27T09:57:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fe9e2a00640 10 client.26938 handle_command_reply: tid=0 2024-05-27T09:57:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 client.26938 shutdown 2024-05-27T09:57:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 msgr2=0x557bbf1be720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1be720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80039c0 tx=0x7fe9e80040d0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 shutdown_connections 2024-05-27T09:57:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x557bbee0e1b0 0x557bbf236f30 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557bbee02300 0x557bbf22d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557bbeded4d0 0x557bbf1be720 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 --2- 172.21.15.71:0/3281718466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557bbede52f0 0x557bbf1be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fe9e2a00640 0 client.26938 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 >> 172.21.15.71:0/3281718466 conn(0x557bbf1b2e20 msgr2=0x557bbf1b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 shutdown_connections 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 1 -- 172.21.15.71:0/3281718466 wait complete. 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.605+0000 7fea0ac1d740 20 client.26938 trim_cache size 0 max 16384 2024-05-27T09:57:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:57:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:57:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:57:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe9e40b2950 msgr2=0x7fe9e40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe9e40b2950 0x7fe9e40b4e60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0fe4a0 tx=0x7fe9f4005d80 comp rx=0 tx=0).stop 2024-05-27T09:57:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9fc102280 msgr2=0x7fe9fc105130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9fc102280 0x7fe9fc105130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000e9f0 tx=0x7fe9f000eeb0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 shutdown_connections 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fe9e40b2950 0x7fe9e40b4e60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9fc1104c0 0x7fe9fc105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9fc104b10 0x7fe9fc105670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 --2- 172.21.15.71:0/4054973795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9fc102280 0x7fe9fc105130 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 >> 172.21.15.71:0/4054973795 conn(0x7fe9fc0fd9d0 msgr2=0x7fe9fc111820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 shutdown_connections 2024-05-27T09:57:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:44.606+0000 7fea03c00640 1 -- 172.21.15.71:0/4054973795 wait complete. 2024-05-27T09:57:45.207 INFO:tasks.workunit.client.0.smithi071.stdout:truncating to largest ever: 0x63e9b52 2024-05-27T09:57:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:44 smithi122 ceph-mon[36436]: pgmap v309: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 185 KiB/s wr, 63 op/s 2024-05-27T09:57:45.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:44 smithi071 ceph-mon[31451]: pgmap v309: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 185 KiB/s wr, 63 op/s 2024-05-27T09:57:45.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:44 smithi072 ceph-mon[35951]: pgmap v309: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 185 KiB/s wr, 63 op/s 2024-05-27T09:57:47.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:46 smithi122 ceph-mon[36436]: pgmap v310: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 185 KiB/s wr, 63 op/s 2024-05-27T09:57:47.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:46 smithi071 ceph-mon[31451]: pgmap v310: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 185 KiB/s wr, 63 op/s 2024-05-27T09:57:47.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:46 smithi072 ceph-mon[35951]: pgmap v310: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 185 KiB/s wr, 63 op/s 2024-05-27T09:57:49.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:48 smithi122 ceph-mon[36436]: pgmap v311: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 704 KiB/s wr, 221 op/s 2024-05-27T09:57:49.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:48 smithi071 ceph-mon[31451]: pgmap v311: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 704 KiB/s wr, 221 op/s 2024-05-27T09:57:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:48 smithi072 ceph-mon[35951]: pgmap v311: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 704 KiB/s wr, 221 op/s 2024-05-27T09:57:50.522 INFO:tasks.workunit.client.0.smithi071.stdout:20000 read 0xa6cbf1 thru 0xa6e358 (0x1768 bytes) 2024-05-27T09:57:51.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:50 smithi122 ceph-mon[36436]: pgmap v312: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 684 KiB/s wr, 218 op/s 2024-05-27T09:57:51.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:50 smithi071 ceph-mon[31451]: pgmap v312: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 684 KiB/s wr, 218 op/s 2024-05-27T09:57:51.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:50 smithi072 ceph-mon[35951]: pgmap v312: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 684 KiB/s wr, 218 op/s 2024-05-27T09:57:53.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:52 smithi122 ceph-mon[36436]: pgmap v313: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.1 MiB/s wr, 381 op/s 2024-05-27T09:57:53.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:52 smithi071 ceph-mon[31451]: pgmap v313: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.1 MiB/s wr, 381 op/s 2024-05-27T09:57:53.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:52 smithi072 ceph-mon[35951]: pgmap v313: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.1 MiB/s wr, 381 op/s 2024-05-27T09:57:54.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:53 smithi122 ceph-mon[36436]: pgmap v314: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 986 KiB/s wr, 321 op/s 2024-05-27T09:57:54.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:53 smithi071 ceph-mon[31451]: pgmap v314: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 986 KiB/s wr, 321 op/s 2024-05-27T09:57:54.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:53 smithi072 ceph-mon[35951]: pgmap v314: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 986 KiB/s wr, 321 op/s 2024-05-27T09:57:55.157 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0x63ed6b9 2024-05-27T09:57:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:56 smithi122 ceph-mon[36436]: pgmap v315: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 986 KiB/s wr, 321 op/s 2024-05-27T09:57:57.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:56 smithi071 ceph-mon[31451]: pgmap v315: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 986 KiB/s wr, 321 op/s 2024-05-27T09:57:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:56 smithi072 ceph-mon[35951]: pgmap v315: 97 pgs: 97 active+clean; 95 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 986 KiB/s wr, 321 op/s 2024-05-27T09:57:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.858+0000 7fad09800640 1 -- 172.21.15.71:0/3037937631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad04104df0 msgr2=0x7fad04105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.858+0000 7fad09800640 1 --2- 172.21.15.71:0/3037937631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad04104df0 0x7fad04105200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7facf4009900 tx=0x7facf402a510 comp rx=0 tx=0).stop 2024-05-27T09:57:57.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.859+0000 7fad09800640 1 -- 172.21.15.71:0/3037937631 shutdown_connections 2024-05-27T09:57:57.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.859+0000 7fad09800640 1 --2- 172.21.15.71:0/3037937631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0410e200 0x7fad041106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.859+0000 7fad09800640 1 --2- 172.21.15.71:0/3037937631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0410b850 0x7fad0410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.859+0000 7fad09800640 1 --2- 172.21.15.71:0/3037937631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad04104df0 0x7fad04105200 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.859+0000 7fad09800640 1 -- 172.21.15.71:0/3037937631 >> 172.21.15.71:0/3037937631 conn(0x7fad040782d0 msgr2=0x7fad04078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.862+0000 7fad09800640 1 -- 172.21.15.71:0/3037937631 shutdown_connections 2024-05-27T09:57:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.862+0000 7fad09800640 1 -- 172.21.15.71:0/3037937631 wait complete. 2024-05-27T09:57:57.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.863+0000 7fad09800640 1 Processor -- start 2024-05-27T09:57:57.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad09800640 1 -- start start 2024-05-27T09:57:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad09800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad04104df0 0x7fad041a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad09800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0410b850 0x7fad041a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad09800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0410e200 0x7fad0419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad09800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad04113eb0 con 0x7fad0410b850 2024-05-27T09:57:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad09800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fad04113d30 con 0x7fad0410e200 2024-05-27T09:57:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad09800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad04114030 con 0x7fad04104df0 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.864+0000 7fad03400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0410e200 0x7fad0419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad02000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0410b850 0x7fad041a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0410e200 0x7fad0419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45806/0 (socket says 172.21.15.71:45806) 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad02a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad04104df0 0x7fad041a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 -- 172.21.15.71:0/2509361323 learned_addr learned my addr 172.21.15.71:0/2509361323 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 -- 172.21.15.71:0/2509361323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad04104df0 msgr2=0x7fad041a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad04104df0 0x7fad041a26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 -- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0410b850 msgr2=0x7fad041a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0410b850 0x7fad041a2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 -- 172.21.15.71:0/2509361323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0419cf70 con 0x7fad0410e200 2024-05-27T09:57:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.865+0000 7fad03400640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0410e200 0x7fad0419c8d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7facfc00efd0 tx=0x7facfc00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.866+0000 7facfb400640 1 -- 172.21.15.71:0/2509361323 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc003b70 con 0x7fad0410e200 2024-05-27T09:57:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.866+0000 7facfb400640 1 -- 172.21.15.71:0/2509361323 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc003d10 con 0x7fad0410e200 2024-05-27T09:57:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.866+0000 7facfb400640 1 -- 172.21.15.71:0/2509361323 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0108a0 con 0x7fad0410e200 2024-05-27T09:57:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.866+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0419d260 con 0x7fad0410e200 2024-05-27T09:57:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.866+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041a9540 con 0x7fad0410e200 2024-05-27T09:57:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.870+0000 7facfb400640 1 -- 172.21.15.71:0/2509361323 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7facfc004020 con 0x7fad0410e200 2024-05-27T09:57:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.870+0000 7fad10817740 1 Processor -- start 2024-05-27T09:57:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.870+0000 7fad10817740 1 -- start start 2024-05-27T09:57:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad10817740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdec1b0 0x55fbed18e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad10817740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed18eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad10817740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed18f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad10817740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fbed0ffb90 con 0x55fbecdec1b0 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad10817740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55fbed0ef730 con 0x55fbecdc32f0 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad10817740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fbed0f3770 con 0x55fbecdcb4d0 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad02a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed18eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad02000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdec1b0 0x55fbed18e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad02a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed18eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45818/0 (socket says 172.21.15.71:45818) 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad02a00640 1 -- 172.21.15.71:0/2620234641 learned_addr learned my addr 172.21.15.71:0/2620234641 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.871+0000 7fad02000640 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed18f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7fad02a00640 1 -- 172.21.15.71:0/2620234641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 msgr2=0x55fbed18f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7fad02a00640 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed18f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7fad02a00640 1 -- 172.21.15.71:0/2620234641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdec1b0 msgr2=0x55fbed18e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7fad02a00640 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdec1b0 0x55fbed18e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7fad02a00640 1 -- 172.21.15.71:0/2620234641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbed0888b0 con 0x55fbecdc32f0 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7fad02a00640 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed18eda0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7facf4000c00 tx=0x7facf40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ddac246525d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7facfb400640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7face80b29d0 0x7face80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7facfb400640 1 -- 172.21.15.71:0/2509361323 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7facfc0e2960 con 0x7fad0410e200 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7facefe00640 1 -- 172.21.15.71:0/2620234641 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4035040 con 0x55fbecdc32f0 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7fad02000640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7face80b29d0 0x7face80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.872+0000 7facefe00640 1 -- 172.21.15.71:0/2620234641 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf40054f0 con 0x55fbecdc32f0 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.873+0000 7facefe00640 1 -- 172.21.15.71:0/2620234641 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf40035f0 con 0x55fbecdc32f0 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 -- 172.21.15.71:0/2620234641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 msgr2=0x55fbed18eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed18eda0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7facf4000c00 tx=0x7facf40040c0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad02000640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7face80b29d0 0x7face80b4ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55fbed18b9d0 tx=0x7facf00095b0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 -- 172.21.15.71:0/2620234641 shutdown_connections 2024-05-27T09:57:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed18f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed18eda0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 --2- 172.21.15.71:0/2620234641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdec1b0 0x55fbed18e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 -- 172.21.15.71:0/2620234641 >> 172.21.15.71:0/2620234641 conn(0x55fbecde0300 msgr2=0x55fbed18b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 -- 172.21.15.71:0/2620234641 shutdown_connections 2024-05-27T09:57:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 -- 172.21.15.71:0/2620234641 wait complete. 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.874+0000 7fad10817740 1 -- start start 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 1 Processor -- start 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdc32f0 0x55fbed198a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed198f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed1a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fbecdd5790 con 0x55fbecdc32f0 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55fbed097bc0 con 0x55fbecdec1b0 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fbed19b930 con 0x55fbecdcb4d0 2024-05-27T09:57:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.875+0000 7fad10817740 10 client.0 _ll_register_callbacks cb 0x55fbed075400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdc32f0 0x55fbed198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:55382/0 (socket says 172.21.15.71:55382) 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 -- 172.21.15.71:0/2570102803 learned_addr learned my addr 172.21.15.71:0/2570102803 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdc32f0 0x55fbed198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49204/0 (socket says 172.21.15.71:49204) 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad03400640 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed1a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 -- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 msgr2=0x55fbed1a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed1a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 -- 172.21.15.71:0/2570102803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdc32f0 msgr2=0x55fbed198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdc32f0 0x55fbed198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 -- 172.21.15.71:0/2570102803 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbece04210 con 0x55fbecdcb4d0 2024-05-27T09:57:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.876+0000 7fad02000640 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed198f50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7facf0013fd0 tx=0x7facf0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1dee6b25aa6bb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.877+0000 7facecc00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:57:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.877+0000 7facecc00640 1 -- 172.21.15.71:0/2570102803 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0027070 con 0x55fbecdcb4d0 2024-05-27T09:57:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.877+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facf40054f0 con 0x55fbecdcb4d0 2024-05-27T09:57:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.877+0000 7facecc00640 1 -- 172.21.15.71:0/2570102803 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7facf0020de0 con 0x55fbecdcb4d0 2024-05-27T09:57:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.877+0000 7facecc00640 1 -- 172.21.15.71:0/2570102803 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7facf0005020 con 0x55fbecdcb4d0 2024-05-27T09:57:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.877+0000 7fad10817740 10 client.26950 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.877+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fbeced0620 con 0x55fbecdcb4d0 2024-05-27T09:57:57.880 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7facecc00640 1 -- 172.21.15.71:0/2570102803 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf40054f0 con 0x55fbecdcb4d0 2024-05-27T09:57:57.880 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7facecc00640 1 -- 172.21.15.71:0/2570102803 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7facf002b400 con 0x55fbecdcb4d0 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7fad10817740 10 client.26950 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7fad10817740 10 client.26950 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7fad10817740 20 client.26950 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7fad10817740 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecdaad80 0x55fbed1aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7fad10817740 4 client.26950 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbed101ae0 con 0x55fbecdaad80 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.878+0000 7fad02a00640 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecdaad80 0x55fbed1aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.879+0000 7facecc00640 10 client.26950 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.879+0000 7fad02a00640 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecdaad80 0x55fbed1aad20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a7d33d019b6c3b9 server_cookie=7e068311c2f5e2b8 in_seq=0 out_seq=0 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.879+0000 7facecc00640 1 -- 172.21.15.71:0/2570102803 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55fbed101ae0 con 0x55fbecdaad80 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.879+0000 7facecc00640 10 client.26950 handle_command_reply: tid=0 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 client.26950 shutdown 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 msgr2=0x55fbed198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed198f50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7facf0013fd0 tx=0x7facf0005f90 comp rx=0 tx=0).stop 2024-05-27T09:57:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 shutdown_connections 2024-05-27T09:57:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed1a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdcb4d0 0x55fbed198f50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecdaad80 0x55fbed1aad20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 --2- 172.21.15.71:0/2570102803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdc32f0 0x55fbed198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 >> 172.21.15.71:0/2570102803 conn(0x55fbecde0300 msgr2=0x55fbed190580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7facecc00640 0 client.26950 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 shutdown_connections 2024-05-27T09:57:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 1 -- 172.21.15.71:0/2570102803 wait complete. 2024-05-27T09:57:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.880+0000 7fad10817740 20 client.26950 trim_cache size 0 max 16384 2024-05-27T09:57:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.902+0000 7fad10817740 1 Processor -- start 2024-05-27T09:57:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.902+0000 7fad10817740 1 -- start start 2024-05-27T09:57:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad10817740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdc32f0 0x55fbed194250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad10817740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad10817740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed18a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad10817740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad041b4630 con 0x55fbecdcb4d0 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad10817740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fad041b1f00 con 0x55fbecdec1b0 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad10817740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad041afd70 con 0x55fbecdc32f0 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad02000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad02a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdc32f0 0x55fbed194250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad02a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdc32f0 0x55fbed194250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:55398/0 (socket says 172.21.15.71:55398) 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad02a00640 1 -- 172.21.15.71:0/2627477311 learned_addr learned my addr 172.21.15.71:0/2627477311 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad02000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49216/0 (socket says 172.21.15.71:49216) 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.903+0000 7fad03400640 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed18a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.904+0000 7fad02a00640 1 -- 172.21.15.71:0/2627477311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 msgr2=0x55fbed18a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.904+0000 7fad02a00640 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed18a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.904+0000 7fad02a00640 1 -- 172.21.15.71:0/2627477311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 msgr2=0x55fbed19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.904+0000 7fad02a00640 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.904+0000 7fad02a00640 1 -- 172.21.15.71:0/2627477311 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbed1a7800 con 0x55fbecdc32f0 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.904+0000 7fad02a00640 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdc32f0 0x55fbed194250 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7facf4009900 tx=0x7facf4004c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164148f957371d1a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.904+0000 7facef400640 1 -- 172.21.15.71:0/2627477311 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4035040 con 0x55fbecdc32f0 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.905+0000 7facef400640 1 -- 172.21.15.71:0/2627477311 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf4057070 con 0x55fbecdc32f0 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.905+0000 7facef400640 1 -- 172.21.15.71:0/2627477311 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4003850 con 0x55fbecdc32f0 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 -- 172.21.15.71:0/2627477311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdc32f0 msgr2=0x55fbed194250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdc32f0 0x55fbed194250 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7facf4009900 tx=0x7facf4004c00 comp rx=0 tx=0).stop 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 -- 172.21.15.71:0/2627477311 shutdown_connections 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdec1b0 0x55fbed18a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 --2- 172.21.15.71:0/2627477311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdc32f0 0x55fbed194250 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 -- 172.21.15.71:0/2627477311 >> 172.21.15.71:0/2627477311 conn(0x55fbecde0300 msgr2=0x55fbed1982a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 -- 172.21.15.71:0/2627477311 shutdown_connections 2024-05-27T09:57:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 -- 172.21.15.71:0/2627477311 wait complete. 2024-05-27T09:57:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 -- start start 2024-05-27T09:57:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.906+0000 7fad10817740 1 Processor -- start 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad10817740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed1929f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad10817740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed192f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad10817740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdec1b0 0x55fbed193490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad10817740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad041b03c0 con 0x55fbecdcb4d0 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad10817740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fad041b1830 con 0x55fbecdc32f0 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad10817740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad041b0a90 con 0x55fbecdec1b0 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad10817740 10 client.0 _ll_register_callbacks cb 0x7facf0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:57:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad02000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed192f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad02000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed192f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49218/0 (socket says 172.21.15.71:49218) 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad02000640 1 -- 172.21.15.71:0/2396319534 learned_addr learned my addr 172.21.15.71:0/2396319534 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad02a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed1929f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.907+0000 7fad03400640 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdec1b0 0x55fbed193490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7fad02a00640 1 -- 172.21.15.71:0/2396319534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdec1b0 msgr2=0x55fbed193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7fad02a00640 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdec1b0 0x55fbed193490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7fad02a00640 1 -- 172.21.15.71:0/2396319534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 msgr2=0x55fbed192f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7fad02a00640 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed192f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7fad02a00640 1 -- 172.21.15.71:0/2396319534 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbed19fdf0 con 0x55fbecdc32f0 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7fad02a00640 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed1929f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7facf402ab00 tx=0x7facf4009540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8de1605b57770a07 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7facecc00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:57:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7facecc00640 1 -- 172.21.15.71:0/2396319534 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4035040 con 0x55fbecdc32f0 2024-05-27T09:57:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7facecc00640 1 -- 172.21.15.71:0/2396319534 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7facf4004970 con 0x55fbecdc32f0 2024-05-27T09:57:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.908+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facf4057070 con 0x55fbecdc32f0 2024-05-27T09:57:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.909+0000 7facecc00640 1 -- 172.21.15.71:0/2396319534 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7facf406b050 con 0x55fbecdc32f0 2024-05-27T09:57:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.909+0000 7fad10817740 10 client.26930 fetch_fsmap learned FSMap version 32 2024-05-27T09:57:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.909+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fbed1a1080 con 0x55fbecdc32f0 2024-05-27T09:57:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.909+0000 7facecc00640 1 -- 172.21.15.71:0/2396319534 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf4057070 con 0x55fbecdc32f0 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.909+0000 7facecc00640 1 -- 172.21.15.71:0/2396319534 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7facf4003af0 con 0x55fbecdc32f0 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad10817740 10 client.26930 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad10817740 10 client.26930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad10817740 20 client.26930 populate_metadata read hostname 'smithi071' 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad10817740 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecd801c0 0x55fbed1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad10817740 4 client.26930 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fbed0fb2c0 con 0x55fbecd801c0 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad02000640 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecd801c0 0x55fbed1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:57:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7facecc00640 10 client.26930 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.910+0000 7fad02000640 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecd801c0 0x55fbed1a1370 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643fb15a122c0117 server_cookie=36781c2cb523e72e in_seq=0 out_seq=0 2024-05-27T09:57:57.925 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7facecc00640 1 -- 172.21.15.71:0/2396319534 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fbed0fb2c0 con 0x55fbecd801c0 2024-05-27T09:57:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7facecc00640 10 client.26930 handle_command_reply: tid=0 2024-05-27T09:57:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 client.26930 shutdown 2024-05-27T09:57:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 msgr2=0x55fbed1929f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed1929f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7facf402ab00 tx=0x7facf4009540 comp rx=0 tx=0).stop 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 shutdown_connections 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbecdec1b0 0x55fbed193490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55fbecd801c0 0x55fbed1a1370 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fbecdcb4d0 0x55fbed192f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 --2- 172.21.15.71:0/2396319534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fbecdc32f0 0x55fbed1929f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7facecc00640 0 client.26930 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.926+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 >> 172.21.15.71:0/2396319534 conn(0x55fbecde0300 msgr2=0x55fbed198270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.927+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 shutdown_connections 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.927+0000 7fad10817740 1 -- 172.21.15.71:0/2396319534 wait complete. 2024-05-27T09:57:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.927+0000 7fad10817740 20 client.26930 trim_cache size 0 max 16384 2024-05-27T09:57:57.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:57:57.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:57:57.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:57:57.928 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7face80b29d0 msgr2=0x7face80b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7face80b29d0 0x7face80b4ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55fbed18b9d0 tx=0x7facf00095b0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0410e200 msgr2=0x7fad0419c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0410e200 0x7fad0419c8d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7facfc00efd0 tx=0x7facfc00c6a0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 shutdown_connections 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7face80b29d0 0x7face80b4ee0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0410e200 0x7fad0419c8d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0410b850 0x7fad041a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 --2- 172.21.15.71:0/2509361323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad04104df0 0x7fad041a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:57:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 >> 172.21.15.71:0/2509361323 conn(0x7fad040782d0 msgr2=0x7fad0410a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:57:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 shutdown_connections 2024-05-27T09:57:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:57:57.928+0000 7fad09800640 1 -- 172.21.15.71:0/2509361323 wait complete. 2024-05-27T09:57:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:57:58 smithi122 ceph-mon[36436]: pgmap v316: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.5 MiB/s wr, 484 op/s 2024-05-27T09:57:59.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:57:58 smithi071 ceph-mon[31451]: pgmap v316: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.5 MiB/s wr, 484 op/s 2024-05-27T09:57:59.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:57:58 smithi072 ceph-mon[35951]: pgmap v316: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.5 MiB/s wr, 484 op/s 2024-05-27T09:58:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:00 smithi122 ceph-mon[36436]: pgmap v317: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1020 KiB/s wr, 326 op/s 2024-05-27T09:58:01.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:00 smithi071 ceph-mon[31451]: pgmap v317: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1020 KiB/s wr, 326 op/s 2024-05-27T09:58:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:00 smithi072 ceph-mon[35951]: pgmap v317: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1020 KiB/s wr, 326 op/s 2024-05-27T09:58:03.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:02 smithi122 ceph-mon[36436]: pgmap v318: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 497 op/s 2024-05-27T09:58:03.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:02 smithi071 ceph-mon[31451]: pgmap v318: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 497 op/s 2024-05-27T09:58:03.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:02 smithi072 ceph-mon[35951]: pgmap v318: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 497 op/s 2024-05-27T09:58:04.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:03 smithi122 ceph-mon[36436]: pgmap v319: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 334 op/s 2024-05-27T09:58:04.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:03 smithi071 ceph-mon[31451]: pgmap v319: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 334 op/s 2024-05-27T09:58:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:03 smithi072 ceph-mon[35951]: pgmap v319: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 334 op/s 2024-05-27T09:58:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:05 smithi122 ceph-mon[36436]: osdmap e92: 12 total, 12 up, 12 in 2024-05-27T09:58:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:05 smithi122 ceph-mon[36436]: pgmap v321: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 401 op/s 2024-05-27T09:58:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:05 smithi071 ceph-mon[31451]: osdmap e92: 12 total, 12 up, 12 in 2024-05-27T09:58:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:05 smithi071 ceph-mon[31451]: pgmap v321: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 401 op/s 2024-05-27T09:58:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:05 smithi072 ceph-mon[35951]: osdmap e92: 12 total, 12 up, 12 in 2024-05-27T09:58:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:05 smithi072 ceph-mon[35951]: pgmap v321: 97 pgs: 97 active+clean; 134 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 401 op/s 2024-05-27T09:58:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:08 smithi122 ceph-mon[36436]: pgmap v322: 97 pgs: 97 active+clean; 130 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-05-27T09:58:09.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:08 smithi071 ceph-mon[31451]: pgmap v322: 97 pgs: 97 active+clean; 130 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-05-27T09:58:09.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:08 smithi072 ceph-mon[35951]: pgmap v322: 97 pgs: 97 active+clean; 130 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-05-27T09:58:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 -- 172.21.15.71:0/4085353919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 msgr2=0x7f03c0103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 --2- 172.21.15.71:0/4085353919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c0103850 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009900 tx=0x7f03b002a410 comp rx=0 tx=0).stop 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 -- 172.21.15.71:0/4085353919 shutdown_connections 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 --2- 172.21.15.71:0/4085353919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c0104400 0x7f03c01107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 --2- 172.21.15.71:0/4085353919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03c010a150 0x7f03c0103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 --2- 172.21.15.71:0/4085353919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c0103850 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 -- 172.21.15.71:0/4085353919 >> 172.21.15.71:0/4085353919 conn(0x7f03c00ff480 msgr2=0x7f03c01018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 -- 172.21.15.71:0/4085353919 shutdown_connections 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.172+0000 7f03c6c00640 1 -- 172.21.15.71:0/4085353919 wait complete. 2024-05-27T09:58:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 Processor -- start 2024-05-27T09:58:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 -- start start 2024-05-27T09:58:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03c0104400 0x7f03c019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c019dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c010a150 0x7f03c01a8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0113ef0 con 0x7f03c0104400 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0113d70 con 0x7f03c0109cb0 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.174+0000 7f03c6c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0114070 con 0x7f03c010a150 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03c4c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c010a150 0x7f03c01a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03b7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c019dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03c4c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c010a150 0x7f03c01a8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41926/0 (socket says 172.21.15.71:41926) 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03b7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c019dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46984/0 (socket says 172.21.15.71:46984) 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03c4c00640 1 -- 172.21.15.71:0/481713629 learned_addr learned my addr 172.21.15.71:0/481713629 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03bfe00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03c0104400 0x7f03c019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03b7e00640 1 -- 172.21.15.71:0/481713629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c010a150 msgr2=0x7f03c01a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03b7e00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c010a150 0x7f03c01a8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03b7e00640 1 -- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03c0104400 msgr2=0x7f03c019d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03b7e00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03c0104400 0x7f03c019d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03b7e00640 1 -- 172.21.15.71:0/481713629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c01a8d90 con 0x7f03c0109cb0 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.175+0000 7f03bfe00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03c0104400 0x7f03c019d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.176+0000 7f03b7e00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c019dd10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f03c006c530 tx=0x7f03a800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.176+0000 7f03bd600640 1 -- 172.21.15.71:0/481713629 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a800cc40 con 0x7f03c0109cb0 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.176+0000 7f03bd600640 1 -- 172.21.15.71:0/481713629 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03a800cde0 con 0x7f03c0109cb0 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.176+0000 7f03bd600640 1 -- 172.21.15.71:0/481713629 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8010430 con 0x7f03c0109cb0 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.176+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c01a8f60 con 0x7f03c0109cb0 2024-05-27T09:58:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.176+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01a93d0 con 0x7f03c0109cb0 2024-05-27T09:58:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03bd600640 1 -- 172.21.15.71:0/481713629 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f03a80105d0 con 0x7f03c0109cb0 2024-05-27T09:58:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 Processor -- start 2024-05-27T09:58:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 -- start start 2024-05-27T09:58:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8b031b0 0x5649f8ea5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8ea5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8ae24d0 0x5649f8ea62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5649f8e16b90 con 0x5649f8ae24d0 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5649f8e06730 con 0x5649f8b031b0 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.180+0000 7f03cdbed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5649f8e0a770 con 0x5649f8ada2f0 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8ea5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03c4c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8b031b0 0x5649f8ea5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8ea5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41928/0 (socket says 172.21.15.71:41928) 2024-05-27T09:58:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 -- 172.21.15.71:0/3567620385 learned_addr learned my addr 172.21.15.71:0/3567620385 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03b7e00640 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8ae24d0 0x5649f8ea62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 -- 172.21.15.71:0/3567620385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8b031b0 msgr2=0x5649f8ea5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8b031b0 0x5649f8ea5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 -- 172.21.15.71:0/3567620385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8ae24d0 msgr2=0x5649f8ea62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8ae24d0 0x5649f8ea62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 -- 172.21.15.71:0/3567620385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f8d9f8b0 con 0x5649f8ada2f0 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03c4c00640 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8b031b0 0x5649f8ea5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.181+0000 7f03bfe00640 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8ea5da0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f03c0104990 tx=0x7f03b00042d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775791794ec2fc48 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.182+0000 7f03bd600640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03a40b29d0 0x7f03a40b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.182+0000 7f03b5200640 1 -- 172.21.15.71:0/3567620385 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0035030 con 0x5649f8ada2f0 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.182+0000 7f03b5200640 1 -- 172.21.15.71:0/3567620385 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b00044c0 con 0x5649f8ada2f0 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.182+0000 7f03b5200640 1 -- 172.21.15.71:0/3567620385 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b00035f0 con 0x5649f8ada2f0 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.182+0000 7f03bd600640 1 -- 172.21.15.71:0/481713629 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f03a80e2a30 con 0x7f03c0109cb0 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.182+0000 7f03c4c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03a40b29d0 0x7f03a40b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 -- 172.21.15.71:0/3567620385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 msgr2=0x5649f8ea5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8ea5da0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f03c0104990 tx=0x7f03b00042d0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03c4c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03a40b29d0 0x7f03a40b4ee0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5649f8ea29d0 tx=0x7f03b8009500 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 -- 172.21.15.71:0/3567620385 shutdown_connections 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8ae24d0 0x5649f8ea62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8ea5da0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 --2- 172.21.15.71:0/3567620385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8b031b0 0x5649f8ea5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 -- 172.21.15.71:0/3567620385 >> 172.21.15.71:0/3567620385 conn(0x5649f8af7300 msgr2=0x5649f8ea2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 -- 172.21.15.71:0/3567620385 shutdown_connections 2024-05-27T09:58:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.183+0000 7f03cdbed740 1 -- 172.21.15.71:0/3567620385 wait complete. 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.184+0000 7f03cdbed740 1 -- start start 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.184+0000 7f03cdbed740 1 Processor -- start 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ada2f0 0x5649f8eaf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ae24d0 0x5649f8eaff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03cdbed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5649f8aec790 con 0x5649f8b031b0 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03cdbed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5649f8daebc0 con 0x5649f8ada2f0 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03cdbed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5649f8eb2930 con 0x5649f8ae24d0 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03cdbed740 10 client.0 _ll_register_callbacks cb 0x5649f8d8c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03bfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ada2f0 0x5649f8eaf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03c4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03bfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ada2f0 0x5649f8eaf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:46998/0 (socket says 172.21.15.71:46998) 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03bfe00640 1 -- 172.21.15.71:0/2551760842 learned_addr learned my addr 172.21.15.71:0/2551760842 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03b7e00640 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ae24d0 0x5649f8eaff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03bfe00640 1 -- 172.21.15.71:0/2551760842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ae24d0 msgr2=0x5649f8eaff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03bfe00640 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ae24d0 0x5649f8eaff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03bfe00640 1 -- 172.21.15.71:0/2551760842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 msgr2=0x5649f8ebbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.185+0000 7f03bfe00640 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.186+0000 7f03bfe00640 1 -- 172.21.15.71:0/2551760842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f8b1b210 con 0x5649f8ada2f0 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.186+0000 7f03bfe00640 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ada2f0 0x5649f8eaf9f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f03b002a450 tx=0x7f03b0004f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19f016c25b0c77fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.186+0000 7f03ad600640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.186+0000 7f03ad600640 1 -- 172.21.15.71:0/2551760842 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0051060 con 0x5649f8ada2f0 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.186+0000 7f03ad600640 1 -- 172.21.15.71:0/2551760842 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f03b0005520 con 0x5649f8ada2f0 2024-05-27T09:58:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.186+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649f8e18ae0 con 0x5649f8ada2f0 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03ad600640 1 -- 172.21.15.71:0/2551760842 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f03b0035040 con 0x5649f8ada2f0 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 10 client.26942 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649f8be7620 con 0x5649f8ada2f0 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03ad600640 1 -- 172.21.15.71:0/2551760842 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5649f8e18ae0 con 0x5649f8ada2f0 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03ad600640 1 -- 172.21.15.71:0/2551760842 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f03b004b030 con 0x5649f8ada2f0 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 10 client.26942 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 10 client.26942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 20 client.26942 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8ac1d80 0x5649f8ec1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 4 client.26942 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.187+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649f8e122c0 con 0x5649f8ac1d80 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.188+0000 7f03b7e00640 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8ac1d80 0x5649f8ec1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.188+0000 7f03b7e00640 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8ac1d80 0x5649f8ec1a60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2a3695f222ac67a server_cookie=ecc9095f51ec5920 in_seq=0 out_seq=0 2024-05-27T09:58:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.188+0000 7f03ad600640 10 client.26942 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03ad600640 1 -- 172.21.15.71:0/2551760842 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5649f8e122c0 con 0x5649f8ac1d80 2024-05-27T09:58:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03ad600640 10 client.26942 handle_command_reply: tid=0 2024-05-27T09:58:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 client.26942 shutdown 2024-05-27T09:58:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ada2f0 msgr2=0x5649f8eaf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ada2f0 0x5649f8eaf9f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f03b002a450 tx=0x7f03b0004f20 comp rx=0 tx=0).stop 2024-05-27T09:58:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 shutdown_connections 2024-05-27T09:58:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8ac1d80 0x5649f8ec1a60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ae24d0 0x5649f8eaff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03ad600640 0 client.26942 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2551760842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ada2f0 0x5649f8eaf9f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 >> 172.21.15.71:0/2551760842 conn(0x5649f8af7300 msgr2=0x5649f8ea5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 shutdown_connections 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.189+0000 7f03cdbed740 1 -- 172.21.15.71:0/2551760842 wait complete. 2024-05-27T09:58:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.190+0000 7f03cdbed740 20 client.26942 trim_cache size 0 max 16384 2024-05-27T09:58:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.207+0000 7f03cdbed740 1 Processor -- start 2024-05-27T09:58:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03cdbed740 1 -- start start 2024-05-27T09:58:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8eab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8eb1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03cdbed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01b4590 con 0x5649f8b031b0 2024-05-27T09:58:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03cdbed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01b1e60 con 0x5649f8ae24d0 2024-05-27T09:58:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03cdbed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01afcd0 con 0x5649f8ada2f0 2024-05-27T09:58:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03c4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03c4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41892/0 (socket says 172.21.15.71:41892) 2024-05-27T09:58:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03b7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8eb1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03c4c00640 1 -- 172.21.15.71:0/202709836 learned_addr learned my addr 172.21.15.71:0/202709836 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.208+0000 7f03bfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8eab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.209+0000 7f03c4c00640 1 -- 172.21.15.71:0/202709836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 msgr2=0x5649f8eab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.209+0000 7f03c4c00640 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8eab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.209+0000 7f03c4c00640 1 -- 172.21.15.71:0/202709836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 msgr2=0x5649f8eb1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.209+0000 7f03c4c00640 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8eb1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.209+0000 7f03c4c00640 1 -- 172.21.15.71:0/202709836 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f8ea2c00 con 0x5649f8b031b0 2024-05-27T09:58:11.211 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.209+0000 7f03bfe00640 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8eab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:11.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.209+0000 7f03b7e00640 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8eb1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:11.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.210+0000 7f03c4c00640 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f03b800fb00 tx=0x7f03b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d647db3935f73769 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:11.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.210+0000 7f03afe00640 1 -- 172.21.15.71:0/202709836 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b801d6c0 con 0x5649f8b031b0 2024-05-27T09:58:11.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.210+0000 7f03afe00640 1 -- 172.21.15.71:0/202709836 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b802d070 con 0x5649f8b031b0 2024-05-27T09:58:11.212 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.210+0000 7f03afe00640 1 -- 172.21.15.71:0/202709836 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8028bd0 con 0x5649f8b031b0 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 -- 172.21.15.71:0/202709836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 msgr2=0x5649f8ebbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f03b800fb00 tx=0x7f03b8017000 comp rx=0 tx=0).stop 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 -- 172.21.15.71:0/202709836 shutdown_connections 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ebbc00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8eb1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 --2- 172.21.15.71:0/202709836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8eab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 -- 172.21.15.71:0/202709836 >> 172.21.15.71:0/202709836 conn(0x5649f8af7300 msgr2=0x5649f8eaf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 -- 172.21.15.71:0/202709836 shutdown_connections 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.211+0000 7f03cdbed740 1 -- 172.21.15.71:0/202709836 wait complete. 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.212+0000 7f03cdbed740 1 -- start start 2024-05-27T09:58:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.212+0000 7f03cdbed740 1 Processor -- start 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8f222d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8f22810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03cdbed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ec20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03cdbed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01b0320 con 0x5649f8b031b0 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03cdbed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01b1790 con 0x5649f8ae24d0 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03cdbed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01b09f0 con 0x5649f8ada2f0 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03cdbed740 10 client.0 _ll_register_callbacks cb 0x7f03b80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03bfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8f222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03bfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8f222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:41940/0 (socket says 172.21.15.71:41940) 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03bfe00640 1 -- 172.21.15.71:0/2501508647 learned_addr learned my addr 172.21.15.71:0/2501508647 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03c4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ec20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03b7e00640 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8f22810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03bfe00640 1 -- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 msgr2=0x5649f8f22810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03bfe00640 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8f22810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03bfe00640 1 -- 172.21.15.71:0/2501508647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 msgr2=0x5649f8ec20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.213+0000 7f03bfe00640 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ec20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.214+0000 7f03bfe00640 1 -- 172.21.15.71:0/2501508647 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f8ec2690 con 0x5649f8ada2f0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.214+0000 7f03bfe00640 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8f222d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f03b002a450 tx=0x7f03b0001e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cbb58ae8c8b49d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.214+0000 7f03ad600640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.214+0000 7f03ad600640 1 -- 172.21.15.71:0/2501508647 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0051040 con 0x5649f8ada2f0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.214+0000 7f03ad600640 1 -- 172.21.15.71:0/2501508647 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f03b0055d60 con 0x5649f8ada2f0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.214+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b802d070 con 0x5649f8ada2f0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.214+0000 7f03ad600640 1 -- 172.21.15.71:0/2501508647 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f03b0066050 con 0x5649f8ada2f0 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 10 client.26974 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649f8f29920 con 0x5649f8ada2f0 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03ad600640 1 -- 172.21.15.71:0/2501508647 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b802d070 con 0x5649f8ada2f0 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03ad600640 1 -- 172.21.15.71:0/2501508647 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f03b005d070 con 0x5649f8ada2f0 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 10 client.26974 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 10 client.26974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 20 client.26974 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8a971c0 0x5649f8f2c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 4 client.26974 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:58:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.215+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649f8d8c4b0 con 0x5649f8a971c0 2024-05-27T09:58:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.216+0000 7f03b7e00640 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8a971c0 0x5649f8f2c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.216+0000 7f03b7e00640 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8a971c0 0x5649f8f2c080 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=577a9f1708dc21fa server_cookie=e4f2a7bad9fca863 in_seq=0 out_seq=0 2024-05-27T09:58:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.216+0000 7f03ad600640 10 client.26974 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:11.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:10 smithi122 ceph-mon[36436]: pgmap v323: 97 pgs: 97 active+clean; 130 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-05-27T09:58:11.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:10 smithi122 ceph-mon[36436]: osdmap e93: 12 total, 12 up, 12 in 2024-05-27T09:58:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.237+0000 7f03ad600640 1 -- 172.21.15.71:0/2501508647 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5649f8d8c4b0 con 0x5649f8a971c0 2024-05-27T09:58:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.237+0000 7f03ad600640 10 client.26974 handle_command_reply: tid=0 2024-05-27T09:58:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.237+0000 7f03cdbed740 1 client.26974 shutdown 2024-05-27T09:58:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.238+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 msgr2=0x5649f8f222d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.238+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8f222d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f03b002a450 tx=0x7f03b0001e50 comp rx=0 tx=0).stop 2024-05-27T09:58:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.239+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 shutdown_connections 2024-05-27T09:58:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.239+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5649f8a971c0 0x5649f8f2c080 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.239+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5649f8b031b0 0x5649f8ec20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.239+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5649f8ae24d0 0x5649f8f22810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.239+0000 7f03cdbed740 1 --2- 172.21.15.71:0/2501508647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5649f8ada2f0 0x5649f8f222d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.239+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 >> 172.21.15.71:0/2501508647 conn(0x5649f8af7300 msgr2=0x5649f8eafcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.240+0000 7f03ad600640 0 client.26974 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.240+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 shutdown_connections 2024-05-27T09:58:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.240+0000 7f03cdbed740 1 -- 172.21.15.71:0/2501508647 wait complete. 2024-05-27T09:58:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.241+0000 7f03cdbed740 20 client.26974 trim_cache size 0 max 16384 2024-05-27T09:58:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:58:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:58:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03a40b29d0 msgr2=0x7f03a40b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03a40b29d0 0x7f03a40b4ee0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5649f8ea29d0 tx=0x7f03b8009500 comp rx=0 tx=0).stop 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 msgr2=0x7f03c019dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c019dd10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f03c006c530 tx=0x7f03a800ee50 comp rx=0 tx=0).stop 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 shutdown_connections 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f03a40b29d0 0x7f03a40b4ee0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c010a150 0x7f03c01a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0109cb0 0x7f03c019dd10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 --2- 172.21.15.71:0/481713629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03c0104400 0x7f03c019d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 >> 172.21.15.71:0/481713629 conn(0x7f03c00ff480 msgr2=0x7f03c00ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 shutdown_connections 2024-05-27T09:58:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:11.242+0000 7f03c6c00640 1 -- 172.21.15.71:0/481713629 wait complete. 2024-05-27T09:58:11.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:10 smithi071 ceph-mon[31451]: pgmap v323: 97 pgs: 97 active+clean; 130 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-05-27T09:58:11.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:10 smithi071 ceph-mon[31451]: osdmap e93: 12 total, 12 up, 12 in 2024-05-27T09:58:11.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:10 smithi072 ceph-mon[35951]: pgmap v323: 97 pgs: 97 active+clean; 130 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-05-27T09:58:11.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:10 smithi072 ceph-mon[35951]: osdmap e93: 12 total, 12 up, 12 in 2024-05-27T09:58:13.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:12 smithi122 ceph-mon[36436]: pgmap v325: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-05-27T09:58:13.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:12 smithi071 ceph-mon[31451]: pgmap v325: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-05-27T09:58:13.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:12 smithi072 ceph-mon[35951]: pgmap v325: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-05-27T09:58:15.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:14 smithi122 ceph-mon[36436]: pgmap v326: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.4 MiB/s wr, 464 op/s 2024-05-27T09:58:15.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:14 smithi071 ceph-mon[31451]: pgmap v326: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.4 MiB/s wr, 464 op/s 2024-05-27T09:58:15.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:14 smithi072 ceph-mon[35951]: pgmap v326: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.4 MiB/s wr, 464 op/s 2024-05-27T09:58:16.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:16 smithi071 ceph-mon[31451]: pgmap v327: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.3 MiB/s wr, 414 op/s 2024-05-27T09:58:16.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:16 smithi072 ceph-mon[35951]: pgmap v327: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.3 MiB/s wr, 414 op/s 2024-05-27T09:58:16.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:16 smithi122 ceph-mon[36436]: pgmap v327: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.3 MiB/s wr, 414 op/s 2024-05-27T09:58:19.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:18 smithi122 ceph-mon[36436]: pgmap v328: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.2 MiB/s wr, 407 op/s 2024-05-27T09:58:19.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:18 smithi071 ceph-mon[31451]: pgmap v328: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.2 MiB/s wr, 407 op/s 2024-05-27T09:58:19.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:18 smithi072 ceph-mon[35951]: pgmap v328: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.2 MiB/s wr, 407 op/s 2024-05-27T09:58:21.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:20 smithi122 ceph-mon[36436]: pgmap v329: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.2 MiB/s wr, 407 op/s 2024-05-27T09:58:21.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:20 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:58:21.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:20 smithi071 ceph-mon[31451]: pgmap v329: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.2 MiB/s wr, 407 op/s 2024-05-27T09:58:21.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:20 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:58:21.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:20 smithi072 ceph-mon[35951]: pgmap v329: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.2 MiB/s wr, 407 op/s 2024-05-27T09:58:21.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:20 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:58:21.717 INFO:tasks.workunit.client.0.smithi071.stdout:copying to largest ever: 0x63ef9ee 2024-05-27T09:58:23.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: pgmap v330: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.6 MiB/s wr, 522 op/s 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:22 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: pgmap v330: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.6 MiB/s wr, 522 op/s 2024-05-27T09:58:23.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:22 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: pgmap v330: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.6 MiB/s wr, 522 op/s 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:23.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:22 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-05-27T09:58:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: Unable to set osd_memory_target on smithi122 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:58:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:24.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:23 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:24.250 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-05-27T09:58:24.250 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: Unable to set osd_memory_target on smithi122 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:58:24.250 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.250 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.251 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.251 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.251 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:24.251 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:23 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-05-27T09:58:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: Unable to set osd_memory_target on smithi122 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:58:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:24.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:23 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.505+0000 7f8575000640 1 -- 172.21.15.71:0/2256656249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570104250 msgr2=0x7f85701105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.505+0000 7f8575000640 1 --2- 172.21.15.71:0/2256656249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570104250 0x7f85701105d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8568009ca0 tx=0x7f856802a8c0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.505+0000 7f8575000640 1 -- 172.21.15.71:0/2256656249 shutdown_connections 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.505+0000 7f8575000640 1 --2- 172.21.15.71:0/2256656249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570104250 0x7f85701105d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.505+0000 7f8575000640 1 --2- 172.21.15.71:0/2256656249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 0x7f8570103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.505+0000 7f8575000640 1 --2- 172.21.15.71:0/2256656249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8570109ab0 0x7f85701036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.505+0000 7f8575000640 1 -- 172.21.15.71:0/2256656249 >> 172.21.15.71:0/2256656249 conn(0x7f8570079240 msgr2=0x7f8570079680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.506+0000 7f8575000640 1 -- 172.21.15.71:0/2256656249 shutdown_connections 2024-05-27T09:58:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.506+0000 7f8575000640 1 -- 172.21.15.71:0/2256656249 wait complete. 2024-05-27T09:58:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.507+0000 7f8575000640 1 Processor -- start 2024-05-27T09:58:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.507+0000 7f8575000640 1 -- start start 2024-05-27T09:58:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f8575000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8570104250 0x7f857010a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f8575000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570109ab0 0x7f857010aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f8575000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 0x7f857010b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f8575000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8570113d10 con 0x7f8570104250 2024-05-27T09:58:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f8575000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8570113b90 con 0x7f8570109ab0 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f8575000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8570113e90 con 0x7f8570109f50 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f856ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570109ab0 0x7f857010aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f856fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 0x7f857010b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f856ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570109ab0 0x7f857010aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34100/0 (socket says 172.21.15.71:34100) 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f856ea00640 1 -- 172.21.15.71:0/3383249249 learned_addr learned my addr 172.21.15.71:0/3383249249 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.508+0000 7f856fe00640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 0x7f857010b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:33980/0 (socket says 172.21.15.71:33980) 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856ea00640 1 -- 172.21.15.71:0/3383249249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 msgr2=0x7f857010b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856ea00640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 0x7f857010b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856f400640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8570104250 0x7f857010a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856ea00640 1 -- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8570104250 msgr2=0x7f857010a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856ea00640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8570104250 0x7f857010a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856ea00640 1 -- 172.21.15.71:0/3383249249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85701acf00 con 0x7f8570109ab0 2024-05-27T09:58:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856fe00640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 0x7f857010b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856f400640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8570104250 0x7f857010a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:58:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.509+0000 7f856ea00640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570109ab0 0x7f857010aac0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e9f0 tx=0x7f855c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.512+0000 7f8567e00640 1 -- 172.21.15.71:0/3383249249 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00ccc0 con 0x7f8570109ab0 2024-05-27T09:58:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.512+0000 7f8567e00640 1 -- 172.21.15.71:0/3383249249 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f855c0035f0 con 0x7f8570109ab0 2024-05-27T09:58:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.512+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85701ad190 con 0x7f8570109ab0 2024-05-27T09:58:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.512+0000 7f8567e00640 1 -- 172.21.15.71:0/3383249249 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00ce60 con 0x7f8570109ab0 2024-05-27T09:58:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.512+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85701ad690 con 0x7f8570109ab0 2024-05-27T09:58:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.519+0000 7f8567e00640 1 -- 172.21.15.71:0/3383249249 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f855c010690 con 0x7f8570109ab0 2024-05-27T09:58:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.519+0000 7f857d67e740 1 Processor -- start 2024-05-27T09:58:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.519+0000 7f857d67e740 1 -- start start 2024-05-27T09:58:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f857d67e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f744298a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f857d67e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f744298fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f857d67e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442994e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f857d67e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f744209b90 con 0x55f743ef61b0 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f857d67e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f7441f9730 con 0x55f743ed54d0 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f857d67e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f7441fd770 con 0x55f743ecd2f0 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f856fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f744298a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f856fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f744298a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55132/0 (socket says 172.21.15.71:55132) 2024-05-27T09:58:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.520+0000 7f856fe00640 1 -- 172.21.15.71:0/4125593472 learned_addr learned my addr 172.21.15.71:0/4125593472 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856ea00640 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856f400640 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f744298fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856fe00640 1 -- 172.21.15.71:0/4125593472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 msgr2=0x55f744298fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856fe00640 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f744298fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856fe00640 1 -- 172.21.15.71:0/4125593472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 msgr2=0x55f7442994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856fe00640 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856fe00640 1 -- 172.21.15.71:0/4125593472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7441928b0 con 0x55f743ef61b0 2024-05-27T09:58:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f8567e00640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f85540b2aa0 0x7f85540b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f856f400640 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f744298fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:58:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.521+0000 7f8567e00640 1 -- 172.21.15.71:0/3383249249 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f855c0e2d30 con 0x7f8570109ab0 2024-05-27T09:58:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.522+0000 7f856fe00640 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f744298a60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8568009ca0 tx=0x7f8568009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fd45c73ff0392 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.522+0000 7f856f400640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f85540b2aa0 0x7f85540b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.522+0000 7f8564c00640 1 -- 172.21.15.71:0/4125593472 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568031650 con 0x55f743ef61b0 2024-05-27T09:58:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.522+0000 7f8564c00640 1 -- 172.21.15.71:0/4125593472 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8568036040 con 0x55f743ef61b0 2024-05-27T09:58:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.522+0000 7f8564c00640 1 -- 172.21.15.71:0/4125593472 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85680044a0 con 0x55f743ef61b0 2024-05-27T09:58:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.523+0000 7f857d67e740 1 -- 172.21.15.71:0/4125593472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 msgr2=0x55f744298a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.523+0000 7f857d67e740 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f744298a60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8568009ca0 tx=0x7f8568009950 comp rx=0 tx=0).stop 2024-05-27T09:58:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.524+0000 7f856f400640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f85540b2aa0 0x7f85540b4fb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8560005fd0 tx=0x7f8560005f60 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.524+0000 7f857d67e740 1 -- 172.21.15.71:0/4125593472 shutdown_connections 2024-05-27T09:58:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.524+0000 7f857d67e740 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.524+0000 7f857d67e740 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f744298fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.524+0000 7f857d67e740 1 --2- 172.21.15.71:0/4125593472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f744298a60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.524+0000 7f857d67e740 1 -- 172.21.15.71:0/4125593472 >> 172.21.15.71:0/4125593472 conn(0x55f743eea300 msgr2=0x55f744295210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.525+0000 7f857d67e740 1 -- 172.21.15.71:0/4125593472 shutdown_connections 2024-05-27T09:58:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.525+0000 7f857d67e740 1 -- 172.21.15.71:0/4125593472 wait complete. 2024-05-27T09:58:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.526+0000 7f857d67e740 1 -- start start 2024-05-27T09:58:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.526+0000 7f857d67e740 1 Processor -- start 2024-05-27T09:58:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.527+0000 7f857d67e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ecd2f0 0x55f7442a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.527+0000 7f857d67e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442a3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.527+0000 7f857d67e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ef61b0 0x55f7442aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.527+0000 7f857d67e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f743edf790 con 0x55f743ecd2f0 2024-05-27T09:58:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.527+0000 7f857d67e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f7441a1bc0 con 0x55f743ed54d0 2024-05-27T09:58:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.527+0000 7f857d67e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f7442a59b0 con 0x55f743ef61b0 2024-05-27T09:58:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.527+0000 7f857d67e740 10 client.0 _ll_register_callbacks cb 0x55f74417f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ecd2f0 0x55f7442a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ef61b0 0x55f7442aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ecd2f0 0x55f7442a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55142/0 (socket says 172.21.15.71:55142) 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856f400640 1 -- 172.21.15.71:0/3364249263 learned_addr learned my addr 172.21.15.71:0/3364249263 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856ea00640 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856fe00640 1 -- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 msgr2=0x55f7442a3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856fe00640 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442a3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856fe00640 1 -- 172.21.15.71:0/3364249263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ecd2f0 msgr2=0x55f7442a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856fe00640 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ecd2f0 0x55f7442a2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856fe00640 1 -- 172.21.15.71:0/3364249263 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f743f0e210 con 0x55f743ef61b0 2024-05-27T09:58:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.528+0000 7f856f400640 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ecd2f0 0x55f7442a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.529+0000 7f856fe00640 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ef61b0 0x55f7442aed70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f856802aeb0 tx=0x7f8568032f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=827412771b028cc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.529+0000 7f8559600640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:58:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.529+0000 7f8559600640 1 -- 172.21.15.71:0/3364249263 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568004530 con 0x55f743ef61b0 2024-05-27T09:58:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.529+0000 7f8559600640 1 -- 172.21.15.71:0/3364249263 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f856804b040 con 0x55f743ef61b0 2024-05-27T09:58:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.529+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8568036040 con 0x55f743ef61b0 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f8559600640 1 -- 172.21.15.71:0/3364249263 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f85680046d0 con 0x55f743ef61b0 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 10 client.26983 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f743fda620 con 0x55f743ef61b0 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f8559600640 1 -- 172.21.15.71:0/3364249263 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8568036040 con 0x55f743ef61b0 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f8559600640 1 -- 172.21.15.71:0/3364249263 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f856804f070 con 0x55f743ef61b0 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 10 client.26983 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 10 client.26983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 20 client.26983 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743eb4d80 0x55f7442b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 4 client.26983 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.530+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f74420bae0 con 0x55f743eb4d80 2024-05-27T09:58:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.531+0000 7f856f400640 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743eb4d80 0x55f7442b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.531+0000 7f856f400640 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743eb4d80 0x55f7442b4b60 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe62045d3094f299 server_cookie=b1a3b7a2204dbe3b in_seq=0 out_seq=0 2024-05-27T09:58:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.531+0000 7f8559600640 10 client.26983 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.532+0000 7f8559600640 1 -- 172.21.15.71:0/3364249263 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f74420bae0 con 0x55f743eb4d80 2024-05-27T09:58:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.532+0000 7f8559600640 10 client.26983 handle_command_reply: tid=0 2024-05-27T09:58:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.532+0000 7f857d67e740 1 client.26983 shutdown 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.532+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ef61b0 msgr2=0x55f7442aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.532+0000 7f857d67e740 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ef61b0 0x55f7442aed70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f856802aeb0 tx=0x7f8568032f30 comp rx=0 tx=0).stop 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 shutdown_connections 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ef61b0 0x55f7442aed70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ed54d0 0x55f7442a3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743eb4d80 0x55f7442b4b60 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 --2- 172.21.15.71:0/3364249263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ecd2f0 0x55f7442a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 >> 172.21.15.71:0/3364249263 conn(0x55f743eea300 msgr2=0x55f744298890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f8559600640 0 client.26983 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 shutdown_connections 2024-05-27T09:58:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 1 -- 172.21.15.71:0/3364249263 wait complete. 2024-05-27T09:58:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.533+0000 7f857d67e740 20 client.26983 trim_cache size 0 max 16384 2024-05-27T09:58:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.563+0000 7f857d67e740 1 Processor -- start 2024-05-27T09:58:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.563+0000 7f857d67e740 1 -- start start 2024-05-27T09:58:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.563+0000 7f857d67e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f74429e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f857d67e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ed54d0 0x55f7442aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f857d67e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ef61b0 0x55f7442b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f857d67e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8550011010 con 0x55f743ed54d0 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f857d67e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f855000e8e0 con 0x55f743ef61b0 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f857d67e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f855000c750 con 0x55f743ecd2f0 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f74429e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f74429e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34014/0 (socket says 172.21.15.71:34014) 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856f400640 1 -- 172.21.15.71:0/2676310545 learned_addr learned my addr 172.21.15.71:0/2676310545 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ef61b0 0x55f7442b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856ea00640 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ed54d0 0x55f7442aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.566 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856fe00640 1 -- 172.21.15.71:0/2676310545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 msgr2=0x55f74429e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856fe00640 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f74429e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856fe00640 1 -- 172.21.15.71:0/2676310545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ed54d0 msgr2=0x55f7442aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.564+0000 7f856fe00640 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ed54d0 0x55f7442aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.565+0000 7f856fe00640 1 -- 172.21.15.71:0/2676310545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f744295bd0 con 0x55f743ef61b0 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.565+0000 7f856fe00640 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ef61b0 0x55f7442b7b80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f856802ade0 tx=0x7f8568005d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73da21261c05c610 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.565+0000 7f855be00640 1 -- 172.21.15.71:0/2676310545 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568004530 con 0x55f743ef61b0 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.565+0000 7f855be00640 1 -- 172.21.15.71:0/2676310545 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8568036070 con 0x55f743ef61b0 2024-05-27T09:58:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.565+0000 7f855be00640 1 -- 172.21.15.71:0/2676310545 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568003e20 con 0x55f743ef61b0 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.566+0000 7f857d67e740 1 -- 172.21.15.71:0/2676310545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ef61b0 msgr2=0x55f7442b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.566+0000 7f857d67e740 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ef61b0 0x55f7442b7b80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f856802ade0 tx=0x7f8568005d80 comp rx=0 tx=0).stop 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 -- 172.21.15.71:0/2676310545 shutdown_connections 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ef61b0 0x55f7442b7b80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ed54d0 0x55f7442aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 --2- 172.21.15.71:0/2676310545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ecd2f0 0x55f74429e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 -- 172.21.15.71:0/2676310545 >> 172.21.15.71:0/2676310545 conn(0x55f743eea300 msgr2=0x55f7442a4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 -- 172.21.15.71:0/2676310545 shutdown_connections 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 -- 172.21.15.71:0/2676310545 wait complete. 2024-05-27T09:58:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.567+0000 7f857d67e740 1 -- start start 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 1 Processor -- start 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ecd2f0 0x55f7442b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ed54d0 0x55f7442b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f74431afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f855000cda0 con 0x55f743ef61b0 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f855000e210 con 0x55f743ecd2f0 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f855000d470 con 0x55f743ed54d0 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.568+0000 7f857d67e740 10 client.0 _ll_register_callbacks cb 0x7f855c0e9200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ed54d0 0x55f7442b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ed54d0 0x55f7442b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34030/0 (socket says 172.21.15.71:34030) 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 -- 172.21.15.71:0/180281844 learned_addr learned my addr 172.21.15.71:0/180281844 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856fe00640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f74431afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856f400640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ecd2f0 0x55f7442b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 -- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ecd2f0 msgr2=0x55f7442b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ecd2f0 0x55f7442b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 -- 172.21.15.71:0/180281844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 msgr2=0x55f74431afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f74431afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 -- 172.21.15.71:0/180281844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f74431b4e0 con 0x55f743ed54d0 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856f400640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ecd2f0 0x55f7442b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f856ea00640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ed54d0 0x55f7442b55f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f855c003f80 tx=0x7f855c0ab060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6377c1d688d079c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.569+0000 7f8559600640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:58:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f8559600640 1 -- 172.21.15.71:0/180281844 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0e6020 con 0x55f743ed54d0 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f8559600640 1 -- 172.21.15.71:0/180281844 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f855c0e0d80 con 0x55f743ed54d0 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8568036070 con 0x55f743ed54d0 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f8559600640 1 -- 172.21.15.71:0/180281844 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f855c0eb070 con 0x55f743ed54d0 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 10 client.26989 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f74431c740 con 0x55f743ed54d0 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f8559600640 1 -- 172.21.15.71:0/180281844 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8568036070 con 0x55f743ed54d0 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f8559600640 1 -- 172.21.15.71:0/180281844 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f855c0a64f0 con 0x55f743ed54d0 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 10 client.26989 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 10 client.26989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 20 client.26989 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743e8a1c0 0x55f74431ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 4 client.26989 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:58:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.570+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7442052c0 con 0x55f743e8a1c0 2024-05-27T09:58:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.571+0000 7f856f400640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743e8a1c0 0x55f74431ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.571+0000 7f8559600640 10 client.26989 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.571+0000 7f856f400640 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743e8a1c0 0x55f74431ef80 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da54cbac00bf5429 server_cookie=610de5622a672020 in_seq=0 out_seq=0 2024-05-27T09:58:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.593+0000 7f8559600640 1 -- 172.21.15.71:0/180281844 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f7442052c0 con 0x55f743e8a1c0 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.593+0000 7f8559600640 10 client.26989 handle_command_reply: tid=0 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.593+0000 7f857d67e740 1 client.26989 shutdown 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.593+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ed54d0 msgr2=0x55f7442b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.593+0000 7f857d67e740 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ed54d0 0x55f7442b55f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f855c003f80 tx=0x7f855c0ab060 comp rx=0 tx=0).stop 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 shutdown_connections 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f743e8a1c0 0x55f74431ef80 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f743ef61b0 0x55f74431afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f743ed54d0 0x55f7442b55f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 --2- 172.21.15.71:0/180281844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f743ecd2f0 0x55f7442b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f8559600640 0 client.26989 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 >> 172.21.15.71:0/180281844 conn(0x55f743eea300 msgr2=0x55f7442a4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 shutdown_connections 2024-05-27T09:58:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 1 -- 172.21.15.71:0/180281844 wait complete. 2024-05-27T09:58:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.594+0000 7f857d67e740 20 client.26989 trim_cache size 0 max 16384 2024-05-27T09:58:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:58:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:58:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:58:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f85540b2aa0 msgr2=0x7f85540b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f85540b2aa0 0x7f85540b4fb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8560005fd0 tx=0x7f8560005f60 comp rx=0 tx=0).stop 2024-05-27T09:58:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570109ab0 msgr2=0x7f857010aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570109ab0 0x7f857010aac0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e9f0 tx=0x7f855c00eeb0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 shutdown_connections 2024-05-27T09:58:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f85540b2aa0 0x7f85540b4fb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8570109f50 0x7f857010b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8570109ab0 0x7f857010aac0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 --2- 172.21.15.71:0/3383249249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8570104250 0x7f857010a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.595+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 >> 172.21.15.71:0/3383249249 conn(0x7f8570079240 msgr2=0x7f8570075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.596+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 shutdown_connections 2024-05-27T09:58:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:24.596+0000 7f8575000640 1 -- 172.21.15.71:0/3383249249 wait complete. 2024-05-27T09:58:25.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi072 to 176.1M 2024-05-27T09:58:25.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: Unable to set osd_memory_target on smithi072 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:58:25.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: pgmap v331: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 989 KiB/s wr, 318 op/s 2024-05-27T09:58:25.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:58:25.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:58:25.231 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:24 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:25.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi072 to 176.1M 2024-05-27T09:58:25.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: Unable to set osd_memory_target on smithi072 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:58:25.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: pgmap v331: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 989 KiB/s wr, 318 op/s 2024-05-27T09:58:25.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:58:25.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:58:25.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:24 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi072 to 176.1M 2024-05-27T09:58:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: Unable to set osd_memory_target on smithi072 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-05-27T09:58:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: pgmap v331: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 989 KiB/s wr, 318 op/s 2024-05-27T09:58:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-27T09:58:25.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:58:25.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:58:25.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:24 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:58:26.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:25 smithi122 ceph-mon[36436]: Adjusting osd_memory_target on smithi071 to 176.4M 2024-05-27T09:58:26.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:25 smithi122 ceph-mon[36436]: Unable to set osd_memory_target on smithi071 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-27T09:58:26.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:25 smithi071 ceph-mon[31451]: Adjusting osd_memory_target on smithi071 to 176.4M 2024-05-27T09:58:26.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:25 smithi071 ceph-mon[31451]: Unable to set osd_memory_target on smithi071 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-27T09:58:26.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:25 smithi072 ceph-mon[35951]: Adjusting osd_memory_target on smithi071 to 176.4M 2024-05-27T09:58:26.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:25 smithi072 ceph-mon[35951]: Unable to set osd_memory_target on smithi071 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-27T09:58:27.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:26 smithi122 ceph-mon[36436]: pgmap v332: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 989 KiB/s wr, 318 op/s 2024-05-27T09:58:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:26 smithi071 ceph-mon[31451]: pgmap v332: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 989 KiB/s wr, 318 op/s 2024-05-27T09:58:27.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:26 smithi072 ceph-mon[35951]: pgmap v332: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 989 KiB/s wr, 318 op/s 2024-05-27T09:58:28.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:27 smithi122 ceph-mon[36436]: pgmap v333: 97 pgs: 97 active+clean; 140 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-05-27T09:58:28.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:27 smithi071 ceph-mon[31451]: pgmap v333: 97 pgs: 97 active+clean; 140 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-05-27T09:58:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:27 smithi072 ceph-mon[35951]: pgmap v333: 97 pgs: 97 active+clean; 140 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-05-27T09:58:31.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:30 smithi122 ceph-mon[36436]: pgmap v334: 97 pgs: 97 active+clean; 140 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.1 MiB/s wr, 352 op/s 2024-05-27T09:58:31.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:30 smithi071 ceph-mon[31451]: pgmap v334: 97 pgs: 97 active+clean; 140 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.1 MiB/s wr, 352 op/s 2024-05-27T09:58:31.262 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:30 smithi072 ceph-mon[35951]: pgmap v334: 97 pgs: 97 active+clean; 140 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.1 MiB/s wr, 352 op/s 2024-05-27T09:58:33.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:32 smithi122 ceph-mon[36436]: pgmap v335: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.5 MiB/s wr, 511 op/s 2024-05-27T09:58:33.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:32 smithi071 ceph-mon[31451]: pgmap v335: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.5 MiB/s wr, 511 op/s 2024-05-27T09:58:33.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:32 smithi072 ceph-mon[35951]: pgmap v335: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.5 MiB/s wr, 511 op/s 2024-05-27T09:58:34.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:33 smithi122 ceph-mon[36436]: pgmap v336: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.1 MiB/s wr, 358 op/s 2024-05-27T09:58:34.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:33 smithi071 ceph-mon[31451]: pgmap v336: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.1 MiB/s wr, 358 op/s 2024-05-27T09:58:34.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:33 smithi072 ceph-mon[35951]: pgmap v336: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.1 MiB/s wr, 358 op/s 2024-05-27T09:58:37.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:36 smithi122 ceph-mon[36436]: pgmap v337: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.1 MiB/s wr, 358 op/s 2024-05-27T09:58:37.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:36 smithi071 ceph-mon[31451]: pgmap v337: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.1 MiB/s wr, 358 op/s 2024-05-27T09:58:37.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:36 smithi072 ceph-mon[35951]: pgmap v337: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.1 MiB/s wr, 358 op/s 2024-05-27T09:58:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.846+0000 7f6c7fc00640 1 -- 172.21.15.71:0/845310299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7810c350 msgr2=0x7f6c78105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.846+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/845310299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7810c350 0x7f6c78105f90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009900 tx=0x7f6c6002a3f0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.848+0000 7f6c7fc00640 1 -- 172.21.15.71:0/845310299 shutdown_connections 2024-05-27T09:58:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.848+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/845310299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c78106600 0x7f6c781129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.848+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/845310299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7810c350 0x7f6c78105f90 secure :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009900 tx=0x7f6c6002a3f0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.848+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/845310299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c7810beb0 0x7f6c78105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.848+0000 7f6c7fc00640 1 -- 172.21.15.71:0/845310299 >> 172.21.15.71:0/845310299 conn(0x7f6c781016b0 msgr2=0x7f6c78103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.849+0000 7f6c7fc00640 1 -- 172.21.15.71:0/845310299 shutdown_connections 2024-05-27T09:58:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.850+0000 7f6c7fc00640 1 -- 172.21.15.71:0/845310299 wait complete. 2024-05-27T09:58:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.853+0000 7f6c7fc00640 1 Processor -- start 2024-05-27T09:58:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.853+0000 7f6c7fc00640 1 -- start start 2024-05-27T09:58:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.854+0000 7f6c7fc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c78106600 0x7f6c781a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.854+0000 7f6c7fc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c7810beb0 0x7f6c781a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.854+0000 7f6c7fc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7819ca70 0x7f6c7819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.854+0000 7f6c7fc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781160f0 con 0x7f6c78106600 2024-05-27T09:58:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.854+0000 7f6c7fc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78115f70 con 0x7f6c7819ca70 2024-05-27T09:58:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.854+0000 7f6c7fc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78116270 con 0x7f6c7810beb0 2024-05-27T09:58:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7819ca70 0x7f6c7819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7819ca70 0x7f6c7819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49828/0 (socket says 172.21.15.71:49828) 2024-05-27T09:58:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 -- 172.21.15.71:0/2308694292 learned_addr learned my addr 172.21.15.71:0/2308694292 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c7810beb0 0x7f6c781a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c78106600 0x7f6c781a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 -- 172.21.15.71:0/2308694292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c7810beb0 msgr2=0x7f6c781a2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c7810beb0 0x7f6c781a2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 -- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c78106600 msgr2=0x7f6c781a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c78106600 0x7f6c781a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7dc00640 1 -- 172.21.15.71:0/2308694292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7819d600 con 0x7f6c7819ca70 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.855+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c78106600 0x7f6c781a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.856+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7819ca70 0x7f6c7819ce80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000efd0 tx=0x7f6c7000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.856+0000 7f6c76000640 1 -- 172.21.15.71:0/2308694292 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70003b70 con 0x7f6c7819ca70 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.856+0000 7f6c76000640 1 -- 172.21.15.71:0/2308694292 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c70003d10 con 0x7f6c7819ca70 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.856+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c781a96e0 con 0x7f6c7819ca70 2024-05-27T09:58:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.856+0000 7f6c76000640 1 -- 172.21.15.71:0/2308694292 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700108a0 con 0x7f6c7819ca70 2024-05-27T09:58:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.856+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c781a9a90 con 0x7f6c7819ca70 2024-05-27T09:58:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.860+0000 7f6c86bed740 1 Processor -- start 2024-05-27T09:58:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.862+0000 7f6c76000640 1 -- 172.21.15.71:0/2308694292 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f6c70004020 con 0x7f6c7819ca70 2024-05-27T09:58:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.862+0000 7f6c86bed740 1 -- start start 2024-05-27T09:58:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66c61b0 0x5585a6a68860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a68da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c86bed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5585a69d9b90 con 0x5585a66c61b0 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c86bed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5585a69c9730 con 0x5585a669d2f0 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c86bed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5585a69cd770 con 0x5585a66a54d0 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66c61b0 0x5585a6a68860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a68da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a68da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49842/0 (socket says 172.21.15.71:49842) 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66c61b0 0x5585a6a68860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55226/0 (socket says 172.21.15.71:55226) 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.863+0000 7f6c7d200640 1 -- 172.21.15.71:0/2323923914 learned_addr learned my addr 172.21.15.71:0/2323923914 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c6fe00640 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c7d200640 1 -- 172.21.15.71:0/2323923914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 msgr2=0x5585a6a692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c7d200640 1 -- 172.21.15.71:0/2323923914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66c61b0 msgr2=0x5585a6a68860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66c61b0 0x5585a6a68860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c7d200640 1 -- 172.21.15.71:0/2323923914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585a69628b0 con 0x5585a669d2f0 2024-05-27T09:58:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a68da0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009c20 tx=0x7f6c680117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a638bd1f9530814c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.864+0000 7f6c6e000640 1 -- 172.21.15.71:0/2323923914 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68012450 con 0x5585a669d2f0 2024-05-27T09:58:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.865+0000 7f6c76000640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6c5c0b29d0 0x7f6c5c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.865+0000 7f6c6e000640 1 -- 172.21.15.71:0/2323923914 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c68012aa0 con 0x5585a669d2f0 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.865+0000 7f6c76000640 1 -- 172.21.15.71:0/2308694292 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f6c700e2a70 con 0x7f6c7819ca70 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.865+0000 7f6c6e000640 1 -- 172.21.15.71:0/2323923914 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6800fa50 con 0x5585a669d2f0 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.865+0000 7f6c6fe00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6c5c0b29d0 0x7f6c5c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 -- 172.21.15.71:0/2323923914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 msgr2=0x5585a6a68da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c6fe00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6c5c0b29d0 0x7f6c5c0b4ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c60008000 tx=0x7f6c60000bc0 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a68da0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009c20 tx=0x7f6c680117b0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 -- 172.21.15.71:0/2323923914 shutdown_connections 2024-05-27T09:58:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a68da0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2323923914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66c61b0 0x5585a6a68860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 -- 172.21.15.71:0/2323923914 >> 172.21.15.71:0/2323923914 conn(0x5585a66ba300 msgr2=0x5585a6a65010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 -- 172.21.15.71:0/2323923914 shutdown_connections 2024-05-27T09:58:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.866+0000 7f6c86bed740 1 -- 172.21.15.71:0/2323923914 wait complete. 2024-05-27T09:58:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.867+0000 7f6c86bed740 1 -- start start 2024-05-27T09:58:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.867+0000 7f6c86bed740 1 Processor -- start 2024-05-27T09:58:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a81350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66a54d0 0x5585a6a81890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66c61b0 0x5585a6a7b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c86bed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5585a66af790 con 0x5585a66a54d0 2024-05-27T09:58:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c86bed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5585a6971bc0 con 0x5585a66c61b0 2024-05-27T09:58:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c86bed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5585a6a75990 con 0x5585a669d2f0 2024-05-27T09:58:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c7dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66c61b0 0x5585a6a7b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c7dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66c61b0 0x5585a6a7b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49858/0 (socket says 172.21.15.71:49858) 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66a54d0 0x5585a6a81890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1562184453 learned_addr learned my addr 172.21.15.71:0/1562184453 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c7d200640 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a81350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1562184453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 msgr2=0x5585a6a81350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a81350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1562184453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66a54d0 msgr2=0x5585a6a81890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66a54d0 0x5585a6a81890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1562184453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585a66de210 con 0x5585a66c61b0 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.868+0000 7f6c86bed740 10 client.0 _ll_register_callbacks cb 0x5585a694f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66c61b0 0x5585a6a7b740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6c700a5dd0 tx=0x7f6c700098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dce5c65d6f0a05d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c68012aa0 con 0x5585a66c61b0 2024-05-27T09:58:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c66a00640 10 client.26975 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:58:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c66a00640 1 -- 172.21.15.71:0/1562184453 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700ca050 con 0x5585a66c61b0 2024-05-27T09:58:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c66a00640 1 -- 172.21.15.71:0/1562184453 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f6c700c43e0 con 0x5585a66c61b0 2024-05-27T09:58:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c66a00640 1 -- 172.21.15.71:0/1562184453 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c700ae100 con 0x5585a66c61b0 2024-05-27T09:58:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c86bed740 10 client.26975 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.869+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({fsmap=32}) -- 0x5585a67aa620 con 0x5585a66c61b0 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c66a00640 1 -- 172.21.15.71:0/1562184453 <== mon.2 v2:172.21.15.72:3300/0 4 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f6c700c3070 con 0x5585a66c61b0 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c86bed740 10 client.26975 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c86bed740 10 client.26975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c86bed740 20 client.26975 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a6684d80 0x5585a6a8d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c86bed740 4 client.26975 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585a69dbae0 con 0x5585a6684d80 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.870+0000 7f6c7d200640 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a6684d80 0x5585a6a8d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.871+0000 7f6c7d200640 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a6684d80 0x5585a6a8d210 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a12fcaba0e239a server_cookie=8f1429252ce43200 in_seq=0 out_seq=0 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.871+0000 7f6c66a00640 10 client.26975 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c66a00640 1 -- 172.21.15.71:0/1562184453 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5585a69dbae0 con 0x5585a6684d80 2024-05-27T09:58:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c66a00640 10 client.26975 handle_command_reply: tid=0 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 client.26975 shutdown 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66c61b0 msgr2=0x5585a6a7b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66c61b0 0x5585a6a7b740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6c700a5dd0 tx=0x7f6c700098e0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 shutdown_connections 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66c61b0 0x5585a6a7b740 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a6684d80 0x5585a6a8d210 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a66a54d0 0x5585a6a81890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c66a00640 0 client.26975 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1562184453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a81350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.872+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 >> 172.21.15.71:0/1562184453 conn(0x5585a66ba300 msgr2=0x5585a6a68800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.873+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 shutdown_connections 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.873+0000 7f6c86bed740 1 -- 172.21.15.71:0/1562184453 wait complete. 2024-05-27T09:58:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.873+0000 7f6c86bed740 20 client.26975 trim_cache size 0 max 16384 2024-05-27T09:58:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.895+0000 7f6c86bed740 1 Processor -- start 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c86bed740 1 -- start start 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a76eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a64330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66a54d0 0x5585a6a69130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c86bed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781b0760 con 0x5585a6684d80 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c86bed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781ae030 con 0x5585a66a54d0 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c86bed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781abf00 con 0x5585a669d2f0 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c7dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66a54d0 0x5585a6a69130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a76eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c7dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66a54d0 0x5585a6a69130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49872/0 (socket says 172.21.15.71:49872) 2024-05-27T09:58:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1439502912 learned_addr learned my addr 172.21.15.71:0/1439502912 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.896+0000 7f6c6fe00640 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a64330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1439502912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 msgr2=0x5585a6a64330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a64330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1439502912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 msgr2=0x5585a6a76eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a76eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c7dc00640 1 -- 172.21.15.71:0/1439502912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585a6a654a0 con 0x5585a66a54d0 2024-05-27T09:58:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c7d200640 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a76eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66a54d0 0x5585a6a69130 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000cba0 tx=0x7f6c70011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8304fe056d704e61 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.897+0000 7f6c6d600640 1 -- 172.21.15.71:0/1439502912 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700ca070 con 0x5585a66a54d0 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.898+0000 7f6c6d600640 1 -- 172.21.15.71:0/1439502912 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c68012aa0 con 0x5585a66a54d0 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.898+0000 7f6c6d600640 1 -- 172.21.15.71:0/1439502912 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700a92b0 con 0x5585a66a54d0 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.898+0000 7f6c86bed740 1 -- 172.21.15.71:0/1439502912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66a54d0 msgr2=0x5585a6a69130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.898+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66a54d0 0x5585a6a69130 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000cba0 tx=0x7f6c70011000 comp rx=0 tx=0).stop 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 -- 172.21.15.71:0/1439502912 shutdown_connections 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a66a54d0 0x5585a6a69130 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a669d2f0 0x5585a6a64330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 --2- 172.21.15.71:0/1439502912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a76eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 -- 172.21.15.71:0/1439502912 >> 172.21.15.71:0/1439502912 conn(0x5585a66ba300 msgr2=0x5585a6a6a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 -- 172.21.15.71:0/1439502912 shutdown_connections 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 -- 172.21.15.71:0/1439502912 wait complete. 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 -- start start 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.899+0000 7f6c86bed740 1 Processor -- start 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a87430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a87970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c86bed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a82830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c86bed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781ac550 con 0x5585a6684d80 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c86bed740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781ad960 con 0x5585a669d2f0 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c86bed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781acbc0 con 0x5585a66a54d0 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c86bed740 10 client.0 _ll_register_callbacks cb 0x7f6c70004830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a87970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a87970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49888/0 (socket says 172.21.15.71:49888) 2024-05-27T09:58:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c6fe00640 1 -- 172.21.15.71:0/2290066561 learned_addr learned my addr 172.21.15.71:0/2290066561 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a87430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.900+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a82830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c6fe00640 1 -- 172.21.15.71:0/2290066561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 msgr2=0x5585a6a82830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c6fe00640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a82830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c6fe00640 1 -- 172.21.15.71:0/2290066561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 msgr2=0x5585a6a87430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c6fe00640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a87430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c6fe00640 1 -- 172.21.15.71:0/2290066561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585a6a82ef0 con 0x5585a669d2f0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c7dc00640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a82830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c6fe00640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a87970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c7806c670 tx=0x7f6c60005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35db4b4948eb1a4a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c66a00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c66a00640 1 -- 172.21.15.71:0/2290066561 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60035040 con 0x5585a669d2f0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c68012aa0 con 0x5585a669d2f0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c66a00640 1 -- 172.21.15.71:0/2290066561 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f6c600037f0 con 0x5585a669d2f0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c66a00640 1 -- 172.21.15.71:0/2290066561 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c600039f0 con 0x5585a669d2f0 2024-05-27T09:58:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.901+0000 7f6c86bed740 10 client.26981 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5585a6af52f0 con 0x5585a669d2f0 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c66a00640 1 -- 172.21.15.71:0/2290066561 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c68012aa0 con 0x5585a669d2f0 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c66a00640 1 -- 172.21.15.71:0/2290066561 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f6c60054020 con 0x5585a669d2f0 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c86bed740 10 client.26981 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c86bed740 10 client.26981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c86bed740 20 client.26981 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a66c61b0 0x5585a6af7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c86bed740 4 client.26981 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5585a69d52c0 con 0x5585a66c61b0 2024-05-27T09:58:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.902+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a66c61b0 0x5585a6af7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.903+0000 7f6c7d200640 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a66c61b0 0x5585a6af7a00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bea03a62183418b3 server_cookie=1bce083b77c531df in_seq=0 out_seq=0 2024-05-27T09:58:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.903+0000 7f6c66a00640 10 client.26981 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c66a00640 1 -- 172.21.15.71:0/2290066561 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5585a69d52c0 con 0x5585a66c61b0 2024-05-27T09:58:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c66a00640 10 client.26981 handle_command_reply: tid=0 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 client.26981 shutdown 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 msgr2=0x5585a6a87970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a87970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c7806c670 tx=0x7f6c60005a20 comp rx=0 tx=0).stop 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 shutdown_connections 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585a66a54d0 0x5585a6a82830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5585a669d2f0 0x5585a6a87970 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5585a66c61b0 0x5585a6af7a00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 --2- 172.21.15.71:0/2290066561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585a6684d80 0x5585a6a87430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 >> 172.21.15.71:0/2290066561 conn(0x5585a66ba300 msgr2=0x5585a6a6aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c66a00640 0 client.26981 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 shutdown_connections 2024-05-27T09:58:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.918+0000 7f6c86bed740 1 -- 172.21.15.71:0/2290066561 wait complete. 2024-05-27T09:58:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.919+0000 7f6c86bed740 20 client.26981 trim_cache size 0 max 16384 2024-05-27T09:58:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:58:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:58:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:58:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6c5c0b29d0 msgr2=0x7f6c5c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6c5c0b29d0 0x7f6c5c0b4ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c60008000 tx=0x7f6c60000bc0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7819ca70 msgr2=0x7f6c7819ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7819ca70 0x7f6c7819ce80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000efd0 tx=0x7f6c7000c6a0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 shutdown_connections 2024-05-27T09:58:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f6c5c0b29d0 0x7f6c5c0b4ee0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c7819ca70 0x7f6c7819ce80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c7810beb0 0x7f6c781a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 --2- 172.21.15.71:0/2308694292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c78106600 0x7f6c781a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 >> 172.21.15.71:0/2308694292 conn(0x7f6c781016b0 msgr2=0x7f6c78111950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 shutdown_connections 2024-05-27T09:58:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:37.920+0000 7f6c7fc00640 1 -- 172.21.15.71:0/2308694292 wait complete. 2024-05-27T09:58:39.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:38 smithi122 ceph-mon[36436]: pgmap v338: 97 pgs: 97 active+clean; 132 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 522 op/s 2024-05-27T09:58:39.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:38 smithi071 ceph-mon[31451]: pgmap v338: 97 pgs: 97 active+clean; 132 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 522 op/s 2024-05-27T09:58:39.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:38 smithi072 ceph-mon[35951]: pgmap v338: 97 pgs: 97 active+clean; 132 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 522 op/s 2024-05-27T09:58:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:40 smithi122 ceph-mon[36436]: pgmap v339: 97 pgs: 97 active+clean; 132 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 997 KiB/s wr, 323 op/s 2024-05-27T09:58:41.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:40 smithi071 ceph-mon[31451]: pgmap v339: 97 pgs: 97 active+clean; 132 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 997 KiB/s wr, 323 op/s 2024-05-27T09:58:41.282 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:40 smithi072 ceph-mon[35951]: pgmap v339: 97 pgs: 97 active+clean; 132 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 997 KiB/s wr, 323 op/s 2024-05-27T09:58:42.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:41 smithi072 ceph-mon[35951]: pgmap v340: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 496 op/s 2024-05-27T09:58:42.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:41 smithi122 ceph-mon[36436]: pgmap v340: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 496 op/s 2024-05-27T09:58:42.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:41 smithi071 ceph-mon[31451]: pgmap v340: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 496 op/s 2024-05-27T09:58:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:44 smithi122 ceph-mon[36436]: pgmap v341: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1013 KiB/s wr, 337 op/s 2024-05-27T09:58:45.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:44 smithi071 ceph-mon[31451]: pgmap v341: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1013 KiB/s wr, 337 op/s 2024-05-27T09:58:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:44 smithi072 ceph-mon[35951]: pgmap v341: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1013 KiB/s wr, 337 op/s 2024-05-27T09:58:47.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:46 smithi122 ceph-mon[36436]: pgmap v342: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1013 KiB/s wr, 337 op/s 2024-05-27T09:58:47.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:46 smithi071 ceph-mon[31451]: pgmap v342: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1013 KiB/s wr, 337 op/s 2024-05-27T09:58:47.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:46 smithi072 ceph-mon[35951]: pgmap v342: 97 pgs: 97 active+clean; 138 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1013 KiB/s wr, 337 op/s 2024-05-27T09:58:48.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:47 smithi122 ceph-mon[36436]: pgmap v343: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 489 op/s 2024-05-27T09:58:48.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:47 smithi071 ceph-mon[31451]: pgmap v343: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 489 op/s 2024-05-27T09:58:48.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:47 smithi072 ceph-mon[35951]: pgmap v343: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 489 op/s 2024-05-27T09:58:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 -- 172.21.15.71:0/3376408265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e6410a120 msgr2=0x7f9e64103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 --2- 172.21.15.71:0/3376408265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e6410a120 0x7f9e64103d60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009900 tx=0x7f9e5002a400 comp rx=0 tx=0).stop 2024-05-27T09:58:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 -- 172.21.15.71:0/3376408265 shutdown_connections 2024-05-27T09:58:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 --2- 172.21.15.71:0/3376408265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e641043d0 0x7f9e641107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 --2- 172.21.15.71:0/3376408265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e6410a120 0x7f9e64103d60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 --2- 172.21.15.71:0/3376408265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e64109c80 0x7f9e64103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 -- 172.21.15.71:0/3376408265 >> 172.21.15.71:0/3376408265 conn(0x7f9e640ff360 msgr2=0x7f9e641017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 -- 172.21.15.71:0/3376408265 shutdown_connections 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.151+0000 7f9e6b000640 1 -- 172.21.15.71:0/3376408265 wait complete. 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.152+0000 7f9e6b000640 1 Processor -- start 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.152+0000 7f9e6b000640 1 -- start start 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e6b000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e641043d0 0x7f9e6419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e6b000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e64109c80 0x7f9e6419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e6b000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e6410a120 0x7f9e641a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e6b000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64113e70 con 0x7f9e641043d0 2024-05-27T09:58:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e6b000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64113cf0 con 0x7f9e64109c80 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e6b000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64113ff0 con 0x7f9e6410a120 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e641043d0 0x7f9e6419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e63400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e64109c80 0x7f9e6419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e63400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e64109c80 0x7f9e6419de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34830/0 (socket says 172.21.15.71:34830) 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e63400640 1 -- 172.21.15.71:0/770567864 learned_addr learned my addr 172.21.15.71:0/770567864 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.153+0000 7f9e69000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e6410a120 0x7f9e641a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.154+0000 7f9e63400640 1 -- 172.21.15.71:0/770567864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e6410a120 msgr2=0x7f9e641a87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.154+0000 7f9e63400640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e6410a120 0x7f9e641a87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.154+0000 7f9e63400640 1 -- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e641043d0 msgr2=0x7f9e6419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.154+0000 7f9e63400640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e641043d0 0x7f9e6419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.154+0000 7f9e63400640 1 -- 172.21.15.71:0/770567864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e641a8cf0 con 0x7f9e64109c80 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.154+0000 7f9e69000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e6410a120 0x7f9e641a87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.154+0000 7f9e63400640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e64109c80 0x7f9e6419de50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e5002a920 tx=0x7f9e50031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.155+0000 7f9e60c00640 1 -- 172.21.15.71:0/770567864 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5003f030 con 0x7f9e64109c80 2024-05-27T09:58:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.155+0000 7f9e60c00640 1 -- 172.21.15.71:0/770567864 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e50004490 con 0x7f9e64109c80 2024-05-27T09:58:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.155+0000 7f9e60c00640 1 -- 172.21.15.71:0/770567864 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50035070 con 0x7f9e64109c80 2024-05-27T09:58:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.155+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e641a8f20 con 0x7f9e64109c80 2024-05-27T09:58:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.155+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e641a92d0 con 0x7f9e64109c80 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.158+0000 7f9e71fdd740 1 Processor -- start 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.158+0000 7f9e71fdd740 1 -- start start 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e60c00640 1 -- 172.21.15.71:0/770567864 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f9e50042030 con 0x7f9e64109c80 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5503b1b0 0x55ff553dd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff550122f0 0x55ff553ddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553de2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff5534eb90 con 0x55ff5503b1b0 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ff5533e730 con 0x55ff5501a4d0 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ff55342770 con 0x55ff550122f0 2024-05-27T09:58:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff550122f0 0x55ff553ddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e63400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553de2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff550122f0 0x55ff553ddda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36304/0 (socket says 172.21.15.71:36304) 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e63e00640 1 -- 172.21.15.71:0/1824665982 learned_addr learned my addr 172.21.15.71:0/1824665982 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.159+0000 7f9e69000640 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5503b1b0 0x55ff553dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.160+0000 7f9e63400640 1 -- 172.21.15.71:0/1824665982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff550122f0 msgr2=0x55ff553ddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.160+0000 7f9e63400640 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff550122f0 0x55ff553ddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.160+0000 7f9e63400640 1 -- 172.21.15.71:0/1824665982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5503b1b0 msgr2=0x55ff553dd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.160+0000 7f9e63400640 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5503b1b0 0x55ff553dd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.160+0000 7f9e63400640 1 -- 172.21.15.71:0/1824665982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff552d78b0 con 0x55ff5501a4d0 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.160+0000 7f9e63e00640 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff550122f0 0x55ff553ddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.160+0000 7f9e63400640 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553de2e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9e500fffd0 tx=0x7f9e50108cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682e2fd43fd50263 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.161+0000 7f9e59600640 1 -- 172.21.15.71:0/1824665982 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50111070 con 0x55ff5501a4d0 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.161+0000 7f9e60c00640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9e480b29d0 0x7f9e480b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.161+0000 7f9e59600640 1 -- 172.21.15.71:0/1824665982 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e5010ac80 con 0x55ff5501a4d0 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.161+0000 7f9e59600640 1 -- 172.21.15.71:0/1824665982 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e500c6260 con 0x55ff5501a4d0 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.161+0000 7f9e69000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9e480b29d0 0x7f9e480b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.161+0000 7f9e60c00640 1 -- 172.21.15.71:0/770567864 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f9e50102880 con 0x7f9e64109c80 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 -- 172.21.15.71:0/1824665982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 msgr2=0x55ff553de2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553de2e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9e500fffd0 tx=0x7f9e50108cd0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e69000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9e480b29d0 0x7f9e480b4ee0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ff553da9d0 tx=0x7f9e5c009500 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 -- 172.21.15.71:0/1824665982 shutdown_connections 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553de2e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff550122f0 0x55ff553ddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/1824665982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5503b1b0 0x55ff553dd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 -- 172.21.15.71:0/1824665982 >> 172.21.15.71:0/1824665982 conn(0x55ff5502f300 msgr2=0x55ff553da010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 -- 172.21.15.71:0/1824665982 shutdown_connections 2024-05-27T09:58:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.162+0000 7f9e71fdd740 1 -- 172.21.15.71:0/1824665982 wait complete. 2024-05-27T09:58:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.163+0000 7f9e71fdd740 1 -- start start 2024-05-27T09:58:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.163+0000 7f9e71fdd740 1 Processor -- start 2024-05-27T09:58:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff550122f0 0x55ff553e7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5501a4d0 0x55ff553e7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff55024790 con 0x55ff5501a4d0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55ff552e6bc0 con 0x55ff550122f0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ff553ea750 con 0x55ff5503b1b0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e71fdd740 10 client.0 _ll_register_callbacks cb 0x55ff552c4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff550122f0 0x55ff553e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e63400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5501a4d0 0x55ff553e7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff550122f0 0x55ff553e7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:34848/0 (socket says 172.21.15.71:34848) 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e69000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e63e00640 1 -- 172.21.15.71:0/3637396575 learned_addr learned my addr 172.21.15.71:0/3637396575 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.164+0000 7f9e63e00640 1 -- 172.21.15.71:0/3637396575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 msgr2=0x55ff553e83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.165+0000 7f9e63e00640 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.165+0000 7f9e63e00640 1 -- 172.21.15.71:0/3637396575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5501a4d0 msgr2=0x55ff553e7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.165+0000 7f9e63e00640 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5501a4d0 0x55ff553e7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.165+0000 7f9e63e00640 1 -- 172.21.15.71:0/3637396575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff55053210 con 0x55ff550122f0 2024-05-27T09:58:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.165+0000 7f9e69000640 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.165+0000 7f9e63e00640 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff550122f0 0x55ff553e7930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9e540126d0 tx=0x7f9e54012b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4639cae45f88a089 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e4e000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e4e000640 1 -- 172.21.15.71:0/3637396575 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54004050 con 0x55ff550122f0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e4e000640 1 -- 172.21.15.71:0/3637396575 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f9e540041f0 con 0x55ff550122f0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e5010ac80 con 0x55ff550122f0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e4e000640 1 -- 172.21.15.71:0/3637396575 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9e540043f0 con 0x55ff550122f0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e71fdd740 10 client.26993 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ff5511f620 con 0x55ff550122f0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e4e000640 1 -- 172.21.15.71:0/3637396575 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e5010ac80 con 0x55ff550122f0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.167+0000 7f9e4e000640 1 -- 172.21.15.71:0/3637396575 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f9e54003b20 con 0x55ff550122f0 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.168+0000 7f9e71fdd740 10 client.26993 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.168+0000 7f9e71fdd740 10 client.26993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.168+0000 7f9e71fdd740 20 client.26993 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.168+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54ff9d80 0x55ff553f9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.168+0000 7f9e71fdd740 4 client.26993 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:58:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.168+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff55350ae0 con 0x55ff54ff9d80 2024-05-27T09:58:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.168+0000 7f9e63400640 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54ff9d80 0x55ff553f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.169+0000 7f9e63400640 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54ff9d80 0x55ff553f9980 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1bf43a820ee8f2 server_cookie=3713b723826ad68e in_seq=0 out_seq=0 2024-05-27T09:58:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.169+0000 7f9e4e000640 10 client.26993 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.169+0000 7f9e4e000640 1 -- 172.21.15.71:0/3637396575 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ff55350ae0 con 0x55ff54ff9d80 2024-05-27T09:58:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.169+0000 7f9e4e000640 10 client.26993 handle_command_reply: tid=0 2024-05-27T09:58:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.169+0000 7f9e71fdd740 1 client.26993 shutdown 2024-05-27T09:58:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff550122f0 msgr2=0x55ff553e7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff550122f0 0x55ff553e7930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9e540126d0 tx=0x7f9e54012b90 comp rx=0 tx=0).stop 2024-05-27T09:58:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 shutdown_connections 2024-05-27T09:58:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54ff9d80 0x55ff553f9980 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff5501a4d0 0x55ff553e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3637396575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff550122f0 0x55ff553e7930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 >> 172.21.15.71:0/3637396575 conn(0x55ff5502f300 msgr2=0x55ff553df580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e4e000640 0 client.26993 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 shutdown_connections 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3637396575 wait complete. 2024-05-27T09:58:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.170+0000 7f9e71fdd740 20 client.26993 trim_cache size 0 max 16384 2024-05-27T09:58:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.188+0000 7f9e71fdd740 1 Processor -- start 2024-05-27T09:58:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.188+0000 7f9e71fdd740 1 -- start start 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553e1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641b4620 con 0x55ff550122f0 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641b1ef0 con 0x55ff5501a4d0 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641afd60 con 0x55ff5503b1b0 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e69000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e69000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36318/0 (socket says 172.21.15.71:36318) 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e69000640 1 -- 172.21.15.71:0/3061261210 learned_addr learned my addr 172.21.15.71:0/3061261210 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.189+0000 7f9e63400640 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553e1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e69000640 1 -- 172.21.15.71:0/3061261210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 msgr2=0x55ff553e1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e69000640 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553e1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e69000640 1 -- 172.21.15.71:0/3061261210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 msgr2=0x55ff553e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e69000640 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e69000640 1 -- 172.21.15.71:0/3061261210 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff553e8740 con 0x55ff5503b1b0 2024-05-27T09:58:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e63e00640 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e63400640 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:58:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e69000640 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e19c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00fc90 tx=0x7f9e5c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f799f843615e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e58c00640 1 -- 172.21.15.71:0/3061261210 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00fcc0 con 0x55ff5503b1b0 2024-05-27T09:58:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e58c00640 1 -- 172.21.15.71:0/3061261210 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e5c02a930 con 0x55ff5503b1b0 2024-05-27T09:58:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.190+0000 7f9e58c00640 1 -- 172.21.15.71:0/3061261210 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c01f7e0 con 0x55ff5503b1b0 2024-05-27T09:58:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.191+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3061261210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 msgr2=0x55ff553e19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.191+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e19c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00fc90 tx=0x7f9e5c01a000 comp rx=0 tx=0).stop 2024-05-27T09:58:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3061261210 shutdown_connections 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553e19c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/3061261210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3061261210 >> 172.21.15.71:0/3061261210 conn(0x55ff5502f300 msgr2=0x55ff553e9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3061261210 shutdown_connections 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 -- 172.21.15.71:0/3061261210 wait complete. 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 -- start start 2024-05-27T09:58:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.192+0000 7f9e71fdd740 1 Processor -- start 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553ea960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e71fdd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641b03b0 con 0x55ff550122f0 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641b1820 con 0x55ff5501a4d0 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e71fdd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641b0a80 con 0x55ff5503b1b0 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e71fdd740 10 client.0 _ll_register_callbacks cb 0x7f9e54009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e69000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e69000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553eb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36332/0 (socket says 172.21.15.71:36332) 2024-05-27T09:58:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e69000640 1 -- 172.21.15.71:0/749802616 learned_addr learned my addr 172.21.15.71:0/749802616 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:58:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.193+0000 7f9e63e00640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.194+0000 7f9e63400640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.194+0000 7f9e63e00640 1 -- 172.21.15.71:0/749802616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 msgr2=0x55ff553eb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.194+0000 7f9e63e00640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553eb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.194+0000 7f9e63e00640 1 -- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 msgr2=0x55ff553eaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:58:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.195+0000 7f9e63e00640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553eaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.195+0000 7f9e63e00640 1 -- 172.21.15.71:0/749802616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff55460050 con 0x55ff550122f0 2024-05-27T09:58:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.195+0000 7f9e63400640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:58:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.196+0000 7f9e63e00640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553ea960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55ff553f3ea0 tx=0x7f9e54005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37b8ddc5b5240a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:58:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.196+0000 7f9e4e000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:58:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.196+0000 7f9e4e000640 1 -- 172.21.15.71:0/749802616 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5402b040 con 0x55ff550122f0 2024-05-27T09:58:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e4e000640 1 -- 172.21.15.71:0/749802616 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f9e54025a40 con 0x55ff550122f0 2024-05-27T09:58:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e5c02a930 con 0x55ff550122f0 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e4e000640 1 -- 172.21.15.71:0/749802616 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9e54025c40 con 0x55ff550122f0 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e71fdd740 10 client.16830 fetch_fsmap learned FSMap version 32 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ff55461150 con 0x55ff550122f0 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e4e000640 1 -- 172.21.15.71:0/749802616 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e5c02a930 con 0x55ff550122f0 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e4e000640 1 -- 172.21.15.71:0/749802616 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f9e54005240 con 0x55ff550122f0 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e71fdd740 10 client.16830 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e71fdd740 10 client.16830 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.197+0000 7f9e71fdd740 20 client.16830 populate_metadata read hostname 'smithi071' 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.198+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54fcf1c0 0x55ff55463910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.198+0000 7f9e71fdd740 4 client.16830 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.198+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff5534a2c0 con 0x55ff54fcf1c0 2024-05-27T09:58:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.198+0000 7f9e63400640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54fcf1c0 0x55ff55463910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:58:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.198+0000 7f9e63400640 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54fcf1c0 0x55ff55463910 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cac64a8415baae server_cookie=6d4275d3978301f4 in_seq=0 out_seq=0 2024-05-27T09:58:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.198+0000 7f9e4e000640 10 client.16830 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.218+0000 7f9e4e000640 1 -- 172.21.15.71:0/749802616 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ff5534a2c0 con 0x55ff54fcf1c0 2024-05-27T09:58:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.218+0000 7f9e4e000640 10 client.16830 handle_command_reply: tid=0 2024-05-27T09:58:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.218+0000 7f9e71fdd740 1 client.16830 shutdown 2024-05-27T09:58:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 msgr2=0x55ff553ea960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553ea960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55ff553f3ea0 tx=0x7f9e54005cc0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 shutdown_connections 2024-05-27T09:58:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff5503b1b0 0x55ff553eb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55ff5501a4d0 0x55ff553eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55ff54fcf1c0 0x55ff55463910 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 --2- 172.21.15.71:0/749802616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff550122f0 0x55ff553ea960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 >> 172.21.15.71:0/749802616 conn(0x55ff5502f300 msgr2=0x55ff553dd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.219+0000 7f9e4e000640 0 client.16830 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:58:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.220+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 shutdown_connections 2024-05-27T09:58:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.220+0000 7f9e71fdd740 1 -- 172.21.15.71:0/749802616 wait complete. 2024-05-27T09:58:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.220+0000 7f9e71fdd740 20 client.16830 trim_cache size 0 max 16384 2024-05-27T09:58:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:58:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:58:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9e480b29d0 msgr2=0x7f9e480b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9e480b29d0 0x7f9e480b4ee0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ff553da9d0 tx=0x7f9e5c009500 comp rx=0 tx=0).stop 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e64109c80 msgr2=0x7f9e6419de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e64109c80 0x7f9e6419de50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e5002a920 tx=0x7f9e50031a20 comp rx=0 tx=0).stop 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 shutdown_connections 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f9e480b29d0 0x7f9e480b4ee0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e6410a120 0x7f9e641a87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e64109c80 0x7f9e6419de50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 --2- 172.21.15.71:0/770567864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e641043d0 0x7f9e6419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:58:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 >> 172.21.15.71:0/770567864 conn(0x7f9e640ff360 msgr2=0x7f9e64076860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:58:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 shutdown_connections 2024-05-27T09:58:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:58:51.221+0000 7f9e6b000640 1 -- 172.21.15.71:0/770567864 wait complete. 2024-05-27T09:58:51.235 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:50 smithi122 ceph-mon[36436]: pgmap v344: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 946 KiB/s wr, 325 op/s 2024-05-27T09:58:51.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:50 smithi071 ceph-mon[31451]: pgmap v344: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 946 KiB/s wr, 325 op/s 2024-05-27T09:58:51.283 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:50 smithi072 ceph-mon[35951]: pgmap v344: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 946 KiB/s wr, 325 op/s 2024-05-27T09:58:52.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:51 smithi122 ceph-mon[36436]: pgmap v345: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 483 op/s 2024-05-27T09:58:52.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:51 smithi071 ceph-mon[31451]: pgmap v345: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 483 op/s 2024-05-27T09:58:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:51 smithi072 ceph-mon[35951]: pgmap v345: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 483 op/s 2024-05-27T09:58:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:54 smithi122 ceph-mon[36436]: pgmap v346: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 983 KiB/s wr, 310 op/s 2024-05-27T09:58:55.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:54 smithi071 ceph-mon[31451]: pgmap v346: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 983 KiB/s wr, 310 op/s 2024-05-27T09:58:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:54 smithi072 ceph-mon[35951]: pgmap v346: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 983 KiB/s wr, 310 op/s 2024-05-27T09:58:56.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:55 smithi122 ceph-mon[36436]: pgmap v347: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 983 KiB/s wr, 310 op/s 2024-05-27T09:58:56.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:55 smithi071 ceph-mon[31451]: pgmap v347: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 983 KiB/s wr, 310 op/s 2024-05-27T09:58:56.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:55 smithi072 ceph-mon[35951]: pgmap v347: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 983 KiB/s wr, 310 op/s 2024-05-27T09:58:59.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:58 smithi122 ceph-mon[36436]: pgmap v348: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 470 op/s 2024-05-27T09:58:59.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:58 smithi071 ceph-mon[31451]: pgmap v348: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 470 op/s 2024-05-27T09:58:59.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:58 smithi072 ceph-mon[35951]: pgmap v348: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 470 op/s 2024-05-27T09:59:00.177 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:58:59 smithi072 ceph-mon[35951]: pgmap v349: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 995 KiB/s wr, 317 op/s 2024-05-27T09:59:00.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:58:59 smithi122 ceph-mon[36436]: pgmap v349: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 995 KiB/s wr, 317 op/s 2024-05-27T09:59:00.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:58:59 smithi071 ceph-mon[31451]: pgmap v349: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 995 KiB/s wr, 317 op/s 2024-05-27T09:59:02.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:01 smithi122 ceph-mon[36436]: pgmap v350: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.6 MiB/s wr, 495 op/s 2024-05-27T09:59:02.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:01 smithi071 ceph-mon[31451]: pgmap v350: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.6 MiB/s wr, 495 op/s 2024-05-27T09:59:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:01 smithi072 ceph-mon[35951]: pgmap v350: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.6 MiB/s wr, 495 op/s 2024-05-27T09:59:03.958 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-27T09:59:03.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:59:04.459 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.488+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2967721671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a78113d10 msgr2=0x7f5a78116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.488+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2967721671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a78113d10 0x7f5a78116130 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009ca0 tx=0x7f5a6002a8e0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.488+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2967721671 shutdown_connections 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.488+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2967721671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a781167c0 0x7f5a78118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.488+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2967721671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a78113d10 0x7f5a78116130 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.488+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2967721671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a7810a380 0x7f5a7810a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.488+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2967721671 >> 172.21.15.71:0/2967721671 conn(0x7f5a7806f800 msgr2=0x7f5a7806fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.489+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2967721671 shutdown_connections 2024-05-27T09:59:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.489+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2967721671 wait complete. 2024-05-27T09:59:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.491+0000 7f5a7ca00640 1 Processor -- start 2024-05-27T09:59:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.491+0000 7f5a7ca00640 1 -- start start 2024-05-27T09:59:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a7ca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7810a380 0x7f5a781a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a7ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a78113d10 0x7f5a781a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a7ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781167c0 0x7f5a781adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a7ca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78122a90 con 0x7f5a781167c0 2024-05-27T09:59:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a7ca00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78122910 con 0x7f5a7810a380 2024-05-27T09:59:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a7ca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78122c10 con 0x7f5a78113d10 2024-05-27T09:59:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a76800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7810a380 0x7f5a781a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a76800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7810a380 0x7f5a781a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:41990/0 (socket says 172.21.15.71:41990) 2024-05-27T09:59:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.492+0000 7f5a76800640 1 -- 172.21.15.71:0/2339638027 learned_addr learned my addr 172.21.15.71:0/2339638027 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a6de00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a78113d10 0x7f5a781a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a77200640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781167c0 0x7f5a781adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a76800640 1 -- 172.21.15.71:0/2339638027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a78113d10 msgr2=0x7f5a781a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a76800640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a78113d10 0x7f5a781a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a76800640 1 -- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781167c0 msgr2=0x7f5a781adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a76800640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781167c0 0x7f5a781adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a76800640 1 -- 172.21.15.71:0/2339638027 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a781ae310 con 0x7f5a7810a380 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a77200640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781167c0 0x7f5a781adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.493+0000 7f5a76800640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7810a380 0x7f5a781a94b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e9c0 tx=0x7f5a6800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.494+0000 7f5a6fe00640 1 -- 172.21.15.71:0/2339638027 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800cd80 con 0x7f5a7810a380 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.494+0000 7f5a6fe00640 1 -- 172.21.15.71:0/2339638027 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a680054d0 con 0x7f5a7810a380 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.494+0000 7f5a6fe00640 1 -- 172.21.15.71:0/2339638027 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68010430 con 0x7f5a7810a380 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.494+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a781ae600 con 0x7f5a7810a380 2024-05-27T09:59:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.494+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a781aead0 con 0x7f5a7810a380 2024-05-27T09:59:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.497+0000 7f5a843b4740 1 Processor -- start 2024-05-27T09:59:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.497+0000 7f5a6fe00640 1 -- 172.21.15.71:0/2339638027 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5a68004fd0 con 0x7f5a7810a380 2024-05-27T09:59:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a843b4740 1 -- start start 2024-05-27T09:59:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51bba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a843b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f5c512cb90 con 0x55f5c4df84d0 2024-05-27T09:59:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a843b4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f5c511c730 con 0x55f5c4df02f0 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a843b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f5c5120770 con 0x55f5c4e191b0 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a77200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a76800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a77200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51bba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34070/0 (socket says 172.21.15.71:34070) 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.498+0000 7f5a77200640 1 -- 172.21.15.71:0/1405005407 learned_addr learned my addr 172.21.15.71:0/1405005407 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a77200640 1 -- 172.21.15.71:0/1405005407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 msgr2=0x55f5c51bbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a77200640 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51bbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a77200640 1 -- 172.21.15.71:0/1405005407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 msgr2=0x55f5c51bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a77200640 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51bc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a77200640 1 -- 172.21.15.71:0/1405005407 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5c50b58b0 con 0x55f5c4e191b0 2024-05-27T09:59:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:59:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.499+0000 7f5a77200640 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51bba60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000bca0 tx=0x7f5a7000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3bd44f72f03098b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.500+0000 7f5a6fe00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5a5c0b2940 0x7f5a5c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.500+0000 7f5a67400640 1 -- 172.21.15.71:0/1405005407 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70015070 con 0x55f5c4e191b0 2024-05-27T09:59:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.500+0000 7f5a67400640 1 -- 172.21.15.71:0/1405005407 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a700054d0 con 0x55f5c4e191b0 2024-05-27T09:59:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.500+0000 7f5a67400640 1 -- 172.21.15.71:0/1405005407 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a700116a0 con 0x55f5c4e191b0 2024-05-27T09:59:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.500+0000 7f5a76800640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5a5c0b2940 0x7f5a5c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.501+0000 7f5a6fe00640 1 -- 172.21.15.71:0/2339638027 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f5a680e2b90 con 0x7f5a7810a380 2024-05-27T09:59:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.503+0000 7f5a843b4740 1 -- 172.21.15.71:0/1405005407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 msgr2=0x55f5c51bba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.503+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51bba60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000bca0 tx=0x7f5a7000f730 comp rx=0 tx=0).stop 2024-05-27T09:59:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.503+0000 7f5a76800640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5a5c0b2940 0x7f5a5c0b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55f5c51b9550 tx=0x7f5a680e6640 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.503+0000 7f5a843b4740 1 -- 172.21.15.71:0/1405005407 shutdown_connections 2024-05-27T09:59:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.504+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.504+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51bbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.504+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1405005407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51bba60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.504+0000 7f5a843b4740 1 -- 172.21.15.71:0/1405005407 >> 172.21.15.71:0/1405005407 conn(0x55f5c4e0d300 msgr2=0x55f5c51b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.504+0000 7f5a843b4740 1 -- 172.21.15.71:0/1405005407 shutdown_connections 2024-05-27T09:59:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.504+0000 7f5a843b4740 1 -- 172.21.15.71:0/1405005407 wait complete. 2024-05-27T09:59:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.504+0000 7f5a843b4740 1 -- start start 2024-05-27T09:59:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 1 Processor -- start 2024-05-27T09:59:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f5c4e02790 con 0x55f5c4df84d0 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f5c50c4bc0 con 0x55f5c4df02f0 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f5c51c8b90 con 0x55f5c4e191b0 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.505+0000 7f5a843b4740 10 client.0 _ll_register_callbacks cb 0x55f5c50a2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42018/0 (socket says 172.21.15.71:42018) 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 -- 172.21.15.71:0/1569355613 learned_addr learned my addr 172.21.15.71:0/1569355613 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 -- 172.21.15.71:0/1569355613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 msgr2=0x55f5c51c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 -- 172.21.15.71:0/1569355613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 msgr2=0x55f5c51c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 -- 172.21.15.71:0/1569355613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5c4e31210 con 0x55f5c4e191b0 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.506+0000 7f5a77200640 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51d1ec0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5a70005d80 tx=0x7f5a70000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0b359251a791a42 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.507+0000 7f5a5be00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.507+0000 7f5a5be00640 1 -- 172.21.15.71:0/1569355613 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70015040 con 0x55f5c4e191b0 2024-05-27T09:59:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.507+0000 7f5a5be00640 1 -- 172.21.15.71:0/1569355613 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f5a70005010 con 0x55f5c4e191b0 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.507+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a700054d0 con 0x55f5c4e191b0 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.507+0000 7f5a5be00640 1 -- 172.21.15.71:0/1569355613 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5a70005210 con 0x55f5c4e191b0 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.507+0000 7f5a843b4740 10 client.27037 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.507+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f5c4efd620 con 0x55f5c4e191b0 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a5be00640 1 -- 172.21.15.71:0/1569355613 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a700054d0 con 0x55f5c4e191b0 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a5be00640 1 -- 172.21.15.71:0/1569355613 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f5a70027040 con 0x55f5c4e191b0 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a843b4740 10 client.27037 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a843b4740 10 client.27037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a843b4740 20 client.27037 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dd7d80 0x55f5c51d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a843b4740 4 client.27037 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5c512eae0 con 0x55f5c4dd7d80 2024-05-27T09:59:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.508+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dd7d80 0x55f5c51d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.509+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dd7d80 0x55f5c51d7d40 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc9f4cb14a4e729a server_cookie=530a4b534586dc6a in_seq=0 out_seq=0 2024-05-27T09:59:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.509+0000 7f5a5be00640 10 client.27037 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.510+0000 7f5a5be00640 1 -- 172.21.15.71:0/1569355613 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f5c512eae0 con 0x55f5c4dd7d80 2024-05-27T09:59:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.510+0000 7f5a5be00640 10 client.27037 handle_command_reply: tid=0 2024-05-27T09:59:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.510+0000 7f5a843b4740 1 client.27037 shutdown 2024-05-27T09:59:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 msgr2=0x55f5c51d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51d1ec0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5a70005d80 tx=0x7f5a70000bc0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 shutdown_connections 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51d1ec0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dd7d80 0x55f5c51d7d40 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a5be00640 0 client.27037 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df84d0 0x55f5c51c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1569355613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c51c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 >> 172.21.15.71:0/1569355613 conn(0x55f5c4e0d300 msgr2=0x55f5c51bb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 shutdown_connections 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.511+0000 7f5a843b4740 1 -- 172.21.15.71:0/1569355613 wait complete. 2024-05-27T09:59:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.512+0000 7f5a843b4740 20 client.27037 trim_cache size 0 max 16384 2024-05-27T09:59:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.535+0000 7f5a843b4740 1 Processor -- start 2024-05-27T09:59:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.536+0000 7f5a843b4740 1 -- start start 2024-05-27T09:59:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.536+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df02f0 0x55f5c51c6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.536+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df84d0 0x55f5c51dad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.536+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51db2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.536+0000 7f5a843b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781c1130 con 0x55f5c4df02f0 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.536+0000 7f5a843b4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781bea00 con 0x55f5c4df84d0 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.536+0000 7f5a843b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781bc870 con 0x55f5c4e191b0 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a77200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df02f0 0x55f5c51c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a77200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df02f0 0x55f5c51c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34034/0 (socket says 172.21.15.71:34034) 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a77200640 1 -- 172.21.15.71:0/2717359329 learned_addr learned my addr 172.21.15.71:0/2717359329 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a6de00640 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df84d0 0x55f5c51dad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a6de00640 1 -- 172.21.15.71:0/2717359329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 msgr2=0x55f5c51db2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a6de00640 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51db2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a6de00640 1 -- 172.21.15.71:0/2717359329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df02f0 msgr2=0x55f5c51c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a6de00640 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df02f0 0x55f5c51c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.537+0000 7f5a6de00640 1 -- 172.21.15.71:0/2717359329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5c51ddea0 con 0x55f5c4df84d0 2024-05-27T09:59:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.538+0000 7f5a6de00640 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df84d0 0x55f5c51dad70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5a6002ae00 tx=0x7f5a60005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365d00ea4e5afe59 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.538+0000 7f5a66a00640 1 -- 172.21.15.71:0/2717359329 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60031450 con 0x55f5c4df84d0 2024-05-27T09:59:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.539+0000 7f5a66a00640 1 -- 172.21.15.71:0/2717359329 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a60036040 con 0x55f5c4df84d0 2024-05-27T09:59:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.539+0000 7f5a66a00640 1 -- 172.21.15.71:0/2717359329 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60004280 con 0x55f5c4df84d0 2024-05-27T09:59:04.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.540+0000 7f5a843b4740 1 -- 172.21.15.71:0/2717359329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df84d0 msgr2=0x55f5c51dad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.540+0000 7f5a843b4740 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df84d0 0x55f5c51dad70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5a6002ae00 tx=0x7f5a60005fd0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.540 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.541+0000 7f5a843b4740 1 -- 172.21.15.71:0/2717359329 shutdown_connections 2024-05-27T09:59:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.541+0000 7f5a843b4740 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4e191b0 0x55f5c51db2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.541+0000 7f5a843b4740 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df84d0 0x55f5c51dad70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.541+0000 7f5a843b4740 1 --2- 172.21.15.71:0/2717359329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4df02f0 0x55f5c51c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.541+0000 7f5a843b4740 1 -- 172.21.15.71:0/2717359329 >> 172.21.15.71:0/2717359329 conn(0x55f5c4e0d300 msgr2=0x55f5c51c0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.541+0000 7f5a843b4740 1 -- 172.21.15.71:0/2717359329 shutdown_connections 2024-05-27T09:59:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.541+0000 7f5a843b4740 1 -- 172.21.15.71:0/2717359329 wait complete. 2024-05-27T09:59:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.542+0000 7f5a843b4740 1 -- start start 2024-05-27T09:59:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.542+0000 7f5a843b4740 1 Processor -- start 2024-05-27T09:59:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.543+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c5238550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.543+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4df84d0 0x55f5c5238ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.543+0000 7f5a843b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4e191b0 0x55f5c51da2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.543+0000 7f5a843b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781bcec0 con 0x55f5c4e191b0 2024-05-27T09:59:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.543+0000 7f5a843b4740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781be330 con 0x55f5c4df02f0 2024-05-27T09:59:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.543+0000 7f5a843b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781bd590 con 0x55f5c4df84d0 2024-05-27T09:59:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.543+0000 7f5a843b4740 10 client.0 _ll_register_callbacks cb 0x7f5a7000bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4df84d0 0x55f5c5238ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a77200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c5238550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4df84d0 0x55f5c5238ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34098/0 (socket says 172.21.15.71:34098) 2024-05-27T09:59:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 -- 172.21.15.71:0/1712647543 learned_addr learned my addr 172.21.15.71:0/1712647543 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a77200640 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4e191b0 0x55f5c51da2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 -- 172.21.15.71:0/1712647543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 msgr2=0x55f5c5238550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c5238550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 -- 172.21.15.71:0/1712647543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4e191b0 msgr2=0x55f5c51da2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4e191b0 0x55f5c51da2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a6de00640 1 -- 172.21.15.71:0/1712647543 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5c51da9a0 con 0x55f5c4df84d0 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.544+0000 7f5a77200640 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4e191b0 0x55f5c51da2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.545+0000 7f5a6de00640 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4df84d0 0x55f5c5238ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5a6002aea0 tx=0x7f5a60032dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fedd846f06d12e4c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.545+0000 7f5a5be00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:59:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.545+0000 7f5a5be00640 1 -- 172.21.15.71:0/1712647543 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60058070 con 0x55f5c4df84d0 2024-05-27T09:59:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.546+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a60036040 con 0x55f5c4df84d0 2024-05-27T09:59:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.546+0000 7f5a5be00640 1 -- 172.21.15.71:0/1712647543 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f5a60031860 con 0x55f5c4df84d0 2024-05-27T09:59:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.546+0000 7f5a5be00640 1 -- 172.21.15.71:0/1712647543 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5a60062050 con 0x55f5c4df84d0 2024-05-27T09:59:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.546+0000 7f5a843b4740 10 client.27040 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.546+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f5c523fb90 con 0x55f5c4df84d0 2024-05-27T09:59:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a5be00640 1 -- 172.21.15.71:0/1712647543 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a60036040 con 0x55f5c4df84d0 2024-05-27T09:59:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a5be00640 1 -- 172.21.15.71:0/1712647543 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f5a600046d0 con 0x55f5c4df84d0 2024-05-27T09:59:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a843b4740 10 client.27040 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a843b4740 10 client.27040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a843b4740 20 client.27040 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dad1c0 0x55f5c5242280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a843b4740 4 client.27040 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:59:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.547+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5c51282c0 con 0x55f5c4dad1c0 2024-05-27T09:59:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.548+0000 7f5a77200640 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dad1c0 0x55f5c5242280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.548+0000 7f5a77200640 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dad1c0 0x55f5c5242280 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5317d03534a06a0 server_cookie=b734aeceeab13df3 in_seq=0 out_seq=0 2024-05-27T09:59:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.548+0000 7f5a5be00640 10 client.27040 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a5be00640 1 -- 172.21.15.71:0/1712647543 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f5c51282c0 con 0x55f5c4dad1c0 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a5be00640 10 client.27040 handle_command_reply: tid=0 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 client.27040 shutdown 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4df84d0 msgr2=0x55f5c5238ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4df84d0 0x55f5c5238ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5a6002aea0 tx=0x7f5a60032dc0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 shutdown_connections 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f5c4dad1c0 0x55f5c5242280 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5c4e191b0 0x55f5c51da2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5c4df84d0 0x55f5c5238ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 --2- 172.21.15.71:0/1712647543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f5c4df02f0 0x55f5c5238550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a5be00640 0 client.27040 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 >> 172.21.15.71:0/1712647543 conn(0x55f5c4e0d300 msgr2=0x55f5c51c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.567+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 shutdown_connections 2024-05-27T09:59:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.568+0000 7f5a843b4740 1 -- 172.21.15.71:0/1712647543 wait complete. 2024-05-27T09:59:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.568+0000 7f5a843b4740 20 client.27040 trim_cache size 0 max 16384 2024-05-27T09:59:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:59:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:59:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:59:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.568+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5a5c0b2940 msgr2=0x7f5a5c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.568+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5a5c0b2940 0x7f5a5c0b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55f5c51b9550 tx=0x7f5a680e6640 comp rx=0 tx=0).stop 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.568+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7810a380 msgr2=0x7f5a781a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.568+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7810a380 0x7f5a781a94b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e9c0 tx=0x7f5a6800ee80 comp rx=0 tx=0).stop 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 shutdown_connections 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5a5c0b2940 0x7f5a5c0b4e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781167c0 0x7f5a781adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a78113d10 0x7f5a781a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 --2- 172.21.15.71:0/2339638027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7810a380 0x7f5a781a94b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 >> 172.21.15.71:0/2339638027 conn(0x7f5a7806f800 msgr2=0x7f5a78116cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 shutdown_connections 2024-05-27T09:59:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:04.569+0000 7f5a7ca00640 1 -- 172.21.15.71:0/2339638027 wait complete. 2024-05-27T09:59:04.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:04 smithi071 ceph-mon[31451]: pgmap v351: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.0 MiB/s wr, 337 op/s 2024-05-27T09:59:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:04 smithi122 ceph-mon[36436]: pgmap v351: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.0 MiB/s wr, 337 op/s 2024-05-27T09:59:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:04 smithi072 ceph-mon[35951]: pgmap v351: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.0 MiB/s wr, 337 op/s 2024-05-27T09:59:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:05 smithi122 ceph-mon[36436]: osdmap e94: 12 total, 12 up, 12 in 2024-05-27T09:59:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:05 smithi122 ceph-mon[36436]: pgmap v353: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.2 MiB/s wr, 404 op/s 2024-05-27T09:59:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:05 smithi071 ceph-mon[31451]: osdmap e94: 12 total, 12 up, 12 in 2024-05-27T09:59:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:05 smithi071 ceph-mon[31451]: pgmap v353: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.2 MiB/s wr, 404 op/s 2024-05-27T09:59:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:05 smithi072 ceph-mon[35951]: osdmap e94: 12 total, 12 up, 12 in 2024-05-27T09:59:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:05 smithi072 ceph-mon[35951]: pgmap v353: 97 pgs: 97 active+clean; 144 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.2 MiB/s wr, 404 op/s 2024-05-27T09:59:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.021+0000 7f0108a00700 1 -- 172.21.15.71:0/448145412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0104109860 msgr2=0x7f01041111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.021+0000 7f0108a00700 1 --2- 172.21.15.71:0/448145412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0104109860 0x7f01041111c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00b0a0 tx=0x7f00fc00b3b0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.022+0000 7f0108a00700 1 -- 172.21.15.71:0/448145412 shutdown_connections 2024-05-27T09:59:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.022+0000 7f0108a00700 1 --2- 172.21.15.71:0/448145412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0104109860 0x7f01041111c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.022+0000 7f0108a00700 1 --2- 172.21.15.71:0/448145412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01041045e0 0x7f01041049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.022+0000 7f0108a00700 1 --2- 172.21.15.71:0/448145412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0104108f10 0x7f0104109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.022+0000 7f0108a00700 1 -- 172.21.15.71:0/448145412 >> 172.21.15.71:0/448145412 conn(0x7f0104100030 msgr2=0x7f0104102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.022+0000 7f0108a00700 1 -- 172.21.15.71:0/448145412 shutdown_connections 2024-05-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.022+0000 7f0108a00700 1 -- 172.21.15.71:0/448145412 wait complete. 2024-05-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 Processor -- start 2024-05-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 -- start start 2024-05-27T09:59:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01041045e0 0x7f010419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0104108f10 0x7f010419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0104109860 0x7f01041a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01041144e0 con 0x7f0104108f10 2024-05-27T09:59:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0104114360 con 0x7f01041045e0 2024-05-27T09:59:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.024+0000 7f0108a00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0104114660 con 0x7f0104109860 2024-05-27T09:59:07.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0101e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01041045e0 0x7f010419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:07.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0101e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01041045e0 0x7f010419d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42050/0 (socket says 172.21.15.71:42050) 2024-05-27T09:59:07.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0101e00700 1 -- 172.21.15.71:0/3439445721 learned_addr learned my addr 172.21.15.71:0/3439445721 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:07.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0102800700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0104109860 0x7f01041a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0101400700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0104108f10 0x7f010419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0102800700 1 -- 172.21.15.71:0/3439445721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01041045e0 msgr2=0x7f010419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0102800700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01041045e0 0x7f010419d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0102800700 1 -- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0104108f10 msgr2=0x7f010419d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0102800700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0104108f10 0x7f010419d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0102800700 1 -- 172.21.15.71:0/3439445721 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01041a1ee0 con 0x7f0104109860 2024-05-27T09:59:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.025+0000 7f0101e00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01041045e0 0x7f010419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.026+0000 7f0102800700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0104109860 0x7f01041a1840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00b070 tx=0x7f00fc004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.026+0000 7f00faa00700 1 -- 172.21.15.71:0/3439445721 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc021070 con 0x7f0104109860 2024-05-27T09:59:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.026+0000 7f00faa00700 1 -- 172.21.15.71:0/3439445721 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00fc007b80 con 0x7f0104109860 2024-05-27T09:59:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.026+0000 7f00faa00700 1 -- 172.21.15.71:0/3439445721 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc005040 con 0x7f0104109860 2024-05-27T09:59:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.026+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01041a2170 con 0x7f0104109860 2024-05-27T09:59:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.027+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01041a2660 con 0x7f0104109860 2024-05-27T09:59:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.028+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01040512b0 con 0x7f0104109860 2024-05-27T09:59:07.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.030+0000 7f00faa00700 1 -- 172.21.15.71:0/3439445721 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f00fc024070 con 0x7f0104109860 2024-05-27T09:59:07.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.033+0000 7f00faa00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00e80b2a70 0x7f00e80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:07.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.033+0000 7f00faa00700 1 -- 172.21.15.71:0/3439445721 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f00fc00f020 con 0x7f0104109860 2024-05-27T09:59:07.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.033+0000 7f0101e00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00e80b2a70 0x7f00e80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:07.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.034+0000 7f0101e00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00e80b2a70 0x7f00e80b4f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00f4011550 tx=0x7f00f4009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:07.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.036+0000 7f00faa00700 1 -- 172.21.15.71:0/3439445721 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f00fc02b020 con 0x7f0104109860 2024-05-27T09:59:07.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.387+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01041a9bb0 con 0x7f0104109860 2024-05-27T09:59:07.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.388+0000 7f00faa00700 1 -- 172.21.15.71:0/3439445721 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f00fc0ab420 con 0x7f0104109860 2024-05-27T09:59:07.390 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:59:07.390 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:59:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00e80b2a70 msgr2=0x7f00e80b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00e80b2a70 0x7f00e80b4f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00f4011550 tx=0x7f00f4009260 comp rx=0 tx=0).stop 2024-05-27T09:59:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0104109860 msgr2=0x7f01041a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0104109860 0x7f01041a1840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00b070 tx=0x7f00fc004c80 comp rx=0 tx=0).stop 2024-05-27T09:59:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 shutdown_connections 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f00e80b2a70 0x7f00e80b4f80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0104109860 0x7f01041a1840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01041045e0 0x7f010419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.391+0000 7f0108a00700 1 --2- 172.21.15.71:0/3439445721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0104108f10 0x7f010419d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.392+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 >> 172.21.15.71:0/3439445721 conn(0x7f0104100030 msgr2=0x7f010410a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.392+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 shutdown_connections 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:07.392+0000 7f0108a00700 1 -- 172.21.15.71:0/3439445721 wait complete. 2024-05-27T09:59:07.394 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:59:07.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:07 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3439445721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:07.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:07 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3439445721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:07.778 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:07 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3439445721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:08.248 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-05-27T09:59:08.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-05-27T09:59:08.724 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:08.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:08 smithi122 ceph-mon[36436]: pgmap v354: 97 pgs: 97 active+clean; 133 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-27T09:59:08.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:08 smithi071 ceph-mon[31451]: pgmap v354: 97 pgs: 97 active+clean; 133 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-27T09:59:08.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:08 smithi072 ceph-mon[35951]: pgmap v354: 97 pgs: 97 active+clean; 133 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-27T09:59:10.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:09 smithi122 ceph-mon[36436]: pgmap v355: 97 pgs: 97 active+clean; 133 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-27T09:59:10.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:09 smithi071 ceph-mon[31451]: pgmap v355: 97 pgs: 97 active+clean; 133 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-27T09:59:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:09 smithi072 ceph-mon[35951]: pgmap v355: 97 pgs: 97 active+clean; 133 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 -- 172.21.15.71:0/1987658898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14076c60 msgr2=0x7fec14077070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 --2- 172.21.15.71:0/1987658898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14076c60 0x7fec14077070 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec04009990 tx=0x7fec04009ca0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 -- 172.21.15.71:0/1987658898 shutdown_connections 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 --2- 172.21.15.71:0/1987658898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14115360 0x7fec14117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 --2- 172.21.15.71:0/1987658898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14076c60 0x7fec14077070 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 --2- 172.21.15.71:0/1987658898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec140775b0 0x7fec14114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 -- 172.21.15.71:0/1987658898 >> 172.21.15.71:0/1987658898 conn(0x7fec140ffe90 msgr2=0x7fec141022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 -- 172.21.15.71:0/1987658898 shutdown_connections 2024-05-27T09:59:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.306+0000 7fec19400700 1 -- 172.21.15.71:0/1987658898 wait complete. 2024-05-27T09:59:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 Processor -- start 2024-05-27T09:59:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 -- start start 2024-05-27T09:59:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14076c60 0x7fec141a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec140775b0 0x7fec141a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14115360 0x7fec141a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec1411aab0 con 0x7fec140775b0 2024-05-27T09:59:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fec1411a930 con 0x7fec14076c60 2024-05-27T09:59:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.308+0000 7fec19400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec1411ac30 con 0x7fec14115360 2024-05-27T09:59:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec13200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14115360 0x7fec141a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14076c60 0x7fec141a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14076c60 0x7fec141a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42078/0 (socket says 172.21.15.71:42078) 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 -- 172.21.15.71:0/3228704632 learned_addr learned my addr 172.21.15.71:0/3228704632 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec0be00700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec140775b0 0x7fec141a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec13200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14115360 0x7fec141a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34132/0 (socket says 172.21.15.71:34132) 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 -- 172.21.15.71:0/3228704632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14115360 msgr2=0x7fec141a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14115360 0x7fec141a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 -- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec140775b0 msgr2=0x7fec141a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec140775b0 0x7fec141a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.309+0000 7fec12800700 1 -- 172.21.15.71:0/3228704632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec141a6310 con 0x7fec14076c60 2024-05-27T09:59:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.310+0000 7fec12800700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14076c60 0x7fec141a1440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec040057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:11.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.310+0000 7fec0b400700 1 -- 172.21.15.71:0/3228704632 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04027070 con 0x7fec14076c60 2024-05-27T09:59:11.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.310+0000 7fec0b400700 1 -- 172.21.15.71:0/3228704632 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec04022470 con 0x7fec14076c60 2024-05-27T09:59:11.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.310+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec141a65a0 con 0x7fec14076c60 2024-05-27T09:59:11.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.310+0000 7fec0b400700 1 -- 172.21.15.71:0/3228704632 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04017650 con 0x7fec14076c60 2024-05-27T09:59:11.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.310+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec141a6a80 con 0x7fec14076c60 2024-05-27T09:59:11.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.315+0000 7fec0b400700 1 -- 172.21.15.71:0/3228704632 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fec0402a070 con 0x7fec14076c60 2024-05-27T09:59:11.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.316+0000 7fec27e83b80 1 Processor -- start 2024-05-27T09:59:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.316+0000 7fec27e83b80 1 -- start start 2024-05-27T09:59:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.316+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab00ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.316+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab00f380 0x5616ab008f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab0094d0 0x5616ab0098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec27e83b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5616aaf36fd0 con 0x5616ab0094d0 2024-05-27T09:59:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec27e83b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5616aaf26b70 con 0x5616aae89fd0 2024-05-27T09:59:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec27e83b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5616aaf2abb0 con 0x5616ab00f380 2024-05-27T09:59:11.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec13200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab00ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec0be00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab0094d0 0x5616ab0098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec13200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab00ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42086/0 (socket says 172.21.15.71:42086) 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec13200700 1 -- 172.21.15.71:0/3589530462 learned_addr learned my addr 172.21.15.71:0/3589530462 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec12800700 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab00f380 0x5616ab008f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec13200700 1 -- 172.21.15.71:0/3589530462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab00f380 msgr2=0x5616ab008f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.317+0000 7fec13200700 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab00f380 0x5616ab008f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.318+0000 7fec13200700 1 -- 172.21.15.71:0/3589530462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab0094d0 msgr2=0x5616ab0098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.318+0000 7fec13200700 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab0094d0 0x5616ab0098e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.318+0000 7fec13200700 1 -- 172.21.15.71:0/3589530462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616aaeef5b0 con 0x5616aae89fd0 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.318+0000 7fec0b400700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7febf80b29f0 0x7febf80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.318+0000 7fec13200700 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab00ee40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fec0c011680 tx=0x7fec0c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29912830cb871d74 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.318+0000 7fec0b400700 1 -- 172.21.15.71:0/3228704632 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7fec040e3580 con 0x7fec14076c60 2024-05-27T09:59:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.318+0000 7fec12800700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7febf80b29f0 0x7febf80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.319+0000 7fec03e00700 1 -- 172.21.15.71:0/3589530462 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c019030 con 0x5616aae89fd0 2024-05-27T09:59:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.319+0000 7fec03e00700 1 -- 172.21.15.71:0/3589530462 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec0c0093a0 con 0x5616aae89fd0 2024-05-27T09:59:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.319+0000 7fec03e00700 1 -- 172.21.15.71:0/3589530462 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c007500 con 0x5616aae89fd0 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 -- 172.21.15.71:0/3589530462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 msgr2=0x5616ab00ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab00ee40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fec0c011680 tx=0x7fec0c009920 comp rx=0 tx=0).stop 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec12800700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7febf80b29f0 0x7febf80b4f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec040e0cd0 tx=0x7fec040b3040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 -- 172.21.15.71:0/3589530462 shutdown_connections 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab0094d0 0x5616ab0098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab00ee40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3589530462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab00f380 0x5616ab008f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 -- 172.21.15.71:0/3589530462 >> 172.21.15.71:0/3589530462 conn(0x5616aaeea150 msgr2=0x5616ab004190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 -- 172.21.15.71:0/3589530462 shutdown_connections 2024-05-27T09:59:11.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.320+0000 7fec27e83b80 1 -- 172.21.15.71:0/3589530462 wait complete. 2024-05-27T09:59:11.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.321+0000 7fec27e83b80 1 -- start start 2024-05-27T09:59:11.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.321+0000 7fec27e83b80 1 Processor -- start 2024-05-27T09:59:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab012a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab012fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab0134e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec27e83b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5616aae2d130 con 0x5616ab00f380 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec27e83b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5616aaec78f0 con 0x5616aae89fd0 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec27e83b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5616ab015e50 con 0x5616ab0094d0 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec27e83b80 10 client.0 _ll_register_callbacks cb 0x5616aaed0e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec13200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab012a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec0be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab012fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec13200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab012a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42088/0 (socket says 172.21.15.71:42088) 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec13200700 1 -- 172.21.15.71:0/1836225027 learned_addr learned my addr 172.21.15.71:0/1836225027 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.322+0000 7fec13200700 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab0134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec0be00700 1 -- 172.21.15.71:0/1836225027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 msgr2=0x5616ab012a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec0be00700 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab012a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec0be00700 1 -- 172.21.15.71:0/1836225027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 msgr2=0x5616ab0134e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec0be00700 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab0134e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec0be00700 1 -- 172.21.15.71:0/1836225027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616aae76a60 con 0x5616ab0094d0 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec13200700 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab0134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec0be00700 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab012fa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7febfc0116c0 tx=0x7febfc0119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccfcbc849589ae8e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec00c00700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.323+0000 7fec00c00700 1 -- 172.21.15.71:0/1836225027 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc01f060 con 0x5616ab0094d0 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.324+0000 7fec00c00700 1 -- 172.21.15.71:0/1836225027 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7febfc004300 con 0x5616ab0094d0 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.324+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616aaf38f20 con 0x5616ab0094d0 2024-05-27T09:59:11.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.324+0000 7fec00c00700 1 -- 172.21.15.71:0/1836225027 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7febfc004500 con 0x5616ab0094d0 2024-05-27T09:59:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.324+0000 7fec27e83b80 10 client.27058 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.324+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5616aaef71f0 con 0x5616ab0094d0 2024-05-27T09:59:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.324+0000 7fec00c00700 1 -- 172.21.15.71:0/1836225027 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5616aaf38f20 con 0x5616ab0094d0 2024-05-27T09:59:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec00c00700 1 -- 172.21.15.71:0/1836225027 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7febfc019030 con 0x5616ab0094d0 2024-05-27T09:59:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec27e83b80 10 client.27058 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec27e83b80 10 client.27058 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec27e83b80 20 client.27058 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab033c60 0x5616ab0360a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec27e83b80 4 client.27058 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616aaf32700 con 0x5616ab033c60 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec13200700 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab033c60 0x5616ab0360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec00c00700 10 client.27058 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.325+0000 7fec13200700 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab033c60 0x5616ab0360a0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ef068eaf731c88 server_cookie=54615caeb693b4bd in_seq=0 out_seq=0 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec00c00700 1 -- 172.21.15.71:0/1836225027 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5616aaf32700 con 0x5616ab033c60 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec00c00700 10 client.27058 handle_command_reply: tid=0 2024-05-27T09:59:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 client.27058 shutdown 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 msgr2=0x5616ab012fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab012fa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7febfc0116c0 tx=0x7febfc0119d0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 shutdown_connections 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab033c60 0x5616ab0360a0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab0134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab012a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1836225027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab012fa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.327+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 >> 172.21.15.71:0/1836225027 conn(0x5616aaeea150 msgr2=0x5616ab007da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.328+0000 7fec00c00700 0 client.27058 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.328+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 shutdown_connections 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.328+0000 7fec27e83b80 1 -- 172.21.15.71:0/1836225027 wait complete. 2024-05-27T09:59:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.328+0000 7fec27e83b80 20 client.27058 trim_cache size 0 max 16384 2024-05-27T09:59:11.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.356+0000 7fec27e83b80 1 Processor -- start 2024-05-27T09:59:11.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.357+0000 7fec27e83b80 1 -- start start 2024-05-27T09:59:11.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.357+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab011a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab00fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab00ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec27e83b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec141af5a0 con 0x5616ab00f380 2024-05-27T09:59:11.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec27e83b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fec14074890 con 0x5616aae89fd0 2024-05-27T09:59:11.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec27e83b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec14072700 con 0x5616ab0094d0 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab00fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab00fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34160/0 (socket says 172.21.15.71:34160) 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 -- 172.21.15.71:0/3420652338 learned_addr learned my addr 172.21.15.71:0/3420652338 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec13200700 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab011a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec13200700 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab00ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 -- 172.21.15.71:0/3420652338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 msgr2=0x5616ab011a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab011a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 -- 172.21.15.71:0/3420652338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 msgr2=0x5616ab00ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab00ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec0be00700 1 -- 172.21.15.71:0/3420652338 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616ab010fd0 con 0x5616ab0094d0 2024-05-27T09:59:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.358+0000 7fec13200700 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab011a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.359+0000 7fec0be00700 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab00fa80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7febfc000c00 tx=0x7febfc009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba5e1ade09972 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.359+0000 7fec03400700 1 -- 172.21.15.71:0/3420652338 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc029080 con 0x5616ab0094d0 2024-05-27T09:59:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.359+0000 7fec03400700 1 -- 172.21.15.71:0/3420652338 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc00fad0 con 0x5616ab0094d0 2024-05-27T09:59:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.359+0000 7fec03400700 1 -- 172.21.15.71:0/3420652338 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc02d460 con 0x5616ab0094d0 2024-05-27T09:59:11.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 -- 172.21.15.71:0/3420652338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 msgr2=0x5616ab00fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:11.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab00fa80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7febfc000c00 tx=0x7febfc009370 comp rx=0 tx=0).stop 2024-05-27T09:59:11.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 -- 172.21.15.71:0/3420652338 shutdown_connections 2024-05-27T09:59:11.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab00ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616aae89fd0 0x5616ab011a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 --2- 172.21.15.71:0/3420652338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616ab0094d0 0x5616ab00fa80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 -- 172.21.15.71:0/3420652338 >> 172.21.15.71:0/3420652338 conn(0x5616aaeea150 msgr2=0x5616ab011350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 -- 172.21.15.71:0/3420652338 shutdown_connections 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.360+0000 7fec27e83b80 1 -- 172.21.15.71:0/3420652338 wait complete. 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.361+0000 7fec27e83b80 1 -- start start 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.361+0000 7fec27e83b80 1 Processor -- start 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616aae89fd0 0x5616ab01b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ab0094d0 0x5616ab01b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec27e83b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab018070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec27e83b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec14072d50 con 0x5616ab00f380 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec27e83b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fec140741c0 con 0x5616ab0094d0 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec27e83b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec14073420 con 0x5616aae89fd0 2024-05-27T09:59:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec27e83b80 10 client.0 _ll_register_callbacks cb 0x5616aaffd8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec0be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ab0094d0 0x5616ab01b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec13200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616aae89fd0 0x5616ab01b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec13200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616aae89fd0 0x5616ab01b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34172/0 (socket says 172.21.15.71:34172) 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec13200700 1 -- 172.21.15.71:0/1369243882 learned_addr learned my addr 172.21.15.71:0/1369243882 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec0be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ab0094d0 0x5616ab01b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:42098/0 (socket says 172.21.15.71:42098) 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec13200700 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab018070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec0be00700 1 -- 172.21.15.71:0/1369243882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616aae89fd0 msgr2=0x5616ab01b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec0be00700 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616aae89fd0 0x5616ab01b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec0be00700 1 -- 172.21.15.71:0/1369243882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 msgr2=0x5616ab018070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec0be00700 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab018070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.362+0000 7fec0be00700 1 -- 172.21.15.71:0/1369243882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616ab0185b0 con 0x5616ab0094d0 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec0be00700 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ab0094d0 0x5616ab01b5e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7febfc00fa50 tx=0x7febfc0055e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2e1a4efcccd60d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec00c00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec00c00700 1 -- 172.21.15.71:0/1369243882 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc029040 con 0x5616ab0094d0 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec00c00700 1 -- 172.21.15.71:0/1369243882 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7febfc00f5a0 con 0x5616ab0094d0 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febfc00fad0 con 0x5616ab0094d0 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec00c00700 1 -- 172.21.15.71:0/1369243882 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7febfc0046a0 con 0x5616ab0094d0 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec27e83b80 10 client.27038 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.363+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5616ab09ee40 con 0x5616ab0094d0 2024-05-27T09:59:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec00c00700 1 -- 172.21.15.71:0/1369243882 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc00fad0 con 0x5616ab0094d0 2024-05-27T09:59:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec00c00700 1 -- 172.21.15.71:0/1369243882 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7febfc019050 con 0x5616ab0094d0 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec27e83b80 10 client.27038 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec27e83b80 10 client.27038 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec27e83b80 20 client.27038 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab09f520 0x5616ab0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec27e83b80 4 client.27038 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.364+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5616aada93e0 con 0x5616ab09f520 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.365+0000 7fec13200700 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab09f520 0x5616ab0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.365+0000 7fec13200700 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab09f520 0x5616ab0a1940 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c63f704044ca8e57 server_cookie=531798b017f58eb4 in_seq=0 out_seq=0 2024-05-27T09:59:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:11.365+0000 7fec00c00700 10 client.27038 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:11.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:11 smithi071 ceph-mon[31451]: osdmap e95: 12 total, 12 up, 12 in 2024-05-27T09:59:11.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:11 smithi072 ceph-mon[35951]: osdmap e95: 12 total, 12 up, 12 in 2024-05-27T09:59:11.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:11 smithi122 ceph-mon[36436]: osdmap e95: 12 total, 12 up, 12 in 2024-05-27T09:59:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.334+0000 7fec00c00700 1 -- 172.21.15.71:0/1369243882 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5616aada93e0 con 0x5616ab09f520 2024-05-27T09:59:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.334+0000 7fec00c00700 10 client.27038 handle_command_reply: tid=0 2024-05-27T09:59:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.334+0000 7fec27e83b80 1 client.27038 shutdown 2024-05-27T09:59:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.334+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ab0094d0 msgr2=0x5616ab01b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.334+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ab0094d0 0x5616ab01b5e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7febfc00fa50 tx=0x7febfc0055e0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 shutdown_connections 2024-05-27T09:59:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5616ab09f520 0x5616ab0a1940 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616ab00f380 0x5616ab018070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616aae89fd0 0x5616ab01b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 --2- 172.21.15.71:0/1369243882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ab0094d0 0x5616ab01b5e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec00c00700 0 client.27038 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 >> 172.21.15.71:0/1369243882 conn(0x5616aaeea150 msgr2=0x5616ab007da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 shutdown_connections 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 1 -- 172.21.15.71:0/1369243882 wait complete. 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.335+0000 7fec27e83b80 20 client.27038 trim_cache size 0 max 16384 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:59:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 34, 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "34ee7f79": { 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 34, 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 130.0, 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:59:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:12.339 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7febf80b29f0 msgr2=0x7febf80b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7febf80b29f0 0x7febf80b4f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec040e0cd0 tx=0x7fec040b3040 comp rx=0 tx=0).stop 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14076c60 msgr2=0x7fec141a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14076c60 0x7fec141a1440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec040057c0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 shutdown_connections 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7febf80b29f0 0x7febf80b4f00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec14115360 0x7fec141a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14076c60 0x7fec141a1440 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 --2- 172.21.15.71:0/3228704632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec140775b0 0x7fec141a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 >> 172.21.15.71:0/3228704632 conn(0x7fec140ffe90 msgr2=0x7fec14100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 shutdown_connections 2024-05-27T09:59:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:12.337+0000 7fec19400700 1 -- 172.21.15.71:0/3228704632 wait complete. 2024-05-27T09:59:12.750 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:12 smithi071 ceph-mon[31451]: pgmap v357: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 524 op/s 2024-05-27T09:59:12.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:12 smithi122 ceph-mon[36436]: pgmap v357: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 524 op/s 2024-05-27T09:59:13.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:12 smithi072 ceph-mon[35951]: pgmap v357: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 524 op/s 2024-05-27T09:59:13.142 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '34ee7f79', quiesce took 9.2 seconds. Will release after: 0.8000000000000007 2024-05-27T09:59:13.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:59:14.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:13 smithi122 ceph-mon[36436]: pgmap v358: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 469 op/s 2024-05-27T09:59:14.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:13 smithi071 ceph-mon[31451]: pgmap v358: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 469 op/s 2024-05-27T09:59:14.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:13 smithi072 ceph-mon[35951]: pgmap v358: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 469 op/s 2024-05-27T09:59:14.387 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:16.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:15 smithi071 ceph-mon[31451]: pgmap v359: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.3 MiB/s wr, 419 op/s 2024-05-27T09:59:16.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:15 smithi122 ceph-mon[36436]: pgmap v359: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.3 MiB/s wr, 419 op/s 2024-05-27T09:59:16.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:15 smithi072 ceph-mon[35951]: pgmap v359: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.3 MiB/s wr, 419 op/s 2024-05-27T09:59:16.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 -- 172.21.15.71:0/3892963438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac075d20 msgr2=0x7f23ac076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:16.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 --2- 172.21.15.71:0/3892963438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac075d20 0x7f23ac076130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f239c009990 tx=0x7f239c009ca0 comp rx=0 tx=0).stop 2024-05-27T09:59:16.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 -- 172.21.15.71:0/3892963438 shutdown_connections 2024-05-27T09:59:16.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 --2- 172.21.15.71:0/3892963438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23ac1109a0 0x7f23ac112e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:16.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 --2- 172.21.15.71:0/3892963438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac075d20 0x7f23ac076130 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:16.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 --2- 172.21.15.71:0/3892963438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac076670 0x7f23ac110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:16.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 -- 172.21.15.71:0/3892963438 >> 172.21.15.71:0/3892963438 conn(0x7f23ac079d00 msgr2=0x7f23ac07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:16.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 -- 172.21.15.71:0/3892963438 shutdown_connections 2024-05-27T09:59:16.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.690+0000 7f23b1400700 1 -- 172.21.15.71:0/3892963438 wait complete. 2024-05-27T09:59:16.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.691+0000 7f23b1400700 1 Processor -- start 2024-05-27T09:59:16.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.692+0000 7f23b1400700 1 -- start start 2024-05-27T09:59:16.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.692+0000 7f23b1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac075d20 0x7f23ac19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:16.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.692+0000 7f23b1400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23ac076670 0x7f23ac19d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:16.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.692+0000 7f23b1400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac1109a0 0x7f23ac1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:16.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.692+0000 7f23b1400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1164e0 con 0x7f23ac076670 2024-05-27T09:59:16.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.692+0000 7f23b1400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac116360 con 0x7f23ac075d20 2024-05-27T09:59:16.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.692+0000 7f23b1400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac116660 con 0x7f23ac1109a0 2024-05-27T09:59:16.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac075d20 0x7f23ac19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:16.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac075d20 0x7f23ac19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:33100/0 (socket says 172.21.15.71:33100) 2024-05-27T09:59:16.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 -- 172.21.15.71:0/3332498876 learned_addr learned my addr 172.21.15.71:0/3332498876 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:16.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23b0a00700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac1109a0 0x7f23ac1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:16.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23a3400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23ac076670 0x7f23ac19d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:16.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 -- 172.21.15.71:0/3332498876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac1109a0 msgr2=0x7f23ac1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:16.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac1109a0 0x7f23ac1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:16.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 -- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23ac076670 msgr2=0x7f23ac19d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:16.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23ac076670 0x7f23ac19d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:16.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 -- 172.21.15.71:0/3332498876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac1a1d60 con 0x7f23ac075d20 2024-05-27T09:59:16.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.693+0000 7f23abe00700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac075d20 0x7f23ac19ce90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f239c0057c0 tx=0x7f239c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:16.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.694+0000 7f23a9600700 1 -- 172.21.15.71:0/3332498876 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c00fb00 con 0x7f23ac075d20 2024-05-27T09:59:16.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.694+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac1a1ff0 con 0x7f23ac075d20 2024-05-27T09:59:16.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.694+0000 7f23a9600700 1 -- 172.21.15.71:0/3332498876 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f239c00fca0 con 0x7f23ac075d20 2024-05-27T09:59:16.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.694+0000 7f23a9600700 1 -- 172.21.15.71:0/3332498876 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c017650 con 0x7f23ac075d20 2024-05-27T09:59:16.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.694+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac1a24c0 con 0x7f23ac075d20 2024-05-27T09:59:16.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.695+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac077290 con 0x7f23ac075d20 2024-05-27T09:59:16.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.698+0000 7f23a9600700 1 -- 172.21.15.71:0/3332498876 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f239c009d10 con 0x7f23ac075d20 2024-05-27T09:59:16.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.700+0000 7f23a9600700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23900b29f0 0x7f23900b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:16.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.700+0000 7f23a9600700 1 -- 172.21.15.71:0/3332498876 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f239c0e3780 con 0x7f23ac075d20 2024-05-27T09:59:16.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.700+0000 7f23a3400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23900b29f0 0x7f23900b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:16.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.701+0000 7f23a3400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23900b29f0 0x7f23900b4f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23ac07a700 tx=0x7f2394009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:16.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.702+0000 7f23a9600700 1 -- 172.21.15.71:0/3332498876 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f239c013070 con 0x7f23ac075d20 2024-05-27T09:59:16.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.994+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23ac19e1f0 con 0x7f23ac075d20 2024-05-27T09:59:16.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.996+0000 7f23a9600700 1 -- 172.21.15.71:0/3332498876 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11855 (secure 0 0 0) 0x7f239c0a6020 con 0x7f23ac075d20 2024-05-27T09:59:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:59:16.997 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:53:43.841126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24508,24518,24530]},"id":1}]} 2024-05-27T09:59:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23900b29f0 msgr2=0x7f23900b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23900b29f0 0x7f23900b4f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23ac07a700 tx=0x7f2394009260 comp rx=0 tx=0).stop 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac075d20 msgr2=0x7f23ac19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac075d20 0x7f23ac19ce90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f239c0057c0 tx=0x7f239c0057f0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 shutdown_connections 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f23900b29f0 0x7f23900b4f00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23ac1109a0 0x7f23ac1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23ac075d20 0x7f23ac19ce90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 --2- 172.21.15.71:0/3332498876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23ac076670 0x7f23ac19d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:16.999+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 >> 172.21.15.71:0/3332498876 conn(0x7f23ac079d00 msgr2=0x7f23ac100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:17.000+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 shutdown_connections 2024-05-27T09:59:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:17.000+0000 7f23b1400700 1 -- 172.21.15.71:0/3332498876 wait complete. 2024-05-27T09:59:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-05-27T09:59:17.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:17 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3332498876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:17.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:17 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3332498876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:17.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:17 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3332498876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 -- 172.21.15.71:0/1894253274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b48102ab0 msgr2=0x7f0b48102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/1894253274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b48102ab0 0x7f0b48102ec0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009900 tx=0x7f0b3402a410 comp rx=0 tx=0).stop 2024-05-27T09:59:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 -- 172.21.15.71:0/1894253274 shutdown_connections 2024-05-27T09:59:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/1894253274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b4810d340 0x7f0b4810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/1894253274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b48102ab0 0x7f0b48102ec0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/1894253274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b481089e0 0x7f0b48102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 -- 172.21.15.71:0/1894253274 >> 172.21.15.71:0/1894253274 conn(0x7f0b480fe210 msgr2=0x7f0b48100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 -- 172.21.15.71:0/1894253274 shutdown_connections 2024-05-27T09:59:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.797+0000 7f0b4dc00640 1 -- 172.21.15.71:0/1894253274 wait complete. 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.798+0000 7f0b4dc00640 1 Processor -- start 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.798+0000 7f0b4dc00640 1 -- start start 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b4dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b48102ab0 0x7f0b4819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b4dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b481089e0 0x7f0b4819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b4dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b4810d340 0x7f0b4819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b4dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b48112bf0 con 0x7f0b4810d340 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b4dc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0b48112a70 con 0x7f0b48102ab0 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b4dc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0b48112d70 con 0x7f0b481089e0 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b4d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b4810d340 0x7f0b4819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b47400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b481089e0 0x7f0b4819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b47e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b48102ab0 0x7f0b4819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b47e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b48102ab0 0x7f0b4819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:33120/0 (socket says 172.21.15.71:33120) 2024-05-27T09:59:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b47e00640 1 -- 172.21.15.71:0/4098592627 learned_addr learned my addr 172.21.15.71:0/4098592627 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.799+0000 7f0b47400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b481089e0 0x7f0b4819acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34626/0 (socket says 172.21.15.71:34626) 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b47e00640 1 -- 172.21.15.71:0/4098592627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b481089e0 msgr2=0x7f0b4819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b47e00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b481089e0 0x7f0b4819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b47e00640 1 -- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b4810d340 msgr2=0x7f0b4819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b47e00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b4810d340 0x7f0b4819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b47e00640 1 -- 172.21.15.71:0/4098592627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4819f5c0 con 0x7f0b48102ab0 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b47e00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b48102ab0 0x7f0b4819a760 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800e9c0 tx=0x7f0b3800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b44c00640 1 -- 172.21.15.71:0/4098592627 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800cd80 con 0x7f0b48102ab0 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.800+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4819f8b0 con 0x7f0b48102ab0 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.801+0000 7f0b44c00640 1 -- 172.21.15.71:0/4098592627 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b380054d0 con 0x7f0b48102ab0 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.801+0000 7f0b44c00640 1 -- 172.21.15.71:0/4098592627 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38010430 con 0x7f0b48102ab0 2024-05-27T09:59:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.801+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b481a7230 con 0x7f0b48102ab0 2024-05-27T09:59:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.804+0000 7f0b5622f740 1 Processor -- start 2024-05-27T09:59:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b5622f740 1 -- start start 2024-05-27T09:59:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c52930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c52e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c533b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b5622f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dad9bc3b90 con 0x55dad988f4d0 2024-05-27T09:59:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b5622f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55dad9bb3730 con 0x55dad98872f0 2024-05-27T09:59:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b5622f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dad9bb7770 con 0x55dad98b01b0 2024-05-27T09:59:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b47400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b4d200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c52930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b47400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39286/0 (socket says 172.21.15.71:39286) 2024-05-27T09:59:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.805+0000 7f0b47400640 1 -- 172.21.15.71:0/2861125403 learned_addr learned my addr 172.21.15.71:0/2861125403 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b44c00640 1 -- 172.21.15.71:0/4098592627 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0b38005020 con 0x7f0b48102ab0 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b4d200640 1 -- 172.21.15.71:0/2861125403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 msgr2=0x55dad9c52e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b4d200640 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c52e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b4d200640 1 -- 172.21.15.71:0/2861125403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 msgr2=0x55dad9c533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b4d200640 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b4d200640 1 -- 172.21.15.71:0/2861125403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad9b4c8b0 con 0x55dad98b01b0 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b47400640 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.806+0000 7f0b4d200640 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c52930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009f00 tx=0x7f0b40011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a693a17fb4b63b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.807+0000 7f0b3d600640 1 -- 172.21.15.71:0/2861125403 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40004d20 con 0x55dad98b01b0 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.807+0000 7f0b3d600640 1 -- 172.21.15.71:0/2861125403 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b40004050 con 0x55dad98b01b0 2024-05-27T09:59:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.807+0000 7f0b3d600640 1 -- 172.21.15.71:0/2861125403 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40005280 con 0x55dad98b01b0 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b44c00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0b2c0b2950 0x7f0b2c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 -- 172.21.15.71:0/2861125403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 msgr2=0x55dad9c52930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c52930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009f00 tx=0x7f0b40011810 comp rx=0 tx=0).stop 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 -- 172.21.15.71:0/2861125403 shutdown_connections 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c52e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2861125403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c52930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 -- 172.21.15.71:0/2861125403 >> 172.21.15.71:0/2861125403 conn(0x55dad98a4300 msgr2=0x55dad9c4f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b44c00640 1 -- 172.21.15.71:0/4098592627 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f0b380e2a20 con 0x7f0b48102ab0 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b47e00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0b2c0b2950 0x7f0b2c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 -- 172.21.15.71:0/2861125403 shutdown_connections 2024-05-27T09:59:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.808+0000 7f0b5622f740 1 -- 172.21.15.71:0/2861125403 wait complete. 2024-05-27T09:59:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.809+0000 7f0b47e00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0b2c0b2950 0x7f0b2c0b4e60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55dad9c502c0 tx=0x7f0b380a9b90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.809+0000 7f0b5622f740 1 -- start start 2024-05-27T09:59:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.809+0000 7f0b5622f740 1 Processor -- start 2024-05-27T09:59:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c61060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad988f4d0 0x55dad9c615a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c6d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b5622f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dad9899790 con 0x55dad98872f0 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b5622f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55dad9b5bbc0 con 0x55dad988f4d0 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b5622f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dad9c64050 con 0x55dad98b01b0 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b5622f740 10 client.0 _ll_register_callbacks cb 0x55dad9b39400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b4d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c61060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b47400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad988f4d0 0x55dad9c615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b4d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c61060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39290/0 (socket says 172.21.15.71:39290) 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b4d200640 1 -- 172.21.15.71:0/4191432820 learned_addr learned my addr 172.21.15.71:0/4191432820 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.810+0000 7f0b4d200640 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c6d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b47400640 1 -- 172.21.15.71:0/4191432820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 msgr2=0x55dad9c6d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b47400640 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c6d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b47400640 1 -- 172.21.15.71:0/4191432820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 msgr2=0x55dad9c61060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b47400640 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c61060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b47400640 1 -- 172.21.15.71:0/4191432820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad98c8210 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b47400640 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad988f4d0 0x55dad9c615a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005ab0 tx=0x7f0b340043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b233b710f9a361e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b32000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b32000640 1 -- 172.21.15.71:0/4191432820 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34035040 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.811+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b40004050 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b32000640 1 -- 172.21.15.71:0/4191432820 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f0b34005450 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b32000640 1 -- 172.21.15.71:0/4191432820 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0b34005650 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 10 client.27053 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dad9994620 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b32000640 1 -- 172.21.15.71:0/4191432820 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b40004050 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b32000640 1 -- 172.21.15.71:0/4191432820 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f0b340039b0 con 0x55dad988f4d0 2024-05-27T09:59:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 10 client.27053 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 10 client.27053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 20 client.27053 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad986ed80 0x55dad9c732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 4 client.27053 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.812+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dad9bc5ae0 con 0x55dad986ed80 2024-05-27T09:59:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.813+0000 7f0b4d200640 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad986ed80 0x55dad9c732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.813+0000 7f0b4d200640 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad986ed80 0x55dad9c732c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c123d1802892659a server_cookie=af9ef5539b7f65f8 in_seq=0 out_seq=0 2024-05-27T09:59:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.813+0000 7f0b32000640 10 client.27053 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.814+0000 7f0b32000640 1 -- 172.21.15.71:0/4191432820 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55dad9bc5ae0 con 0x55dad986ed80 2024-05-27T09:59:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.814+0000 7f0b32000640 10 client.27053 handle_command_reply: tid=0 2024-05-27T09:59:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.814+0000 7f0b5622f740 1 client.27053 shutdown 2024-05-27T09:59:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad988f4d0 msgr2=0x55dad9c615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad988f4d0 0x55dad9c615a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005ab0 tx=0x7f0b340043b0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 shutdown_connections 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c6d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad988f4d0 0x55dad9c615a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad986ed80 0x55dad9c732c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 --2- 172.21.15.71:0/4191432820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c61060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 >> 172.21.15.71:0/4191432820 conn(0x55dad98a4300 msgr2=0x55dad9c527f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b32000640 0 client.27053 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 shutdown_connections 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 1 -- 172.21.15.71:0/4191432820 wait complete. 2024-05-27T09:59:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.815+0000 7f0b5622f740 20 client.27053 trim_cache size 0 max 16384 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 Processor -- start 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 -- start start 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c6d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c6d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c61000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b481afed0 con 0x55dad988f4d0 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0b481ad7a0 con 0x55dad98872f0 2024-05-27T09:59:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b5622f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0b481ab630 con 0x55dad98b01b0 2024-05-27T09:59:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b47400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c6d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b4d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c6d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b47400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c6d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39304/0 (socket says 172.21.15.71:39304) 2024-05-27T09:59:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.833+0000 7f0b47400640 1 -- 172.21.15.71:0/2894105403 learned_addr learned my addr 172.21.15.71:0/2894105403 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b4d200640 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c61000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b47400640 1 -- 172.21.15.71:0/2894105403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 msgr2=0x55dad9c61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b47400640 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c61000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b47400640 1 -- 172.21.15.71:0/2894105403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 msgr2=0x55dad9c6d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b47400640 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c6d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b47400640 1 -- 172.21.15.71:0/2894105403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad9c5f5b0 con 0x55dad988f4d0 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b4d200640 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c6d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.834+0000 7f0b47400640 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c6d630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b34031440 tx=0x7f0b34004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad820142ae3c23e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --set-id 34ee7f79 --release --await' 2024-05-27T09:59:17.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --set-id 34ee7f79 --release --await 2024-05-27T09:59:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.835+0000 7f0b3cc00640 1 -- 172.21.15.71:0/2894105403 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34035030 con 0x55dad988f4d0 2024-05-27T09:59:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.835+0000 7f0b3cc00640 1 -- 172.21.15.71:0/2894105403 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b34041070 con 0x55dad988f4d0 2024-05-27T09:59:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.835+0000 7f0b3cc00640 1 -- 172.21.15.71:0/2894105403 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34031af0 con 0x55dad988f4d0 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 -- 172.21.15.71:0/2894105403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 msgr2=0x55dad9c6d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c6d630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b34031440 tx=0x7f0b34004420 comp rx=0 tx=0).stop 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 -- 172.21.15.71:0/2894105403 shutdown_connections 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad98b01b0 0x55dad9c61000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad988f4d0 0x55dad9c6d630 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 --2- 172.21.15.71:0/2894105403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98872f0 0x55dad9c6d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 -- 172.21.15.71:0/2894105403 >> 172.21.15.71:0/2894105403 conn(0x55dad98a4300 msgr2=0x55dad9c608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 -- 172.21.15.71:0/2894105403 shutdown_connections 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 -- 172.21.15.71:0/2894105403 wait complete. 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.836+0000 7f0b5622f740 1 -- start start 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 1 Processor -- start 2024-05-27T09:59:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad988f4d0 0x55dad9c647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98b01b0 0x55dad9c64d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b481abc80 con 0x55dad98872f0 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0b481ad0d0 con 0x55dad98b01b0 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0b481ac330 con 0x55dad988f4d0 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b5622f740 10 client.0 _ll_register_callbacks cb 0x7f0b34009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.837+0000 7f0b4d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39320/0 (socket says 172.21.15.71:39320) 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 -- 172.21.15.71:0/404892890 learned_addr learned my addr 172.21.15.71:0/404892890 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b47400640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad988f4d0 0x55dad9c647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98b01b0 0x55dad9c64d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 -- 172.21.15.71:0/404892890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad988f4d0 msgr2=0x55dad9c647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad988f4d0 0x55dad9c647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 -- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98b01b0 msgr2=0x55dad9c64d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98b01b0 0x55dad9c64d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 -- 172.21.15.71:0/404892890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad9cd99c0 con 0x55dad98872f0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b47400640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad988f4d0 0x55dad9c647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b4d200640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c642a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009f00 tx=0x7f0b40013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc21551bf04eaff server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.838+0000 7f0b32000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b32000640 1 -- 172.21.15.71:0/404892890 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40003bb0 con 0x55dad98872f0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b32000640 1 -- 172.21.15.71:0/404892890 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f0b4001f040 con 0x55dad98872f0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b34041070 con 0x55dad98872f0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b32000640 1 -- 172.21.15.71:0/404892890 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0b40003d50 con 0x55dad98872f0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 10 client.16893 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dad9cdabf0 con 0x55dad98872f0 2024-05-27T09:59:17.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b32000640 1 -- 172.21.15.71:0/404892890 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b34041070 con 0x55dad98872f0 2024-05-27T09:59:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b32000640 1 -- 172.21.15.71:0/404892890 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f0b40005370 con 0x55dad98872f0 2024-05-27T09:59:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 10 client.16893 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 10 client.16893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 20 client.16893 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad98441c0 0x55dad9cdd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 4 client.16893 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:59:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.839+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dad9bbf2c0 con 0x55dad98441c0 2024-05-27T09:59:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.840+0000 7f0b47400640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad98441c0 0x55dad9cdd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.841+0000 7f0b47400640 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad98441c0 0x55dad9cdd250 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64bc2ff56b1927a server_cookie=a16a4be28d9189bc in_seq=0 out_seq=0 2024-05-27T09:59:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.841+0000 7f0b32000640 10 client.16893 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.857+0000 7f0b32000640 1 -- 172.21.15.71:0/404892890 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55dad9bbf2c0 con 0x55dad98441c0 2024-05-27T09:59:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.857+0000 7f0b32000640 10 client.16893 handle_command_reply: tid=0 2024-05-27T09:59:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.857+0000 7f0b5622f740 1 client.16893 shutdown 2024-05-27T09:59:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.857+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 msgr2=0x55dad9c642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.857+0000 7f0b5622f740 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c642a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009f00 tx=0x7f0b40013040 comp rx=0 tx=0).stop 2024-05-27T09:59:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 shutdown_connections 2024-05-27T09:59:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55dad98b01b0 0x55dad9c64d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dad988f4d0 0x55dad9c647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55dad98441c0 0x55dad9cdd250 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 --2- 172.21.15.71:0/404892890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dad98872f0 0x55dad9c642a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 >> 172.21.15.71:0/404892890 conn(0x55dad98a4300 msgr2=0x55dad9c61320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b32000640 0 client.16893 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 shutdown_connections 2024-05-27T09:59:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 1 -- 172.21.15.71:0/404892890 wait complete. 2024-05-27T09:59:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.858+0000 7f0b5622f740 20 client.16893 trim_cache size 0 max 16384 2024-05-27T09:59:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:59:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:59:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.859+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0b2c0b2950 msgr2=0x7f0b2c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.859+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0b2c0b2950 0x7f0b2c0b4e60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55dad9c502c0 tx=0x7f0b380a9b90 comp rx=0 tx=0).stop 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.859+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b48102ab0 msgr2=0x7f0b4819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.859+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b48102ab0 0x7f0b4819a760 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800e9c0 tx=0x7f0b3800ee80 comp rx=0 tx=0).stop 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.859+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 shutdown_connections 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.859+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0b2c0b2950 0x7f0b2c0b4e60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.860+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b4810d340 0x7f0b4819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.860+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b481089e0 0x7f0b4819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.860+0000 7f0b4dc00640 1 --2- 172.21.15.71:0/4098592627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b48102ab0 0x7f0b4819a760 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.860+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 >> 172.21.15.71:0/4098592627 conn(0x7f0b480fe210 msgr2=0x7f0b481009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.860+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 shutdown_connections 2024-05-27T09:59:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:17.860+0000 7f0b4dc00640 1 -- 172.21.15.71:0/4098592627 wait complete. 2024-05-27T09:59:18.259 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:18.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:18 smithi071 ceph-mon[31451]: pgmap v360: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 718 KiB/s wr, 234 op/s 2024-05-27T09:59:18.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:18 smithi122 ceph-mon[36436]: pgmap v360: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 718 KiB/s wr, 234 op/s 2024-05-27T09:59:18.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:18 smithi072 ceph-mon[35951]: pgmap v360: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 718 KiB/s wr, 234 op/s 2024-05-27T09:59:20.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:19 smithi122 ceph-mon[36436]: pgmap v361: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 718 KiB/s wr, 234 op/s 2024-05-27T09:59:20.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:19 smithi071 ceph-mon[31451]: pgmap v361: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 718 KiB/s wr, 234 op/s 2024-05-27T09:59:20.279 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:19 smithi072 ceph-mon[35951]: pgmap v361: 97 pgs: 97 active+clean; 142 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 718 KiB/s wr, 234 op/s 2024-05-27T09:59:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 -- 172.21.15.71:0/1039668077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810af30 msgr2=0x7f5bf810b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 --2- 172.21.15.71:0/1039668077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810af30 0x7f5bf810b340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009990 tx=0x7f5be4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 -- 172.21.15.71:0/1039668077 shutdown_connections 2024-05-27T09:59:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 --2- 172.21.15.71:0/1039668077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bf810b880 0x7f5bf81131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 --2- 172.21.15.71:0/1039668077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 0x7f5bf8106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 --2- 172.21.15.71:0/1039668077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810af30 0x7f5bf810b340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 -- 172.21.15.71:0/1039668077 >> 172.21.15.71:0/1039668077 conn(0x7f5bf8101e70 msgr2=0x7f5bf81042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:20.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 -- 172.21.15.71:0/1039668077 shutdown_connections 2024-05-27T09:59:20.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.507+0000 7f5bfca00700 1 -- 172.21.15.71:0/1039668077 wait complete. 2024-05-27T09:59:20.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.509+0000 7f5bfca00700 1 Processor -- start 2024-05-27T09:59:20.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.509+0000 7f5bfca00700 1 -- start start 2024-05-27T09:59:20.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bfca00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 0x7f5bf819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bfca00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bf810af30 0x7f5bf819d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bfca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810b880 0x7f5bf81a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bfca00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8116490 con 0x7f5bf8106600 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bfca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8116310 con 0x7f5bf810b880 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bfca00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8116610 con 0x7f5bf810af30 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 0x7f5bf819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 0x7f5bf819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39344/0 (socket says 172.21.15.71:39344) 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bf7400700 1 -- 172.21.15.71:0/2165175403 learned_addr learned my addr 172.21.15.71:0/2165175403 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810b880 0x7f5bf81a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.510+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bf810af30 0x7f5bf819d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5bf7400700 1 -- 172.21.15.71:0/2165175403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bf810af30 msgr2=0x7f5bf819d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5bf7400700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bf810af30 0x7f5bf819d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5bf7400700 1 -- 172.21.15.71:0/2165175403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810b880 msgr2=0x7f5bf81a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5bf7400700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810b880 0x7f5bf81a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5bf7400700 1 -- 172.21.15.71:0/2165175403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf81a1cd0 con 0x7f5bf8106600 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5bf7400700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 0x7f5bf819ce00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5be800eb30 tx=0x7f5be800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5befe00700 1 -- 172.21.15.71:0/2165175403 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be800cbd0 con 0x7f5bf8106600 2024-05-27T09:59:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5befe00700 1 -- 172.21.15.71:0/2165175403 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5be80044d0 con 0x7f5bf8106600 2024-05-27T09:59:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.511+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf81a1fc0 con 0x7f5bf8106600 2024-05-27T09:59:20.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.512+0000 7f5befe00700 1 -- 172.21.15.71:0/2165175403 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8003e30 con 0x7f5bf8106600 2024-05-27T09:59:20.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.512+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a98e0 con 0x7f5bf8106600 2024-05-27T09:59:20.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.515+0000 7f5befe00700 1 -- 172.21.15.71:0/2165175403 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5be8004000 con 0x7f5bf8106600 2024-05-27T09:59:20.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 Processor -- start 2024-05-27T09:59:20.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 -- start start 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5befe00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5bdc0b29f0 0x7f5bdc0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2900af0 0x5578f2993c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f2994180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f29a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5578f28c1f40 con 0x5578f2900af0 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5578f28b1ae0 con 0x5578f2814f40 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5578f28b5b20 con 0x5578f299e840 2024-05-27T09:59:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.517+0000 7f5befe00700 1 -- 172.21.15.71:0/2165175403 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f5be80e2a10 con 0x7f5bf8106600 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2900af0 0x5578f2993c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2900af0 0x5578f2993c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39348/0 (socket says 172.21.15.71:39348) 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 -- 172.21.15.71:0/323706503 learned_addr learned my addr 172.21.15.71:0/323706503 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f2994180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5bdc0b29f0 0x7f5bdc0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f29a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 -- 172.21.15.71:0/323706503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 msgr2=0x5578f29a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f29a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 -- 172.21.15.71:0/323706503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 msgr2=0x5578f2994180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f2994180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7400700 1 -- 172.21.15.71:0/323706503 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f287a520 con 0x5578f2900af0 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.518+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f29a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.519+0000 7f5bf7400700 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2900af0 0x5578f2993c40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c5b0 tx=0x7f5be80a5bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30fd97cbee34e88 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.519+0000 7f5becc00700 1 -- 172.21.15.71:0/323706503 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be80a9400 con 0x5578f2900af0 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.519+0000 7f5becc00700 1 -- 172.21.15.71:0/323706503 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5be80b2440 con 0x5578f2900af0 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.519+0000 7f5becc00700 1 -- 172.21.15.71:0/323706503 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be80a5420 con 0x5578f2900af0 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.519+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5bdc0b29f0 0x7f5bdc0b4f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009ec0 tx=0x7f5bf0009920 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/323706503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2900af0 msgr2=0x5578f2993c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2900af0 0x5578f2993c40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c5b0 tx=0x7f5be80a5bd0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/323706503 shutdown_connections 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f29a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2900af0 0x5578f2993c40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/323706503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f2994180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/323706503 >> 172.21.15.71:0/323706503 conn(0x5578f28ae490 msgr2=0x5578f298fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/323706503 shutdown_connections 2024-05-27T09:59:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.520+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/323706503 wait complete. 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.521+0000 7f5c0cb24b80 1 -- start start 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.521+0000 7f5c0cb24b80 1 Processor -- start 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f299b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2900af0 0x5578f299bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f299c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5578f27b80a0 con 0x5578f2814f40 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5578f2852860 con 0x5578f2900af0 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5578f29a1350 con 0x5578f299e840 2024-05-27T09:59:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5c0cb24b80 10 client.0 _ll_register_callbacks cb 0x5578f285bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f299b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5bf6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2900af0 0x5578f299bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5bf6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2900af0 0x5578f299bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:33202/0 (socket says 172.21.15.71:33202) 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f299b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39354/0 (socket says 172.21.15.71:39354) 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5bf6a00700 1 -- 172.21.15.71:0/347597419 learned_addr learned my addr 172.21.15.71:0/347597419 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.522+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f299c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5bf6a00700 1 -- 172.21.15.71:0/347597419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 msgr2=0x5578f299c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f299c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5bf6a00700 1 -- 172.21.15.71:0/347597419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 msgr2=0x5578f299b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f299b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5bf6a00700 1 -- 172.21.15.71:0/347597419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f28019d0 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2900af0 0x5578f299bd90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5bf806cfd0 tx=0x7f5be4005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f4a8c5d9161c375 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5be1600700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5be1600700 1 -- 172.21.15.71:0/347597419 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be400bdd0 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be80b2440 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.523+0000 7f5be1600700 1 -- 172.21.15.71:0/347597419 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f5be4003680 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5be1600700 1 -- 172.21.15.71:0/347597419 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5be4031050 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 10 client.27071 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5578f2882160 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5be1600700 1 -- 172.21.15.71:0/347597419 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5be80b2440 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5be1600700 1 -- 172.21.15.71:0/347597419 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f5be4023960 con 0x5578f2900af0 2024-05-27T09:59:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 10 client.27071 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 10 client.27071 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 20 client.27071 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f29ae1d0 0x5578f29b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 4 client.27071 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.524+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578f28c3e90 con 0x5578f29ae1d0 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.525+0000 7f5bf7400700 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f29ae1d0 0x5578f29b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.525+0000 7f5bf7400700 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f29ae1d0 0x5578f29b06a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=265e41fbd3036fda server_cookie=8b59faf65371093d in_seq=0 out_seq=0 2024-05-27T09:59:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.525+0000 7f5be1600700 10 client.27071 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.526+0000 7f5be1600700 1 -- 172.21.15.71:0/347597419 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5578f28c3e90 con 0x5578f29ae1d0 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.526+0000 7f5be1600700 10 client.27071 handle_command_reply: tid=0 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.526+0000 7f5c0cb24b80 1 client.27071 shutdown 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.526+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2900af0 msgr2=0x5578f299bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.526+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2900af0 0x5578f299bd90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5bf806cfd0 tx=0x7f5be4005800 comp rx=0 tx=0).stop 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 shutdown_connections 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f29ae1d0 0x5578f29b06a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f299e840 0x5578f299c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f299b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/347597419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2900af0 0x5578f299bd90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 >> 172.21.15.71:0/347597419 conn(0x5578f28ae490 msgr2=0x5578f2993c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5be1600700 0 client.27071 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 shutdown_connections 2024-05-27T09:59:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/347597419 wait complete. 2024-05-27T09:59:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.527+0000 7f5c0cb24b80 20 client.27071 trim_cache size 0 max 16384 2024-05-27T09:59:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.549+0000 7f5c0cb24b80 1 Processor -- start 2024-05-27T09:59:20.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.549+0000 7f5c0cb24b80 1 -- start start 2024-05-27T09:59:20.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f28ae490 0x5578f299c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f299fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81b3660 con 0x5578f28ae490 2024-05-27T09:59:20.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81b0ef0 con 0x5578f2814f40 2024-05-27T09:59:20.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81aed60 con 0x5578f2900af0 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f28ae490 0x5578f299c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f28ae490 0x5578f299c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39370/0 (socket says 172.21.15.71:39370) 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf7400700 1 -- 172.21.15.71:0/2844466406 learned_addr learned my addr 172.21.15.71:0/2844466406 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f299fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf6a00700 1 -- 172.21.15.71:0/2844466406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 msgr2=0x5578f29a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf6a00700 1 -- 172.21.15.71:0/2844466406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f28ae490 msgr2=0x5578f299c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f28ae490 0x5578f299c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.550+0000 7f5bf6a00700 1 -- 172.21.15.71:0/2844466406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f298b940 con 0x5578f2814f40 2024-05-27T09:59:20.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.551+0000 7f5bf7400700 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f28ae490 0x5578f299c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:20.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.551+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f299fc60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5be40098e0 tx=0x7f5be4024fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531863ac000f2f8d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:20.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.551+0000 7f5be3e00700 1 -- 172.21.15.71:0/2844466406 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be400bcd0 con 0x5578f2814f40 2024-05-27T09:59:20.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.551+0000 7f5be3e00700 1 -- 172.21.15.71:0/2844466406 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5be4028070 con 0x5578f2814f40 2024-05-27T09:59:20.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.551+0000 7f5be3e00700 1 -- 172.21.15.71:0/2844466406 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be40238e0 con 0x5578f2814f40 2024-05-27T09:59:20.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/2844466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 msgr2=0x5578f299fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f299fc60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5be40098e0 tx=0x7f5be4024fd0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/2844466406 shutdown_connections 2024-05-27T09:59:20.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f28ae490 0x5578f299c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/2844466406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f2814f40 0x5578f299fc60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/2844466406 >> 172.21.15.71:0/2844466406 conn(0x5578f2994350 msgr2=0x5578f299a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/2844466406 shutdown_connections 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.552+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/2844466406 wait complete. 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.553+0000 7f5c0cb24b80 1 -- start start 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.553+0000 7f5c0cb24b80 1 Processor -- start 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.553+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f29a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.553+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f28ae490 0x5578f29a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.553+0000 7f5c0cb24b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.553+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81af3b0 con 0x5578f2814f40 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.553+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81b0820 con 0x5578f28ae490 2024-05-27T09:59:20.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5c0cb24b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81afa80 con 0x5578f2900af0 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5c0cb24b80 10 client.0 _ll_register_callbacks cb 0x5578f285bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f29a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f29a68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39382/0 (socket says 172.21.15.71:39382) 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 -- 172.21.15.71:0/3532495204 learned_addr learned my addr 172.21.15.71:0/3532495204 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f28ae490 0x5578f29a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 -- 172.21.15.71:0/3532495204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 msgr2=0x5578f29a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 -- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f28ae490 msgr2=0x5578f29a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:20.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f28ae490 0x5578f29a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7400700 1 -- 172.21.15.71:0/3532495204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f29a1eb0 con 0x5578f2814f40 2024-05-27T09:59:20.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.554+0000 7f5bf7e00700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:20.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5bf7400700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f29a68d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5be80a9c20 tx=0x7f5be80b2580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68865a03f6e7c49e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:20.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5be1600700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:59:20.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5be1600700 1 -- 172.21.15.71:0/3532495204 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be801e4f0 con 0x5578f2814f40 2024-05-27T09:59:20.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5be1600700 1 -- 172.21.15.71:0/3532495204 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f5be80a9ef0 con 0x5578f2814f40 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be4028070 con 0x5578f2814f40 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5be1600700 1 -- 172.21.15.71:0/3532495204 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5be80c4360 con 0x5578f2814f40 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5c0cb24b80 10 client.16911 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5578f2a22110 con 0x5578f2814f40 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.555+0000 7f5be1600700 1 -- 172.21.15.71:0/3532495204 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5be4028070 con 0x5578f2814f40 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5be1600700 1 -- 172.21.15.71:0/3532495204 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f5be80b2660 con 0x5578f2814f40 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5c0cb24b80 10 client.16911 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5c0cb24b80 10 client.16911 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5c0cb24b80 20 client.16911 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:20.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f299e840 0x5578f2a242f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:20.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5c0cb24b80 4 client.16911 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "34ee7f79", "release": true, "await": true}] 2024-05-27T09:59:20.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "set_id": "34ee7f79", "release": true, "await": true}) -- 0x5578f28bd670 con 0x5578f299e840 2024-05-27T09:59:20.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.556+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f299e840 0x5578f2a242f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:20.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.557+0000 7f5bf6a00700 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f299e840 0x5578f2a242f0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c317b4f58a361c server_cookie=65e728f53ec8e697 in_seq=0 out_seq=0 2024-05-27T09:59:20.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.557+0000 7f5be1600700 10 client.16911 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:20.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.771+0000 7f5be1600700 1 -- 172.21.15.71:0/3532495204 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5578f28bd670 con 0x5578f299e840 2024-05-27T09:59:20.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.771+0000 7f5be1600700 10 client.16911 handle_command_reply: tid=0 2024-05-27T09:59:20.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.771+0000 7f5c0cb24b80 1 client.16911 shutdown 2024-05-27T09:59:20.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.772+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 msgr2=0x5578f29a68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.772+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f29a68d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5be80a9c20 tx=0x7f5be80b2580 comp rx=0 tx=0).stop 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.773+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 shutdown_connections 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.773+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5578f299e840 0x5578f2a242f0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.773+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578f2900af0 0x5578f29a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.773+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5578f2814f40 0x5578f29a68d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.773+0000 7f5c0cb24b80 1 --2- 172.21.15.71:0/3532495204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5578f28ae490 0x5578f29a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.773+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 >> 172.21.15.71:0/3532495204 conn(0x5578f2994350 msgr2=0x5578f299c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.773+0000 7f5be1600700 0 client.16911 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:20.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.774+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 shutdown_connections 2024-05-27T09:59:20.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.774+0000 7f5c0cb24b80 1 -- 172.21.15.71:0/3532495204 wait complete. 2024-05-27T09:59:20.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.775+0000 7f5c0cb24b80 20 client.16911 trim_cache size 0 max 16384 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 32, 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 36, 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "34ee7f79": { 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 36, 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:59:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 130.0, 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RELEASED", 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:20.780 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:59:20.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5bdc0b29f0 msgr2=0x7f5bdc0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5bdc0b29f0 0x7f5bdc0b4f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009ec0 tx=0x7f5bf0009920 comp rx=0 tx=0).stop 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 msgr2=0x7f5bf819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 0x7f5bf819ce00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5be800eb30 tx=0x7f5be800ee40 comp rx=0 tx=0).stop 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 shutdown_connections 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5bdc0b29f0 0x7f5bdc0b4f00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf810b880 0x7f5bf81a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bf8106600 0x7f5bf819ce00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 --2- 172.21.15.71:0/2165175403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bf810af30 0x7f5bf819d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.777+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 >> 172.21.15.71:0/2165175403 conn(0x7f5bf8101e70 msgr2=0x7f5bf8102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.778+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 shutdown_connections 2024-05-27T09:59:20.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:20.778+0000 7f5bfca00700 1 -- 172.21.15.71:0/2165175403 wait complete. 2024-05-27T09:59:21.685 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '34ee7f79', total seconds elapsed: 17.7 2024-05-27T09:59:22.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:21 smithi122 ceph-mon[36436]: pgmap v362: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 735 KiB/s wr, 242 op/s 2024-05-27T09:59:22.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:21 smithi071 ceph-mon[31451]: pgmap v362: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 735 KiB/s wr, 242 op/s 2024-05-27T09:59:22.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:21 smithi072 ceph-mon[35951]: pgmap v362: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 735 KiB/s wr, 242 op/s 2024-05-27T09:59:24.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:23 smithi122 ceph-mon[36436]: pgmap v363: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-05-27T09:59:24.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:23 smithi071 ceph-mon[31451]: pgmap v363: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-05-27T09:59:24.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:23 smithi072 ceph-mon[35951]: pgmap v363: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-05-27T09:59:25.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:25 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:59:25.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:25 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:59:25.528 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:25 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T09:59:26.038 INFO:tasks.workunit.client.0.smithi071.stdout:All 50000 operations completed A-OK! 2024-05-27T09:59:26.068 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-27T09:59:26.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-27T09:59:26.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:26 smithi122 ceph-mon[36436]: pgmap v364: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-05-27T09:59:26.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:26 smithi071 ceph-mon[31451]: pgmap v364: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-05-27T09:59:26.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:26 smithi072 ceph-mon[35951]: pgmap v364: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-05-27T09:59:27.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:27 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:59:27.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:27 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:59:27.480 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:27 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:59:27.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:27 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:59:27.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:27 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:59:27.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:27 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:59:27.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:27 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T09:59:27.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:27 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T09:59:27.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:27 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T09:59:28.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:28 smithi122 ceph-mon[36436]: pgmap v365: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 617 KiB/s wr, 192 op/s 2024-05-27T09:59:28.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:28 smithi071 ceph-mon[31451]: pgmap v365: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 617 KiB/s wr, 192 op/s 2024-05-27T09:59:28.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:28 smithi072 ceph-mon[35951]: pgmap v365: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 617 KiB/s wr, 192 op/s 2024-05-27T09:59:30.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:29 smithi122 ceph-mon[36436]: pgmap v366: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 614 KiB/s wr, 189 op/s 2024-05-27T09:59:30.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:29 smithi071 ceph-mon[31451]: pgmap v366: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 614 KiB/s wr, 189 op/s 2024-05-27T09:59:30.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:29 smithi072 ceph-mon[35951]: pgmap v366: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 614 KiB/s wr, 189 op/s 2024-05-27T09:59:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 -- 172.21.15.71:0/2037870410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 msgr2=0x7f380c11b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 --2- 172.21.15.71:0/2037870410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 0x7f380c11b1b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3804009ca0 tx=0x7f380402a940 comp rx=0 tx=0).stop 2024-05-27T09:59:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 -- 172.21.15.71:0/2037870410 shutdown_connections 2024-05-27T09:59:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 --2- 172.21.15.71:0/2037870410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 0x7f380c11b1b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 --2- 172.21.15.71:0/2037870410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c116430 0x7f380c118850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 --2- 172.21.15.71:0/2037870410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f380c10b0f0 0x7f380c10b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 -- 172.21.15.71:0/2037870410 >> 172.21.15.71:0/2037870410 conn(0x7f380c06f1b0 msgr2=0x7f380c06f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 -- 172.21.15.71:0/2037870410 shutdown_connections 2024-05-27T09:59:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.112+0000 7f3811a00640 1 -- 172.21.15.71:0/2037870410 wait complete. 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.113+0000 7f3811a00640 1 Processor -- start 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.113+0000 7f3811a00640 1 -- start start 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f3811a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c10b0f0 0x7f380c1a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f3811a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f380c116430 0x7f380c1a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f3811a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 0x7f380c1a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f3811a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f380c11e860 con 0x7f380c116430 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f3811a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f380c11e6e0 con 0x7f380c118d90 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f3811a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f380c11e9e0 con 0x7f380c10b0f0 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c10b0f0 0x7f380c1a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c10b0f0 0x7f380c1a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:60856/0 (socket says 172.21.15.71:60856) 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 -- 172.21.15.71:0/3018706236 learned_addr learned my addr 172.21.15.71:0/3018706236 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380b400640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 0x7f380c1a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380a000640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f380c116430 0x7f380c1a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 -- 172.21.15.71:0/3018706236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 msgr2=0x7f380c1a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 0x7f380c1a9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 -- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f380c116430 msgr2=0x7f380c1a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f380c116430 0x7f380c1a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380aa00640 1 -- 172.21.15.71:0/3018706236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c1aa0c0 con 0x7f380c10b0f0 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.114+0000 7f380b400640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 0x7f380c1a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.115+0000 7f380aa00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c10b0f0 0x7f380c1a5260 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00ea60 tx=0x7f37fc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.115+0000 7f3803400640 1 -- 172.21.15.71:0/3018706236 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00cde0 con 0x7f380c10b0f0 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.115+0000 7f3803400640 1 -- 172.21.15.71:0/3018706236 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37fc0035f0 con 0x7f380c10b0f0 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.115+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380c1aa3b0 con 0x7f380c10b0f0 2024-05-27T09:59:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.115+0000 7f3803400640 1 -- 172.21.15.71:0/3018706236 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc010690 con 0x7f380c10b0f0 2024-05-27T09:59:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.115+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380c1b1d30 con 0x7f380c10b0f0 2024-05-27T09:59:31.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 Processor -- start 2024-05-27T09:59:31.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 -- start start 2024-05-27T09:59:31.120 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3803400640 1 -- 172.21.15.71:0/3018706236 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f37fc0037a0 con 0x7f380c10b0f0 2024-05-27T09:59:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7c98860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c98da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78d54d0 0x562ef7c992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ef7c09b90 con 0x562ef78d54d0 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562ef7bf9730 con 0x562ef78f61b0 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f3818a2b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ef7bfd770 con 0x562ef78cd2f0 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f380b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7c98860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f380b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7c98860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49730/0 (socket says 172.21.15.71:49730) 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.120+0000 7f380b400640 1 -- 172.21.15.71:0/166030213 learned_addr learned my addr 172.21.15.71:0/166030213 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380a000640 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78d54d0 0x562ef7c992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380aa00640 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c98da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.123 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380b400640 1 -- 172.21.15.71:0/166030213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 msgr2=0x562ef7c98da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380b400640 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c98da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380b400640 1 -- 172.21.15.71:0/166030213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78d54d0 msgr2=0x562ef7c992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380b400640 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78d54d0 0x562ef7c992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380b400640 1 -- 172.21.15.71:0/166030213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef7b928b0 con 0x562ef78f61b0 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380aa00640 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c98da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.121+0000 7f380b400640 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7c98860 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3804009ca0 tx=0x7f3804009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2030891e2432a0fd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.122+0000 7f37f7e00640 1 -- 172.21.15.71:0/166030213 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804034040 con 0x562ef78f61b0 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.122+0000 7f37f7e00640 1 -- 172.21.15.71:0/166030213 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3804003e20 con 0x562ef78f61b0 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.122+0000 7f37f7e00640 1 -- 172.21.15.71:0/166030213 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38040308a0 con 0x562ef78f61b0 2024-05-27T09:59:31.124 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.122+0000 7f3803400640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37f00b2950 0x7f37f00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.125 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.122+0000 7f3803400640 1 -- 172.21.15.71:0/3018706236 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f37fc0e2900 con 0x7f380c10b0f0 2024-05-27T09:59:31.125 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.122+0000 7f380aa00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37f00b2950 0x7f37f00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 -- 172.21.15.71:0/166030213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 msgr2=0x562ef7c98860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7c98860 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3804009ca0 tx=0x7f3804009990 comp rx=0 tx=0).stop 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f380aa00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37f00b2950 0x7f37f00b4e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x562ef7c96350 tx=0x7f37fc00ef90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 -- 172.21.15.71:0/166030213 shutdown_connections 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78d54d0 0x562ef7c992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c98da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 --2- 172.21.15.71:0/166030213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7c98860 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 -- 172.21.15.71:0/166030213 >> 172.21.15.71:0/166030213 conn(0x562ef78ea300 msgr2=0x562ef7c95010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 -- 172.21.15.71:0/166030213 shutdown_connections 2024-05-27T09:59:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 -- 172.21.15.71:0/166030213 wait complete. 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.123+0000 7f3818a2b740 1 -- start start 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 1 Processor -- start 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7ca2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78d54d0 0x562ef7ca2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7caec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ef78df790 con 0x562ef78cd2f0 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562ef7ba1bc0 con 0x562ef78f61b0 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ef7ca5930 con 0x562ef78d54d0 2024-05-27T09:59:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.124+0000 7f3818a2b740 10 client.0 _ll_register_callbacks cb 0x562ef7b7f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7ca2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7ca2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46372/0 (socket says 172.21.15.71:46372) 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 -- 172.21.15.71:0/3672971423 learned_addr learned my addr 172.21.15.71:0/3672971423 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380a000640 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78d54d0 0x562ef7ca2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7caec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 -- 172.21.15.71:0/3672971423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78d54d0 msgr2=0x562ef7ca2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78d54d0 0x562ef7ca2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 -- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 msgr2=0x562ef7caec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7caec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 -- 172.21.15.71:0/3672971423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef790e210 con 0x562ef78cd2f0 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f380b400640 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7ca2a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f380402fcb0 tx=0x7f380402fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c75dd7f8a6baacb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f37f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.125+0000 7f37f4c00640 1 -- 172.21.15.71:0/3672971423 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804034040 con 0x562ef78cd2f0 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f37f4c00640 1 -- 172.21.15.71:0/3672971423 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f38040308d0 con 0x562ef78cd2f0 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3804003e20 con 0x562ef78cd2f0 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f37f4c00640 1 -- 172.21.15.71:0/3672971423 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3804049040 con 0x562ef78cd2f0 2024-05-27T09:59:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 10 client.16923 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562ef79da620 con 0x562ef78cd2f0 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f37f4c00640 1 -- 172.21.15.71:0/3672971423 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3804003e20 con 0x562ef78cd2f0 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f37f4c00640 1 -- 172.21.15.71:0/3672971423 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f380402f070 con 0x562ef78cd2f0 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 10 client.16923 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 20 client.16923 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef78b4d80 0x562ef7cb4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 4 client.16923 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.126+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ef7c0bae0 con 0x562ef78b4d80 2024-05-27T09:59:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.127+0000 7f380a000640 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef78b4d80 0x562ef7cb4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.127+0000 7f380a000640 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef78b4d80 0x562ef7cb4a50 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de5d64ba11af16b server_cookie=56641c9ab394f505 in_seq=0 out_seq=0 2024-05-27T09:59:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.127+0000 7f37f4c00640 10 client.16923 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.129+0000 7f37f4c00640 1 -- 172.21.15.71:0/3672971423 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x562ef7c0bae0 con 0x562ef78b4d80 2024-05-27T09:59:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.129+0000 7f37f4c00640 10 client.16923 handle_command_reply: tid=0 2024-05-27T09:59:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.129+0000 7f3818a2b740 1 client.16923 shutdown 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 msgr2=0x562ef7ca2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7ca2a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f380402fcb0 tx=0x7f380402fdb0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 shutdown_connections 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78f61b0 0x562ef7caec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78d54d0 0x562ef7ca2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef78b4d80 0x562ef7cb4a50 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3672971423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7ca2a10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 >> 172.21.15.71:0/3672971423 conn(0x562ef78ea300 msgr2=0x562ef7c98690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f37f4c00640 0 client.16923 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 shutdown_connections 2024-05-27T09:59:31.137 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 1 -- 172.21.15.71:0/3672971423 wait complete. 2024-05-27T09:59:31.137 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.130+0000 7f3818a2b740 20 client.16923 trim_cache size 0 max 16384 2024-05-27T09:59:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 Processor -- start 2024-05-27T09:59:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 -- start start 2024-05-27T09:59:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c94330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7ca4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78f61b0 0x562ef7caebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1bce50 con 0x562ef78f61b0 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1ba720 con 0x562ef78d54d0 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.148+0000 7f3818a2b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1b8590 con 0x562ef78cd2f0 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7ca4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c94330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7ca4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49740/0 (socket says 172.21.15.71:49740) 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 -- 172.21.15.71:0/3149592696 learned_addr learned my addr 172.21.15.71:0/3149592696 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380b400640 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78f61b0 0x562ef7caebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 -- 172.21.15.71:0/3149592696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 msgr2=0x562ef7c94330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c94330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 -- 172.21.15.71:0/3149592696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78f61b0 msgr2=0x562ef7caebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78f61b0 0x562ef7caebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 -- 172.21.15.71:0/3149592696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef7c8f050 con 0x562ef78d54d0 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f380a000640 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7ca4840 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x562ef7c8f020 tx=0x7f37f8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfa93e19a1ed87d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.149+0000 7f37f7400640 1 -- 172.21.15.71:0/3149592696 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8005220 con 0x562ef78d54d0 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f37f7400640 1 -- 172.21.15.71:0/3149592696 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f8004c50 con 0x562ef78d54d0 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f37f7400640 1 -- 172.21.15.71:0/3149592696 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f801e9f0 con 0x562ef78d54d0 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f3818a2b740 1 -- 172.21.15.71:0/3149592696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 msgr2=0x562ef7ca4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7ca4840 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x562ef7c8f020 tx=0x7f37f8005f90 comp rx=0 tx=0).stop 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f3818a2b740 1 -- 172.21.15.71:0/3149592696 shutdown_connections 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78f61b0 0x562ef7caebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7ca4840 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.150+0000 7f3818a2b740 1 --2- 172.21.15.71:0/3149592696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78cd2f0 0x562ef7c94330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.151+0000 7f3818a2b740 1 -- 172.21.15.71:0/3149592696 >> 172.21.15.71:0/3149592696 conn(0x562ef78ea300 msgr2=0x562ef7ca4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.151+0000 7f3818a2b740 1 -- 172.21.15.71:0/3149592696 shutdown_connections 2024-05-27T09:59:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.151+0000 7f3818a2b740 1 -- 172.21.15.71:0/3149592696 wait complete. 2024-05-27T09:59:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.151+0000 7f3818a2b740 1 -- start start 2024-05-27T09:59:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.151+0000 7f3818a2b740 1 Processor -- start 2024-05-27T09:59:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7cb7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7cb82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f3818a2b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78f61b0 0x562ef7cb51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f3818a2b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1b8be0 con 0x562ef78cd2f0 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f3818a2b740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1ba050 con 0x562ef78d54d0 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f3818a2b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1b92b0 con 0x562ef78f61b0 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f3818a2b740 10 client.0 _ll_register_callbacks cb 0x7f37f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f380a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7cb82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f380a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7cb82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49752/0 (socket says 172.21.15.71:49752) 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f380a000640 1 -- 172.21.15.71:0/912385703 learned_addr learned my addr 172.21.15.71:0/912385703 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f380b400640 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7cb7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f380a000640 1 -- 172.21.15.71:0/912385703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78f61b0 msgr2=0x562ef7cb51e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T09:59:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.152+0000 7f380a000640 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78f61b0 0x562ef7cb51e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f380a000640 1 -- 172.21.15.71:0/912385703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 msgr2=0x562ef7cb7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f380a000640 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7cb7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f380a000640 1 -- 172.21.15.71:0/912385703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef7cb5950 con 0x562ef78d54d0 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f380a000640 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7cb82c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f37f801e630 tx=0x7f37f8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d78a31ea05811c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f37f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f37f4c00640 1 -- 172.21.15.71:0/912385703 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f801e970 con 0x562ef78d54d0 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f37f4c00640 1 -- 172.21.15.71:0/912385703 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f37f801eb10 con 0x562ef78d54d0 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37f8004c50 con 0x562ef78d54d0 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f37f4c00640 1 -- 172.21.15.71:0/912385703 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f37f801ed10 con 0x562ef78d54d0 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f3818a2b740 10 client.27095 fetch_fsmap learned FSMap version 32 2024-05-27T09:59:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.153+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562ef7d1c990 con 0x562ef78d54d0 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f37f4c00640 1 -- 172.21.15.71:0/912385703 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f8004c50 con 0x562ef78d54d0 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f37f4c00640 1 -- 172.21.15.71:0/912385703 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) ==== 8338+0+0 (secure 0 0 0) 0x7f37f8030070 con 0x562ef78d54d0 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f3818a2b740 10 client.27095 fetch_fsmap finished waiting for FSMap version 32 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f3818a2b740 10 client.27095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f3818a2b740 20 client.27095 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f3818a2b740 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef788a1c0 0x562ef7d1f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f3818a2b740 4 client.27095 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ef7c052c0 con 0x562ef788a1c0 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.154+0000 7f380b400640 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef788a1c0 0x562ef7d1f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.155+0000 7f37f4c00640 10 client.27095 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.155+0000 7f380b400640 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef788a1c0 0x562ef7d1f080 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70cd69f6b89b80b4 server_cookie=1397ca54566a0fad in_seq=0 out_seq=0 2024-05-27T09:59:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.593+0000 7f37f4c00640 1 -- 172.21.15.71:0/912385703 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562ef7c052c0 con 0x562ef788a1c0 2024-05-27T09:59:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.593+0000 7f37f4c00640 10 client.27095 handle_command_reply: tid=0 2024-05-27T09:59:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.593+0000 7f3818a2b740 1 client.27095 shutdown 2024-05-27T09:59:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 msgr2=0x562ef7cb82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7cb82c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f37f801e630 tx=0x7f37f8004750 comp rx=0 tx=0).stop 2024-05-27T09:59:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 shutdown_connections 2024-05-27T09:59:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef78f61b0 0x562ef7cb51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562ef78d54d0 0x562ef7cb82c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x562ef788a1c0 0x562ef7d1f080 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 --2- 172.21.15.71:0/912385703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef78cd2f0 0x562ef7cb7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 >> 172.21.15.71:0/912385703 conn(0x562ef78ea300 msgr2=0x562ef7ca4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f37f4c00640 0 client.27095 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 shutdown_connections 2024-05-27T09:59:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.594+0000 7f3818a2b740 1 -- 172.21.15.71:0/912385703 wait complete. 2024-05-27T09:59:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.595+0000 7f3818a2b740 20 client.27095 trim_cache size 0 max 16384 2024-05-27T09:59:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:59:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:59:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:59:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.597+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37f00b2950 msgr2=0x7f37f00b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.597+0000 7f3811a00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37f00b2950 0x7f37f00b4e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x562ef7c96350 tx=0x7f37fc00ef90 comp rx=0 tx=0).stop 2024-05-27T09:59:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.597+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c10b0f0 msgr2=0x7f380c1a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.597+0000 7f3811a00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c10b0f0 0x7f380c1a5260 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00ea60 tx=0x7f37fc00ef20 comp rx=0 tx=0).stop 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 shutdown_connections 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f37f00b2950 0x7f37f00b4e60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c118d90 0x7f380c1a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f380c116430 0x7f380c1a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 --2- 172.21.15.71:0/3018706236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c10b0f0 0x7f380c1a5260 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 >> 172.21.15.71:0/3018706236 conn(0x7f380c06f1b0 msgr2=0x7f380c10c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 shutdown_connections 2024-05-27T09:59:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:31.598+0000 7f3811a00640 1 -- 172.21.15.71:0/3018706236 wait complete. 2024-05-27T09:59:32.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:31 smithi122 ceph-mon[36436]: pgmap v367: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 438 op/s 2024-05-27T09:59:32.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:31 smithi071 ceph-mon[31451]: pgmap v367: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 438 op/s 2024-05-27T09:59:32.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:31 smithi072 ceph-mon[35951]: pgmap v367: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 438 op/s 2024-05-27T09:59:34.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:33 smithi122 ceph-mon[36436]: pgmap v368: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-05-27T09:59:34.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:33 smithi071 ceph-mon[31451]: pgmap v368: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-05-27T09:59:34.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:33 smithi072 ceph-mon[35951]: pgmap v368: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-05-27T09:59:36.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:35 smithi122 ceph-mon[36436]: pgmap v369: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-05-27T09:59:36.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:35 smithi071 ceph-mon[31451]: pgmap v369: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-05-27T09:59:36.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:35 smithi072 ceph-mon[35951]: pgmap v369: 97 pgs: 97 active+clean; 144 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-05-27T09:59:38.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:37 smithi122 ceph-mon[36436]: pgmap v370: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.3 MiB/s wr, 526 op/s 2024-05-27T09:59:38.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:37 smithi071 ceph-mon[31451]: pgmap v370: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.3 MiB/s wr, 526 op/s 2024-05-27T09:59:38.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:37 smithi072 ceph-mon[35951]: pgmap v370: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.3 MiB/s wr, 526 op/s 2024-05-27T09:59:40.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:39 smithi122 ceph-mon[36436]: pgmap v371: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 370 op/s 2024-05-27T09:59:40.257 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-27T09:59:40.257 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.5 2024-05-27T09:59:40.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:59:40.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:39 smithi071 ceph-mon[31451]: pgmap v371: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 370 op/s 2024-05-27T09:59:40.275 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:39 smithi072 ceph-mon[35951]: pgmap v371: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 370 op/s 2024-05-27T09:59:40.741 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:41.140 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-05-27T09:59:41.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-27T09:59:42.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:41 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:59:42.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:41 smithi122 ceph-mon[36436]: pgmap v372: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 527 op/s 2024-05-27T09:59:42.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:41 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:59:42.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:41 smithi071 ceph-mon[31451]: pgmap v372: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 527 op/s 2024-05-27T09:59:42.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:41 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:59:42.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:41 smithi072 ceph-mon[35951]: pgmap v372: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 527 op/s 2024-05-27T09:59:42.334 DEBUG:teuthology.parallel:result is None 2024-05-27T09:59:42.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-27T09:59:42.416 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-27T09:59:42.416 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-27T09:59:42.437 INFO:tasks.quiescer:joining Quiescers 2024-05-27T09:59:42.437 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-27T09:59:42.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T09:59:43.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:42 smithi071 ceph-mon[31451]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:59:43.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:42 smithi122 ceph-mon[36436]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:59:43.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:42 smithi072 ceph-mon[35951]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-27T09:59:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:43.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 -- 172.21.15.71:0/1488800749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf00764a0 msgr2=0x7f7cf0114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:43.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/1488800749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf00764a0 0x7f7cf0114e20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0098f0 tx=0x7f7cdc009c00 comp rx=0 tx=0).stop 2024-05-27T09:59:43.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 -- 172.21.15.71:0/1488800749 shutdown_connections 2024-05-27T09:59:43.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/1488800749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf0115360 0x7f7cf0117780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/1488800749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf0075b50 0x7f7cf0075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/1488800749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf00764a0 0x7f7cf0114e20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 -- 172.21.15.71:0/1488800749 >> 172.21.15.71:0/1488800749 conn(0x7f7cf0100030 msgr2=0x7f7cf0102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:43.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 -- 172.21.15.71:0/1488800749 shutdown_connections 2024-05-27T09:59:43.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.401+0000 7f7cf5e00700 1 -- 172.21.15.71:0/1488800749 wait complete. 2024-05-27T09:59:43.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.403+0000 7f7cf5e00700 1 Processor -- start 2024-05-27T09:59:43.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.403+0000 7f7cf5e00700 1 -- start start 2024-05-27T09:59:43.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.403+0000 7f7cf5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf0075b50 0x7f7cf00753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:43.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.403+0000 7f7cf5e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf00764a0 0x7f7cf006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:43.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7cf5e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf0115360 0x7f7cf006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:43.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7cf5e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf011aad0 con 0x7f7cf0115360 2024-05-27T09:59:43.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7cf5e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf011a950 con 0x7f7cf0075b50 2024-05-27T09:59:43.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7cf5e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf011ac50 con 0x7f7cf00764a0 2024-05-27T09:59:43.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf0075b50 0x7f7cf00753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:43.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf0075b50 0x7f7cf00753b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:60510/0 (socket says 172.21.15.71:60510) 2024-05-27T09:59:43.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 -- 172.21.15.71:0/2359482933 learned_addr learned my addr 172.21.15.71:0/2359482933 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:43.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7cee000700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf00764a0 0x7f7cf006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:43.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7cef400700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf0115360 0x7f7cf006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:43.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 -- 172.21.15.71:0/2359482933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf00764a0 msgr2=0x7f7cf006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:43.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf00764a0 0x7f7cf006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 -- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf0115360 msgr2=0x7f7cf006eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:43.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf0115360 0x7f7cf006eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7ceea00700 1 -- 172.21.15.71:0/2359482933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0072ee0 con 0x7f7cf0075b50 2024-05-27T09:59:43.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.404+0000 7f7cee000700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf00764a0 0x7f7cf006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:43.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.405+0000 7f7ceea00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf0075b50 0x7f7cf00753b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000e9c0 tx=0x7f7ce000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:43.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.405+0000 7f7cf4a00700 1 -- 172.21.15.71:0/2359482933 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000cbd0 con 0x7f7cf0075b50 2024-05-27T09:59:43.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.405+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf00731d0 con 0x7f7cf0075b50 2024-05-27T09:59:43.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.405+0000 7f7cf4a00700 1 -- 172.21.15.71:0/2359482933 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ce000cd70 con 0x7f7cf0075b50 2024-05-27T09:59:43.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.405+0000 7f7cf4a00700 1 -- 172.21.15.71:0/2359482933 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0010430 con 0x7f7cf0075b50 2024-05-27T09:59:43.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.405+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf00736c0 con 0x7f7cf0075b50 2024-05-27T09:59:43.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.406+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf0077290 con 0x7f7cf0075b50 2024-05-27T09:59:43.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.411+0000 7f7cf4a00700 1 -- 172.21.15.71:0/2359482933 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f7ce0004750 con 0x7f7cf0075b50 2024-05-27T09:59:43.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.413+0000 7f7cf4a00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7cd40b29f0 0x7f7cd40b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:43.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.413+0000 7f7cf4a00700 1 -- 172.21.15.71:0/2359482933 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f7ce00e2c10 con 0x7f7cf0075b50 2024-05-27T09:59:43.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.413+0000 7f7cee000700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7cd40b29f0 0x7f7cd40b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:43.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.413+0000 7f7cf4a00700 1 -- 172.21.15.71:0/2359482933 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7ce00aa5f0 con 0x7f7cf0075b50 2024-05-27T09:59:43.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.414+0000 7f7cee000700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7cd40b29f0 0x7f7cd40b4f00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0103630 tx=0x7f7cdc019040 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:43.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.713+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cf006fa10 con 0x7f7cf0075b50 2024-05-27T09:59:43.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.714+0000 7f7cf4a00700 1 -- 172.21.15.71:0/2359482933 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11857 (secure 0 0 0) 0x7f7ce00a9ef0 con 0x7f7cf0075b50 2024-05-27T09:59:43.715 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:59:43.715 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:59:41.465301+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:59:43.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7cd40b29f0 msgr2=0x7f7cd40b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:43.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7cd40b29f0 0x7f7cd40b4f00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0103630 tx=0x7f7cdc019040 comp rx=0 tx=0).stop 2024-05-27T09:59:43.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf0075b50 msgr2=0x7f7cf00753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:43.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf0075b50 0x7f7cf00753b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000e9c0 tx=0x7f7ce000ed80 comp rx=0 tx=0).stop 2024-05-27T09:59:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 shutdown_connections 2024-05-27T09:59:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7cd40b29f0 0x7f7cd40b4f00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf0115360 0x7f7cf006eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cf0075b50 0x7f7cf00753b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.717+0000 7f7cf5e00700 1 --2- 172.21.15.71:0/2359482933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf00764a0 0x7f7cf006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.718+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 >> 172.21.15.71:0/2359482933 conn(0x7f7cf0100030 msgr2=0x7f7cf0100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.718+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 shutdown_connections 2024-05-27T09:59:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:43.718+0000 7f7cf5e00700 1 -- 172.21.15.71:0/2359482933 wait complete. 2024-05-27T09:59:43.721 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 34 2024-05-27T09:59:44.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:43 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2359482933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:44.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:43 smithi122 ceph-mon[36436]: pgmap v373: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 278 op/s 2024-05-27T09:59:44.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:43 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2359482933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:44.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:43 smithi071 ceph-mon[31451]: pgmap v373: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 278 op/s 2024-05-27T09:59:44.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:43 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2359482933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:44.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:43 smithi072 ceph-mon[35951]: pgmap v373: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 278 op/s 2024-05-27T09:59:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 -- 172.21.15.71:0/1116745455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e54111740 msgr2=0x7f7e54118ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1116745455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e54111740 0x7f7e54118ee0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009be0 tx=0x7f7e4c02a6c0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 -- 172.21.15.71:0/1116745455 shutdown_connections 2024-05-27T09:59:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1116745455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e54111740 0x7f7e54118ee0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1116745455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e54110c80 0x7f7e541110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1116745455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e5406c020 0x7f7e5406c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 -- 172.21.15.71:0/1116745455 >> 172.21.15.71:0/1116745455 conn(0x7f7e5406eb10 msgr2=0x7f7e54070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 -- 172.21.15.71:0/1116745455 shutdown_connections 2024-05-27T09:59:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.833+0000 7f7e59a00640 1 -- 172.21.15.71:0/1116745455 wait complete. 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.834+0000 7f7e59a00640 1 Processor -- start 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.834+0000 7f7e59a00640 1 -- start start 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e59a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e5406c020 0x7f7e541a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e59a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e54110c80 0x7f7e541a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e59a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e54111740 0x7f7e541a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e59a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5411c670 con 0x7f7e54111740 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e59a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5411c4f0 con 0x7f7e5406c020 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e59a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5411c7f0 con 0x7f7e54110c80 2024-05-27T09:59:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e52a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e5406c020 0x7f7e541a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e52a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e5406c020 0x7f7e541a5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32820/0 (socket says 172.21.15.71:32820) 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e52a00640 1 -- 172.21.15.71:0/1624233187 learned_addr learned my addr 172.21.15.71:0/1624233187 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e53400640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e54111740 0x7f7e541a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.835+0000 7f7e52000640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e54110c80 0x7f7e541a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e52a00640 1 -- 172.21.15.71:0/1624233187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e54110c80 msgr2=0x7f7e541a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e52a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e54110c80 0x7f7e541a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e52a00640 1 -- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e54111740 msgr2=0x7f7e541a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e52a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e54111740 0x7f7e541a9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e52a00640 1 -- 172.21.15.71:0/1624233187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e541aa090 con 0x7f7e5406c020 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e52a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e5406c020 0x7f7e541a5230 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400e9f0 tx=0x7f7e4400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e4b400640 1 -- 172.21.15.71:0/1624233187 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4400ccc0 con 0x7f7e5406c020 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e4b400640 1 -- 172.21.15.71:0/1624233187 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e440054d0 con 0x7f7e5406c020 2024-05-27T09:59:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e541aa380 con 0x7f7e5406c020 2024-05-27T09:59:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e4b400640 1 -- 172.21.15.71:0/1624233187 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44010430 con 0x7f7e5406c020 2024-05-27T09:59:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.836+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e541aa880 con 0x7f7e5406c020 2024-05-27T09:59:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 Processor -- start 2024-05-27T09:59:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 -- start start 2024-05-27T09:59:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e4b400640 1 -- 172.21.15.71:0/1624233187 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f7e440046c0 con 0x7f7e5406c020 2024-05-27T09:59:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91fd1b0 0x5576d959f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d959fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91dc4d0 0x5576d95a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576d9510b90 con 0x5576d91dc4d0 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5576d9500730 con 0x5576d91fd1b0 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.840+0000 7f7e60993740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5576d9504770 con 0x5576d91d42f0 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91fd1b0 0x5576d959f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91fd1b0 0x5576d959f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32828/0 (socket says 172.21.15.71:32828) 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 -- 172.21.15.71:0/1866175116 learned_addr learned my addr 172.21.15.71:0/1866175116 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e52000640 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91dc4d0 0x5576d95a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e52a00640 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d959fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 -- 172.21.15.71:0/1866175116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 msgr2=0x5576d959fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d959fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 -- 172.21.15.71:0/1866175116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91dc4d0 msgr2=0x5576d95a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91dc4d0 0x5576d95a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e53400640 1 -- 172.21.15.71:0/1866175116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d94998b0 con 0x5576d91fd1b0 2024-05-27T09:59:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.841+0000 7f7e52000640 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91dc4d0 0x5576d95a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.842+0000 7f7e53400640 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91fd1b0 0x5576d959f860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009be0 tx=0x7f7e4c030420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9d4dd45c4c5e61b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.842+0000 7f7e3fe00640 1 -- 172.21.15.71:0/1866175116 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c041030 con 0x5576d91fd1b0 2024-05-27T09:59:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.842+0000 7f7e3fe00640 1 -- 172.21.15.71:0/1866175116 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4c003e20 con 0x5576d91fd1b0 2024-05-27T09:59:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.842+0000 7f7e3fe00640 1 -- 172.21.15.71:0/1866175116 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c036040 con 0x5576d91fd1b0 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.842+0000 7f7e4b400640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7e380b2950 0x7f7e380b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.842+0000 7f7e4b400640 1 -- 172.21.15.71:0/1624233187 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f7e440e2940 con 0x7f7e5406c020 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e52a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7e380b2950 0x7f7e380b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 -- 172.21.15.71:0/1866175116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91fd1b0 msgr2=0x5576d959f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91fd1b0 0x5576d959f860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009be0 tx=0x7f7e4c030420 comp rx=0 tx=0).stop 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 -- 172.21.15.71:0/1866175116 shutdown_connections 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91dc4d0 0x5576d95a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d959fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 --2- 172.21.15.71:0/1866175116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91fd1b0 0x5576d959f860 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 -- 172.21.15.71:0/1866175116 >> 172.21.15.71:0/1866175116 conn(0x5576d91f1300 msgr2=0x5576d959c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 -- 172.21.15.71:0/1866175116 shutdown_connections 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e60993740 1 -- 172.21.15.71:0/1866175116 wait complete. 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.843+0000 7f7e52a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7e380b2950 0x7f7e380b4e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e440e0140 tx=0x7f7e440e5f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 -- start start 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 Processor -- start 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576d91e6790 con 0x5576d91fd1b0 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5576d94a8bc0 con 0x5576d91d42f0 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5576d95ac930 con 0x5576d91dc4d0 2024-05-27T09:59:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.844+0000 7f7e60993740 10 client.0 _ll_register_callbacks cb 0x5576d9486400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e52000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32838/0 (socket says 172.21.15.71:32838) 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 -- 172.21.15.71:0/3287190899 learned_addr learned my addr 172.21.15.71:0/3287190899 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 -- 172.21.15.71:0/3287190899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 msgr2=0x5576d95a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 -- 172.21.15.71:0/3287190899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 msgr2=0x5576d95b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 -- 172.21.15.71:0/3287190899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d9215210 con 0x5576d91d42f0 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e52000640 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e53400640 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95a9a40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c02acb0 tx=0x7f7e4c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a743a62ff7adc96 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.845+0000 7f7e3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e3cc00640 1 -- 172.21.15.71:0/3287190899 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c041030 con 0x5576d91d42f0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e4c003e20 con 0x5576d91d42f0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e3cc00640 1 -- 172.21.15.71:0/3287190899 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f7e4c042070 con 0x5576d91d42f0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e3cc00640 1 -- 172.21.15.71:0/3287190899 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7e4c057050 con 0x5576d91d42f0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e60993740 10 client.27113 fetch_fsmap learned FSMap version 34 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5576d92e1620 con 0x5576d91d42f0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e3cc00640 1 -- 172.21.15.71:0/3287190899 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4c003e20 con 0x5576d91d42f0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.846+0000 7f7e3cc00640 1 -- 172.21.15.71:0/3287190899 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7e4c004660 con 0x5576d91d42f0 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e60993740 10 client.27113 fetch_fsmap finished waiting for FSMap version 34 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e60993740 10 client.27113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e60993740 20 client.27113 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e60993740 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91bbd80 0x5576d95bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e60993740 4 client.27113 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576d9512ae0 con 0x5576d91bbd80 2024-05-27T09:59:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e52000640 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91bbd80 0x5576d95bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e52000640 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91bbd80 0x5576d95bba80 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ce9fe7d38df3f18 server_cookie=292c9344363f0b30 in_seq=0 out_seq=0 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.847+0000 7f7e3cc00640 10 client.27113 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.848+0000 7f7e3cc00640 1 -- 172.21.15.71:0/3287190899 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5576d9512ae0 con 0x5576d91bbd80 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.848+0000 7f7e3cc00640 10 client.27113 handle_command_reply: tid=0 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.848+0000 7f7e60993740 1 client.27113 shutdown 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.848+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 msgr2=0x5576d95a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.848+0000 7f7e60993740 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95a9a40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c02acb0 tx=0x7f7e4c004ab0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 shutdown_connections 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91bbd80 0x5576d95bba80 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 --2- 172.21.15.71:0/3287190899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95a9a40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e3cc00640 0 client.27113 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 >> 172.21.15.71:0/3287190899 conn(0x5576d91f1300 msgr2=0x5576d959f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 shutdown_connections 2024-05-27T09:59:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 1 -- 172.21.15.71:0/3287190899 wait complete. 2024-05-27T09:59:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.849+0000 7f7e60993740 20 client.27113 trim_cache size 0 max 16384 2024-05-27T09:59:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.865+0000 7f7e60993740 1 Processor -- start 2024-05-27T09:59:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.865+0000 7f7e60993740 1 -- start start 2024-05-27T09:59:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e60993740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d95ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e60993740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91dc4d0 0x5576d95b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e60993740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e60993740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541bcd70 con 0x5576d91fd1b0 2024-05-27T09:59:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e60993740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541ba610 con 0x5576d91dc4d0 2024-05-27T09:59:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e60993740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541b8480 con 0x5576d91d42f0 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e53400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d95ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e53400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d95ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53426/0 (socket says 172.21.15.71:53426) 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e53400640 1 -- 172.21.15.71:0/2766414338 learned_addr learned my addr 172.21.15.71:0/2766414338 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e52000640 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91dc4d0 0x5576d95b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.866+0000 7f7e53400640 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e53400640 1 -- 172.21.15.71:0/2766414338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91dc4d0 msgr2=0x5576d95b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e53400640 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91dc4d0 0x5576d95b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e53400640 1 -- 172.21.15.71:0/2766414338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 msgr2=0x5576d95a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e53400640 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95a6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e53400640 1 -- 172.21.15.71:0/2766414338 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d95a7f90 con 0x5576d91d42f0 2024-05-27T09:59:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e53400640 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d95ac170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0308a0 tx=0x7f7e4c009280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61965ecca7fbb8f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e3f400640 1 -- 172.21.15.71:0/2766414338 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c041040 con 0x5576d91d42f0 2024-05-27T09:59:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e3f400640 1 -- 172.21.15.71:0/2766414338 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4c030420 con 0x5576d91d42f0 2024-05-27T09:59:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.867+0000 7f7e3f400640 1 -- 172.21.15.71:0/2766414338 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c036030 con 0x5576d91d42f0 2024-05-27T09:59:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 -- 172.21.15.71:0/2766414338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 msgr2=0x5576d95ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d95ac170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0308a0 tx=0x7f7e4c009280 comp rx=0 tx=0).stop 2024-05-27T09:59:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 -- 172.21.15.71:0/2766414338 shutdown_connections 2024-05-27T09:59:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d95a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91dc4d0 0x5576d95b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 --2- 172.21.15.71:0/2766414338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91d42f0 0x5576d95ac170 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 -- 172.21.15.71:0/2766414338 >> 172.21.15.71:0/2766414338 conn(0x5576d91f1300 msgr2=0x5576d95a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 -- 172.21.15.71:0/2766414338 shutdown_connections 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.868+0000 7f7e60993740 1 -- 172.21.15.71:0/2766414338 wait complete. 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 -- start start 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 Processor -- start 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95be460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d9621ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541b8ad0 con 0x5576d91fd1b0 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541b9f40 con 0x5576d91d42f0 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541b91a0 con 0x5576d91dc4d0 2024-05-27T09:59:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.869+0000 7f7e60993740 10 client.0 _ll_register_callbacks cb 0x7f7e400097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e53400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d9621ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95be460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53436/0 (socket says 172.21.15.71:53436) 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 -- 172.21.15.71:0/4128824196 learned_addr learned my addr 172.21.15.71:0/4128824196 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e53400640 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 -- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 msgr2=0x5576d95bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 -- 172.21.15.71:0/4128824196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 msgr2=0x5576d9621ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d9621ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 -- 172.21.15.71:0/4128824196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d9622410 con 0x5576d91dc4d0 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e53400640 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d9621ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e52000640 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95be460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7e54071030 tx=0x7f7e40003b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68f9a74998c6abab server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.870+0000 7f7e3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e3cc00640 1 -- 172.21.15.71:0/4128824196 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40010a80 con 0x5576d91dc4d0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e3cc00640 1 -- 172.21.15.71:0/4128824196 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f7e40010c20 con 0x5576d91dc4d0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e4c030420 con 0x5576d91dc4d0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e3cc00640 1 -- 172.21.15.71:0/4128824196 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7e40010e20 con 0x5576d91dc4d0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 10 client.27142 fetch_fsmap learned FSMap version 34 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5576d9623570 con 0x5576d91dc4d0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e3cc00640 1 -- 172.21.15.71:0/4128824196 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4c030420 con 0x5576d91dc4d0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e3cc00640 1 -- 172.21.15.71:0/4128824196 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7e4001d580 con 0x5576d91dc4d0 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 10 client.27142 fetch_fsmap finished waiting for FSMap version 34 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 10 client.27142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 20 client.27142 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91911c0 0x5576d9625d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 4 client.27142 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-27T09:59:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.871+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576d950c2c0 con 0x5576d91911c0 2024-05-27T09:59:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.872+0000 7f7e53400640 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91911c0 0x5576d9625d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.872+0000 7f7e3cc00640 10 client.27142 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:44.872+0000 7f7e53400640 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91911c0 0x5576d9625d10 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c9fd61350c890c server_cookie=5f2ab5425d1ad4f0 in_seq=0 out_seq=0 2024-05-27T09:59:45.033 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.033+0000 7f7e3cc00640 1 -- 172.21.15.71:0/4128824196 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5576d950c2c0 con 0x5576d91911c0 2024-05-27T09:59:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.033+0000 7f7e3cc00640 10 client.27142 handle_command_reply: tid=0 2024-05-27T09:59:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 client.27142 shutdown 2024-05-27T09:59:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 msgr2=0x5576d95be460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95be460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7e54071030 tx=0x7f7e40003b10 comp rx=0 tx=0).stop 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 shutdown_connections 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x5576d91911c0 0x5576d9625d10 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d91fd1b0 0x5576d9621ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576d91dc4d0 0x5576d95be460 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 --2- 172.21.15.71:0/4128824196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5576d91d42f0 0x5576d95bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 >> 172.21.15.71:0/4128824196 conn(0x5576d91f1300 msgr2=0x5576d95a4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.034+0000 7f7e3cc00640 0 client.27142 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.035+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 shutdown_connections 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.035+0000 7f7e60993740 1 -- 172.21.15.71:0/4128824196 wait complete. 2024-05-27T09:59:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.035+0000 7f7e60993740 20 client.27142 trim_cache size 0 max 16384 2024-05-27T09:59:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:{ 2024-05-27T09:59:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout: "return_code": 0 2024-05-27T09:59:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stdout:} 2024-05-27T09:59:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7e380b2950 msgr2=0x7f7e380b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7e380b2950 0x7f7e380b4e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e440e0140 tx=0x7f7e440e5f90 comp rx=0 tx=0).stop 2024-05-27T09:59:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e5406c020 msgr2=0x7f7e541a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e5406c020 0x7f7e541a5230 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400e9f0 tx=0x7f7e4400edf0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 shutdown_connections 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f7e380b2950 0x7f7e380b4e60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e54111740 0x7f7e541a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e54110c80 0x7f7e541a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 --2- 172.21.15.71:0/1624233187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e5406c020 0x7f7e541a5230 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.036+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 >> 172.21.15.71:0/1624233187 conn(0x7f7e5406eb10 msgr2=0x7f7e5406ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.037+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 shutdown_connections 2024-05-27T09:59:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi071.front.sepia.ceph.com.smithi071.stderr:2024-05-27T09:59:45.037+0000 7f7e59a00640 1 -- 172.21.15.71:0/1624233187 wait complete. 2024-05-27T09:59:45.392 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db / --timeout 90 --expiration 142.5 --await-for 45.0' 2024-05-27T09:59:45.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db / --timeout 90 --expiration 142.5 --await-for 45.0 2024-05-27T09:59:45.931 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:46.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:45 smithi071 ceph-mon[31451]: pgmap v374: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 278 op/s 2024-05-27T09:59:46.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:45 smithi122 ceph-mon[36436]: pgmap v374: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 278 op/s 2024-05-27T09:59:46.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:45 smithi072 ceph-mon[35951]: pgmap v374: 97 pgs: 97 active+clean; 163 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 278 op/s 2024-05-27T09:59:46.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2051017203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 msgr2=0x7fa8dc10e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:46.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2051017203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc10e120 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009990 tx=0x7fa8c4009ca0 comp rx=0 tx=0).stop 2024-05-27T09:59:46.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2051017203 shutdown_connections 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2051017203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8dc10e6f0 0x7fa8dc110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2051017203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8dc105280 0x7fa8dc105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2051017203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc10e120 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2051017203 >> 172.21.15.71:0/2051017203 conn(0x7fa8dc078ab0 msgr2=0x7fa8dc078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2051017203 shutdown_connections 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.796+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2051017203 wait complete. 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.797+0000 7fa8dbe00700 1 Processor -- start 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.797+0000 7fa8dbe00700 1 -- start start 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.797+0000 7fa8dbe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8dc105280 0x7fa8dc1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8dbe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc1a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8dbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8dc10e6f0 0x7fa8dc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8dbe00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc1142a0 con 0x7fa8dc105280 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8dbe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc114120 con 0x7fa8dc10e6f0 2024-05-27T09:59:46.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8dbe00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc114420 con 0x7fa8dc105bd0 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8daa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8dc105280 0x7fa8dc1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc1a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc1a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53452/0 (socket says 172.21.15.71:53452) 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 -- 172.21.15.71:0/2027906722 learned_addr learned my addr 172.21.15.71:0/2027906722 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8db400700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8dc10e6f0 0x7fa8dc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 -- 172.21.15.71:0/2027906722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8dc10e6f0 msgr2=0x7fa8dc19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8dc10e6f0 0x7fa8dc19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 -- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8dc105280 msgr2=0x7fa8dc1a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8dc105280 0x7fa8dc1a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8d2000700 1 -- 172.21.15.71:0/2027906722 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc19b270 con 0x7fa8dc105bd0 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.798+0000 7fa8daa00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8dc105280 0x7fa8dc1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.799+0000 7fa8d2000700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc1a0ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4000c00 tx=0x7fa8c40057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.799+0000 7fa8d3e00700 1 -- 172.21.15.71:0/2027906722 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4027070 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.799+0000 7fa8d3e00700 1 -- 172.21.15.71:0/2027906722 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4022470 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.799+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc19b500 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.799+0000 7fa8d3e00700 1 -- 172.21.15.71:0/2027906722 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4017650 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.799+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc1a7760 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.800+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc06bed0 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.803+0000 7fa8d3e00700 1 -- 172.21.15.71:0/2027906722 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fa8c402a070 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.804+0000 7fa8d3e00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8c00b2a70 0x7fa8c00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.805+0000 7fa8d3e00700 1 -- 172.21.15.71:0/2027906722 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7fa8c40e3540 con 0x7fa8dc105bd0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.805+0000 7fa8daa00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8c00b2a70 0x7fa8c00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.805+0000 7fa8daa00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8c00b2a70 0x7fa8c00b4f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc011490 tx=0x7fa8cc009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:46.807+0000 7fa8d3e00700 1 -- 172.21.15.71:0/2027906722 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa8c4013070 con 0x7fa8dc105bd0 2024-05-27T09:59:47.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.091+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8dc19bfe0 con 0x7fa8dc105bd0 2024-05-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.092+0000 7fa8d3e00700 1 -- 172.21.15.71:0/2027906722 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11857 (secure 0 0 0) 0x7fa8c40aaf50 con 0x7fa8dc105bd0 2024-05-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:59:47.093 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:59:41.465301+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.095+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8c00b2a70 msgr2=0x7fa8c00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.095+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8c00b2a70 0x7fa8c00b4f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc011490 tx=0x7fa8cc009260 comp rx=0 tx=0).stop 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 msgr2=0x7fa8dc1a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc1a0ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4000c00 tx=0x7fa8c40057c0 comp rx=0 tx=0).stop 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 shutdown_connections 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa8c00b2a70 0x7fa8c00b4f80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8dc10e6f0 0x7fa8dc19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8dc105280 0x7fa8dc1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 --2- 172.21.15.71:0/2027906722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8dc105bd0 0x7fa8dc1a0ef0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 >> 172.21.15.71:0/2027906722 conn(0x7fa8dc078ab0 msgr2=0x7fa8dc101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 shutdown_connections 2024-05-27T09:59:47.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:47.096+0000 7fa8dbe00700 1 -- 172.21.15.71:0/2027906722 wait complete. 2024-05-27T09:59:47.097 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 34 2024-05-27T09:59:47.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:47 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2027906722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:47.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:47 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2027906722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:47.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:47 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2027906722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T09:59:48.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:48 smithi071 ceph-mon[31451]: pgmap v375: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 366 op/s 2024-05-27T09:59:48.479 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:48 smithi122 ceph-mon[36436]: pgmap v375: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 366 op/s 2024-05-27T09:59:48.526 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:48 smithi072 ceph-mon[35951]: pgmap v375: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 366 op/s 2024-05-27T09:59:48.580 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24530 quiesce db --cancel --all' 2024-05-27T09:59:48.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24530 quiesce db --cancel --all 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 -- 172.21.15.71:0/1056928806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd010e900 msgr2=0x7f3bd0110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 --2- 172.21.15.71:0/1056928806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd010e900 0x7f3bd0110de0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800b0a0 tx=0x7f3bc800b3b0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 -- 172.21.15.71:0/1056928806 shutdown_connections 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 --2- 172.21.15.71:0/1056928806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd010e900 0x7f3bd0110de0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 --2- 172.21.15.71:0/1056928806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bd01054d0 0x7f3bd01058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 --2- 172.21.15.71:0/1056928806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd0105e20 0x7f3bd010e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 -- 172.21.15.71:0/1056928806 >> 172.21.15.71:0/1056928806 conn(0x7f3bd00fedb0 msgr2=0x7f3bd01011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.252+0000 7f3bd8600700 1 -- 172.21.15.71:0/1056928806 shutdown_connections 2024-05-27T09:59:49.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.253+0000 7f3bd8600700 1 -- 172.21.15.71:0/1056928806 wait complete. 2024-05-27T09:59:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 Processor -- start 2024-05-27T09:59:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 -- start start 2024-05-27T09:59:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01054d0 0x7f3bd019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd0105e20 0x7f3bd019d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bd010e900 0x7f3bd01a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0114430 con 0x7f3bd0105e20 2024-05-27T09:59:49.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01142b0 con 0x7f3bd010e900 2024-05-27T09:59:49.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.254+0000 7f3bd8600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01145b0 con 0x7f3bd01054d0 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.255+0000 7f3bd5c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01054d0 0x7f3bd019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.255+0000 7f3bd5200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd0105e20 0x7f3bd019d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.255+0000 7f3bd5c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01054d0 0x7f3bd019cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53462/0 (socket says 172.21.15.71:53462) 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.255+0000 7f3bd5c00700 1 -- 172.21.15.71:0/3186073583 learned_addr learned my addr 172.21.15.71:0/3186073583 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.255+0000 7f3bd6600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bd010e900 0x7f3bd01a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bd5c00700 1 -- 172.21.15.71:0/3186073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bd010e900 msgr2=0x7f3bd01a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bd010e900 0x7f3bd01a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bd5c00700 1 -- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd0105e20 msgr2=0x7f3bd019d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd0105e20 0x7f3bd019d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bd5c00700 1 -- 172.21.15.71:0/3186073583 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01a1e50 con 0x7f3bd01054d0 2024-05-27T09:59:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01054d0 0x7f3bd019cf80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e9a0 tx=0x7f3bc400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bce000700 1 -- 172.21.15.71:0/3186073583 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400cbd0 con 0x7f3bd01054d0 2024-05-27T09:59:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bce000700 1 -- 172.21.15.71:0/3186073583 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc400cd70 con 0x7f3bd01054d0 2024-05-27T09:59:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd01a2140 con 0x7f3bd01054d0 2024-05-27T09:59:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.256+0000 7f3bce000700 1 -- 172.21.15.71:0/3186073583 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4018680 con 0x7f3bd01054d0 2024-05-27T09:59:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.257+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd01a9a60 con 0x7f3bd01054d0 2024-05-27T09:59:49.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.261+0000 7f3bce000700 1 -- 172.21.15.71:0/3186073583 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f3bc4010430 con 0x7f3bd01054d0 2024-05-27T09:59:49.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 Processor -- start 2024-05-27T09:59:49.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 -- start start 2024-05-27T09:59:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5025c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb502b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb4fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f7fb429fd0 con 0x55f7fb37cfd0 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f7fb419b70 con 0x55f7fb468b80 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.262+0000 7f3be721db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f7fb41dbb0 con 0x55f7fb4fc670 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bd6600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bd5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb4fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bd5200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb4fca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53468/0 (socket says 172.21.15.71:53468) 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bd5200700 1 -- 172.21.15.71:0/3770078996 learned_addr learned my addr 172.21.15.71:0/3770078996 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb502b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bce000700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3bb80b2a70 0x7f3bb80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bce000700 1 -- 172.21.15.71:0/3186073583 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f3bc40e2850 con 0x7f3bd01054d0 2024-05-27T09:59:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.263+0000 7f3bd6600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3bb80b2a70 0x7f3bb80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd6600700 1 -- 172.21.15.71:0/3770078996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 msgr2=0x55f7fb4fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd6600700 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb4fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd6600700 1 -- 172.21.15.71:0/3770078996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 msgr2=0x55f7fb502b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd6600700 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb502b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd6600700 1 -- 172.21.15.71:0/3770078996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fb3e25b0 con 0x55f7fb468b80 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd5200700 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb4fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb502b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd6600700 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5025c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009fd0 tx=0x7f3bc800bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cea1eef2982e5a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.264+0000 7f3bd6600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3bb80b2a70 0x7f3bb80b4f80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8025000 tx=0x7f3bc8029000 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.265+0000 7f3bc2a00700 1 -- 172.21.15.71:0/3770078996 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80092e0 con 0x55f7fb468b80 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.265+0000 7f3bc2a00700 1 -- 172.21.15.71:0/3770078996 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc8007a70 con 0x55f7fb468b80 2024-05-27T09:59:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.265+0000 7f3bc2a00700 1 -- 172.21.15.71:0/3770078996 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8005650 con 0x55f7fb468b80 2024-05-27T09:59:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 -- 172.21.15.71:0/3770078996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 msgr2=0x55f7fb5025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5025c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009fd0 tx=0x7f3bc800bc00 comp rx=0 tx=0).stop 2024-05-27T09:59:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 -- 172.21.15.71:0/3770078996 shutdown_connections 2024-05-27T09:59:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb4fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5025c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 --2- 172.21.15.71:0/3770078996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb502b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 -- 172.21.15.71:0/3770078996 >> 172.21.15.71:0/3770078996 conn(0x55f7fb416520 msgr2=0x55f7fb4f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.266+0000 7f3be721db80 1 -- 172.21.15.71:0/3770078996 shutdown_connections 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.267+0000 7f3be721db80 1 -- 172.21.15.71:0/3770078996 wait complete. 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.267+0000 7f3be721db80 1 -- start start 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 1 Processor -- start 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb506430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb506970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb4fc670 0x55f7fb506eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f7fb320130 con 0x55f7fb4fc670 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55f7fb3ba8f0 con 0x55f7fb468b80 2024-05-27T09:59:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f7fb4fd400 con 0x55f7fb37cfd0 2024-05-27T09:59:49.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.268+0000 7f3be721db80 10 client.0 _ll_register_callbacks cb 0x55f7fb3c3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb4fc670 0x55f7fb506eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd5c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb506430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb4fc670 0x55f7fb506eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54074/0 (socket says 172.21.15.71:54074) 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 -- 172.21.15.71:0/920121175 learned_addr learned my addr 172.21.15.71:0/920121175 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd5200700 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb506970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 -- 172.21.15.71:0/920121175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 msgr2=0x55f7fb506430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb506430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 -- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 msgr2=0x55f7fb506970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb506970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 -- 172.21.15.71:0/920121175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fb369a60 con 0x55f7fb4fc670 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bd6600700 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb4fc670 0x55f7fb506eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8005230 tx=0x7f3bc8009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d430436e0891538 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.269+0000 7f3bb7400700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.270+0000 7f3bb7400700 1 -- 172.21.15.71:0/920121175 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8007850 con 0x55f7fb4fc670 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.270+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bc8007a70 con 0x55f7fb4fc670 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.270+0000 7f3bb7400700 1 -- 172.21.15.71:0/920121175 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f3bc8005290 con 0x55f7fb4fc670 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.270+0000 7f3bb7400700 1 -- 172.21.15.71:0/920121175 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3bc8005490 con 0x55f7fb4fc670 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.270+0000 7f3be721db80 10 client.16971 fetch_fsmap learned FSMap version 34 2024-05-27T09:59:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.270+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f7fb3ea1f0 con 0x55f7fb4fc670 2024-05-27T09:59:49.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.270+0000 7f3bb7400700 1 -- 172.21.15.71:0/920121175 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc8007a70 con 0x55f7fb4fc670 2024-05-27T09:59:49.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3bb7400700 1 -- 172.21.15.71:0/920121175 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3bc8011070 con 0x55f7fb4fc670 2024-05-27T09:59:49.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3be721db80 10 client.16971 fetch_fsmap finished waiting for FSMap version 34 2024-05-27T09:59:49.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3be721db80 10 client.16971 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3be721db80 20 client.16971 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3be721db80 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb515fc0 0x55f7fb5183e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3be721db80 4 client.16971 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7fb42bf20 con 0x55f7fb515fc0 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.271+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb515fc0 0x55f7fb5183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.272+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb515fc0 0x55f7fb5183e0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7cb2bb9584ade7 server_cookie=a8ddc4914bb3bf51 in_seq=0 out_seq=0 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.272+0000 7f3bb7400700 10 client.16971 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3bb7400700 1 -- 172.21.15.71:0/920121175 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f7fb42bf20 con 0x55f7fb515fc0 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3bb7400700 10 client.16971 handle_command_reply: tid=0 2024-05-27T09:59:49.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 client.16971 shutdown 2024-05-27T09:59:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb4fc670 msgr2=0x55f7fb506eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb4fc670 0x55f7fb506eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8005230 tx=0x7f3bc8009420 comp rx=0 tx=0).stop 2024-05-27T09:59:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 shutdown_connections 2024-05-27T09:59:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb515fc0 0x55f7fb5183e0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb4fc670 0x55f7fb506eb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb506430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 --2- 172.21.15.71:0/920121175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb506970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 >> 172.21.15.71:0/920121175 conn(0x55f7fb416520 msgr2=0x55f7fb4f6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3bb7400700 0 client.16971 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.273+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 shutdown_connections 2024-05-27T09:59:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.274+0000 7f3be721db80 1 -- 172.21.15.71:0/920121175 wait complete. 2024-05-27T09:59:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.274+0000 7f3be721db80 20 client.16971 trim_cache size 0 max 16384 2024-05-27T09:59:49.281 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T09:59:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 Processor -- start 2024-05-27T09:59:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 -- start start 2024-05-27T09:59:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb5088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb468b80 0x55f7fb4fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb4fc670 0x55f7fb500690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b3930 con 0x55f7fb468b80 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b1190 con 0x55f7fb4fc670 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.303+0000 7f3be721db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01af000 con 0x55f7fb37cfd0 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb468b80 0x55f7fb4fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb468b80 0x55f7fb4fc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54082/0 (socket says 172.21.15.71:54082) 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5200700 1 -- 172.21.15.71:0/1299464474 learned_addr learned my addr 172.21.15.71:0/1299464474 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb5088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd6600700 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb4fc670 0x55f7fb500690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5c00700 1 -- 172.21.15.71:0/1299464474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb4fc670 msgr2=0x55f7fb500690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb4fc670 0x55f7fb500690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5c00700 1 -- 172.21.15.71:0/1299464474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb468b80 msgr2=0x55f7fb4fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb468b80 0x55f7fb4fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd5c00700 1 -- 172.21.15.71:0/1299464474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fb4f39d0 con 0x55f7fb37cfd0 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.304+0000 7f3bd6600700 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb4fc670 0x55f7fb500690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.305+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb5088d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40dff40 tx=0x7f3bc40cc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a64f27a2943d82c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.305+0000 7f3bc2000700 1 -- 172.21.15.71:0/1299464474 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40a5260 con 0x55f7fb37cfd0 2024-05-27T09:59:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.305+0000 7f3bc2000700 1 -- 172.21.15.71:0/1299464474 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc40b2270 con 0x55f7fb37cfd0 2024-05-27T09:59:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.305+0000 7f3bc2000700 1 -- 172.21.15.71:0/1299464474 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40a9f70 con 0x55f7fb37cfd0 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 -- 172.21.15.71:0/1299464474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 msgr2=0x55f7fb5088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb5088d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40dff40 tx=0x7f3bc40cc040 comp rx=0 tx=0).stop 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 -- 172.21.15.71:0/1299464474 shutdown_connections 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb4fc670 0x55f7fb500690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb37cfd0 0x55f7fb5088d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 --2- 172.21.15.71:0/1299464474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb468b80 0x55f7fb4fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 -- 172.21.15.71:0/1299464474 >> 172.21.15.71:0/1299464474 conn(0x55f7fb416520 msgr2=0x55f7fb4fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 -- 172.21.15.71:0/1299464474 shutdown_connections 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.306+0000 7f3be721db80 1 -- 172.21.15.71:0/1299464474 wait complete. 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.307+0000 7f3be721db80 1 -- start start 2024-05-27T09:59:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.307+0000 7f3be721db80 1 Processor -- start 2024-05-27T09:59:49.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.307+0000 7f3be721db80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb51b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.307+0000 7f3be721db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5199e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.307+0000 7f3be721db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb519f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3be721db80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01af650 con 0x55f7fb37cfd0 2024-05-27T09:59:49.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3be721db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b0ac0 con 0x55f7fb468b80 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3be721db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01afd20 con 0x55f7fb4fc670 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3be721db80 10 client.0 _ll_register_callbacks cb 0x55f7fb3c3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb51b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd6600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb519f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5199e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32924/0 (socket says 172.21.15.71:32924) 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 -- 172.21.15.71:0/576668343 learned_addr learned my addr 172.21.15.71:0/576668343 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd6600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb519f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53498/0 (socket says 172.21.15.71:53498) 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 -- 172.21.15.71:0/576668343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 msgr2=0x55f7fb519f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb519f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 -- 172.21.15.71:0/576668343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 msgr2=0x55f7fb51b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb51b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5200700 1 -- 172.21.15.71:0/576668343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fb51a650 con 0x55f7fb468b80 2024-05-27T09:59:49.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.308+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb51b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:49.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.309+0000 7f3bd5200700 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5199e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009d10 tx=0x7f3bbc003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff1a62523df47b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:49.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.309+0000 7f3bb7400700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:49.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.309+0000 7f3bb7400700 1 -- 172.21.15.71:0/576668343 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc004830 con 0x55f7fb468b80 2024-05-27T09:59:49.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.309+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f7fb4ef8a0 con 0x55f7fb468b80 2024-05-27T09:59:49.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.309+0000 7f3bb7400700 1 -- 172.21.15.71:0/576668343 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f3bbc0049d0 con 0x55f7fb468b80 2024-05-27T09:59:49.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.309+0000 7f3bb7400700 1 -- 172.21.15.71:0/576668343 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3bbc004bd0 con 0x55f7fb468b80 2024-05-27T09:59:49.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 10 client.27140 fetch_fsmap learned FSMap version 34 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f7fb581740 con 0x55f7fb468b80 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3bb7400700 1 -- 172.21.15.71:0/576668343 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f7fb4ef8a0 con 0x55f7fb468b80 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3bb7400700 1 -- 172.21.15.71:0/576668343 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3bbc0050e0 con 0x55f7fb468b80 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 10 client.27140 fetch_fsmap finished waiting for FSMap version 34 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 10 client.27140 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 20 client.27140 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb581f70 0x55f7fb584390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 4 client.27140 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.5, "await_for": 45.0}] 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.310+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.5, "await_for": 45.0}) -- 0x55f7fb425700 con 0x55f7fb581f70 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.311+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb581f70 0x55f7fb584390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.311+0000 7f3bb7400700 10 client.27140 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:49.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.311+0000 7f3bd5c00700 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb581f70 0x55f7fb584390 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e48d19c7c4fe46bd server_cookie=ca2b62cea41d9b0e in_seq=0 out_seq=0 2024-05-27T09:59:49.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.316+0000 7f3bb7400700 1 -- 172.21.15.71:0/576668343 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f7fb425700 con 0x55f7fb581f70 2024-05-27T09:59:49.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.316+0000 7f3bb7400700 10 client.27140 handle_command_reply: tid=0 2024-05-27T09:59:49.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.316+0000 7f3be721db80 1 client.27140 shutdown 2024-05-27T09:59:49.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 msgr2=0x55f7fb5199e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5199e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009d10 tx=0x7f3bbc003960 comp rx=0 tx=0).stop 2024-05-27T09:59:49.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 shutdown_connections 2024-05-27T09:59:49.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x55f7fb581f70 0x55f7fb584390 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7fb4fc670 0x55f7fb519f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3bb7400700 0 client.27140 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7fb37cfd0 0x55f7fb51b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 --2- 172.21.15.71:0/576668343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f7fb468b80 0x55f7fb5199e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 >> 172.21.15.71:0/576668343 conn(0x55f7fb416520 msgr2=0x55f7fb5009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 shutdown_connections 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 1 -- 172.21.15.71:0/576668343 wait complete. 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.317+0000 7f3be721db80 20 client.27140 trim_cache size 0 max 16384 2024-05-27T09:59:49.318 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 34, 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 38, 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": { 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "f640e6ea": { 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "version": 38, 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age_ref": 0.0, 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:49.319 INFO:teuthology.orchestra.run.smithi071.stdout: "timeout": 90.0, 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: "expiration": 142.5, 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: "members": { 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: "file:/": { 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: "excluded": false, 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: "state": { 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "QUIESCED", 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:49.320 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:59:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3bb80b2a70 msgr2=0x7f3bb80b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3bb80b2a70 0x7f3bb80b4f80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8025000 tx=0x7f3bc8029000 comp rx=0 tx=0).stop 2024-05-27T09:59:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01054d0 msgr2=0x7f3bd019cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01054d0 0x7f3bd019cf80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e9a0 tx=0x7f3bc400ecb0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 shutdown_connections 2024-05-27T09:59:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f3bb80b2a70 0x7f3bb80b4f80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bd010e900 0x7f3bd01a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.318+0000 7f3bd8600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01054d0 0x7f3bd019cf80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.319+0000 7f3bd8600700 1 --2- 172.21.15.71:0/3186073583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd0105e20 0x7f3bd019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.319+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 >> 172.21.15.71:0/3186073583 conn(0x7f3bd00fedb0 msgr2=0x7f3bd01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.319+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 shutdown_connections 2024-05-27T09:59:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:49.319+0000 7f3bd8600700 1 -- 172.21.15.71:0/3186073583 wait complete. 2024-05-27T09:59:50.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:49 smithi122 ceph-mon[36436]: pgmap v376: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 879 KiB/s wr, 246 op/s 2024-05-27T09:59:50.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:49 smithi071 ceph-mon[31451]: pgmap v376: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 879 KiB/s wr, 246 op/s 2024-05-27T09:59:50.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:49 smithi072 ceph-mon[35951]: pgmap v376: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 879 KiB/s wr, 246 op/s 2024-05-27T09:59:51.225 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f640e6ea', quiesce took 11.0 seconds. Will release after: 11.5 2024-05-27T09:59:52.006 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:51 smithi071 ceph-mon[31451]: pgmap v377: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 879 KiB/s wr, 248 op/s 2024-05-27T09:59:52.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:51 smithi122 ceph-mon[36436]: pgmap v377: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 879 KiB/s wr, 248 op/s 2024-05-27T09:59:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:51 smithi072 ceph-mon[35951]: pgmap v377: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 879 KiB/s wr, 248 op/s 2024-05-27T09:59:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 -- 172.21.15.71:0/1278764401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810b890 msgr2=0x7fd2e81131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 --2- 172.21.15.71:0/1278764401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810b890 0x7fd2e81131f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b0d0 tx=0x7fd2e000b3e0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 -- 172.21.15.71:0/1278764401 shutdown_connections 2024-05-27T09:59:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 --2- 172.21.15.71:0/1278764401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810b890 0x7fd2e81131f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 --2- 172.21.15.71:0/1278764401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e8106610 0x7fd2e8106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 --2- 172.21.15.71:0/1278764401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2e810af40 0x7fd2e810b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 -- 172.21.15.71:0/1278764401 >> 172.21.15.71:0/1278764401 conn(0x7fd2e8102020 msgr2=0x7fd2e8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:52.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 -- 172.21.15.71:0/1278764401 shutdown_connections 2024-05-27T09:59:52.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.732+0000 7fd2ee000700 1 -- 172.21.15.71:0/1278764401 wait complete. 2024-05-27T09:59:52.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.734+0000 7fd2ee000700 1 Processor -- start 2024-05-27T09:59:52.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.735+0000 7fd2ee000700 1 -- start start 2024-05-27T09:59:52.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.735+0000 7fd2ee000700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e8106610 0x7fd2e819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2ee000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810af40 0x7fd2e819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2ee000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2e810b890 0x7fd2e81a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2ee000700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81164c0 con 0x7fd2e8106610 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2ee000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8116340 con 0x7fd2e810b890 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2ee000700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8116640 con 0x7fd2e810af40 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2ecc00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e8106610 0x7fd2e819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810af40 0x7fd2e819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810af40 0x7fd2e819d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:53514/0 (socket says 172.21.15.71:53514) 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2018433661 learned_addr learned my addr 172.21.15.71:0/2018433661 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:52.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.736+0000 7fd2ed600700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2e810b890 0x7fd2e81a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2018433661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2e810b890 msgr2=0x7fd2e81a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2e810b890 0x7fd2e81a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e8106610 msgr2=0x7fd2e819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e8106610 0x7fd2e819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2018433661 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e81a1ca0 con 0x7fd2e810af40 2024-05-27T09:59:52.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810af40 0x7fd2e819d370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400e970 tx=0x7fd2d400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:52.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e5600700 1 -- 172.21.15.71:0/2018433661 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4004a30 con 0x7fd2e810af40 2024-05-27T09:59:52.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e5600700 1 -- 172.21.15.71:0/2018433661 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d400cc90 con 0x7fd2e810af40 2024-05-27T09:59:52.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2e5600700 1 -- 172.21.15.71:0/2018433661 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4005610 con 0x7fd2e810af40 2024-05-27T09:59:52.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.737+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e81a1f90 con 0x7fd2e810af40 2024-05-27T09:59:52.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.738+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e81a98b0 con 0x7fd2e810af40 2024-05-27T09:59:52.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.741+0000 7fd2e5600700 1 -- 172.21.15.71:0/2018433661 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd2d400c7e0 con 0x7fd2e810af40 2024-05-27T09:59:52.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.742+0000 7fd2fe241b80 1 Processor -- start 2024-05-27T09:59:52.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2fe241b80 1 -- start start 2024-05-27T09:59:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569d6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6960 0x556b569dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6d70 0x556b569e2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2e5600700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd2d00b2a70 0x7fd2d00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556b56903eb0 con 0x556b569d6d70 2024-05-27T09:59:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556b568f3a50 con 0x556b569d6960 2024-05-27T09:59:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556b568f7a90 con 0x556b56856eb0 2024-05-27T09:59:52.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2e5600700 1 -- 172.21.15.71:0/2018433661 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7fd2d40e2720 con 0x7fd2e810af40 2024-05-27T09:59:52.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6960 0x556b569dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2ed600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569d6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6960 0x556b569dffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32956/0 (socket says 172.21.15.71:32956) 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.743+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2504867999 learned_addr learned my addr 172.21.15.71:0/2504867999 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2ed600700 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6d70 0x556b569e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd2d00b2a70 0x7fd2d00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2504867999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 msgr2=0x556b569d6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569d6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2504867999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6d70 msgr2=0x556b569e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6d70 0x556b569e2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2504867999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b568bc490 con 0x556b569d6960 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6960 0x556b569dffc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009230 tx=0x7fd2d40a5990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d0b7705035091b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.744+0000 7fd2da000700 1 -- 172.21.15.71:0/2504867999 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40a9110 con 0x556b569d6960 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.745+0000 7fd2da000700 1 -- 172.21.15.71:0/2504867999 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d400cad0 con 0x556b569d6960 2024-05-27T09:59:52.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.745+0000 7fd2da000700 1 -- 172.21.15.71:0/2504867999 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40add50 con 0x556b569d6960 2024-05-27T09:59:52.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2504867999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6960 msgr2=0x556b569dffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6960 0x556b569dffc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009230 tx=0x7fd2d40a5990 comp rx=0 tx=0).stop 2024-05-27T09:59:52.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd2d00b2a70 0x7fd2d00b4f80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009c60 tx=0x7fd2dc009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2504867999 shutdown_connections 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6d70 0x556b569e2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569d6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2504867999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6960 0x556b569dffc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2504867999 >> 172.21.15.71:0/2504867999 conn(0x556b568b7030 msgr2=0x556b569d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2504867999 shutdown_connections 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2504867999 wait complete. 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.746+0000 7fd2fe241b80 1 -- start start 2024-05-27T09:59:52.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 1 Processor -- start 2024-05-27T09:59:52.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6d70 0x556b569e0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556b567fa010 con 0x556b569d6960 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556b568947d0 con 0x556b569d6d70 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556b569e2e80 con 0x556b56856eb0 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.747+0000 7fd2fe241b80 10 client.0 _ll_register_callbacks cb 0x556b5689dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6d70 0x556b569e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ecc00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54134/0 (socket says 172.21.15.71:54134) 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6d70 0x556b569e0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32960/0 (socket says 172.21.15.71:32960) 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2e7e00700 1 -- 172.21.15.71:0/372818635 learned_addr learned my addr 172.21.15.71:0/372818635 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 -- 172.21.15.71:0/372818635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 msgr2=0x556b569dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 -- 172.21.15.71:0/372818635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 msgr2=0x556b569e0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 -- 172.21.15.71:0/372818635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b56843940 con 0x556b569d6d70 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2ed600700 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6d70 0x556b569e0660 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x556b569d1be0 tx=0x7fd2e000be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed7b57d4c3b16a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.748+0000 7fd2cea00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.749+0000 7fd2cea00700 1 -- 172.21.15.71:0/372818635 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0003e10 con 0x556b569d6d70 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.749+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b56905e00 con 0x556b569d6d70 2024-05-27T09:59:52.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.749+0000 7fd2cea00700 1 -- 172.21.15.71:0/372818635 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7fd2e00075c0 con 0x556b569d6d70 2024-05-27T09:59:52.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.749+0000 7fd2cea00700 1 -- 172.21.15.71:0/372818635 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd2e0007800 con 0x556b569d6d70 2024-05-27T09:59:52.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.749+0000 7fd2fe241b80 10 client.27152 fetch_fsmap learned FSMap version 34 2024-05-27T09:59:52.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.749+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556b568c40d0 con 0x556b569d6d70 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2cea00700 1 -- 172.21.15.71:0/372818635 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556b56905e00 con 0x556b569d6d70 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2cea00700 1 -- 172.21.15.71:0/372818635 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd2e0011070 con 0x556b569d6d70 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2fe241b80 10 client.27152 fetch_fsmap finished waiting for FSMap version 34 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2fe241b80 10 client.27152 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2fe241b80 20 client.27152 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569efed0 0x556b569f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2fe241b80 4 client.27152 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b568ff5e0 con 0x556b569efed0 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.750+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569efed0 0x556b569f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.751+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569efed0 0x556b569f22f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=390e1e8a37b6715c server_cookie=5320046ce9866a5f in_seq=0 out_seq=0 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.751+0000 7fd2cea00700 10 client.27152 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2cea00700 1 -- 172.21.15.71:0/372818635 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x556b568ff5e0 con 0x556b569efed0 2024-05-27T09:59:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2cea00700 10 client.27152 handle_command_reply: tid=0 2024-05-27T09:59:52.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 client.27152 shutdown 2024-05-27T09:59:52.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6d70 msgr2=0x556b569e0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6d70 0x556b569e0660 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x556b569d1be0 tx=0x7fd2e000be70 comp rx=0 tx=0).stop 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 shutdown_connections 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569efed0 0x556b569f22f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b569d6d70 0x556b569e0660 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2cea00700 0 client.27152 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/372818635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 >> 172.21.15.71:0/372818635 conn(0x556b568b7030 msgr2=0x556b569d4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.752+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 shutdown_connections 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.753+0000 7fd2fe241b80 1 -- 172.21.15.71:0/372818635 wait complete. 2024-05-27T09:59:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.753+0000 7fd2fe241b80 20 client.27152 trim_cache size 0 max 16384 2024-05-27T09:59:52.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 Processor -- start 2024-05-27T09:59:52.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 -- start start 2024-05-27T09:59:52.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b568b7030 0x556b569ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b56856eb0 0x556b569d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81b3740 con 0x556b569d6960 2024-05-27T09:59:52.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81b0fa0 con 0x556b56856eb0 2024-05-27T09:59:52.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.775+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81aee10 con 0x556b568b7030 2024-05-27T09:59:52.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2ed600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b56856eb0 0x556b569d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b56856eb0 0x556b569d0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32970/0 (socket says 172.21.15.71:32970) 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2713204435 learned_addr learned my addr 172.21.15.71:0/2713204435 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b568b7030 0x556b569ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2713204435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b568b7030 msgr2=0x556b569ebf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b568b7030 0x556b569ebf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2713204435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 msgr2=0x556b569d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 -- 172.21.15.71:0/2713204435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b569df610 con 0x556b56856eb0 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.776+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b56856eb0 0x556b569d0c80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009230 tx=0x7fd2d40050b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc830043470410b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2d9600700 1 -- 172.21.15.71:0/2713204435 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40b2140 con 0x556b56856eb0 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2d9600700 1 -- 172.21.15.71:0/2713204435 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d40c2070 con 0x556b56856eb0 2024-05-27T09:59:52.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2d9600700 1 -- 172.21.15.71:0/2713204435 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40a99a0 con 0x556b56856eb0 2024-05-27T09:59:52.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2713204435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b56856eb0 msgr2=0x556b569d0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b56856eb0 0x556b569d0c80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009230 tx=0x7fd2d40050b0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2713204435 shutdown_connections 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b568b7030 0x556b569ebf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/2713204435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b56856eb0 0x556b569d0c80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.777+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2713204435 >> 172.21.15.71:0/2713204435 conn(0x556b569d5860 msgr2=0x556b569d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.778+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2713204435 shutdown_connections 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.778+0000 7fd2fe241b80 1 -- 172.21.15.71:0/2713204435 wait complete. 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.778+0000 7fd2fe241b80 1 -- start start 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.778+0000 7fd2fe241b80 1 Processor -- start 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569e5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b568b7030 0x556b569e5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2fe241b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81af460 con 0x556b569d6960 2024-05-27T09:59:52.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81b08d0 con 0x556b568b7030 2024-05-27T09:59:52.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2fe241b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81afb30 con 0x556b56856eb0 2024-05-27T09:59:52.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2fe241b80 10 client.0 _ll_register_callbacks cb 0x556b5689dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b568b7030 0x556b569e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2ed600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b568b7030 0x556b569e5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:32984/0 (socket says 172.21.15.71:32984) 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2e7e00700 1 -- 172.21.15.71:0/1670650893 learned_addr learned my addr 172.21.15.71:0/1670650893 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.779+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2e7e00700 1 -- 172.21.15.71:0/1670650893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 msgr2=0x556b569e5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569e5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2e7e00700 1 -- 172.21.15.71:0/1670650893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 msgr2=0x556b569e5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2e7e00700 1 -- 172.21.15.71:0/1670650893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b56a5aa40 con 0x556b568b7030 2024-05-27T09:59:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2e7e00700 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b568b7030 0x556b569e5550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40a6c10 tx=0x7fd2d4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4916cba9cafa3d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2cea00700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2cea00700 1 -- 172.21.15.71:0/1670650893 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40cc2e0 con 0x556b568b7030 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2cea00700 1 -- 172.21.15.71:0/1670650893 <== mon.2 v2:172.21.15.72:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7fd2d40a9c00 con 0x556b568b7030 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d40c2070 con 0x556b568b7030 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2cea00700 1 -- 172.21.15.71:0/1670650893 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd2d40aa0a0 con 0x556b568b7030 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2fe241b80 10 client.27158 fetch_fsmap learned FSMap version 34 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.780+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556b56a5bc60 con 0x556b568b7030 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2cea00700 1 -- 172.21.15.71:0/1670650893 <== mon.2 v2:172.21.15.72:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d40c2070 con 0x556b568b7030 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2cea00700 1 -- 172.21.15.71:0/1670650893 <== mon.2 v2:172.21.15.72:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd2d40b2370 con 0x556b568b7030 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2fe241b80 10 client.27158 fetch_fsmap finished waiting for FSMap version 34 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2fe241b80 10 client.27158 resolve_mds: validated gid 24530 aka daemon mds.b 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2fe241b80 20 client.27158 populate_metadata read hostname 'smithi071' 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569d6d70 0x556b56a5dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:52.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2fe241b80 4 client.27158 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-27T09:59:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 --> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x556b567762c0 con 0x556b569d6d70 2024-05-27T09:59:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.781+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569d6d70 0x556b56a5dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2ecc00700 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569d6d70 0x556b56a5dc70 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ecdccd637506159 server_cookie=c346a16a97078114 in_seq=0 out_seq=0 2024-05-27T09:59:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2cea00700 10 client.27158 ms_handle_connect on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2cea00700 1 -- 172.21.15.71:0/1670650893 <== mds.0 v2:172.21.15.72:6838/1043512787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x556b567762c0 con 0x556b569d6d70 2024-05-27T09:59:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2cea00700 10 client.27158 handle_command_reply: tid=0 2024-05-27T09:59:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 client.27158 shutdown 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b568b7030 msgr2=0x556b569e5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b568b7030 0x556b569e5550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40a6c10 tx=0x7fd2d4009840 comp rx=0 tx=0).stop 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 shutdown_connections 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:6838/1043512787,v1:172.21.15.72:6839/1043512787] conn(0x556b569d6d70 0x556b56a5dc70 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b569d6960 0x556b569e5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b56856eb0 0x556b569e5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 --2- 172.21.15.71:0/1670650893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b568b7030 0x556b569e5550 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2cea00700 0 client.27158 ms_handle_reset on v2:172.21.15.72:6838/1043512787 2024-05-27T09:59:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.782+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 >> 172.21.15.71:0/1670650893 conn(0x556b569d5860 msgr2=0x556b569d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.783+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 shutdown_connections 2024-05-27T09:59:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.783+0000 7fd2fe241b80 1 -- 172.21.15.71:0/1670650893 wait complete. 2024-05-27T09:59:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.783+0000 7fd2fe241b80 20 client.27158 trim_cache size 0 max 16384 2024-05-27T09:59:52.786 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:59:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 34, 2024-05-27T09:59:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: "leader": 24530, 2024-05-27T09:59:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: "set_version": 39, 2024-05-27T09:59:52.787 INFO:teuthology.orchestra.run.smithi071.stdout: "sets": {} 2024-05-27T09:59:52.787 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:59:52.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd2d00b2a70 msgr2=0x7fd2d00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd2d00b2a70 0x7fd2d00b4f80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009c60 tx=0x7fd2dc009260 comp rx=0 tx=0).stop 2024-05-27T09:59:52.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810af40 msgr2=0x7fd2e819d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810af40 0x7fd2e819d370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400e970 tx=0x7fd2d400ec80 comp rx=0 tx=0).stop 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 shutdown_connections 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd2d00b2a70 0x7fd2d00b4f80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2e810b890 0x7fd2e81a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e8106610 0x7fd2e819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 --2- 172.21.15.71:0/2018433661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2e810af40 0x7fd2e819d370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 >> 172.21.15.71:0/2018433661 conn(0x7fd2e8102020 msgr2=0x7fd2e810a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 shutdown_connections 2024-05-27T09:59:52.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:52.784+0000 7fd2ee000700 1 -- 172.21.15.71:0/2018433661 wait complete. 2024-05-27T09:59:53.640 INFO:tasks.quiescer:done joining Quiescers 2024-05-27T09:59:53.641 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-27T09:59:53.655 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:59:53.682 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-27T09:59:53.692 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-05-27T09:59:53.692 INFO:teuthology.task.exec:Executing custom commands... 2024-05-27T09:59:53.692 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T09:59:53.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-05-27T09:59:53.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-05-27T09:59:53.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-27T09:59:54.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 -- 172.21.15.71:0/4156588973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f810a150 msgr2=0x7ff3f8103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/4156588973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f810a150 0x7ff3f8103d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009ca0 tx=0x7ff3e002a8c0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 -- 172.21.15.71:0/4156588973 shutdown_connections 2024-05-27T09:59:54.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/4156588973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 0x7ff3f81107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/4156588973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f810a150 0x7ff3f8103d90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/4156588973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f8109cb0 0x7ff3f8103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 -- 172.21.15.71:0/4156588973 >> 172.21.15.71:0/4156588973 conn(0x7ff3f80ff480 msgr2=0x7ff3f81018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:54.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 -- 172.21.15.71:0/4156588973 shutdown_connections 2024-05-27T09:59:54.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.199+0000 7ff3ffc00640 1 -- 172.21.15.71:0/4156588973 wait complete. 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 Processor -- start 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 -- start start 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 0x7ff3f819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f8109cb0 0x7ff3f819def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f810a150 0x7ff3f81a8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8113ef0 con 0x7ff3f8104400 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8113d70 con 0x7ff3f8109cb0 2024-05-27T09:59:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.200+0000 7ff3ffc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8114070 con 0x7ff3f810a150 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 0x7ff3f819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fdc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f810a150 0x7ff3f81a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 0x7ff3f819d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34500/0 (socket says 172.21.15.71:34500) 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fd200640 1 -- 172.21.15.71:0/233481740 learned_addr learned my addr 172.21.15.71:0/233481740 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3f7e00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f8109cb0 0x7ff3f819def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fdc00640 1 -- 172.21.15.71:0/233481740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f8109cb0 msgr2=0x7ff3f819def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fdc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f8109cb0 0x7ff3f819def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fdc00640 1 -- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 msgr2=0x7ff3f819d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fdc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 0x7ff3f819d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fdc00640 1 -- 172.21.15.71:0/233481740 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f81a8d90 con 0x7ff3f810a150 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.201+0000 7ff3fd200640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 0x7ff3f819d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.202+0000 7ff3fdc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f810a150 0x7ff3f81a8850 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000e970 tx=0x7ff3f000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.202+0000 7ff3f5600640 1 -- 172.21.15.71:0/233481740 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000ccc0 con 0x7ff3f810a150 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.202+0000 7ff3f5600640 1 -- 172.21.15.71:0/233481740 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3f00054d0 con 0x7ff3f810a150 2024-05-27T09:59:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.202+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f81a8fc0 con 0x7ff3f810a150 2024-05-27T09:59:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.202+0000 7ff3f5600640 1 -- 172.21.15.71:0/233481740 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0010430 con 0x7ff3f810a150 2024-05-27T09:59:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.202+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f81a9430 con 0x7ff3f810a150 2024-05-27T09:59:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.203+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f806a230 con 0x7ff3f810a150 2024-05-27T09:59:54.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.206+0000 7ff3f5600640 1 -- 172.21.15.71:0/233481740 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7ff3f0004f80 con 0x7ff3f810a150 2024-05-27T09:59:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.207+0000 7ff3f5600640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3d80b2950 0x7ff3d80b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.207+0000 7ff3f5600640 1 -- 172.21.15.71:0/233481740 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7ff3f00e2b50 con 0x7ff3f810a150 2024-05-27T09:59:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.207+0000 7ff3fd200640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3d80b2950 0x7ff3d80b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.208+0000 7ff3fd200640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3d80b2950 0x7ff3d80b4e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8011440 tx=0x7ff3e8005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:54.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.209+0000 7ff3f5600640 1 -- 172.21.15.71:0/233481740 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff3f0054df0 con 0x7ff3f810a150 2024-05-27T09:59:54.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:53 smithi122 ceph-mon[36436]: pgmap v378: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 176 KiB/s wr, 91 op/s 2024-05-27T09:59:54.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:53 smithi071 ceph-mon[31451]: pgmap v378: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 176 KiB/s wr, 91 op/s 2024-05-27T09:59:54.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:53 smithi072 ceph-mon[35951]: pgmap v378: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 176 KiB/s wr, 91 op/s 2024-05-27T09:59:54.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.444+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7ff3f8075600 con 0x7ff3d80b2950 2024-05-27T09:59:54.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.459+0000 7ff3f5600640 1 -- 172.21.15.71:0/233481740 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7ff3f8075600 con 0x7ff3d80b2950 2024-05-27T09:59:54.459 INFO:teuthology.orchestra.run.smithi071.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-27T00:00:00", "created": "2024-05-27T09:48:04", "first": "2024-05-27T09:49:00", "last": "2024-05-27T09:59:00", "last_pruned": "2024-05-27T09:59:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-05-27T09:59:54.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.462+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3d80b2950 msgr2=0x7ff3d80b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.462+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3d80b2950 0x7ff3d80b4e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8011440 tx=0x7ff3e8005f90 comp rx=0 tx=0).stop 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.462+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f810a150 msgr2=0x7ff3f81a8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.462+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f810a150 0x7ff3f81a8850 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000e970 tx=0x7ff3f000ee30 comp rx=0 tx=0).stop 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.462+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 shutdown_connections 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.462+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7ff3d80b2950 0x7ff3d80b4e60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.462+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f810a150 0x7ff3f81a8850 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.463+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f8109cb0 0x7ff3f819def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.463+0000 7ff3ffc00640 1 --2- 172.21.15.71:0/233481740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f8104400 0x7ff3f819d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.463+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 >> 172.21.15.71:0/233481740 conn(0x7ff3f80ff480 msgr2=0x7ff3f8074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.463+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 shutdown_connections 2024-05-27T09:59:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.463+0000 7ff3ffc00640 1 -- 172.21.15.71:0/233481740 wait complete. 2024-05-27T09:59:54.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-27T09:59:54.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 -- 172.21.15.71:0/1174505572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be810a150 msgr2=0x7f2be8103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 --2- 172.21.15.71:0/1174505572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be810a150 0x7f2be8103d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009900 tx=0x7f2bd802a410 comp rx=0 tx=0).stop 2024-05-27T09:59:54.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 -- 172.21.15.71:0/1174505572 shutdown_connections 2024-05-27T09:59:54.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 --2- 172.21.15.71:0/1174505572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be8104400 0x7f2be81107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 --2- 172.21.15.71:0/1174505572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be810a150 0x7f2be8103d90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 --2- 172.21.15.71:0/1174505572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2be8109cb0 0x7f2be8103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 -- 172.21.15.71:0/1174505572 >> 172.21.15.71:0/1174505572 conn(0x7f2be80ff480 msgr2=0x7f2be81018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 -- 172.21.15.71:0/1174505572 shutdown_connections 2024-05-27T09:59:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.752+0000 7f2bf0800640 1 -- 172.21.15.71:0/1174505572 wait complete. 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.753+0000 7f2bf0800640 1 Processor -- start 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bf0800640 1 -- start start 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bf0800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2be8104400 0x7f2be819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bf0800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be8109cb0 0x7f2be819dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bf0800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be810a150 0x7f2be81a8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bf0800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8113ef0 con 0x7f2be8109cb0 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bf0800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8113d70 con 0x7f2be810a150 2024-05-27T09:59:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bf0800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8114070 con 0x7f2be8104400 2024-05-27T09:59:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bed400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be8109cb0 0x7f2be819dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bede00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2be8104400 0x7f2be819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bed400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be8109cb0 0x7f2be819dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34522/0 (socket says 172.21.15.71:34522) 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bee800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be810a150 0x7f2be81a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.754+0000 7f2bed400640 1 -- 172.21.15.71:0/704487616 learned_addr learned my addr 172.21.15.71:0/704487616 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.755+0000 7f2bede00640 1 -- 172.21.15.71:0/704487616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be810a150 msgr2=0x7f2be81a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.755+0000 7f2bede00640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be810a150 0x7f2be81a8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.755+0000 7f2bede00640 1 -- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be8109cb0 msgr2=0x7f2be819dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.755+0000 7f2bede00640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be8109cb0 0x7f2be819dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.755+0000 7f2bede00640 1 -- 172.21.15.71:0/704487616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be81a8d90 con 0x7f2be8104400 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.755+0000 7f2bed400640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be8109cb0 0x7f2be819dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.755+0000 7f2bede00640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2be8104400 0x7f2be819d7d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00e9c0 tx=0x7f2bdc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.756+0000 7f2be2a00640 1 -- 172.21.15.71:0/704487616 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc00ccc0 con 0x7f2be8104400 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.756+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be81a8f60 con 0x7f2be8104400 2024-05-27T09:59:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.756+0000 7f2be2a00640 1 -- 172.21.15.71:0/704487616 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bdc005020 con 0x7f2be8104400 2024-05-27T09:59:54.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.756+0000 7f2be2a00640 1 -- 172.21.15.71:0/704487616 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc004a00 con 0x7f2be8104400 2024-05-27T09:59:54.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.756+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be81a93d0 con 0x7f2be8104400 2024-05-27T09:59:54.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.757+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be806a230 con 0x7f2be8104400 2024-05-27T09:59:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.760+0000 7f2be2a00640 1 -- 172.21.15.71:0/704487616 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2bdc0051d0 con 0x7f2be8104400 2024-05-27T09:59:54.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.761+0000 7f2be2a00640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2bd00b29d0 0x7f2bd00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:54.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.761+0000 7f2be2a00640 1 -- 172.21.15.71:0/704487616 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f2bdc0e2430 con 0x7f2be8104400 2024-05-27T09:59:54.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.761+0000 7f2bed400640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2bd00b29d0 0x7f2bd00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:54.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.762+0000 7f2bed400640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2bd00b29d0 0x7f2bd00b4ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8006010 tx=0x7f2bd8005a20 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:54.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.763+0000 7f2be2a00640 1 -- 172.21.15.71:0/704487616 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2bdc0a9db0 con 0x7f2be8104400 2024-05-27T09:59:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:54.997+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 --> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2be80751f0 con 0x7f2bd00b29d0 2024-05-27T09:59:55.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.009+0000 7f2be2a00640 1 -- 172.21.15.71:0/704487616 <== mgr.25057 v2:172.21.15.71:6800/813597445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2be80751f0 con 0x7f2bd00b29d0 2024-05-27T09:59:55.008 INFO:teuthology.orchestra.run.smithi071.stdout:/ 1m 6m3h 2024-05-27T09:59:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2bd00b29d0 msgr2=0x7f2bd00b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2bd00b29d0 0x7f2bd00b4ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8006010 tx=0x7f2bd8005a20 comp rx=0 tx=0).stop 2024-05-27T09:59:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2be8104400 msgr2=0x7f2be819d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2be8104400 0x7f2be819d7d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00e9c0 tx=0x7f2bdc00ee80 comp rx=0 tx=0).stop 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 shutdown_connections 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2bd00b29d0 0x7f2bd00b4ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be810a150 0x7f2be81a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2be8109cb0 0x7f2be819dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 --2- 172.21.15.71:0/704487616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2be8104400 0x7f2be819d7d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 >> 172.21.15.71:0/704487616 conn(0x7f2be80ff480 msgr2=0x7f2be810fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 shutdown_connections 2024-05-27T09:59:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.011+0000 7f2bf0800640 1 -- 172.21.15.71:0/704487616 wait complete. 2024-05-27T09:59:55.039 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-27T09:59:55.050 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-27T09:59:55.051 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_a6507388dd5057528934822c0163b0c347ef1d5d/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-27T09:59:55.051 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-27T09:59:55.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T09:59:55.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:54 smithi122 ceph-mon[36436]: from='client.27190 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:59:55.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:54 smithi071 ceph-mon[31451]: from='client.27190 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:59:55.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:54 smithi072 ceph-mon[35951]: from='client.27190 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.369+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1589580818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 msgr2=0x7f2ed0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.369+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1589580818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed0103b10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009900 tx=0x7f2ebc02a410 comp rx=0 tx=0).stop 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.370+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1589580818 shutdown_connections 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.370+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1589580818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed0104180 0x7f2ed01104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.370+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1589580818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed0103b10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.370+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1589580818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed0109a20 0x7f2ed01035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.370+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1589580818 >> 172.21.15.71:0/1589580818 conn(0x7f2ed007a210 msgr2=0x7f2ed007a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.370+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1589580818 shutdown_connections 2024-05-27T09:59:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.370+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1589580818 wait complete. 2024-05-27T09:59:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.371+0000 7f2ed5e00640 1 Processor -- start 2024-05-27T09:59:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.371+0000 7f2ed5e00640 1 -- start start 2024-05-27T09:59:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.371+0000 7f2ed5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed0104180 0x7f2ed019d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.371+0000 7f2ed5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed0109a20 0x7f2ed019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed01a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed0113c40 con 0x7f2ed0109ec0 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed0113ac0 con 0x7f2ed0109a20 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed0113dc0 con 0x7f2ed0104180 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed01a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed01a85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34546/0 (socket says 172.21.15.71:34546) 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 -- 172.21.15.71:0/1253875441 learned_addr learned my addr 172.21.15.71:0/1253875441 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed4a00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed0104180 0x7f2ed019d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ecfe00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed0109a20 0x7f2ed019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 -- 172.21.15.71:0/1253875441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed0104180 msgr2=0x7f2ed019d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed0104180 0x7f2ed019d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 -- 172.21.15.71:0/1253875441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed0109a20 msgr2=0x7f2ed019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed0109a20 0x7f2ed019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.372+0000 7f2ed5400640 1 -- 172.21.15.71:0/1253875441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed01a8ae0 con 0x7f2ed0109ec0 2024-05-27T09:59:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.373+0000 7f2ed5400640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed01a85a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800eb10 tx=0x7f2ec800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:55.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.373+0000 7f2ecd600640 1 -- 172.21.15.71:0/1253875441 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8004b20 con 0x7f2ed0109ec0 2024-05-27T09:59:55.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.373+0000 7f2ecd600640 1 -- 172.21.15.71:0/1253875441 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ec8004cc0 con 0x7f2ed0109ec0 2024-05-27T09:59:55.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.373+0000 7f2ecd600640 1 -- 172.21.15.71:0/1253875441 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8010670 con 0x7f2ed0109ec0 2024-05-27T09:59:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.373+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed01a8cb0 con 0x7f2ed0109ec0 2024-05-27T09:59:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.373+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed01a9180 con 0x7f2ed0109ec0 2024-05-27T09:59:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.374+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed0069d00 con 0x7f2ed0109ec0 2024-05-27T09:59:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.376+0000 7f2ecd600640 1 -- 172.21.15.71:0/1253875441 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2ec8005020 con 0x7f2ed0109ec0 2024-05-27T09:59:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.378+0000 7f2ecd600640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2eb80b29d0 0x7f2eb80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.378+0000 7f2ecd600640 1 -- 172.21.15.71:0/1253875441 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f2ec80e2b30 con 0x7f2ed0109ec0 2024-05-27T09:59:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.378+0000 7f2ed4a00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2eb80b29d0 0x7f2eb80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.379+0000 7f2ed4a00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2eb80b29d0 0x7f2eb80b4ee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ed006c350 tx=0x7f2ec4005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.383+0000 7f2ecd600640 1 -- 172.21.15.71:0/1253875441 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2ec80aa4b0 con 0x7f2ed0109ec0 2024-05-27T09:59:55.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.594+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ed01a9480 con 0x7f2ed0109ec0 2024-05-27T09:59:55.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.598+0000 7f2ecd600640 1 -- 172.21.15.71:0/1253875441 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+23070 (secure 0 0 0) 0x7f2ec80a9db0 con 0x7f2ed0109ec0 2024-05-27T09:59:55.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:59:55.598 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":95,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T09:59:10.510145+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6801/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6800/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/1381797399":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/4081778329":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/193022273":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/4261728686":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2eb80b29d0 msgr2=0x7f2eb80b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2eb80b29d0 0x7f2eb80b4ee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ed006c350 tx=0x7f2ec4005f90 comp rx=0 tx=0).stop 2024-05-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 msgr2=0x7f2ed01a85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed01a85a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800eb10 tx=0x7f2ec800c2d0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 shutdown_connections 2024-05-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2eb80b29d0 0x7f2eb80b4ee0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed0109ec0 0x7f2ed01a85a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed0109a20 0x7f2ed019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 --2- 172.21.15.71:0/1253875441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed0104180 0x7f2ed019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 >> 172.21.15.71:0/1253875441 conn(0x7f2ed007a210 msgr2=0x7f2ed01021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 shutdown_connections 2024-05-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.601+0000 7f2ed5e00640 1 -- 172.21.15.71:0/1253875441 wait complete. 2024-05-27T09:59:55.626 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T09:38:13.148765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T09:43:41.957802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T09:43:46.824583+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T09:59:55.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 -- 172.21.15.71:0/2830907187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 msgr2=0x7f19101104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 --2- 172.21.15.71:0/2830907187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 0x7f19101104f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1908009be0 tx=0x7f190802a6c0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 -- 172.21.15.71:0/2830907187 shutdown_connections 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 --2- 172.21.15.71:0/2830907187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 0x7f19101104f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 --2- 172.21.15.71:0/2830907187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109f00 0x7f1910103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 --2- 172.21.15.71:0/2830907187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1910109a60 0x7f1910103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 -- 172.21.15.71:0/2830907187 >> 172.21.15.71:0/2830907187 conn(0x7f19100ff2c0 msgr2=0x7f19101016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:55.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.903+0000 7f1915200640 1 -- 172.21.15.71:0/2830907187 shutdown_connections 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.904+0000 7f1915200640 1 -- 172.21.15.71:0/2830907187 wait complete. 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.904+0000 7f1915200640 1 Processor -- start 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f1915200640 1 -- start start 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f1915200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 0x7f191019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f1915200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109a60 0x7f191019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f1915200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1910109f00 0x7f191019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f1915200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1910113ca0 con 0x7f1910109f00 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f1915200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1910113b20 con 0x7f1910109a60 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f1915200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1910113e20 con 0x7f1910104210 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f190fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1910109f00 0x7f191019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f190ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109a60 0x7f191019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f190ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109a60 0x7f191019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57914/0 (socket says 172.21.15.71:57914) 2024-05-27T09:59:55.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f190fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1910109f00 0x7f191019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34576/0 (socket says 172.21.15.71:34576) 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f190ea00640 1 -- 172.21.15.71:0/3920685883 learned_addr learned my addr 172.21.15.71:0/3920685883 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.905+0000 7f190f400640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 0x7f191019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f190ea00640 1 -- 172.21.15.71:0/3920685883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 msgr2=0x7f191019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f190ea00640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 0x7f191019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f190ea00640 1 -- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1910109f00 msgr2=0x7f191019ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f190ea00640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1910109f00 0x7f191019ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f190ea00640 1 -- 172.21.15.71:0/3920685883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191019f440 con 0x7f1910109a60 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f190ea00640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109a60 0x7f191019ab40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00e9c0 tx=0x7f18fc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f1907e00640 1 -- 172.21.15.71:0/3920685883 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00ccc0 con 0x7f1910109a60 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f1907e00640 1 -- 172.21.15.71:0/3920685883 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18fc0035f0 con 0x7f1910109a60 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f1907e00640 1 -- 172.21.15.71:0/3920685883 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00ce60 con 0x7f1910109a60 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.906+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191019f730 con 0x7f1910109a60 2024-05-27T09:59:55.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.907+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191019fc30 con 0x7f1910109a60 2024-05-27T09:59:55.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.908+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191006a150 con 0x7f1910109a60 2024-05-27T09:59:55.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.910+0000 7f1907e00640 1 -- 172.21.15.71:0/3920685883 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f18fc004000 con 0x7f1910109a60 2024-05-27T09:59:55.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.912+0000 7f1907e00640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18f40b29d0 0x7f18f40b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:55.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.912+0000 7f1907e00640 1 -- 172.21.15.71:0/3920685883 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f18fc0e2950 con 0x7f1910109a60 2024-05-27T09:59:55.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.912+0000 7f190f400640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18f40b29d0 0x7f18f40b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:55.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.913+0000 7f190f400640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18f40b29d0 0x7f18f40b4ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f191006c400 tx=0x7f190000b390 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:55.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:55.914+0000 7f1907e00640 1 -- 172.21.15.71:0/3920685883 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f191019fc30 con 0x7f1910109a60 2024-05-27T09:59:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:55 smithi071 ceph-mon[31451]: from='client.27196 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:59:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:55 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1253875441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:59:56.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:55 smithi071 ceph-mon[31451]: pgmap v379: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 176 KiB/s wr, 91 op/s 2024-05-27T09:59:56.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.119+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f191010b570 con 0x7f1910109a60 2024-05-27T09:59:56.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.120+0000 7f1907e00640 1 -- 172.21.15.71:0/3920685883 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f18fc0aa2d0 con 0x7f1910109a60 2024-05-27T09:59:56.122 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-05-27T09:59:56.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18f40b29d0 msgr2=0x7f18f40b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18f40b29d0 0x7f18f40b4ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f191006c400 tx=0x7f190000b390 comp rx=0 tx=0).stop 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109a60 msgr2=0x7f191019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109a60 0x7f191019ab40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00e9c0 tx=0x7f18fc00ee80 comp rx=0 tx=0).stop 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 shutdown_connections 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f18f40b29d0 0x7f18f40b4ee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1910109f00 0x7f191019ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1910109a60 0x7f191019ab40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 --2- 172.21.15.71:0/3920685883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1910104210 0x7f191019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 >> 172.21.15.71:0/3920685883 conn(0x7f19100ff2c0 msgr2=0x7f1910101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 shutdown_connections 2024-05-27T09:59:56.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.123+0000 7f1915200640 1 -- 172.21.15.71:0/3920685883 wait complete. 2024-05-27T09:59:56.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T09:59:56.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:55 smithi122 ceph-mon[36436]: from='client.27196 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:59:56.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:55 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1253875441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:59:56.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:55 smithi122 ceph-mon[36436]: pgmap v379: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 176 KiB/s wr, 91 op/s 2024-05-27T09:59:56.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:55 smithi072 ceph-mon[35951]: from='client.27196 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-27T09:59:56.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:55 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1253875441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T09:59:56.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:55 smithi072 ceph-mon[35951]: pgmap v379: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 176 KiB/s wr, 91 op/s 2024-05-27T09:59:56.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.419+0000 7f0d6aa00640 1 -- 172.21.15.71:0/209629542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6410bc70 msgr2=0x7f0d64105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.419+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/209629542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6410bc70 0x7f0d64105810 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009900 tx=0x7f0d5802a3f0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.419+0000 7f0d6aa00640 1 -- 172.21.15.71:0/209629542 shutdown_connections 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.419+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/209629542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d641063c0 0x7f0d64112790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.419+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/209629542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410c110 0x7f0d64105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.419+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/209629542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6410bc70 0x7f0d64105810 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.419+0000 7f0d6aa00640 1 -- 172.21.15.71:0/209629542 >> 172.21.15.71:0/209629542 conn(0x7f0d6407d590 msgr2=0x7f0d6407d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.420+0000 7f0d6aa00640 1 -- 172.21.15.71:0/209629542 shutdown_connections 2024-05-27T09:59:56.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.420+0000 7f0d6aa00640 1 -- 172.21.15.71:0/209629542 wait complete. 2024-05-27T09:59:56.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.421+0000 7f0d6aa00640 1 Processor -- start 2024-05-27T09:59:56.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.421+0000 7f0d6aa00640 1 -- start start 2024-05-27T09:59:56.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d6aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d641063c0 0x7f0d641a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d6aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410bc70 0x7f0d641a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d6aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d6410c110 0x7f0d6419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d6aa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64115e60 con 0x7f0d6410bc70 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d6aa00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64115ce0 con 0x7f0d641063c0 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d6aa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64115fe0 con 0x7f0d6410c110 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410bc70 0x7f0d641a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410bc70 0x7f0d641a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34606/0 (socket says 172.21.15.71:34606) 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 -- 172.21.15.71:0/1817803335 learned_addr learned my addr 172.21.15.71:0/1817803335 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d69600640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d641063c0 0x7f0d641a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d6a000640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d6410c110 0x7f0d6419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 -- 172.21.15.71:0/1817803335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d6410c110 msgr2=0x7f0d6419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d6410c110 0x7f0d6419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 -- 172.21.15.71:0/1817803335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d641063c0 msgr2=0x7f0d641a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d641063c0 0x7f0d641a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d68c00640 1 -- 172.21.15.71:0/1817803335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6419ce30 con 0x7f0d6410bc70 2024-05-27T09:59:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.422+0000 7f0d69600640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d641063c0 0x7f0d641a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:56.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.423+0000 7f0d68c00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410bc70 0x7f0d641a2ac0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000e980 tx=0x7f0d5000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:56.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.423+0000 7f0d62000640 1 -- 172.21.15.71:0/1817803335 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000cd80 con 0x7f0d6410bc70 2024-05-27T09:59:56.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.423+0000 7f0d62000640 1 -- 172.21.15.71:0/1817803335 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d500108e0 con 0x7f0d6410bc70 2024-05-27T09:59:56.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.423+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6419d0c0 con 0x7f0d6410bc70 2024-05-27T09:59:56.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.423+0000 7f0d62000640 1 -- 172.21.15.71:0/1817803335 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50018990 con 0x7f0d6410bc70 2024-05-27T09:59:56.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.423+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d641a9320 con 0x7f0d6410bc70 2024-05-27T09:59:56.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.424+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d64106f50 con 0x7f0d6410bc70 2024-05-27T09:59:56.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.427+0000 7f0d62000640 1 -- 172.21.15.71:0/1817803335 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0d5001f020 con 0x7f0d6410bc70 2024-05-27T09:59:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.429+0000 7f0d62000640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0d4c0b2950 0x7f0d4c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.430+0000 7f0d62000640 1 -- 172.21.15.71:0/1817803335 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f0d500e2f10 con 0x7f0d6410bc70 2024-05-27T09:59:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.430+0000 7f0d69600640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0d4c0b2950 0x7f0d4c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.431+0000 7f0d69600640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0d4c0b2950 0x7f0d4c0b4e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000c00 tx=0x7f0d58031400 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:56.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.432+0000 7f0d62000640 1 -- 172.21.15.71:0/1817803335 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0d50026070 con 0x7f0d6410bc70 2024-05-27T09:59:56.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.640+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0d6410a140 con 0x7f0d6410bc70 2024-05-27T09:59:56.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.641+0000 7f0d62000640 1 -- 172.21.15.71:0/1817803335 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f0d500aa890 con 0x7f0d6410bc70 2024-05-27T09:59:56.641 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-05-27T09:59:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.643+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0d4c0b2950 msgr2=0x7f0d4c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.643+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0d4c0b2950 0x7f0d4c0b4e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000c00 tx=0x7f0d58031400 comp rx=0 tx=0).stop 2024-05-27T09:59:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.643+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410bc70 msgr2=0x7f0d641a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.643+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410bc70 0x7f0d641a2ac0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000e980 tx=0x7f0d5000ee40 comp rx=0 tx=0).stop 2024-05-27T09:59:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 shutdown_connections 2024-05-27T09:59:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f0d4c0b2950 0x7f0d4c0b4e60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d6410c110 0x7f0d6419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6410bc70 0x7f0d641a2ac0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 --2- 172.21.15.71:0/1817803335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d641063c0 0x7f0d641a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 >> 172.21.15.71:0/1817803335 conn(0x7f0d6407d590 msgr2=0x7f0d64107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:56.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 shutdown_connections 2024-05-27T09:59:56.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.644+0000 7f0d6aa00640 1 -- 172.21.15.71:0/1817803335 wait complete. 2024-05-27T09:59:56.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T09:59:56.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 -- 172.21.15.71:0/4122603437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc112120 msgr2=0x7fd6bc114540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 --2- 172.21.15.71:0/4122603437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc112120 0x7fd6bc114540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009900 tx=0x7fd6a802a410 comp rx=0 tx=0).stop 2024-05-27T09:59:56.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 -- 172.21.15.71:0/4122603437 shutdown_connections 2024-05-27T09:59:56.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 --2- 172.21.15.71:0/4122603437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6bc114a80 0x7fd6bc116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 --2- 172.21.15.71:0/4122603437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc112120 0x7fd6bc114540 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 --2- 172.21.15.71:0/4122603437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6bc078720 0x7fd6bc078b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 -- 172.21.15.71:0/4122603437 >> 172.21.15.71:0/4122603437 conn(0x7fd6bc101550 msgr2=0x7fd6bc1039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:56.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 -- 172.21.15.71:0/4122603437 shutdown_connections 2024-05-27T09:59:56.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.953+0000 7fd6c4400640 1 -- 172.21.15.71:0/4122603437 wait complete. 2024-05-27T09:59:56.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.954+0000 7fd6c4400640 1 Processor -- start 2024-05-27T09:59:56.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.954+0000 7fd6c4400640 1 -- start start 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c4400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc078720 0x7fd6bc1a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c4400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6bc112120 0x7fd6bc1a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c4400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6bc114a80 0x7fd6bc1a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c4400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc11a440 con 0x7fd6bc078720 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c4400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc11a2c0 con 0x7fd6bc114a80 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c4400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc11a5c0 con 0x7fd6bc112120 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c1a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc078720 0x7fd6bc1a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.955+0000 7fd6c1a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc078720 0x7fd6bc1a0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34634/0 (socket says 172.21.15.71:34634) 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c1a00640 1 -- 172.21.15.71:0/2640272093 learned_addr learned my addr 172.21.15.71:0/2640272093 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c1000640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6bc112120 0x7fd6bc1a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c2400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6bc114a80 0x7fd6bc1a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c2400640 1 -- 172.21.15.71:0/2640272093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6bc112120 msgr2=0x7fd6bc1a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c2400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6bc112120 0x7fd6bc1a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c2400640 1 -- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc078720 msgr2=0x7fd6bc1a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c2400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc078720 0x7fd6bc1a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c2400640 1 -- 172.21.15.71:0/2640272093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc1a5d00 con 0x7fd6bc114a80 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c1a00640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc078720 0x7fd6bc1a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c1000640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6bc112120 0x7fd6bc1a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.956+0000 7fd6c2400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6bc114a80 0x7fd6bc1a56c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009fd0 tx=0x7fd6b400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:56.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.957+0000 7fd6ba000640 1 -- 172.21.15.71:0/2640272093 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400ce20 con 0x7fd6bc114a80 2024-05-27T09:59:56.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.958+0000 7fd6ba000640 1 -- 172.21.15.71:0/2640272093 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6b4005020 con 0x7fd6bc114a80 2024-05-27T09:59:56.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.958+0000 7fd6ba000640 1 -- 172.21.15.71:0/2640272093 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4010690 con 0x7fd6bc114a80 2024-05-27T09:59:56.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.958+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6bc1a5ff0 con 0x7fd6bc114a80 2024-05-27T09:59:56.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.958+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6bc1a64c0 con 0x7fd6bc114a80 2024-05-27T09:59:56.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.959+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6bc069e30 con 0x7fd6bc114a80 2024-05-27T09:59:56.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.961+0000 7fd6ba000640 1 -- 172.21.15.71:0/2640272093 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd6b40054d0 con 0x7fd6bc114a80 2024-05-27T09:59:56.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.963+0000 7fd6ba000640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd6a40b29e0 0x7fd6a40b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:56.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.963+0000 7fd6ba000640 1 -- 172.21.15.71:0/2640272093 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7fd6b40e2c90 con 0x7fd6bc114a80 2024-05-27T09:59:56.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.963+0000 7fd6c1a00640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd6a40b29e0 0x7fd6a40b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:56.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.964+0000 7fd6c1a00640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd6a40b29e0 0x7fd6a40b4ef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0011500 tx=0x7fd6b0005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:56.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:56.967+0000 7fd6ba000640 1 -- 172.21.15.71:0/2640272093 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd6b40aa610 con 0x7fd6bc114a80 2024-05-27T09:59:57.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.172+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd6bc103af0 con 0x7fd6bc114a80 2024-05-27T09:59:57.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.174+0000 7fd6ba000640 1 -- 172.21.15.71:0/2640272093 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7fd6b40a9f10 con 0x7fd6bc114a80 2024-05-27T09:59:57.174 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd6a40b29e0 msgr2=0x7fd6a40b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd6a40b29e0 0x7fd6a40b4ef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0011500 tx=0x7fd6b0005f90 comp rx=0 tx=0).stop 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6bc114a80 msgr2=0x7fd6bc1a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6bc114a80 0x7fd6bc1a56c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009fd0 tx=0x7fd6b400ef10 comp rx=0 tx=0).stop 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 shutdown_connections 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd6a40b29e0 0x7fd6a40b4ef0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6bc114a80 0x7fd6bc1a56c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6bc112120 0x7fd6bc1a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 --2- 172.21.15.71:0/2640272093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6bc078720 0x7fd6bc1a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.176+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 >> 172.21.15.71:0/2640272093 conn(0x7fd6bc101550 msgr2=0x7fd6bc07b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:57.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.177+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 shutdown_connections 2024-05-27T09:59:57.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.177+0000 7fd6c4400640 1 -- 172.21.15.71:0/2640272093 wait complete. 2024-05-27T09:59:57.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-27T09:59:57.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:56 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3920685883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:59:57.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:56 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1817803335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-27T09:59:57.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:56 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3920685883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:59:57.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:56 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1817803335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-27T09:59:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:56 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3920685883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-27T09:59:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:56 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1817803335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 -- 172.21.15.71:0/1807714530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010f330 msgr2=0x7f1320116ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 --2- 172.21.15.71:0/1807714530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010f330 0x7f1320116ad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1318009ca0 tx=0x7f131802a8c0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 -- 172.21.15.71:0/1807714530 shutdown_connections 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 --2- 172.21.15.71:0/1807714530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010f330 0x7f1320116ad0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 --2- 172.21.15.71:0/1807714530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f132010e870 0x7f132010eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 --2- 172.21.15.71:0/1807714530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 0x7f132010a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 -- 172.21.15.71:0/1807714530 >> 172.21.15.71:0/1807714530 conn(0x7f1320076c80 msgr2=0x7f13200770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 -- 172.21.15.71:0/1807714530 shutdown_connections 2024-05-27T09:59:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.469+0000 7f131f200640 1 -- 172.21.15.71:0/1807714530 wait complete. 2024-05-27T09:59:57.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.470+0000 7f131f200640 1 Processor -- start 2024-05-27T09:59:57.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.470+0000 7f131f200640 1 -- start start 2024-05-27T09:59:57.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 0x7f13201a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:57.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131f200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010e870 0x7f13201a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:57.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131f200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f132010f330 0x7f13201a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:57.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f132011a290 con 0x7f132010a2e0 2024-05-27T09:59:57.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131f200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f132011a110 con 0x7f132010e870 2024-05-27T09:59:57.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131f200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f132011a410 con 0x7f132010f330 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 0x7f13201a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f132010f330 0x7f13201a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 0x7f13201a6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34660/0 (socket says 172.21.15.71:34660) 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131de00640 1 -- 172.21.15.71:0/4254883387 learned_addr learned my addr 172.21.15.71:0/4254883387 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f1315400640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010e870 0x7f13201a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.471+0000 7f131e800640 1 -- 172.21.15.71:0/4254883387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010e870 msgr2=0x7f13201a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131e800640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010e870 0x7f13201a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131e800640 1 -- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 msgr2=0x7f13201a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131e800640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 0x7f13201a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131e800640 1 -- 172.21.15.71:0/4254883387 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13201a10b0 con 0x7f132010f330 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131de00640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 0x7f13201a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131e800640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f132010f330 0x7f13201a0a10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1318005e30 tx=0x7f13180317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f1317400640 1 -- 172.21.15.71:0/4254883387 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318003b70 con 0x7f132010f330 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f1317400640 1 -- 172.21.15.71:0/4254883387 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1318003d10 con 0x7f132010f330 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13201a1340 con 0x7f132010f330 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f1317400640 1 -- 172.21.15.71:0/4254883387 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131802f970 con 0x7f132010f330 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.472+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13201ad680 con 0x7f132010f330 2024-05-27T09:59:57.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.473+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132006a150 con 0x7f132010f330 2024-05-27T09:59:57.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.476+0000 7f1317400640 1 -- 172.21.15.71:0/4254883387 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f131802fb10 con 0x7f132010f330 2024-05-27T09:59:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.477+0000 7f1317400640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f13040b29d0 0x7f13040b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T09:59:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.478+0000 7f1317400640 1 -- 172.21.15.71:0/4254883387 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8513+0+0 (secure 0 0 0) 0x7f1318103850 con 0x7f132010f330 2024-05-27T09:59:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.478+0000 7f131de00640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f13040b29d0 0x7f13040b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T09:59:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.478+0000 7f131de00640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f13040b29d0 0x7f13040b4ee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13201a1b50 tx=0x7f1310005f90 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T09:59:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.480+0000 7f1317400640 1 -- 172.21.15.71:0/4254883387 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f13180cb2e0 con 0x7f132010f330 2024-05-27T09:59:57.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.728+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f1320112150 con 0x7f132010f330 2024-05-27T09:59:57.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.738+0000 7f1317400640 1 -- 172.21.15.71:0/4254883387 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+816170 (secure 0 0 0) 0x7f13180cabe0 con 0x7f132010f330 2024-05-27T09:59:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T09:59:57.750 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T09:59:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 26, 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "active_gid": 25057, 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "active_name": "x", 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "active_addrs": { 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6800", 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 813597445 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-05-27T09:59:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6801", 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 813597445 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "active_addr": "172.21.15.71:6801/813597445", 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "active_change": "2024-05-27T09:47:45.457129+0000", 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "active_mgr_features": 4540701547738038271, 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "available": true, 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "standbys": [ 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "gid": 25049, 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "y", 2024-05-27T09:59:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_features": 4540701547738038271, 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "available_modules": [ 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "alerts", 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How frequently to reexamine health status", 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_destination": { 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_destination", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Email address to send alerts to", 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_from_name": { 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_from_name", 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "Ceph", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Email From: name", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_host": { 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_host", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP server", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_password": { 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_password", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Password to authenticate with", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_port": { 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_port", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "465", 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP port", 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_sender": { 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_sender", 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP envelope sender", 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_ssl": { 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_ssl", 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_user": { 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_user", 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "User to authenticate as", 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "balancer", 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "active": { 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "active", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically balance PGs across cluster", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "begin_time": { 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "begin_time", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0000", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "beginning time of day to automatically balance", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-27T09:59:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "begin_weekday": { 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "begin_weekday", 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0", 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "6", 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-27T09:59:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_max_iterations": { 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_max_iterations", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "25", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "250", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-27T09:59:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_metrics": { 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_metrics", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "pgs,objects,bytes", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-27T09:59:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_step": { 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_step", 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0.5", 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0.001", 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "0.999", 2024-05-27T09:59:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "aggressiveness of optimization", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "end_time": { 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "end_time", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "2359", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "ending time of day to automatically balance", 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "end_weekday": { 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "end_weekday", 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0", 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "6", 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "min_score": { 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "min_score", 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-27T09:59:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": { 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mode", 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "upmap", 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "crush-compat", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "none", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "read", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap-read" 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Balancer mode", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_ids": { 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pool_ids", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap_max_deviation": { 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "upmap_max_deviation", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap_max_optimizations": { 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "upmap_max_optimizations", 2024-05-27T09:59:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephadm", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_down_multiplier": { 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_down_multiplier", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3.0", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_refresh_rate": { 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_refresh_rate", 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "20", 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_starting_port": { 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_starting_port", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "4721", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_ptrace": { 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_ptrace", 2024-05-27T09:59:57.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-27T09:59:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-27T09:59:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "autotune_interval": { 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "autotune_interval", 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-27T09:59:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "autotune_memory_target_ratio": { 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "autotune_memory_target_ratio", 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0.7", 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm_log_destination": { 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephadm_log_destination", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "file", 2024-05-27T09:59:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "file,syslog", 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "syslog" 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "cgroups_split": { 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cgroups_split", 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "config_checks_enabled": { 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_checks_enabled", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "config_dashboard": { 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_dashboard", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_alertmanager": { 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_alertmanager", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_base": { 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_base", 2024-05-27T09:59:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Container image name, without the tag", 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_elasticsearch": { 2024-05-27T09:59:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_elasticsearch", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "elasticsearch container image", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_grafana": { 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_grafana", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_haproxy": { 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_haproxy", 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "HAproxy container image", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_agent": { 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_agent", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger agent container image", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_collector": { 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_collector", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger collector container image", 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_query": { 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_query", 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger query container image", 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_keepalived": { 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_keepalived", 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Keepalived container image", 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_loki": { 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_loki", 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Loki container image", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_node_exporter": { 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_node_exporter", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.816 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_nvmeof": { 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_nvmeof", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.817 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Nvme-of container image", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_prometheus": { 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_prometheus", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_promtail": { 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_promtail", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.819 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Promtail container image", 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_samba": { 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_samba", 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Samba/SMB container image", 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_snmp_gateway": { 2024-05-27T09:59:57.821 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_snmp_gateway", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SNMP Gateway container image", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.822 INFO:teuthology.orchestra.run.smithi071.stdout: "container_init": { 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_init", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Run podman/docker with `--init`", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "daemon_cache_timeout": { 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "daemon_cache_timeout", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "default_cephadm_command_timeout": { 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default_cephadm_command_timeout", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "900", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.825 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "default_registry": { 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default_registry", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.826 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "device_cache_timeout": { 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_cache_timeout", 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1800", 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache device inventory", 2024-05-27T09:59:57.827 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "device_enhanced_scan": { 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_enhanced_scan", 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.828 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "facts_cache_timeout": { 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "facts_cache_timeout", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.829 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache host facts data", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "grafana_dashboards_path": { 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "grafana_dashboards_path", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.830 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "host_check_interval": { 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "host_check_interval", 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.831 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to perform a host check", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "hw_monitoring": { 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "hw_monitoring", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "inventory_list_all": { 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "inventory_list_all", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.833 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.834 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.835 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "log_refresh_metadata": { 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_refresh_metadata", 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-27T09:59:57.836 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.838 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.840 INFO:teuthology.orchestra.run.smithi071.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "*", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "max_count_per_host": { 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_count_per_host", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "max number of daemons per service per host", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "max_osd_draining_count": { 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_osd_draining_count", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.844 INFO:teuthology.orchestra.run.smithi071.stdout: "migration_current": { 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "migration_current", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "internal - do not modify", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.845 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": { 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mode", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "root", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm-package", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "root" 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "mode for remote execution of cephadm", 2024-05-27T09:59:57.846 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "oob_default_addr": { 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "oob_default_addr", 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.847 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "169.254.1.1", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "prometheus_alerts_path": { 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prometheus_alerts_path", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.848 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_insecure": { 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_insecure", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_password": { 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_password", 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_url": { 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_url", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.851 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_username": { 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_username", 2024-05-27T09:59:57.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "secure_monitoring_stack": { 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "secure_monitoring_stack", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.853 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "service_discovery_port": { 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "service_discovery_port", 2024-05-27T09:59:57.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8765", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "cephadm service discovery port", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "ssh_config_file": { 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssh_config_file", 2024-05-27T09:59:57.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "use_agent": { 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "use_agent", 2024-05-27T09:59:57.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.858 INFO:teuthology.orchestra.run.smithi071.stdout: "use_repo_digest": { 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "use_repo_digest", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_failed_host_check": { 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_failed_host_check", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if the host check fails", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.860 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_stray_daemons": { 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_stray_daemons", 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-27T09:59:57.861 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_stray_hosts": { 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_stray_hosts", 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.862 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crash", 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.865 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.867 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.868 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "retain_interval": { 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "retain_interval", 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "31536000", 2024-05-27T09:59:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.870 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_recent_interval": { 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_recent_interval", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1209600", 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "dashboard", 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.872 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.873 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "ALERTMANAGER_API_HOST": { 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.874 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.875 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "AUDIT_API_ENABLED": { 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "AUDIT_API_ENABLED", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.876 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.877 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "ENABLE_BROWSABLE_API": { 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.878 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.879 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.880 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-27T09:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-27T09:59:57.882 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.883 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.886 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.887 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_PASSWORD": { 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.888 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.889 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_URL": { 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_URL", 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.890 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_USERNAME": { 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.892 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.893 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.895 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.896 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "[]", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "MULTICLUSTER_CONFIG": { 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.897 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "{}", 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "PROMETHEUS_API_HOST": { 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-27T09:59:57.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-27T09:59:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-27T09:59:57.900 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-27T09:59:57.901 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.902 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.903 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.904 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.905 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.906 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.907 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_ENABLED": { 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.908 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.909 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8", 2024-05-27T09:59:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "45", 2024-05-27T09:59:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_ACCESS_KEY": { 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.914 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_SECRET_KEY": { 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.915 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_SSL_VERIFY": { 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-27T09:59:57.916 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "UNSAFE_TLS_v1_2": { 2024-05-27T09:59:57.917 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.920 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.921 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "cross_origin_url": { 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cross_origin_url", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.922 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "crt_file": { 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crt_file", 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.923 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "debug": { 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "debug", 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.924 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable/disable debug options", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "jwt_token_ttl": { 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "jwt_token_ttl", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "28800", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.925 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "key_file": { 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "key_file", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.926 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.927 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.928 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.929 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.930 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.931 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "motd": { 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "motd", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.932 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "The message of the day", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "redirect_resolve_ip_addr": { 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "redirect_resolve_ip_addr", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.933 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "::", 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.935 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8080", 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.936 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl": { 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl", 2024-05-27T09:59:57.937 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.938 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl_server_port": { 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl_server_port", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8443", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.939 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_behaviour": { 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_behaviour", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "redirect", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "redirect" 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_error_status_code": { 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_error_status_code", 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "500", 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "400", 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "599", 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.941 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "url_prefix": { 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "url_prefix", 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.942 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "devicehealth", 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_monitoring": { 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enable_monitoring", 2024-05-27T09:59:57.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "monitor device health metrics", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.944 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.945 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.946 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.947 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.948 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.949 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "mark_out_threshold": { 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mark_out_threshold", 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "2419200", 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-27T09:59:57.950 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": { 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pool_name", 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "device_health_metrics", 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.951 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "retention_period": { 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "retention_period", 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15552000", 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.952 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.954 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.954 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long to retain device health metrics", 2024-05-27T09:59:57.954 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.954 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.954 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "scrape_frequency": { 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "scrape_frequency", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "86400", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.955 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "self_heal": { 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "self_heal", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to wake up and check device health", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.957 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_threshold": { 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_threshold", 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "7257600", 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-27T09:59:57.959 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "diskprediction_local", 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.960 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.961 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.962 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.963 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.964 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.965 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "predict_interval": { 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "predict_interval", 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "86400", 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.966 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "predictor_model": { 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "predictor_model", 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.967 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "prophetstor", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.968 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.970 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "influx", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": false, 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "influxdb python module not found", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "batch_size": { 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "batch_size", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5000", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-27T09:59:57.971 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "database": { 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "database", 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "ceph", 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.972 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": { 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "hostname", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.973 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB server hostname", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "30", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "5", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.974 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.975 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.976 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.977 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.978 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.979 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "password": { 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "password", 2024-05-27T09:59:57.980 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "password of InfluxDB server user", 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "port": { 2024-05-27T09:59:57.981 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "port", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8086", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB server port", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.983 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl": { 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "false", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.984 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "threads": { 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "threads", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "32", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.985 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "username": { 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "username", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "username of InfluxDB server user", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.986 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "verify_ssl": { 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "verify_ssl", 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "true", 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-27T09:59:57.987 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "insights", 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.989 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.990 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.991 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "iostat", 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:57.995 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.997 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:57.998 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:57.999 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.000 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "k8sevents", 2024-05-27T09:59:58.001 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_event_retention_days": { 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ceph_event_retention_days", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "7", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "config_check_secs": { 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_check_secs", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "10", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.003 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.009 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "localpool", 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.010 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "failure_domain": { 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "failure_domain", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "host", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "failure domain for any created local pool", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.011 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.012 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": { 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "min_size", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default min_size for any created local pool", 2024-05-27T09:59:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "num_rep": { 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "num_rep", 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3", 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default replica count for any created local pool", 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": { 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pg_num", 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "128", 2024-05-27T09:59:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default pg_num for any created local pool", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "prefix": { 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prefix", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "name prefix for any created local pool", 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "subtree": { 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "subtree", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "rack", 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mds_autoscaler", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mirroring", 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "nfs", 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "orchestrator", 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "fail_fs": { 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "fail_fs", 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator": { 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "orchestrator", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "rook", 2024-05-27T09:59:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "test_orchestrator" 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Orchestrator backend", 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "osd_perf_query", 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "osd_support", 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pg_autoscaler", 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "threshold": { 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "threshold", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3.0", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1.0", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "scaling threshold", 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "progress", 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_pg_recovery_event": { 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_pg_recovery_event", 2024-05-27T09:59:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": { 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enabled", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "max_completed_events": { 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_completed_events", 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "50", 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "number of past completed events to remember", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long the module is going to sleep", 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prometheus", 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "cache": { 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cache", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "exclude_perf_counters": { 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "exclude_perf_counters", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_stats_pools": { 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_stats_pools", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "300", 2024-05-27T09:59:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "scrape_interval": { 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "scrape_interval", 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15.0", 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "::", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "9283", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "stale_cache_strategy": { 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "stale_cache_strategy", 2024-05-27T09:59:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "log", 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_behaviour": { 2024-05-27T09:59:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_behaviour", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "default", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "default", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "error" 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_error_status_code": { 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_error_status_code", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "500", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "400", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "599", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_support", 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi071.stdout: "max_concurrent_snap_create": { 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_concurrent_snap_create", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.111 INFO:teuthology.orchestra.run.smithi071.stdout: "mirror_snapshot_schedule": { 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mirror_snapshot_schedule", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.112 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.113 INFO:teuthology.orchestra.run.smithi071.stdout: "trash_purge_schedule": { 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "trash_purge_schedule", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "restful", 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_auth": { 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enable_auth", 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "key_file": { 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "key_file", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.119 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.120 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.122 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.125 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.126 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rgw", 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.127 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.128 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.129 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.130 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rook", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.134 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.135 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.137 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.138 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.139 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "storage_class": { 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "storage_class", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "local", 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "selftest", 2024-05-27T09:59:58.141 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.142 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.143 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.144 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.145 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.146 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "roption1": { 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "roption1", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.147 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "roption2": { 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "roption2", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "xyz", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.148 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption1": { 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption1", 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.149 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption2": { 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption2", 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.150 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption3": { 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption3", 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.151 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption4": { 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption4", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.152 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption5": { 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption5", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption6": { 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption6", 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.158 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption7": { 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption7", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "42", 2024-05-27T09:59:58.159 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "testkey": { 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testkey", 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.161 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "testlkey": { 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testlkey", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.162 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "testnewline": { 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testnewline", 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.163 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smb", 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.164 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.165 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.166 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.168 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.169 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.170 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "update_orchestration": { 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "update_orchestration", 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.171 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snap_schedule", 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.172 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_m_granularity": { 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_m_granularity", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow minute scheduled snapshots", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.173 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "dump_on_update": { 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "dump_on_update", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "dump database to debug log on update", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.174 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.175 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.176 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.177 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.179 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.180 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "stats", 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.181 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.182 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.183 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.184 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.186 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.187 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "status", 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.188 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.189 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.190 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.191 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "telegraf", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "address": { 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "address", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.197 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "telemetry", 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_basic": { 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_basic", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_crash": { 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_crash", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_device": { 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_device", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_ident": { 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_ident", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_perf": { 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_perf", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "contact": { 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "contact", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "description": { 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "description", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "device_url": { 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_url", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": { 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enabled", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "24", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "8", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "last_opt_revision": { 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "last_opt_revision", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "leaderboard": { 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "leaderboard", 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "leaderboard_description": { 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "leaderboard_description", 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "organization": { 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "organization", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "proxy": { 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "proxy", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "url": { 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "url", 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "test_orchestrator", 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.226 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.227 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.228 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.229 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.230 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.232 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "volumes", 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.233 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.234 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.235 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.236 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "max_concurrent_clones": { 2024-05-27T09:59:58.238 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_concurrent_clones", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "4", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "periodic_async_work": { 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "periodic_async_work", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Periodically check for async work", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "snapshot_clone_delay": { 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snapshot_clone_delay", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.241 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "snapshot_clone_no_wait": { 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snapshot_clone_no_wait", 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-27T09:59:58.242 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.243 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix", 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.244 INFO:teuthology.orchestra.run.smithi071.stdout: "discovery_interval": { 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "discovery_interval", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "100", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.245 INFO:teuthology.orchestra.run.smithi071.stdout: "identifier": { 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "identifier", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.248 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.249 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.250 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.251 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.253 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_host": { 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_host", 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.254 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_port": { 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_port", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10051", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.255 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_sender": { 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_sender", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.256 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: "gid": 25054, 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "z", 2024-05-27T09:59:58.257 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_features": 4540701547738038271, 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "available_modules": [ 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "alerts", 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.258 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How frequently to reexamine health status", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.259 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.260 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.261 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.262 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.263 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_destination": { 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_destination", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.264 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Email address to send alerts to", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_from_name": { 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_from_name", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.265 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "Ceph", 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Email From: name", 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_host": { 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_host", 2024-05-27T09:59:58.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP server", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_password": { 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_password", 2024-05-27T09:59:58.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Password to authenticate with", 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.268 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_port": { 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_port", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "465", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP port", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_sender": { 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_sender", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP envelope sender", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_ssl": { 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_ssl", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.271 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_user": { 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_user", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "User to authenticate as", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.273 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "balancer", 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "active": { 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "active", 2024-05-27T09:59:58.274 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically balance PGs across cluster", 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.275 INFO:teuthology.orchestra.run.smithi071.stdout: "begin_time": { 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "begin_time", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0000", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "beginning time of day to automatically balance", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: "begin_weekday": { 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "begin_weekday", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "6", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.277 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_max_iterations": { 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_max_iterations", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "25", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "250", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_metrics": { 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_metrics", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "pgs,objects,bytes", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_step": { 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_step", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0.5", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0.001", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "0.999", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "aggressiveness of optimization", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.280 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "end_time": { 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "end_time", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "2359", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "ending time of day to automatically balance", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-27T09:59:58.281 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "end_weekday": { 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "end_weekday", 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0", 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "6", 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-27T09:59:58.282 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.283 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.284 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.285 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.286 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.287 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "min_score": { 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "min_score", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.288 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": { 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mode", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.289 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "upmap", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "crush-compat", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "none", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "read", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap-read" 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Balancer mode", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.290 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_ids": { 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pool_ids", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.291 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.292 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.293 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap_max_deviation": { 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "upmap_max_deviation", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-27T09:59:58.294 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap_max_optimizations": { 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "upmap_max_optimizations", 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.295 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephadm", 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_down_multiplier": { 2024-05-27T09:59:58.296 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_down_multiplier", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3.0", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.297 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_refresh_rate": { 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_refresh_rate", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "20", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_starting_port": { 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_starting_port", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "4721", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.299 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_ptrace": { 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_ptrace", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-27T09:59:58.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "autotune_interval": { 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "autotune_interval", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.301 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "autotune_memory_target_ratio": { 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "autotune_memory_target_ratio", 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0.7", 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-27T09:59:58.302 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm_log_destination": { 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephadm_log_destination", 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.303 INFO:teuthology.orchestra.run.smithi071.stdout: "file", 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "file,syslog", 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "syslog" 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "cgroups_split": { 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cgroups_split", 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.304 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "config_checks_enabled": { 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_checks_enabled", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.305 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "config_dashboard": { 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_dashboard", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_alertmanager": { 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_alertmanager", 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.307 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_base": { 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_base", 2024-05-27T09:59:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Container image name, without the tag", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_elasticsearch": { 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_elasticsearch", 2024-05-27T09:59:58.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "elasticsearch container image", 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.310 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_grafana": { 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_grafana", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.311 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_haproxy": { 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_haproxy", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "HAproxy container image", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.312 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_agent": { 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_agent", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger agent container image", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.313 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_collector": { 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_collector", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger collector container image", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_query": { 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_query", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger query container image", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_keepalived": { 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_keepalived", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Keepalived container image", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.316 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_loki": { 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_loki", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Loki container image", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.317 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_node_exporter": { 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_node_exporter", 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.318 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_nvmeof": { 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_nvmeof", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Nvme-of container image", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.319 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_prometheus": { 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_prometheus", 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.320 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_promtail": { 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_promtail", 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.321 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Promtail container image", 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_samba": { 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_samba", 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.322 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Samba/SMB container image", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_snmp_gateway": { 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_snmp_gateway", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.323 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SNMP Gateway container image", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "container_init": { 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_init", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.324 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Run podman/docker with `--init`", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "daemon_cache_timeout": { 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "daemon_cache_timeout", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "default_cephadm_command_timeout": { 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default_cephadm_command_timeout", 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "900", 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "default_registry": { 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default_registry", 2024-05-27T09:59:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "device_cache_timeout": { 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_cache_timeout", 2024-05-27T09:59:58.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1800", 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache device inventory", 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "device_enhanced_scan": { 2024-05-27T09:59:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_enhanced_scan", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.330 INFO:teuthology.orchestra.run.smithi071.stdout: "facts_cache_timeout": { 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "facts_cache_timeout", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache host facts data", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.331 INFO:teuthology.orchestra.run.smithi071.stdout: "grafana_dashboards_path": { 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "grafana_dashboards_path", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "host_check_interval": { 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "host_check_interval", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to perform a host check", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.333 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "hw_monitoring": { 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "hw_monitoring", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.334 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "inventory_list_all": { 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "inventory_list_all", 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.335 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.336 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.337 INFO:teuthology.orchestra.run.smithi071.stdout: "log_refresh_metadata": { 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_refresh_metadata", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.341 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.342 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "*", 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "max_count_per_host": { 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_count_per_host", 2024-05-27T09:59:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "max number of daemons per service per host", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "max_osd_draining_count": { 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_osd_draining_count", 2024-05-27T09:59:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "migration_current": { 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "migration_current", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "internal - do not modify", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": { 2024-05-27T09:59:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mode", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "root", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm-package", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "root" 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "mode for remote execution of cephadm", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "oob_default_addr": { 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "oob_default_addr", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "169.254.1.1", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "prometheus_alerts_path": { 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prometheus_alerts_path", 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_insecure": { 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_insecure", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_password": { 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_password", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_url": { 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_url", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-27T09:59:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_username": { 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_username", 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "secure_monitoring_stack": { 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "secure_monitoring_stack", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "service_discovery_port": { 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "service_discovery_port", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8765", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "cephadm service discovery port", 2024-05-27T09:59:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "ssh_config_file": { 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssh_config_file", 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-27T09:59:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "use_agent": { 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "use_agent", 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-27T09:59:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "use_repo_digest": { 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "use_repo_digest", 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_failed_host_check": { 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_failed_host_check", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if the host check fails", 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_stray_daemons": { 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_stray_daemons", 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_stray_hosts": { 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_stray_hosts", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crash", 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "retain_interval": { 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "retain_interval", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "31536000", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-27T09:59:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_recent_interval": { 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_recent_interval", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1209600", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "dashboard", 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-27T09:59:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "ALERTMANAGER_API_HOST": { 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "AUDIT_API_ENABLED": { 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "AUDIT_API_ENABLED", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "ENABLE_BROWSABLE_API": { 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_PASSWORD": { 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_URL": { 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_URL", 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_USERNAME": { 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "[]", 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "MULTICLUSTER_CONFIG": { 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "{}", 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "PROMETHEUS_API_HOST": { 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-27T09:59:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-27T09:59:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_ENABLED": { 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "45", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_ACCESS_KEY": { 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_SECRET_KEY": { 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_SSL_VERIFY": { 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "UNSAFE_TLS_v1_2": { 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "cross_origin_url": { 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cross_origin_url", 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "crt_file": { 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crt_file", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "debug": { 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "debug", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable/disable debug options", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "jwt_token_ttl": { 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "jwt_token_ttl", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "28800", 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "key_file": { 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "key_file", 2024-05-27T09:59:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "motd": { 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "motd", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "The message of the day", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "redirect_resolve_ip_addr": { 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "redirect_resolve_ip_addr", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "::", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8080", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl": { 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl_server_port": { 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl_server_port", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8443", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_behaviour": { 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_behaviour", 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "redirect", 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "redirect" 2024-05-27T09:59:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_error_status_code": { 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_error_status_code", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "500", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "400", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "599", 2024-05-27T09:59:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "url_prefix": { 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "url_prefix", 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "devicehealth", 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_monitoring": { 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enable_monitoring", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "monitor device health metrics", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "mark_out_threshold": { 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mark_out_threshold", 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "2419200", 2024-05-27T09:59:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": { 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pool_name", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "device_health_metrics", 2024-05-27T09:59:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "retention_period": { 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "retention_period", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15552000", 2024-05-27T09:59:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long to retain device health metrics", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "scrape_frequency": { 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "scrape_frequency", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "86400", 2024-05-27T09:59:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "self_heal": { 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "self_heal", 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to wake up and check device health", 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_threshold": { 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_threshold", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "7257600", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "diskprediction_local", 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "predict_interval": { 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "predict_interval", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "86400", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "predictor_model": { 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "predictor_model", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "prophetstor", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "influx", 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": false, 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "influxdb python module not found", 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "batch_size": { 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "batch_size", 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.473 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5000", 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "database": { 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "database", 2024-05-27T09:59:58.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "ceph", 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": { 2024-05-27T09:59:58.475 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "hostname", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB server hostname", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "30", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "5", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.482 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "password": { 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "password", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "password of InfluxDB server user", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "port": { 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "port", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8086", 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB server port", 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.485 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl": { 2024-05-27T09:59:58.486 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "false", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "threads": { 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "threads", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "32", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.488 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "username": { 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "username", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "username of InfluxDB server user", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.489 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "verify_ssl": { 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "verify_ssl", 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "true", 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.490 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "insights", 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.491 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.492 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.493 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.494 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.495 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.496 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "iostat", 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.498 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.499 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.500 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.501 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.502 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.503 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.504 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "k8sevents", 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_event_retention_days": { 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ceph_event_retention_days", 2024-05-27T09:59:58.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "7", 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "config_check_secs": { 2024-05-27T09:59:58.506 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_check_secs", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "10", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.508 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.509 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.510 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.511 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.512 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.513 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "localpool", 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "failure_domain": { 2024-05-27T09:59:58.514 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "failure_domain", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "host", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "failure domain for any created local pool", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.515 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.517 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.518 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.519 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.520 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": { 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "min_size", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.521 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default min_size for any created local pool", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "num_rep": { 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "num_rep", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default replica count for any created local pool", 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": { 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pg_num", 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "128", 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default pg_num for any created local pool", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "prefix": { 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prefix", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "name prefix for any created local pool", 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "subtree": { 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "subtree", 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "rack", 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mds_autoscaler", 2024-05-27T09:59:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mirroring", 2024-05-27T09:59:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "nfs", 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "orchestrator", 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "fail_fs": { 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "fail_fs", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-27T09:59:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator": { 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "orchestrator", 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm", 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "rook", 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "test_orchestrator" 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Orchestrator backend", 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "osd_perf_query", 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.558 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.561 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.562 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "osd_support", 2024-05-27T09:59:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.568 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.569 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.570 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.571 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pg_autoscaler", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.572 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.573 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.574 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.575 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.576 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.578 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "threshold": { 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "threshold", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.579 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3.0", 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1.0", 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "scaling threshold", 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "progress", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_pg_recovery_event": { 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_pg_recovery_event", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.581 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": { 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enabled", 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.582 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.583 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.586 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.587 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "max_completed_events": { 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_completed_events", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.588 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "50", 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "number of past completed events to remember", 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.589 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long the module is going to sleep", 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.590 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.591 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prometheus", 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "cache": { 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cache", 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.592 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "exclude_perf_counters": { 2024-05-27T09:59:58.593 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "exclude_perf_counters", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.596 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.597 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.598 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.599 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_stats_pools": { 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_stats_pools", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.600 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "300", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.601 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "scrape_interval": { 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "scrape_interval", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15.0", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.602 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "::", 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.603 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "9283", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.604 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.605 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "stale_cache_strategy": { 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "stale_cache_strategy", 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "log", 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_behaviour": { 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_behaviour", 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.607 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "default", 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "default", 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "error" 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_error_status_code": { 2024-05-27T09:59:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_error_status_code", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "500", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "400", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "599", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_support", 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "max_concurrent_snap_create": { 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_concurrent_snap_create", 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "mirror_snapshot_schedule": { 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mirror_snapshot_schedule", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "trash_purge_schedule": { 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "trash_purge_schedule", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "restful", 2024-05-27T09:59:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_auth": { 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enable_auth", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "key_file": { 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "key_file", 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rgw", 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rook", 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "storage_class": { 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "storage_class", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "local", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "selftest", 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "roption1": { 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "roption1", 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "roption2": { 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "roption2", 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "xyz", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption1": { 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption1", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption2": { 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption2", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption3": { 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption3", 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption4": { 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption4", 2024-05-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption5": { 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption5", 2024-05-27T09:59:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption6": { 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption6", 2024-05-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption7": { 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption7", 2024-05-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "42", 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "testkey": { 2024-05-27T09:59:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testkey", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "testlkey": { 2024-05-27T09:59:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testlkey", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "testnewline": { 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testnewline", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smb", 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "update_orchestration": { 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "update_orchestration", 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-27T09:59:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snap_schedule", 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_m_granularity": { 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_m_granularity", 2024-05-27T09:59:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow minute scheduled snapshots", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "dump_on_update": { 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "dump_on_update", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "dump database to debug log on update", 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "stats", 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "status", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "telegraf", 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "address": { 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "address", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "telemetry", 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_basic": { 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_basic", 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_crash": { 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_crash", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_device": { 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_device", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_ident": { 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_ident", 2024-05-27T09:59:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_perf": { 2024-05-27T09:59:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_perf", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "contact": { 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "contact", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "description": { 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "description", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "device_url": { 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_url", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": { 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enabled", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "24", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "8", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "last_opt_revision": { 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "last_opt_revision", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "leaderboard": { 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "leaderboard", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "leaderboard_description": { 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "leaderboard_description", 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "organization": { 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "organization", 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "proxy": { 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "proxy", 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "url": { 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "url", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "test_orchestrator", 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "volumes", 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.744 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "max_concurrent_clones": { 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_concurrent_clones", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "4", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "periodic_async_work": { 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "periodic_async_work", 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Periodically check for async work", 2024-05-27T09:59:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "snapshot_clone_delay": { 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snapshot_clone_delay", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-27T09:59:58.747 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "snapshot_clone_no_wait": { 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snapshot_clone_no_wait", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-27T09:59:58.748 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.749 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix", 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "discovery_interval": { 2024-05-27T09:59:58.750 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "discovery_interval", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "100", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.751 INFO:teuthology.orchestra.run.smithi071.stdout: "identifier": { 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "identifier", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.752 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.753 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.754 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.755 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.757 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.758 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.759 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_host": { 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_host", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.760 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_port": { 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_port", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10051", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_sender": { 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_sender", 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.762 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "modules": [ 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm", 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "dashboard", 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "iostat", 2024-05-27T09:59:58.763 INFO:teuthology.orchestra.run.smithi071.stdout: "nfs", 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "restful", 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_schedule" 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "available_modules": [ 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "alerts", 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.764 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How frequently to reexamine health status", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.765 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.766 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.767 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.768 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.769 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_destination": { 2024-05-27T09:59:58.770 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_destination", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Email address to send alerts to", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.771 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_from_name": { 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_from_name", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "Ceph", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Email From: name", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_host": { 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_host", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP server", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_password": { 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_password", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Password to authenticate with", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_port": { 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_port", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "465", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP port", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.775 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_sender": { 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_sender", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SMTP envelope sender", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.776 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_ssl": { 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_ssl", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.777 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "smtp_user": { 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smtp_user", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "User to authenticate as", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.778 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "balancer", 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "active": { 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "active", 2024-05-27T09:59:58.780 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically balance PGs across cluster", 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "begin_time": { 2024-05-27T09:59:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "begin_time", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0000", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "beginning time of day to automatically balance", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.782 INFO:teuthology.orchestra.run.smithi071.stdout: "begin_weekday": { 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "begin_weekday", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "6", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_max_iterations": { 2024-05-27T09:59:58.783 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_max_iterations", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "25", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "250", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_metrics": { 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_metrics", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "pgs,objects,bytes", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_compat_step": { 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crush_compat_step", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0.5", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0.001", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "0.999", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "aggressiveness of optimization", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.786 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "end_time": { 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "end_time", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "2359", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "ending time of day to automatically balance", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-27T09:59:58.787 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "end_weekday": { 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "end_weekday", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "0", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "6", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-27T09:59:58.788 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.789 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.791 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.793 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "min_score": { 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "min_score", 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-27T09:59:58.794 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": { 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mode", 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "upmap", 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.795 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "crush-compat", 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "none", 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "read", 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap", 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap-read" 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Balancer mode", 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_ids": { 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pool_ids", 2024-05-27T09:59:58.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.797 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.798 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.799 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap_max_deviation": { 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "upmap_max_deviation", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "upmap_max_optimizations": { 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "upmap_max_optimizations", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.801 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephadm", 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_down_multiplier": { 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_down_multiplier", 2024-05-27T09:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3.0", 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.803 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_refresh_rate": { 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_refresh_rate", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "20", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.804 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "agent_starting_port": { 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "agent_starting_port", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "4721", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_ptrace": { 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_ptrace", 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-27T09:59:58.806 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "autotune_interval": { 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "autotune_interval", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-27T09:59:58.807 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "autotune_memory_target_ratio": { 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "autotune_memory_target_ratio", 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0.7", 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.808 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm_log_destination": { 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephadm_log_destination", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "file", 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "file,syslog", 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "syslog" 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "cgroups_split": { 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cgroups_split", 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.810 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "config_checks_enabled": { 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_checks_enabled", 2024-05-27T09:59:58.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.812 INFO:teuthology.orchestra.run.smithi071.stdout: "config_dashboard": { 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_dashboard", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.813 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_alertmanager": { 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_alertmanager", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.814 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_base": { 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_base", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Container image name, without the tag", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.815 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_elasticsearch": { 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_elasticsearch", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "elasticsearch container image", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.816 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_grafana": { 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_grafana", 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.817 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_haproxy": { 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_haproxy", 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "HAproxy container image", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_agent": { 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_agent", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.819 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger agent container image", 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_collector": { 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_collector", 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-27T09:59:58.820 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger collector container image", 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_jaeger_query": { 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_jaeger_query", 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.821 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Jaeger query container image", 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_keepalived": { 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_keepalived", 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.822 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Keepalived container image", 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_loki": { 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_loki", 2024-05-27T09:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Loki container image", 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_node_exporter": { 2024-05-27T09:59:58.824 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_node_exporter", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.825 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_nvmeof": { 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_nvmeof", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Nvme-of container image", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_prometheus": { 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_prometheus", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Prometheus container image", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_promtail": { 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_promtail", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Promtail container image", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.828 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_samba": { 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_samba", 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Samba/SMB container image", 2024-05-27T09:59:58.829 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image_snmp_gateway": { 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_image_snmp_gateway", 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.830 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "SNMP Gateway container image", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "container_init": { 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "container_init", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.831 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Run podman/docker with `--init`", 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "daemon_cache_timeout": { 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "daemon_cache_timeout", 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.832 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "default_cephadm_command_timeout": { 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default_cephadm_command_timeout", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "900", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.833 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "default_registry": { 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default_registry", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "docker.io", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.834 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "device_cache_timeout": { 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_cache_timeout", 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.835 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1800", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache device inventory", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "device_enhanced_scan": { 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_enhanced_scan", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "facts_cache_timeout": { 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "facts_cache_timeout", 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.837 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "seconds to cache host facts data", 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "grafana_dashboards_path": { 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "grafana_dashboards_path", 2024-05-27T09:59:58.838 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "host_check_interval": { 2024-05-27T09:59:58.839 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "host_check_interval", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to perform a host check", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "hw_monitoring": { 2024-05-27T09:59:58.840 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "hw_monitoring", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.841 INFO:teuthology.orchestra.run.smithi071.stdout: "inventory_list_all": { 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "inventory_list_all", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.842 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "log_refresh_metadata": { 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_refresh_metadata", 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.844 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.845 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.846 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.847 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "*", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.850 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "max_count_per_host": { 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_count_per_host", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.851 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "max number of daemons per service per host", 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "max_osd_draining_count": { 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_osd_draining_count", 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.852 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "migration_current": { 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "migration_current", 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.853 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "internal - do not modify", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "mode": { 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mode", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "root", 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm-package", 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "root" 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "mode for remote execution of cephadm", 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "oob_default_addr": { 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "oob_default_addr", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "169.254.1.1", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.856 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "prometheus_alerts_path": { 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prometheus_alerts_path", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.857 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_insecure": { 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_insecure", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.858 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_password": { 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_password", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_url": { 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_url", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "registry_username": { 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "registry_username", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "secure_monitoring_stack": { 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "secure_monitoring_stack", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "service_discovery_port": { 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "service_discovery_port", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8765", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "cephadm service discovery port", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "ssh_config_file": { 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssh_config_file", 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-27T09:59:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "use_agent": { 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "use_agent", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-27T09:59:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "use_repo_digest": { 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "use_repo_digest", 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_failed_host_check": { 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_failed_host_check", 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if the host check fails", 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_stray_daemons": { 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_stray_daemons", 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_on_stray_hosts": { 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_on_stray_hosts", 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crash", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "retain_interval": { 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "retain_interval", 2024-05-27T09:59:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "31536000", 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_recent_interval": { 2024-05-27T09:59:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_recent_interval", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1209600", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "dashboard", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "ALERTMANAGER_API_HOST": { 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "AUDIT_API_ENABLED": { 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "AUDIT_API_ENABLED", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.884 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.885 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "ENABLE_BROWSABLE_API": { 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.887 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-27T09:59:58.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-27T09:59:58.889 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-27T09:59:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-27T09:59:58.891 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.892 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.893 INFO:teuthology.orchestra.run.smithi071.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.895 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_PASSWORD": { 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.896 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.897 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_URL": { 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_URL", 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.898 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_API_USERNAME": { 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.899 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.900 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.901 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.902 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.903 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "[]", 2024-05-27T09:59:58.904 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "MULTICLUSTER_CONFIG": { 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "{}", 2024-05-27T09:59:58.905 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "PROMETHEUS_API_HOST": { 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.906 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.907 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.908 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.909 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.911 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-27T09:59:58.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-27T09:59:58.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-27T09:59:58.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_ENABLED": { 2024-05-27T09:59:58.915 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-27T09:59:58.916 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.917 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "45", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.920 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_ACCESS_KEY": { 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "admin", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.922 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_SECRET_KEY": { 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.923 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "RGW_API_SSL_VERIFY": { 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.924 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "UNSAFE_TLS_v1_2": { 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.926 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.927 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "cross_origin_url": { 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cross_origin_url", 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.929 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "crt_file": { 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "crt_file", 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "debug": { 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "debug", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Enable/disable debug options", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "jwt_token_ttl": { 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "jwt_token_ttl", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "28800", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "key_file": { 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "key_file", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.936 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "motd": { 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "motd", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "The message of the day", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.940 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "redirect_resolve_ip_addr": { 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "redirect_resolve_ip_addr", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "::", 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.942 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8080", 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.943 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.944 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl": { 2024-05-27T09:59:58.945 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.946 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl_server_port": { 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl_server_port", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8443", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.947 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_behaviour": { 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_behaviour", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "redirect", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "redirect" 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.948 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_error_status_code": { 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_error_status_code", 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "500", 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "400", 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "599", 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.949 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "url_prefix": { 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "url_prefix", 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "devicehealth", 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_monitoring": { 2024-05-27T09:59:58.951 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enable_monitoring", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "monitor device health metrics", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.952 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.953 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.954 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.955 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.956 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.957 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "mark_out_threshold": { 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mark_out_threshold", 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "2419200", 2024-05-27T09:59:58.958 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": { 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pool_name", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "device_health_metrics", 2024-05-27T09:59:58.959 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "retention_period": { 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "retention_period", 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.960 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15552000", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long to retain device health metrics", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "scrape_frequency": { 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "scrape_frequency", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.961 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "86400", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "self_heal": { 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "self_heal", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.962 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.963 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how frequently to wake up and check device health", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "warn_threshold": { 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "warn_threshold", 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "7257600", 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "diskprediction_local", 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "predict_interval": { 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "predict_interval", 2024-05-27T09:59:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "86400", 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "predictor_model": { 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "predictor_model", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "prophetstor", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "600", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "influx", 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": false, 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "influxdb python module not found", 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "batch_size": { 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "batch_size", 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5000", 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "database": { 2024-05-27T09:59:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "database", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "ceph", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": { 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "hostname", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB server hostname", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "30", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "5", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "password": { 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "password", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "password of InfluxDB server user", 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "port": { 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "port", 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "8086", 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "InfluxDB server port", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "ssl": { 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ssl", 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "false", 2024-05-27T09:59:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "threads": { 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "threads", 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "32", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "username": { 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "username", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "username of InfluxDB server user", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "verify_ssl": { 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "verify_ssl", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "true", 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "insights", 2024-05-27T09:59:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "iostat", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "k8sevents", 2024-05-27T09:59:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_event_retention_days": { 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "ceph_event_retention_days", 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "7", 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "config_check_secs": { 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "config_check_secs", 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "10", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "localpool", 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "failure_domain": { 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "failure_domain", 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "host", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "failure domain for any created local pool", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": { 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "min_size", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default min_size for any created local pool", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-27T09:59:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "num_rep": { 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "num_rep", 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3", 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default replica count for any created local pool", 2024-05-27T09:59:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": { 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pg_num", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "128", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "default pg_num for any created local pool", 2024-05-27T09:59:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "prefix": { 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prefix", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "name prefix for any created local pool", 2024-05-27T09:59:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "subtree": { 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "subtree", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "rack", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mds_autoscaler", 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mirroring", 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "nfs", 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "orchestrator", 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "fail_fs": { 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "fail_fs", 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator": { 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "orchestrator", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "rook", 2024-05-27T09:59:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "test_orchestrator" 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Orchestrator backend", 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "osd_perf_query", 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "osd_support", 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "pg_autoscaler", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "threshold": { 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "threshold", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "3.0", 2024-05-27T09:59:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1.0", 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "scaling threshold", 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "progress", 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_pg_recovery_event": { 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_pg_recovery_event", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": { 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enabled", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.088 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.089 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "max_completed_events": { 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_completed_events", 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "50", 2024-05-27T09:59:59.090 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "number of past completed events to remember", 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "sleep_interval": { 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sleep_interval", 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "5", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "how long the module is going to sleep", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.092 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.093 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "prometheus", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "cache": { 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cache", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.094 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "exclude_perf_counters": { 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "exclude_perf_counters", 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.095 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.096 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.097 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.099 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_stats_pools": { 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_stats_pools", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.102 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "300", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "scrape_interval": { 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "scrape_interval", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.103 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15.0", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.104 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "::", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "9283", 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.106 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "stale_cache_strategy": { 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "stale_cache_strategy", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.107 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "log", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_behaviour": { 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_behaviour", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.108 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "default", 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "default", 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "error" 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "standby_error_status_code": { 2024-05-27T09:59:59.109 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "standby_error_status_code", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "500", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "400", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "599", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_support", 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.111 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.114 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.115 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "max_concurrent_snap_create": { 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_concurrent_snap_create", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.116 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10", 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "mirror_snapshot_schedule": { 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mirror_snapshot_schedule", 2024-05-27T09:59:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.119 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "trash_purge_schedule": { 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "trash_purge_schedule", 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.120 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "restful", 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.121 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_auth": { 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enable_auth", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.122 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "key_file": { 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "key_file", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.124 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.125 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.127 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.128 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "server_addr": { 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_addr", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.129 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "server_port": { 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "server_port", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.130 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.131 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.132 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rgw", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.134 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.135 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.136 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.137 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.138 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rook", 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.139 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.140 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.141 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.142 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.143 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.144 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.145 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "storage_class": { 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "storage_class", 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "local", 2024-05-27T09:59:59.146 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "selftest", 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.147 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.148 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.149 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.151 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "roption1": { 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "roption1", 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.153 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "roption2": { 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "roption2", 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "xyz", 2024-05-27T09:59:59.154 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption1": { 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption1", 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.155 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption2": { 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption2", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.156 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption3": { 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption3", 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "float", 2024-05-27T09:59:59.157 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption4": { 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption4", 2024-05-27T09:59:59.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption5": { 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption5", 2024-05-27T09:59:59.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption6": { 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption6", 2024-05-27T09:59:59.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rwoption7": { 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rwoption7", 2024-05-27T09:59:59.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "1", 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "42", 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.162 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "testkey": { 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testkey", 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "testlkey": { 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testlkey", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.165 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "testnewline": { 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "testnewline", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.166 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "smb", 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.167 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.168 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.169 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.170 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.172 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.173 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "update_orchestration": { 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "update_orchestration", 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-27T09:59:59.174 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snap_schedule", 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_m_granularity": { 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "allow_m_granularity", 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "allow minute scheduled snapshots", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "dump_on_update": { 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "dump_on_update", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "dump database to debug log on update", 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.182 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "stats", 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.186 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "status", 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "telegraf", 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "address": { 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "address", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "15", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "telemetry", 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_basic": { 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_basic", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_crash": { 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_crash", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_device": { 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_device", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_ident": { 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_ident", 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-27T09:59:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "channel_perf": { 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "channel_perf", 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "contact": { 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "contact", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "description": { 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "description", 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.214 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "device_url": { 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "device_url", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.215 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": { 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "enabled", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "24", 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "8", 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "last_opt_revision": { 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "last_opt_revision", 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "1", 2024-05-27T09:59:59.218 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "leaderboard": { 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "leaderboard", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.219 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "leaderboard_description": { 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "leaderboard_description", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.220 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.221 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.223 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.224 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.225 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "organization": { 2024-05-27T09:59:59.226 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "organization", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.227 INFO:teuthology.orchestra.run.smithi071.stdout: "proxy": { 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "proxy", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.229 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "url": { 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "url", 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.230 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "test_orchestrator", 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.231 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.232 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.233 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.234 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.236 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.237 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "volumes", 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.240 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.241 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.243 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "max_concurrent_clones": { 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "max_concurrent_clones", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "4", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.244 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "periodic_async_work": { 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "periodic_async_work", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Periodically check for async work", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.245 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "snapshot_clone_delay": { 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snapshot_clone_delay", 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-27T09:59:59.246 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "snapshot_clone_no_wait": { 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snapshot_clone_no_wait", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "True", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-27T09:59:59.247 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.248 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix", 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "can_run": true, 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "error_string": "", 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "module_options": { 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "discovery_interval": { 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "discovery_interval", 2024-05-27T09:59:59.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "uint", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "100", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "identifier": { 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "identifier", 2024-05-27T09:59:59.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.251 INFO:teuthology.orchestra.run.smithi071.stdout: "interval": { 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "interval", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "secs", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "60", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.252 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "log_level": { 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_level", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.253 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster": { 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster", 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.254 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_cluster_level": { 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_cluster_level", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.255 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "info", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [ 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "critical", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "error", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "info", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "warning" 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.256 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": { 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "log_to_file", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "bool", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "False", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.257 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "sqlite3_killpoint": { 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "sqlite3_killpoint", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "dev", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "0", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.258 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_host": { 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_host", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.259 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_port": { 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_port", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "int", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "10051", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "zabbix_sender": { 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "zabbix_sender", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "str", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "level": "advanced", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 0, 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "min": "", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "max": "", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "enum_allowed": [], 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "desc": "", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "long_desc": "", 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: "see_also": [] 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "services": { 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "dashboard": "https://172.21.15.71:8443/" 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "always_on_modules": { 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus": [ 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "balancer", 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "devicehealth", 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator", 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscaler", 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "progress", 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_support", 2024-05-27T09:59:59.262 INFO:teuthology.orchestra.run.smithi071.stdout: "status", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "telemetry", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "volumes" 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific": [ 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "balancer", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "devicehealth", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscaler", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "progress", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_support", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "status", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "telemetry", 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: "volumes" 2024-05-27T09:59:59.263 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy": [ 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "balancer", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "devicehealth", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscaler", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "progress", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_support", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "status", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "telemetry", 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "volumes" 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "reef": [ 2024-05-27T09:59:59.264 INFO:teuthology.orchestra.run.smithi071.stdout: "balancer", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "devicehealth", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscaler", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "progress", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_support", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "status", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "telemetry", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "volumes" 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "squid": [ 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "balancer", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-05-27T09:59:59.265 INFO:teuthology.orchestra.run.smithi071.stdout: "devicehealth", 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "orchestrator", 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscaler", 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "progress", 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_support", 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "status", 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "telemetry", 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "volumes" 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "last_failure_osd_epoch": 84, 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "active_clients": [ 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.266 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "devicehealth", 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 665129262 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "libcephsqlite", 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-05-27T09:59:59.267 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3404149346 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "rbd_support", 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1140120235 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snap_schedule", 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 4061460843 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "snap_schedule", 2024-05-27T09:59:59.269 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 528555128 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "volumes", 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-05-27T09:59:59.270 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2024-05-27T09:59:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2315264081 2024-05-27T09:59:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T09:59:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-05-27T09:59:59.271 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T09:59:59.272 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:57 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2640272093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-27T09:59:59.272 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:57 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4254883387' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-27T09:59:59.272 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:57 smithi072 ceph-mon[35951]: pgmap v380: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 177 KiB/s wr, 96 op/s 2024-05-27T09:59:59.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:57 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2640272093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-27T09:59:59.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:57 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4254883387' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-27T09:59:59.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:57 smithi122 ceph-mon[36436]: pgmap v380: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 177 KiB/s wr, 96 op/s 2024-05-27T09:59:59.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f13040b29d0 msgr2=0x7f13040b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f13040b29d0 0x7f13040b4ee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13201a1b50 tx=0x7f1310005f90 comp rx=0 tx=0).stop 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f132010f330 msgr2=0x7f13201a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f132010f330 0x7f13201a0a10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1318005e30 tx=0x7f13180317c0 comp rx=0 tx=0).stop 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 shutdown_connections 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f13040b29d0 0x7f13040b4ee0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f132010f330 0x7f13201a0a10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f132010e870 0x7f13201a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 --2- 172.21.15.71:0/4254883387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f132010a2e0 0x7f13201a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 >> 172.21.15.71:0/4254883387 conn(0x7f1320076c80 msgr2=0x7f1320107d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T09:59:59.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 shutdown_connections 2024-05-27T09:59:59.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T09:59:57.748+0000 7f131f200640 1 -- 172.21.15.71:0/4254883387 wait complete. 2024-05-27T09:59:59.329 DEBUG:tasks.check_counter:Getting stats from a 2024-05-27T09:59:59.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-27T09:59:59.330 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:57 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2640272093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-27T09:59:59.330 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:57 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4254883387' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-27T09:59:59.330 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:57 smithi071 ceph-mon[31451]: pgmap v380: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 177 KiB/s wr, 96 op/s 2024-05-27T09:59:59.776 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:00.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 09:59:59 smithi071 ceph-mon[31451]: pgmap v381: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-27T10:00:00.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31447]: 2024-05-27T09:59:59.999+0000 7f2cfbc00700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-27T10:00:00.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31447]: 2024-05-27T09:59:59.999+0000 7f2cfbc00700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-27T10:00:00.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31447]: 2024-05-27T09:59:59.999+0000 7f2cfbc00700 -1 log_channel(cluster) log [ERR] : mds.i(mds.2): Metadata damage detected 2024-05-27T10:00:00.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 09:59:59 smithi122 ceph-mon[36436]: pgmap v381: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-27T10:00:00.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 09:59:59 smithi072 ceph-mon[35951]: pgmap v381: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-27T10:00:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:00 smithi122 ceph-mon[36436]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-27T10:00:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:00 smithi122 ceph-mon[36436]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-27T10:00:01.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:00 smithi122 ceph-mon[36436]: mds.i(mds.2): Metadata damage detected 2024-05-27T10:00:01.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:00 smithi071 ceph-mon[31451]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-27T10:00:01.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:00 smithi071 ceph-mon[31451]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-27T10:00:01.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:00 smithi071 ceph-mon[31451]: mds.i(mds.2): Metadata damage detected 2024-05-27T10:00:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:00 smithi072 ceph-mon[35951]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-27T10:00:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:00 smithi072 ceph-mon[35951]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-27T10:00:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:00 smithi072 ceph-mon[35951]: mds.i(mds.2): Metadata damage detected 2024-05-27T10:00:02.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:01 smithi122 ceph-mon[36436]: pgmap v382: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-05-27T10:00:02.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:01 smithi071 ceph-mon[31451]: pgmap v382: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-05-27T10:00:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:01 smithi072 ceph-mon[35951]: pgmap v382: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-05-27T10:00:02.396 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 2469, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1818, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 679609, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 756498, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 9, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.377898989, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.174110119, 2024-05-27T10:00:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.251661973, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.011056976, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1816, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.167906363, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000092459 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3964, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002534093, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000639 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 383, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 522, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1819637, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 616210, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 14, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.162738128, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.058454316, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.118816974, 2024-05-27T10:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.013683204, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 522, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.084624672, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000162116 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 42, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000020079, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000478 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1813616, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 534736 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 53, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 108, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 14278, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 308616, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 21, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 7, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.034821873, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.011705903, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.017077493, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.001714700, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 105, 2024-05-27T10:00:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.020199389, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000192375 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 24, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000005437, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000226 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1856, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 165264 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-05-27T10:00:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 128, 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.033938656, 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000265145 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-05-27T10:00:02.403 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 32, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.003173333, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000099166 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 31, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 23, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 23, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.036807375, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001600320 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.404 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 8, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 11, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 12, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 2, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 10, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 12, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 18, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 1, 2024-05-27T10:00:02.405 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 1, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 3, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 79, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 55, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 8, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 2, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 2, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 14, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 2, 2024-05-27T10:00:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 8, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 6, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 6, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-05-27T10:00:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 6, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 24, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 18, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 30, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 7, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 5, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 18 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-05-27T10:00:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 3, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 7, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 7, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-05-27T10:00:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 10, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 145, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 2, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-05-27T10:00:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 47, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 47, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 2, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-05-27T10:00:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4281466, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 27, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.061153706, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002264952 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 18, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 40, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 22, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 17, 2024-05-27T10:00:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 26, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 9, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 21, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 48, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 27, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 1, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 20, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 19, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 121856, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 223632 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-05-27T10:00:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 45, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 2, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 31, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 26, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 104, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.005551501, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005551501 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 11, 2024-05-27T10:00:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.005680163, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000516378 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000134735, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000134735 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-05-27T10:00:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-05-27T10:00:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-05-27T10:00:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002248026, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000749342 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-05-27T10:00:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-05-27T10:00:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 7, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.023192950, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.003313278 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 4, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 2, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 13, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 6, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 672, 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-05-27T10:00:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 264303, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 94, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8032, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 167, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 81914, 2024-05-27T10:00:02.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 441, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 111, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 102051, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 33, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 111, 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-05-27T10:00:02.431 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 111, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.586989770, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005288196 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 111, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 148 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 111, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 9, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 102, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-05-27T10:00:02.432 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 10, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 3, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 30, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 16, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 19, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-05-27T10:00:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 6, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 20, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-05-27T10:00:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-05-27T10:00:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 95, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 14, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 10, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 11, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 1, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 36, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 8 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-05-27T10:00:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 134 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 4, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 4, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 7, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 7, 2024-05-27T10:00:02.437 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2901, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 2232508, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2901, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2901, 2024-05-27T10:00:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2232508, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 111, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 103094, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 111, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 103094, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:02.440 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 111, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 111, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 111, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 111, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.441 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 7, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1043, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 7, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 3, 2024-05-27T10:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1043, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55cc4191c9c0": { 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 47, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 87162, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:02.443 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 47, 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 27, 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 87162, 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:02.444 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T10:00:03.484 INFO:tasks.check_counter:Daemon mds.a mds.exported=2 2024-05-27T10:00:03.484 INFO:tasks.check_counter:Daemon mds.a mds.imported=2 2024-05-27T10:00:03.484 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=6 2024-05-27T10:00:03.485 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-05-27T10:00:03.485 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-05-27T10:00:03.485 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-05-27T10:00:03.485 DEBUG:tasks.check_counter:Getting stats from d 2024-05-27T10:00:03.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-27T10:00:03.928 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:04.228 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:03 smithi071 ceph-mon[31451]: pgmap v383: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 24 op/s 2024-05-27T10:00:04.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:03 smithi122 ceph-mon[36436]: pgmap v383: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 24 op/s 2024-05-27T10:00:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:03 smithi072 ceph-mon[35951]: pgmap v383: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 24 op/s 2024-05-27T10:00:06.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:05 smithi071 ceph-mon[31451]: pgmap v384: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 24 op/s 2024-05-27T10:00:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:05 smithi122 ceph-mon[36436]: pgmap v384: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 24 op/s 2024-05-27T10:00:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:05 smithi072 ceph-mon[35951]: pgmap v384: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 24 op/s 2024-05-27T10:00:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T10:00:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 4, 2024-05-27T10:00:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 4, 2024-05-27T10:00:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 2992, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 448, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 4, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 0, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.006938730, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.000046262, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.001335824, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001678825, 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000559608 2024-05-27T10:00:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 448 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 284, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 273, 2024-05-27T10:00:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1728576, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 168368, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 2, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 1, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.127379289, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.042950299, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.101465057, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.012811470, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 272, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.027845628, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000102373 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1728576, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 168368 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 2, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 208, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 320, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 194000, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-05-27T10:00:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.043072173, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.030827047, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.005293388, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 205, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.044249324, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000215850 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 194000 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 0, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 149745, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 31, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 0, 2024-05-27T10:00:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 928, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 2, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 286, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1688490, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 286, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 286, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1688490, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T10:00:07.313 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-27T10:00:07.314 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-27T10:00:07.314 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-05-27T10:00:07.314 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-05-27T10:00:07.314 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-05-27T10:00:07.314 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-05-27T10:00:07.314 DEBUG:tasks.check_counter:Getting stats from g 2024-05-27T10:00:07.314 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-27T10:00:07.761 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:08.229 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:07 smithi071 ceph-mon[31451]: pgmap v385: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-05-27T10:00:08.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:07 smithi122 ceph-mon[36436]: pgmap v385: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-05-27T10:00:08.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:07 smithi072 ceph-mon[35951]: pgmap v385: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-05-27T10:00:10.495 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T10:00:10.495 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 736, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 738, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 36667585, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 234058, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 8, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.258566432, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.055940179, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.140364796, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.043791942, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 736, 2024-05-27T10:00:10.496 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.080252465, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000109038 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 497, 2024-05-27T10:00:10.497 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 575, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 46275303, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 383537, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 7, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 6, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.229831404, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.046634745, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.143581258, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.028795497, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 574, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.062647296, 2024-05-27T10:00:10.498 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000109141 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 227024 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 401, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 398, 2024-05-27T10:00:10.499 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 42233026, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 154758, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.230577717, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.030953230, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.172563113, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.021278679, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 397, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.043391550, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000109298 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.500 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 212896, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 67616 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-05-27T10:00:10.501 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2496, 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.215695517, 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000086416 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-05-27T10:00:10.503 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 13818, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 3470, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 10348, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 65, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 2, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-05-27T10:00:10.504 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-05-27T10:00:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-05-27T10:00:10.506 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-05-27T10:00:10.507 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-05-27T10:00:10.508 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-05-27T10:00:10.509 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 27413, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 28, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 183140084, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 183242340, 2024-05-27T10:00:10.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 183242280, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 27413 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 4634, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 9131, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 4497, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 221, 2024-05-27T10:00:10.511 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 221, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 0, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 13818, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 13818, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 0, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 145760, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 215416 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-05-27T10:00:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-05-27T10:00:10.514 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.516 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.517 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-05-27T10:00:10.517 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.517 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.517 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.517 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.518 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-05-27T10:00:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 2, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 0, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 0, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 2177, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-05-27T10:00:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 413456, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 4776, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-05-27T10:00:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8032, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 167, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 20650523, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 168752, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 1502, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 26, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 4, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 1502, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1502, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2.084963647, 2024-05-27T10:00:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001388124 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1502, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1503 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 1502, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 1502, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 792, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-05-27T10:00:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 707, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 2, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-05-27T10:00:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-05-27T10:00:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 96, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-05-27T10:00:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 11, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 11, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 11, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-05-27T10:00:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 1630, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 125019742, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 1630, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1630, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 125019742, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 1502, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 124541226, 2024-05-27T10:00:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1502, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 124541226, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-05-27T10:00:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 1502, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 1502, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1502, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1502, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-05-27T10:00:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55bd28429110": { 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:10.543 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:10.544 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T10:00:10.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:10 smithi122 ceph-mon[36436]: osdmap e96: 12 total, 12 up, 12 in 2024-05-27T10:00:10.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:10 smithi122 ceph-mon[36436]: pgmap v387: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-27T10:00:10.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:10 smithi071 ceph-mon[31451]: osdmap e96: 12 total, 12 up, 12 in 2024-05-27T10:00:10.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:10 smithi071 ceph-mon[31451]: pgmap v387: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-27T10:00:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:10 smithi072 ceph-mon[35951]: osdmap e96: 12 total, 12 up, 12 in 2024-05-27T10:00:10.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:10 smithi072 ceph-mon[35951]: pgmap v387: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-27T10:00:11.786 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-27T10:00:11.786 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-27T10:00:11.786 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=6 2024-05-27T10:00:11.786 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-05-27T10:00:11.786 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-05-27T10:00:11.786 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-05-27T10:00:11.786 DEBUG:tasks.check_counter:Getting stats from j 2024-05-27T10:00:11.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-27T10:00:12.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:11 smithi071 ceph-mon[31451]: pgmap v388: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:12.222 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:12.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:11 smithi122 ceph-mon[36436]: pgmap v388: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:12.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:11 smithi072 ceph-mon[35951]: pgmap v388: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:13.997 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:13 smithi071 ceph-mon[31451]: pgmap v389: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:14.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:13 smithi122 ceph-mon[36436]: pgmap v389: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:14.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:13 smithi072 ceph-mon[35951]: pgmap v389: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:14.705 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-05-27T10:00:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 0, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 2, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 0, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 0, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 4, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 0, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.004619115, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.000000000, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.000888012, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 292, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 279, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1732656, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 171376, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 2, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 1, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.132410247, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.045555693, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.105539331, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.012696173, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 279, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.028731798, 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000102981 2024-05-27T10:00:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1732656, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 171376 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 2, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 211, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 320, 2024-05-27T10:00:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 194528, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.042496898, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.031825343, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.004141580, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 208, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.037441537, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000180007 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 194528 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 0, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 149745, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 31, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 928, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 2, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-05-27T10:00:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 290, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1689010, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 290, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 290, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1689010, 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-05-27T10:00:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-05-27T10:00:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-05-27T10:00:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-05-27T10:00:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-05-27T10:00:14.717 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-05-27T10:00:15.538 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-27T10:00:15.538 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-27T10:00:15.538 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-05-27T10:00:15.538 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-05-27T10:00:15.538 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-05-27T10:00:15.538 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-05-27T10:00:15.538 DEBUG:tasks.check_counter:Getting stats from b 2024-05-27T10:00:15.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-27T10:00:15.797 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T10:00:16.911 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:16 smithi072 ceph-mon[35951]: osdmap e97: 12 total, 12 up, 12 in 2024-05-27T10:00:16.911 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:16 smithi072 ceph-mon[35951]: pgmap v391: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-27T10:00:16.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:16 smithi122 ceph-mon[36436]: osdmap e97: 12 total, 12 up, 12 in 2024-05-27T10:00:16.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:16 smithi122 ceph-mon[36436]: pgmap v391: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-27T10:00:17.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:16 smithi071 ceph-mon[31451]: osdmap e97: 12 total, 12 up, 12 in 2024-05-27T10:00:17.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:16 smithi071 ceph-mon[31451]: pgmap v391: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 34344, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 34323, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 9562422, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 101851447, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 27, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 4, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 2.710952261, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.917796022, 2024-05-27T10:00:17.651 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.667269521, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.976403501, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 34324, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 4.588372200, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000133678 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 4660, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.001014933, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000217 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 404512, 2024-05-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 113408 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 31432, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 32210, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 11353252, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 66053996, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 16, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 6, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 2.175898938, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.638223645, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.594944992, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.835826061, 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 32212, 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 5.244946511, 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000162825 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 4201, 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000813260, 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000193 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 1819184, 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 545472 2024-05-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 65850, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 119116, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 21095715, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 87408725, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 174, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 11, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 4.691954821, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 2.108252506, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 2.608486033, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.667786321, 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 119108, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 8.680095749, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000072875 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 75585, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.022228440, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000294 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 148096, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 204736 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "cct": { 2024-05-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi072.stdout: "total_workers": 1, 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "unhealthy_workers": 0 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "finisher-MDSRank": { 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "queue_len": 0, 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "complete_latency": { 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 92575, 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 36.473937265, 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000393993 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "finisher-PurgeQueue": { 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "queue_len": 0, 2024-05-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi072.stdout: "complete_latency": { 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 9376, 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 2.720664320, 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000290173 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "request": 22600, 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "reply": 22543, 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "reply_latency": { 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 22543, 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 171.939343167, 2024-05-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.007627172 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "slow_reply": 0, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "forward": 57, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_fetch_complete": 2, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_fetch_keys": 1, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_commit": 1211, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_split": 22, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_merge": 0, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes": 9335, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_top": 5608, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_bottom": 3716, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_pin_tail": 11, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_pinned": 68, 2024-05-27T10:00:17.659 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_expired": 39, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_with_caps": 3, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": 3, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "subtrees": 3, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse": 25240, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_hit": 24459, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_forward": 56, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_discover": 0, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_dir_fetch": 0, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_remote_ino": 0, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_lock": 3, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "load_cent": 0, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "q": 0, 2024-05-27T10:00:17.660 INFO:teuthology.orchestra.run.smithi072.stdout: "exported": 4, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "exported_inodes": 32, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "imported": 4, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "imported_inodes": 127, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "openino_dir_fetch": 0, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "openino_backtrace_fetch": 3188, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "openino_peer_discover": 0, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "root_rfiles": 4, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "root_rbytes": 234, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "root_rsnaps": 6, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_backtrace_fetch": 3188, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_set_tag": 0, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_backtrace_repaired": 0, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_inotable_repaired": 0, 2024-05-27T10:00:17.661 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_dir_inodes": 90, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_dir_base_inodes": 5, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_dirfrag_rstats": 85, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_file_inodes": 3098, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_inode_file_caps": 14, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_revoke": 17546, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_grant": 20382, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_trunc": 7861, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_caps": 23654, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_caps_dirty": 12763, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_cap_release": 455, 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: "process_request_cap_release": 14853 2024-05-27T10:00:17.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_cache": { 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_update": 0, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_update_receipt": 0, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_try_discover": 0, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_send_discover": 0, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_handle_discover": 8, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "num_strays": 60, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "num_strays_delayed": 0, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "num_strays_enqueuing": 0, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_created": 5478, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_enqueued": 5415, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_reintegrated": 3, 2024-05-27T10:00:17.663 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_migrated": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "num_recovering_processing": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "num_recovering_enqueued": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "num_recovering_prioritized": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "recovery_started": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "recovery_completed": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_quiesce_path": 10, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_quiesce_inode": 36321, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_enqueue_scrub": 5, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_exportdir": 4, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_flush": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_fragmentdir": 22, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_fragstats": 0, 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_inodestats": 0 2024-05-27T10:00:17.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_log": { 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "evlrg": 0, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "evadd": 47617, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "evex": 47588, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "evtrm": 47588, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "ev": 29, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "evexg": 0, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "evexd": 6057, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "segadd": 109, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "segex": 108, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "segtrm": 108, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "seg": 1, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "segmjr": 1, 2024-05-27T10:00:17.665 INFO:teuthology.orchestra.run.smithi072.stdout: "segexg": 0, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "segexd": 9, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "expos": 183140084, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "wrpos": 183242452, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "rdpos": 0, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "jlat": { 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 25185, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 85.146690773, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.003380849 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "replayed": 0 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_mem": { 2024-05-27T10:00:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: "ino": 4643, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "ino+": 10093, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "ino-": 5450, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "dir": 231, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "dir+": 261, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "dir-": 30, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "dn": 9335, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "dn+": 15311, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "dn-": 5976, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "cap": 3, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "cap+": 14273, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "cap-": 14270, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "rss": 189272, 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: "heap": 231824 2024-05-27T10:00:17.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_server": { 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "dispatch_client_request": 40544, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "dispatch_server_request": 276, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_request": 22600, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_session": 43, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_peer_request": 560, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "req_create_latency": { 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 5433, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 66.240653168, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.012192279 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "req_getattr_latency": { 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 180, 2024-05-27T10:00:17.668 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 2.349105144, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.013050584 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "req_getfilelock_latency": { 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "req_link_latency": { 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 3, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.003148207, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.001049402 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookup_latency": { 2024-05-27T10:00:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 1691, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 10.307862559, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.006095720 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookuphash_latency": { 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupino_latency": { 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 1, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000156680, 2024-05-27T10:00:17.670 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000156680 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupname_latency": { 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupparent_latency": { 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupsnap_latency": { 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.671 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lssnap_latency": { 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 12, 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.002087760, 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000173980 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "req_mkdir_latency": { 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 72, 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.065058197, 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000903586 2024-05-27T10:00:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "req_mknod_latency": { 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "req_mksnap_latency": { 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 12, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.104548829, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.008712402 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "req_open_latency": { 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 413, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.114940209, 2024-05-27T10:00:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000278305 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "req_readdir_latency": { 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 471, 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 2.368720701, 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.005029131 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rename_latency": { 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 81, 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.239594582, 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.002957957 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "req_renamesnap_latency": { 2024-05-27T10:00:17.674 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "req_snapdiff_latency": { 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rmdir_latency": { 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 69, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 2.920557803, 2024-05-27T10:00:17.675 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.042326924 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rmsnap_latency": { 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 6, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.048475217, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.008079202 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rmxattr_latency": { 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setattr_latency": { 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 8727, 2024-05-27T10:00:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 64.410712386, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.007380624 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setdirlayout_latency": { 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setfilelock_latency": { 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 8, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.076912700, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.009614087 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.677 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setlayout_latency": { 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setxattr_latency": { 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 8, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.023047411, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.002880926 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "req_symlink_latency": { 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 5, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.003370408, 2024-05-27T10:00:17.678 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000674081 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "req_unlink_latency": { 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 5351, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 22.660391206, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.004234795 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "cap_revoke_eviction": 0, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "cap_acquisition_throttle": 0, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "req_getvxattr_latency": { 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_sessions": { 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "session_count": 2, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "session_add": 6, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "session_remove": 4, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "sessions_open": 2, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "sessions_stale": 0, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "total_load": 5479, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "average_load": 2739, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "avg_session_uptime": 712, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mdthresh_evicted": 0 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mempool": { 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_bytes": 240, 2024-05-27T10:00:17.680 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_items": 240, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:17.681 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:17.682 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_items": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_bytes": 971648, 2024-05-27T10:00:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_items": 4846, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_bytes": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_items": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_bytes": 8152, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_items": 170, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:17.684 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_items": 0, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_bytes": 17785487, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_items": 184468, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_items": 0, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_items": 0 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "objecter": { 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "op_active": 0, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "op_laggy": 0, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "op_send": 79022, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "op_send_bytes": 193312890, 2024-05-27T10:00:17.685 INFO:teuthology.orchestra.run.smithi072.stdout: "op_resend": 37, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "op_reply": 79022, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "op_latency": { 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 79022, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 1263.487779759, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.015989063 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "op_inflight": 0, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "oplen_avg": { 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 79022, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 93575 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.686 INFO:teuthology.orchestra.run.smithi072.stdout: "op": 79022, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "op_r": 3275, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "op_w": 75747, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "op_rmw": 0, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "op_pg": 0, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_stat": 957, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_create": 6019, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_read": 79, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_write": 25259, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_writefull": 227, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_writesame": 0, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_append": 0, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_zero": 0, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_truncate": 6, 2024-05-27T10:00:17.687 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_delete": 6056, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_mapext": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_sparse_read": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_clonerange": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_getxattr": 3196, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_setxattr": 12038, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_cmpxattr": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_rmxattr": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_resetxattrs": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_call": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_watch": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_notify": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_src_cmpxattr": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_pgls": 0, 2024-05-27T10:00:17.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_pgls_filter": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_other": 36715, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_active": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_send": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_resend": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_ping": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "poolop_active": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "poolop_send": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "poolop_resend": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "poolstat_active": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "poolstat_send": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "poolstat_resend": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "statfs_active": 0, 2024-05-27T10:00:17.689 INFO:teuthology.orchestra.run.smithi072.stdout: "statfs_send": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "statfs_resend": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "command_active": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "command_send": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "command_resend": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "map_epoch": 97, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "map_full": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "map_inc": 16, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_sessions": 12, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_session_open": 12, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_session_close": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_laggy": 0, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_wr": 2699, 2024-05-27T10:00:17.690 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_rd": 6, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_del": 318 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "oft": { 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_objs": 1, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_kv_pairs": 0, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_updates": 0, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_removes": 0 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "osd-slow-ops": { 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "slow_ops_count": 27546 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "purge_queue": { 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing_ops": 0, 2024-05-27T10:00:17.691 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing_ops_high_water": 34, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing": 0, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing_high_water": 10, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executed_ops": 5444, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executed": 5415, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_item_in_journal": 0 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 104857600, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 131622, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 30842986, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:17.692 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 131622, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 131622, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 30842986, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-objecter_bytes": { 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 104857600, 2024-05-27T10:00:17.693 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 0, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 0, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 79022, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 194075553, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 79022, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 194075553, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-objecter_ops": { 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 1024, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 0, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 0, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 79022, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 79022, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 79022, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 79022, 2024-05-27T10:00:17.695 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-write_buf_throttle": { 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 3758096384, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 5415, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 762699, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:17.696 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 5415, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 74, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 762699, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-write_buf_throttle-0x558ed6f1aa90": { 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 3758096384, 2024-05-27T10:00:17.697 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 47617, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 179048148, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 47617, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 25185, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 179048148, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:17.698 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.699 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:17.699 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-27T10:00:18.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:17 smithi122 ceph-mon[36436]: pgmap v392: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 242 B/s wr, 7 op/s 2024-05-27T10:00:18.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:17 smithi071 ceph-mon[31451]: pgmap v392: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 242 B/s wr, 7 op/s 2024-05-27T10:00:18.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:17 smithi072 ceph-mon[35951]: pgmap v392: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 242 B/s wr, 7 op/s 2024-05-27T10:00:18.433 INFO:tasks.check_counter:Daemon mds.b mds.exported=4 2024-05-27T10:00:18.433 INFO:tasks.check_counter:Daemon mds.b mds.imported=4 2024-05-27T10:00:18.433 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-05-27T10:00:18.433 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-05-27T10:00:18.433 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-05-27T10:00:18.433 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=22 2024-05-27T10:00:18.433 DEBUG:tasks.check_counter:Getting stats from e 2024-05-27T10:00:18.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-27T10:00:18.676 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T10:00:20.221 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:19 smithi072 ceph-mon[35951]: pgmap v393: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:20.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:19 smithi122 ceph-mon[36436]: pgmap v393: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:20.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:19 smithi071 ceph-mon[31451]: pgmap v393: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-27T10:00:20.282 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-27T10:00:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 0, 2024-05-27T10:00:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 2, 2024-05-27T10:00:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 0, 2024-05-27T10:00:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 0, 2024-05-27T10:00:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 4, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 0, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.000990665, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.000000000, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.000147061, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 0 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 2, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 210, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 320, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 194352, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 5, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 3, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.013007182, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.009056678, 2024-05-27T10:00:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.001307764, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 207, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.034603862, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000167168 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 194352 2024-05-27T10:00:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 291, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 278, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 1732384, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 170752, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 2, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 1, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.057475084, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.016747311, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.045802096, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.006845992, 2024-05-27T10:00:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 278, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.014417003, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000051859 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 1732384, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 170752 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "cct": { 2024-05-27T10:00:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "total_workers": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "unhealthy_workers": 0 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "mempool": { 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_items": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_bytes": 148692, 2024-05-27T10:00:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_items": 30, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_bytes": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_items": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_bytes": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_items": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_items": 0, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_bytes": 928, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_items": 2, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_items": 0, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_items": 0 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 104857600, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 289, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 1688880, 2024-05-27T10:00:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 289, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 289, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 1688880, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:20.293 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-27T10:00:20.968 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-05-27T10:00:20.969 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-05-27T10:00:20.969 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-05-27T10:00:20.969 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-05-27T10:00:20.969 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-05-27T10:00:20.969 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-05-27T10:00:20.969 DEBUG:tasks.check_counter:Getting stats from h 2024-05-27T10:00:20.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-27T10:00:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T10:00:22.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:21 smithi122 ceph-mon[36436]: pgmap v394: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-27T10:00:22.260 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:21 smithi071 ceph-mon[31451]: pgmap v394: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-27T10:00:22.261 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:21 smithi072 ceph-mon[35951]: pgmap v394: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-27T10:00:22.824 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 1002, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 1004, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 931917, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 318700, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 7, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 2, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.086535280, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.034635540, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.020537954, 2024-05-27T10:00:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.022279948, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 1002, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.035543291, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000035472 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 0 2024-05-27T10:00:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 873, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 1082, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 214522, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 880601, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 8, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 5, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.086341520, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.029878123, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.019422389, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.028319768, 2024-05-27T10:00:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 1078, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.058443956, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000054215 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 603936 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 1291, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 1268, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 2124096, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 482220, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 3, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 2, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.169464777, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.050676215, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.076953666, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.044289099, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 1268, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.067957191, 2024-05-27T10:00:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000053593 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 1798176, 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 173760 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "cct": { 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "total_workers": 1, 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "unhealthy_workers": 0 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "finisher-MDSRank": { 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "queue_len": 0, 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "complete_latency": { 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 4800, 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.138359113, 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000028824 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "finisher-PurgeQueue": { 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "queue_len": 0, 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "complete_latency": { 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-05-27T10:00:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "request": 0, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "reply": 0, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "reply_latency": { 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "slow_reply": 0, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "forward": 0, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_fetch_complete": 0, 2024-05-27T10:00:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_fetch_keys": 0, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_commit": 0, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_split": 0, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_merge": 0, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes": 98, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_top": 0, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_bottom": 98, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_pin_tail": 0, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_pinned": 98, 2024-05-27T10:00:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_expired": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "inodes_with_caps": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "subtrees": 1, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_hit": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_forward": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_discover": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_dir_fetch": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_remote_ino": 0, 2024-05-27T10:00:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "traverse_lock": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "load_cent": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "q": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "exported": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "exported_inodes": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "imported": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "imported_inodes": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "openino_dir_fetch": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "openino_backtrace_fetch": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "openino_peer_discover": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "root_rfiles": 0, 2024-05-27T10:00:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "root_rbytes": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "root_rsnaps": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_backtrace_fetch": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_set_tag": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_backtrace_repaired": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_inotable_repaired": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_dir_inodes": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_dir_base_inodes": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_dirfrag_rstats": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "scrub_file_inodes": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_inode_file_caps": 0, 2024-05-27T10:00:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_revoke": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_grant": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_trunc": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_caps": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_caps_dirty": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_cap_release": 0, 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "process_request_cap_release": 0 2024-05-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_cache": { 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_update": 0, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_update_receipt": 0, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_try_discover": 0, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_send_discover": 0, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "dir_handle_discover": 0, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "num_strays": 0, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "num_strays_delayed": 0, 2024-05-27T10:00:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "num_strays_enqueuing": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_created": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_enqueued": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_reintegrated": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "strays_migrated": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "num_recovering_processing": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "num_recovering_enqueued": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "num_recovering_prioritized": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "recovery_started": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "recovery_completed": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_quiesce_path": 0, 2024-05-27T10:00:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_quiesce_inode": 0, 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_enqueue_scrub": 0, 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_exportdir": 0, 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_flush": 0, 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_fragmentdir": 0, 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_fragstats": 0, 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "ireq_inodestats": 0 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_log": { 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "evlrg": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "evadd": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "evex": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "evtrm": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "ev": 374, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "evexg": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "evexd": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "segadd": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "segex": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "segtrm": 0, 2024-05-27T10:00:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "seg": 2, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "segmjr": 2, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "segexg": 0, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "segexd": 0, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "expos": 4194304, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "wrpos": 4863522, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "rdpos": 4861434, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "jlat": { 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "replayed": 374 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_mem": { 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "ino": 20, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "ino+": 142, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "ino-": 122, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "dir": 3, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "dir+": 15, 2024-05-27T10:00:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "dir-": 12, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "dn": 98, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "dn+": 224, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "dn-": 126, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "cap": 0, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "cap+": 0, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "cap-": 0, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "rss": 120976, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "heap": 215440 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_server": { 2024-05-27T10:00:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "dispatch_client_request": 0, 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "dispatch_server_request": 0, 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_request": 0, 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_client_session": 0, 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "handle_peer_request": 0, 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "req_create_latency": { 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "req_getattr_latency": { 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "req_getfilelock_latency": { 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "req_link_latency": { 2024-05-27T10:00:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookup_latency": { 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookuphash_latency": { 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupino_latency": { 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupname_latency": { 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupparent_latency": { 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lookupsnap_latency": { 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "req_lssnap_latency": { 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "req_mkdir_latency": { 2024-05-27T10:00:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "req_mknod_latency": { 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "req_mksnap_latency": { 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "req_open_latency": { 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "req_readdir_latency": { 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rename_latency": { 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "req_renamesnap_latency": { 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "req_snapdiff_latency": { 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rmdir_latency": { 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rmsnap_latency": { 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "req_rmxattr_latency": { 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.855 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setattr_latency": { 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setdirlayout_latency": { 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.856 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setfilelock_latency": { 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setlayout_latency": { 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: "req_setxattr_latency": { 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.858 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: "req_symlink_latency": { 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: "req_unlink_latency": { 2024-05-27T10:00:22.859 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "cap_revoke_eviction": 0, 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "cap_acquisition_throttle": 0, 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "req_getvxattr_latency": { 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.860 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_sessions": { 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "session_count": 2, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "session_add": 6, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "session_remove": 4, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "sessions_open": 5, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "sessions_stale": 0, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "total_load": 0, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "average_load": 0, 2024-05-27T10:00:22.861 INFO:teuthology.orchestra.run.smithi072.stdout: "avg_session_uptime": 4917, 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "mdthresh_evicted": 0 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "mempool": { 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:22.862 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:22.863 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:22.864 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_items": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_bytes": 190808, 2024-05-27T10:00:22.865 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_items": 70, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_bytes": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_items": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_bytes": 8032, 2024-05-27T10:00:22.866 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_items": 167, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_items": 0, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_bytes": 123105, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_items": 935, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_items": 0, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_items": 0 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.867 INFO:teuthology.orchestra.run.smithi072.stdout: "objecter": { 2024-05-27T10:00:22.868 INFO:teuthology.orchestra.run.smithi072.stdout: "op_active": 0, 2024-05-27T10:00:22.868 INFO:teuthology.orchestra.run.smithi072.stdout: "op_laggy": 0, 2024-05-27T10:00:22.868 INFO:teuthology.orchestra.run.smithi072.stdout: "op_send": 2842, 2024-05-27T10:00:22.868 INFO:teuthology.orchestra.run.smithi072.stdout: "op_send_bytes": 21, 2024-05-27T10:00:22.868 INFO:teuthology.orchestra.run.smithi072.stdout: "op_resend": 3, 2024-05-27T10:00:22.868 INFO:teuthology.orchestra.run.smithi072.stdout: "op_reply": 2842, 2024-05-27T10:00:22.868 INFO:teuthology.orchestra.run.smithi072.stdout: "op_latency": { 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 2842, 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 2.176954891, 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000765993 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "op_inflight": 0, 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "oplen_avg": { 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 2842, 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 2843 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "op": 2842, 2024-05-27T10:00:22.869 INFO:teuthology.orchestra.run.smithi072.stdout: "op_r": 2842, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "op_w": 0, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "op_rmw": 0, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "op_pg": 0, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_stat": 1838, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_create": 0, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_read": 1002, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_write": 0, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_writefull": 0, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_writesame": 0, 2024-05-27T10:00:22.870 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_append": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_zero": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_truncate": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_delete": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_mapext": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_sparse_read": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_clonerange": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_getxattr": 1, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_setxattr": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_cmpxattr": 0, 2024-05-27T10:00:22.871 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_rmxattr": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_resetxattrs": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_call": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_watch": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_notify": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_src_cmpxattr": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_pgls": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_pgls_filter": 0, 2024-05-27T10:00:22.872 INFO:teuthology.orchestra.run.smithi072.stdout: "osdop_other": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_active": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_send": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_resend": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "linger_ping": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "poolop_active": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "poolop_send": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "poolop_resend": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "poolstat_active": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "poolstat_send": 0, 2024-05-27T10:00:22.873 INFO:teuthology.orchestra.run.smithi072.stdout: "poolstat_resend": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "statfs_active": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "statfs_send": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "statfs_resend": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "command_active": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "command_send": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "command_resend": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "map_epoch": 97, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "map_full": 0, 2024-05-27T10:00:22.874 INFO:teuthology.orchestra.run.smithi072.stdout: "map_inc": 16, 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_sessions": 5, 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_session_open": 6, 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_session_close": 1, 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_laggy": 0, 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_wr": 0, 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_rd": 2, 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_del": 0 2024-05-27T10:00:22.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "oft": { 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_objs": 0, 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_kv_pairs": 0, 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_updates": 0, 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "omap_total_removes": 0 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "osd-slow-ops": { 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "slow_ops_count": 0 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "purge_queue": { 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing_ops": 0, 2024-05-27T10:00:22.876 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing_ops_high_water": 0, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing": 0, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executing_high_water": 0, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executed_ops": 0, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_executed": 0, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "pq_item_in_journal": 0 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 104857600, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 3162, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 2966689, 2024-05-27T10:00:22.877 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 3162, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 3162, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 2966689, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-objecter_bytes": { 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:22.878 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 104857600, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 0, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 0, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 2842, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 669223, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 2842, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 669223, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.879 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-objecter_ops": { 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 1024, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 0, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 0, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 2842, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 2842, 2024-05-27T10:00:22.880 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 2842, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 2842, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-write_buf_throttle": { 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 3758096384, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-write_buf_throttle-0x556c0f55eb60": { 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 3758096384, 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 0, 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 0, 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:22.883 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 0, 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 0, 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:22.884 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-27T10:00:23.558 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-27T10:00:23.559 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-27T10:00:23.559 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-05-27T10:00:23.559 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-05-27T10:00:23.559 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-05-27T10:00:23.559 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-05-27T10:00:23.559 DEBUG:tasks.check_counter:Getting stats from k 2024-05-27T10:00:23.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-27T10:00:23.797 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.b/config 2024-05-27T10:00:24.161 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:23 smithi072 ceph-mon[35951]: pgmap v395: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-27T10:00:24.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:23 smithi122 ceph-mon[36436]: pgmap v395: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-27T10:00:24.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:23 smithi071 ceph-mon[31451]: pgmap v395: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-27T10:00:25.455 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-27T10:00:25.455 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 0, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 2, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 0, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 0, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 4, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 0, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.000917072, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.000000000, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.000127705, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:25.456 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 0 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 296, 2024-05-27T10:00:25.457 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 283, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 1733744, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 173952, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 2, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 1, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.055524676, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.015676493, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.045585877, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.006584875, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 283, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.012161203, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000042972 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.458 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 1733744, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 173952 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_messages": 2, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages": 214, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_bytes": 320, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_bytes": 195056, 2024-05-27T10:00:25.459 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_created_connections": 5, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_active_connections": 3, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_total_time": 0.013145350, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_send_time": 0.009203133, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_recv_time": 0.001340324, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 211, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.034510739, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000163558 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:25.460 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "msgr_send_encrypted_bytes": 195056 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "cct": { 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "total_workers": 0, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "unhealthy_workers": 0 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "mempool": { 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:25.462 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:25.463 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_items": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_bytes": 148692, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_anon_items": 30, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_bytes": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_items": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:25.464 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_bytes": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_items": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "pgmap_items": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_bytes": 928, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_co_items": 2, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_1_items": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "unittest_2_items": 0 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-27T10:00:25.465 INFO:teuthology.orchestra.run.smithi072.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "val": 0, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "max": 104857600, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "get_started": 0, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "get": 294, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "get_sum": 1689530, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "get_or_fail_success": 294, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "take": 0, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "take_sum": 0, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "put": 294, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "put_sum": 1689530, 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "wait": { 2024-05-27T10:00:25.466 INFO:teuthology.orchestra.run.smithi072.stdout: "avgcount": 0, 2024-05-27T10:00:25.467 INFO:teuthology.orchestra.run.smithi072.stdout: "sum": 0.000000000, 2024-05-27T10:00:25.467 INFO:teuthology.orchestra.run.smithi072.stdout: "avgtime": 0.000000000 2024-05-27T10:00:25.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:25.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-27T10:00:25.467 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-27T10:00:26.121 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:25 smithi072 ceph-mon[35951]: pgmap v396: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-27T10:00:26.147 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-05-27T10:00:26.147 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-05-27T10:00:26.147 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-05-27T10:00:26.147 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-05-27T10:00:26.147 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-05-27T10:00:26.147 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-05-27T10:00:26.147 DEBUG:tasks.check_counter:Getting stats from c 2024-05-27T10:00:26.148 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-27T10:00:26.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:25 smithi122 ceph-mon[36436]: pgmap v396: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-27T10:00:26.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:25 smithi071 ceph-mon[31451]: pgmap v396: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-27T10:00:26.403 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T10:00:27.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:26 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T10:00:27.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:26 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T10:00:27.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:26 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-27T10:00:28.159 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:27 smithi122 ceph-mon[36436]: pgmap v397: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-27T10:00:28.159 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:27 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T10:00:28.159 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:27 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T10:00:28.159 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:27 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1295, 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1274, 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 2123664, 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 484960, 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 1, 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.182447118, 2024-05-27T10:00:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.054601273, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.079822961, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.047516891, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1273, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.067669291, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000053157 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1795728, 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 174592 2024-05-27T10:00:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 8, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 215, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 3868, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 527738, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 7, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.011695434, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.007324521, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.002182705, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000080761, 2024-05-27T10:00:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 213, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.031848716, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000149524 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 527040 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1759, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1761, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 536137, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 559369, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.127063720, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.038925911, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.035235136, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.044049113, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1759, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.064987626, 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000036945 2024-05-27T10:00:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 0 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-05-27T10:00:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4703, 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.135513638, 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000028814 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-05-27T10:00:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 8, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 8, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 8, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 1, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-05-27T10:00:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-05-27T10:00:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-05-27T10:00:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-05-27T10:00:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-05-27T10:00:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 47, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-05-27T10:00:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4281466, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 4278861, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 47 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 4, 2024-05-27T10:00:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 31, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 27, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 2, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 16, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 14, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 8, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 38, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 30, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 122472, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 215440 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 0, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-05-27T10:00:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-05-27T10:00:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-05-27T10:00:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 4, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 2, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 4, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 4129, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 182099, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 49, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 8032, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 167, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 19360, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 64, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-05-27T10:00:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 2737, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 21, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 3, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 2737, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2737, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.358968817, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000496517 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-05-27T10:00:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2737, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 2738 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 2737, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 2737, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 0, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 1737, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 0, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 998, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 0, 2024-05-27T10:00:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 1, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-05-27T10:00:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-05-27T10:00:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 97, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 16, 2024-05-27T10:00:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 4, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 6, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 2, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 0, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 0 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 0, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-05-27T10:00:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 3058, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 2369122, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 3058, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3058, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 2369122, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2737, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 87167, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2737, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 87167, 2024-05-27T10:00:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2737, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 2737, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2737, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 2737, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x5574217b09c0": { 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-05-27T10:00:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:28.246 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-27T10:00:28.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:27 smithi071 ceph-mon[31451]: pgmap v397: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-27T10:00:28.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:27 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T10:00:28.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:27 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T10:00:28.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:27 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T10:00:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:27 smithi072 ceph-mon[35951]: pgmap v397: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-27T10:00:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:27 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-27T10:00:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:27 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-27T10:00:28.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:27 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' 2024-05-27T10:00:28.984 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-27T10:00:28.984 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-27T10:00:28.984 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-05-27T10:00:28.984 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-05-27T10:00:28.984 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-05-27T10:00:28.985 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-05-27T10:00:28.985 DEBUG:tasks.check_counter:Getting stats from f 2024-05-27T10:00:28.985 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-27T10:00:29.226 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T10:00:30.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:29 smithi072 ceph-mon[35951]: pgmap v398: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:30.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:29 smithi122 ceph-mon[36436]: pgmap v398: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:30.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:29 smithi071 ceph-mon[31451]: pgmap v398: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:30.787 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 4, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 4, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 2992, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 448, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 4, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 0, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.001341730, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.000030363, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.000541618, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:30.788 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000707207, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000235735 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 448 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 3, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 214, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 480, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 274016, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 6, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.014249537, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.009707566, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.001806424, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 211, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.040835964, 2024-05-27T10:00:30.790 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000193535 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 274016 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 289, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 278, 2024-05-27T10:00:30.791 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1729936, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 171584, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 2, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 1, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.058522946, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.016920986, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.045913915, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.006903781, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 277, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.013987082, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000050494 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:30.792 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1729936, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 171584 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 0, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:30.793 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:30.795 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 148692, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 30, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-05-27T10:00:30.796 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 928, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 2, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-05-27T10:00:30.797 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 292, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1689167, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 292, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 292, 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1689167, 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:30.799 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-27T10:00:31.523 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-05-27T10:00:31.524 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-05-27T10:00:31.524 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-05-27T10:00:31.524 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-05-27T10:00:31.524 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-05-27T10:00:31.524 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-05-27T10:00:31.524 DEBUG:tasks.check_counter:Getting stats from i 2024-05-27T10:00:31.524 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-27T10:00:31.761 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T10:00:32.174 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:31 smithi122 ceph-mon[36436]: pgmap v399: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T10:00:32.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:31 smithi071 ceph-mon[31451]: pgmap v399: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T10:00:32.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:31 smithi072 ceph-mon[35951]: pgmap v399: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T10:00:33.436 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 721, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1066, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 220962, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1168526, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 18, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.063354146, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.025027029, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.035509064, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.004996341, 2024-05-27T10:00:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1064, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.051485466, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000048388 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 770, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000303439, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000394 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 4144 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 437, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 602, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1833301, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 655683, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 11, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.077552633, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.026845235, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.053922965, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.008664977, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 602, 2024-05-27T10:00:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.058465701, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000097119 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 56, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000013456, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000240 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1815504, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 570528 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 2604, 2024-05-27T10:00:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 2016, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 739272, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1010848, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 18, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 8, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.166872505, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.063603729, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.116969558, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.007715896, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2013, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.087658892, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000043546 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4337, 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000991691, 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000228 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3856, 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 169568 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 311, 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.162077882, 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000521150 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 131, 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.007755810, 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000059204 2024-05-27T10:00:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 361, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 345, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 345, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.532447187, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001543325 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 16, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-05-27T10:00:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 11, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 44, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 1, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 43, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 43, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 128, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 1, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 1, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 3, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 810, 2024-05-27T10:00:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 466, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 12, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 4, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 3, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 2, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 113, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 2, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 24, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 14, 2024-05-27T10:00:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 1, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 6, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 14, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 14, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 105, 2024-05-27T10:00:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 164, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 2, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 164, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 65, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 7, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 192 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 5, 2024-05-27T10:00:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 1, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 65, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 64, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-05-27T10:00:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 10, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 543, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 2, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-05-27T10:00:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 374, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 374, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 2, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-05-27T10:00:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4863522, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 126, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.326465537, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002590996 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 31, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 152, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 121, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 15, 2024-05-27T10:00:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 26, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 11, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 44, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 265, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 221, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 1, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 152, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 151, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 124200, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 223632 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 551, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 2, 2024-05-27T10:00:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 361, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 34, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 180, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 44, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.246212039, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.005595728 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.005793976, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000724247 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 192, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.063819807, 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000332394 2024-05-27T10:00:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-05-27T10:00:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001905412, 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001905412 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 12, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002892293, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000241024 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 7, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.006185376, 2024-05-27T10:00:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000883625 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 13, 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.029152181, 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002242475 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-05-27T10:00:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.036292167, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.036292167 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.010300493, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.005150246 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-05-27T10:00:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001195531, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001195531 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 64, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.128697912, 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002010904 2024-05-27T10:00:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 6, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 4, 2024-05-27T10:00:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 126, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 63, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 703, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 289285, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 122, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 8032, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 167, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 127513, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 998, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 290, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 698188, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 33, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 290, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 290, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.465966348, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.005055056 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-05-27T10:00:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 290, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 337 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 290, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 17, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 273, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 10, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 3, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 129, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 21, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-05-27T10:00:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 76, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 14, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 20, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-05-27T10:00:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 2, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-05-27T10:00:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 97, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 16, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 12, 2024-05-27T10:00:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 48, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 14 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 477 2024-05-27T10:00:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 10, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 10, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 64, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 64, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 3758, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 2441015, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 3758, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3758, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 2441015, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 290, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 707628, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 290, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 707628, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 290, 2024-05-27T10:00:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 290, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 290, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 290, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 64, 2024-05-27T10:00:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 9440, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 64, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 9440, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x558c876bc9c0": { 2024-05-27T10:00:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 374, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 669218, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 374, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 126, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 669218, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:33.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:33.485 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-27T10:00:34.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:33 smithi122 ceph-mon[36436]: pgmap v400: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:34.234 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:33 smithi071 ceph-mon[31451]: pgmap v400: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:34.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:33 smithi072 ceph-mon[35951]: pgmap v400: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:34.323 INFO:tasks.check_counter:Daemon mds.i mds.exported=2 2024-05-27T10:00:34.323 INFO:tasks.check_counter:Daemon mds.i mds.imported=2 2024-05-27T10:00:34.323 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-05-27T10:00:34.324 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-05-27T10:00:34.324 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-05-27T10:00:34.324 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-05-27T10:00:34.324 DEBUG:tasks.check_counter:Getting stats from l 2024-05-27T10:00:34.324 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-27T10:00:34.559 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.c/config 2024-05-27T10:00:36.139 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:35 smithi122 ceph-mon[36436]: pgmap v401: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:36.200 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 4, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 4, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 2992, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 448, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 4, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 0, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.001386468, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.000033927, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.000621115, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000688094, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000229364 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 448 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 3, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 218, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 480, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 274720, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 6, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.014085318, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.009781492, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.001634656, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 215, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.037023075, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000172200 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 274720 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 295, 2024-05-27T10:00:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 284, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1731568, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 175424, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 2, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 1, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.061015239, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.017807901, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.047833530, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.006693193, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 283, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.014718913, 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000052010 2024-05-27T10:00:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1731568, 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 175424 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 0, 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-05-27T10:00:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-05-27T10:00:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-05-27T10:00:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 148709, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 31, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-05-27T10:00:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 928, 2024-05-27T10:00:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 2, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 298, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1689947, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-05-27T10:00:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 298, 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 298, 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1689947, 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-27T10:00:36.212 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-27T10:00:36.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:35 smithi071 ceph-mon[31451]: pgmap v401: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:36.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:35 smithi072 ceph-mon[35951]: pgmap v401: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:36.937 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-05-27T10:00:36.937 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-05-27T10:00:36.937 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-05-27T10:00:36.937 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-05-27T10:00:36.937 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-05-27T10:00:36.937 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-05-27T10:00:36.937 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-27T10:00:36.951 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-27T10:00:36.952 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T10:00:36.952 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:00:37.010 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T10:00:37.010 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:00:37.061 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-05-27T10:00:37.507 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:38.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:37 smithi122 ceph-mon[36436]: pgmap v402: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T10:00:38.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:37 smithi071 ceph-mon[31451]: pgmap v402: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T10:00:38.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:37 smithi072 ceph-mon[35951]: pgmap v402: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-27T10:00:39.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 -- 172.21.15.71:0/1585446531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810b860 msgr2=0x7f8fb81131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:39.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/1585446531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810b860 0x7f8fb81131c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000b0d0 tx=0x7f8fb000b3e0 comp rx=0 tx=0).stop 2024-05-27T10:00:39.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 -- 172.21.15.71:0/1585446531 shutdown_connections 2024-05-27T10:00:39.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/1585446531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810b860 0x7f8fb81131c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:39.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/1585446531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb8106630 0x7f8fb8106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:39.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/1585446531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb810af10 0x7f8fb810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:39.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 -- 172.21.15.71:0/1585446531 >> 172.21.15.71:0/1585446531 conn(0x7f8fb8102020 msgr2=0x7f8fb8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:39.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 -- 172.21.15.71:0/1585446531 shutdown_connections 2024-05-27T10:00:39.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.848+0000 7f8fb7e00700 1 -- 172.21.15.71:0/1585446531 wait complete. 2024-05-27T10:00:39.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.849+0000 7f8fb7e00700 1 Processor -- start 2024-05-27T10:00:39.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.849+0000 7f8fb7e00700 1 -- start start 2024-05-27T10:00:39.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb7e00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb8106630 0x7f8fb819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:39.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb7e00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810af10 0x7f8fb819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb810b860 0x7f8fb81a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb7e00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb81164e0 con 0x7f8fb8106630 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb7e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb8116360 con 0x7f8fb810b860 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb7e00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb8116660 con 0x7f8fb810af10 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb8106630 0x7f8fb819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb6a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb8106630 0x7f8fb819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33078/0 (socket says 172.21.15.71:33078) 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb6a00700 1 -- 172.21.15.71:0/2841549320 learned_addr learned my addr 172.21.15.71:0/2841549320 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fafe00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810af10 0x7f8fb819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.850+0000 7f8fb7400700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb810b860 0x7f8fb81a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8fb7400700 1 -- 172.21.15.71:0/2841549320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810af10 msgr2=0x7f8fb819d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8fb7400700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810af10 0x7f8fb819d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:39.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8fb7400700 1 -- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb8106630 msgr2=0x7f8fb819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:39.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8fb7400700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb8106630 0x7f8fb819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:39.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8fb7400700 1 -- 172.21.15.71:0/2841549320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb81a1ca0 con 0x7f8fb810b860 2024-05-27T10:00:39.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8fb6a00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb8106630 0x7f8fb819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:00:39.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8fb7400700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb810b860 0x7f8fb81a1600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000b770 tx=0x7f8fb0007980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:39.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.851+0000 7f8faf400700 1 -- 172.21.15.71:0/2841549320 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb001f070 con 0x7f8fb810b860 2024-05-27T10:00:39.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.852+0000 7f8faf400700 1 -- 172.21.15.71:0/2841549320 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fb0007dc0 con 0x7f8fb810b860 2024-05-27T10:00:39.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.852+0000 7f8faf400700 1 -- 172.21.15.71:0/2841549320 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb001b430 con 0x7f8fb810b860 2024-05-27T10:00:39.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.852+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb81a1f30 con 0x7f8fb810b860 2024-05-27T10:00:39.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.852+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb81a23c0 con 0x7f8fb810b860 2024-05-27T10:00:39.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.853+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb80512b0 con 0x7f8fb810b860 2024-05-27T10:00:39.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.856+0000 7f8faf400700 1 -- 172.21.15.71:0/2841549320 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f8fb0022070 con 0x7f8fb810b860 2024-05-27T10:00:39.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.857+0000 7f8faf400700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8f9c0b29f0 0x7f8f9c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:39.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.858+0000 7f8faf400700 1 -- 172.21.15.71:0/2841549320 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8513+0+0 (secure 0 0 0) 0x7f8fb000f020 con 0x7f8fb810b860 2024-05-27T10:00:39.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.858+0000 7f8fb6a00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8f9c0b29f0 0x7f8f9c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:39.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.859+0000 7f8fb6a00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8f9c0b29f0 0x7f8f9c0b4f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8011550 tx=0x7f8fa8009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:39.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:39.860+0000 7f8faf400700 1 -- 172.21.15.71:0/2841549320 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8fb0029020 con 0x7f8fb810b860 2024-05-27T10:00:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.108+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8fb802e5e0 con 0x7f8fb810b860 2024-05-27T10:00:40.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:39 smithi071 ceph-mon[31451]: pgmap v403: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.109+0000 7f8faf400700 1 -- 172.21.15.71:0/2841549320 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v97) ==== 81+0+943 (secure 0 0 0) 0x7f8fb00ab430 con 0x7f8fb810b860 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/1797397372 2024-05-28T09:47:45.456631+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/1797397372 2024-05-28T09:47:45.456631+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1381797399 2024-05-28T09:47:45.456631+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/705076844 2024-05-28T09:35:22.974518+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/4081778329 2024-05-28T09:47:45.456631+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2074945861 2024-05-28T09:35:22.974518+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2822189872 2024-05-28T09:34:47.199375+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1615143192 2024-05-28T09:34:47.199375+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/193022273 2024-05-28T09:47:45.456631+0000 2024-05-27T10:00:40.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3742035998 2024-05-28T09:35:22.974518+0000 2024-05-27T10:00:40.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/226136634 2024-05-28T09:34:47.199375+0000 2024-05-27T10:00:40.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/1853756508 2024-05-28T09:35:22.974518+0000 2024-05-27T10:00:40.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/1853756508 2024-05-28T09:35:22.974518+0000 2024-05-27T10:00:40.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/1765745384 2024-05-28T09:34:47.199375+0000 2024-05-27T10:00:40.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/4261728686 2024-05-28T09:47:45.456631+0000 2024-05-27T10:00:40.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/1765745384 2024-05-28T09:34:47.199375+0000 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8f9c0b29f0 msgr2=0x7f8f9c0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8f9c0b29f0 0x7f8f9c0b4f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8011550 tx=0x7f8fa8009260 comp rx=0 tx=0).stop 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb810b860 msgr2=0x7f8fb81a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb810b860 0x7f8fb81a1600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000b770 tx=0x7f8fb0007980 comp rx=0 tx=0).stop 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 shutdown_connections 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8f9c0b29f0 0x7f8f9c0b4f00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb810b860 0x7f8fb81a1600 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb8106630 0x7f8fb819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 --2- 172.21.15.71:0/2841549320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb810af10 0x7f8fb819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 >> 172.21.15.71:0/2841549320 conn(0x7f8fb8102020 msgr2=0x7f8fb8108ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:40.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.112+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 shutdown_connections 2024-05-27T10:00:40.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:40.113+0000 7f8fb7e00700 1 -- 172.21.15.71:0/2841549320 wait complete. 2024-05-27T10:00:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:listed 16 entries 2024-05-27T10:00:40.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:39 smithi122 ceph-mon[36436]: pgmap v403: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:40.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:39 smithi072 ceph-mon[35951]: pgmap v403: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-27T10:00:40.797 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-27T10:00:40.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:00:40.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-27T10:00:40.940 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T10:00:40.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:00:40.941 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T10:00:41.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:40 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2841549320' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-27T10:00:41.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:00:41.020 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-05-27T10:00:41.026 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:40 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2841549320' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-27T10:00:41.104 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T10:00:41.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:00:41.105 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:00:41.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:00:41.182 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-05-27T10:00:41.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:40 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2841549320' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-27T10:00:41.288 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-27T10:00:41.288 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-05-27T10:00:41.288 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:00:41.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/c494ef8188d3ef1ba1af2dc4824b976805f45b54cf7f11dce705b5c3f7fd2ebf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/c494ef8188d3ef1ba1af2dc4824b976805f45b54cf7f11dce705b5c3f7fd2ebf/diff,workdir=/var/lib/containers/storage/overlay/c494ef8188d3ef1ba1af2dc4824b976805f45b54cf7f11dce705b5c3f7fd2ebf/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/61fa753c0f280d549baeae8f4a6781095779595c0ae8c367996d78e30bf54983/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/61fa753c0f280d549baeae8f4a6781095779595c0ae8c367996d78e30bf54983/diff,workdir=/var/lib/containers/storage/overlay/61fa753c0f280d549baeae8f4a6781095779595c0ae8c367996d78e30bf54983/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/161e69d4d21feccf0d679609817d7a42a60849283578792280d3cb9e38e6dc52/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/161e69d4d21feccf0d679609817d7a42a60849283578792280d3cb9e38e6dc52/diff,workdir=/var/lib/containers/storage/overlay/161e69d4d21feccf0d679609817d7a42a60849283578792280d3cb9e38e6dc52/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7db703762953b933a5f7d843470771dd08642dcdf12fdfe0beea016150cb6b3d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/7db703762953b933a5f7d843470771dd08642dcdf12fdfe0beea016150cb6b3d/diff,workdir=/var/lib/containers/storage/overlay/7db703762953b933a5f7d843470771dd08642dcdf12fdfe0beea016150cb6b3d/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d839ff65b96ca1563482862315fe94c9715cf65e86e66f541a4aff25c5d3760f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/d839ff65b96ca1563482862315fe94c9715cf65e86e66f541a4aff25c5d3760f/diff,workdir=/var/lib/containers/storage/overlay/d839ff65b96ca1563482862315fe94c9715cf65e86e66f541a4aff25c5d3760f/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c2278bcca5aa827aeafc3c3c6005d4e473f2ad47f5e2be6edbbb2a6d65978ef6/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/c2278bcca5aa827aeafc3c3c6005d4e473f2ad47f5e2be6edbbb2a6d65978ef6/diff,workdir=/var/lib/containers/storage/overlay/c2278bcca5aa827aeafc3c3c6005d4e473f2ad47f5e2be6edbbb2a6d65978ef6/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5cf461357857fb3edc3a294555a7523edc918a26af6090cb12ad54b1ced81d14/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/5cf461357857fb3edc3a294555a7523edc918a26af6090cb12ad54b1ced81d14/diff,workdir=/var/lib/containers/storage/overlay/5cf461357857fb3edc3a294555a7523edc918a26af6090cb12ad54b1ced81d14/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c047710e15130aae7f1d8b12ce8e356bdfad7217176fd2891470206d599fff71/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/c047710e15130aae7f1d8b12ce8e356bdfad7217176fd2891470206d599fff71/diff,workdir=/var/lib/containers/storage/overlay/c047710e15130aae7f1d8b12ce8e356bdfad7217176fd2891470206d599fff71/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/816c740890dc7b6eca8572ebfc90be446ce79b98fa7b1bad4d963b4be46bc716/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/816c740890dc7b6eca8572ebfc90be446ce79b98fa7b1bad4d963b4be46bc716/diff,workdir=/var/lib/containers/storage/overlay/816c740890dc7b6eca8572ebfc90be446ce79b98fa7b1bad4d963b4be46bc716/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d484739cf742c3603e9e600cad23311dd1bce286fce4c6f25e137ae0efd6c580/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZQWMS5Q4T7TFYBN562RDIDD47V:/var/lib/containers/storage/overlay/l/KPH7Q53F7MSDRTFJ6VBNXJLKMS,upperdir=/var/lib/containers/storage/overlay/d484739cf742c3603e9e600cad23311dd1bce286fce4c6f25e137ae0efd6c580/diff,workdir=/var/lib/containers/storage/overlay/d484739cf742c3603e9e600cad23311dd1bce286fce4c6f25e137ae0efd6c580/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700 0 0 2024-05-27T10:00:41.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:00:41.327 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-05-27T10:00:41.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:00:41.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-05-27T10:00:41.500 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-05-27T10:00:41.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:00:41.504 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-27T10:00:41.517 INFO:tasks.cephadm:Teardown begin 2024-05-27T10:00:41.517 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-27T10:00:41.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T10:00:41.952 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:42.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:41 smithi122 ceph-mon[36436]: pgmap v404: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:42.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:41 smithi071 ceph-mon[31451]: pgmap v404: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:42.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:41 smithi072 ceph-mon[35951]: pgmap v404: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 -- 172.21.15.71:0/986532026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7010af40 msgr2=0x7f2f7010b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/986532026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7010af40 0x7f2f7010b350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009990 tx=0x7f2f5c009ca0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 -- 172.21.15.71:0/986532026 shutdown_connections 2024-05-27T10:00:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/986532026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7010b890 0x7f2f701131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/986532026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f70106610 0x7f2f70106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/986532026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7010af40 0x7f2f7010b350 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 -- 172.21.15.71:0/986532026 >> 172.21.15.71:0/986532026 conn(0x7f2f70102020 msgr2=0x7f2f70104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 -- 172.21.15.71:0/986532026 shutdown_connections 2024-05-27T10:00:44.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.220+0000 7f2f6fe00700 1 -- 172.21.15.71:0/986532026 wait complete. 2024-05-27T10:00:44.222 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:43 smithi071 ceph-mon[31451]: pgmap v405: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-27T10:00:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.222+0000 7f2f6fe00700 1 Processor -- start 2024-05-27T10:00:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.222+0000 7f2f6fe00700 1 -- start start 2024-05-27T10:00:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70106610 0x7f2f7019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6fe00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7010af40 0x7f2f7019d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f7010b890 0x7f2f701a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6fe00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701164f0 con 0x7f2f7010b890 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6fe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70116370 con 0x7f2f70106610 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6fe00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70116670 con 0x7f2f7010af40 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70106610 0x7f2f7019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70106610 0x7f2f7019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57656/0 (socket says 172.21.15.71:57656) 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6f400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f7010b890 0x7f2f701a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6ea00700 1 -- 172.21.15.71:0/1204740482 learned_addr learned my addr 172.21.15.71:0/1204740482 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:00:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.223+0000 7f2f6e000700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7010af40 0x7f2f7019d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.224+0000 7f2f6e000700 1 -- 172.21.15.71:0/1204740482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70106610 msgr2=0x7f2f7019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.224+0000 7f2f6e000700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70106610 0x7f2f7019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.224+0000 7f2f6e000700 1 -- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f7010b890 msgr2=0x7f2f701a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.224+0000 7f2f6e000700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f7010b890 0x7f2f701a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.224+0000 7f2f6e000700 1 -- 172.21.15.71:0/1204740482 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f701a1d50 con 0x7f2f7010af40 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.224+0000 7f2f6e000700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7010af40 0x7f2f7019d420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c000c00 tx=0x7f2f5c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.224+0000 7f2f67400700 1 -- 172.21.15.71:0/1204740482 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c026070 con 0x7f2f7010af40 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.225+0000 7f2f67400700 1 -- 172.21.15.71:0/1204740482 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f5c00b610 con 0x7f2f7010af40 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.225+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f701a1fe0 con 0x7f2f7010af40 2024-05-27T10:00:44.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.225+0000 7f2f67400700 1 -- 172.21.15.71:0/1204740482 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c021e00 con 0x7f2f7010af40 2024-05-27T10:00:44.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.225+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f701a9960 con 0x7f2f7010af40 2024-05-27T10:00:44.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.226+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f70107ac0 con 0x7f2f7010af40 2024-05-27T10:00:44.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.228+0000 7f2f67400700 1 -- 172.21.15.71:0/1204740482 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f2f5c029070 con 0x7f2f7010af40 2024-05-27T10:00:44.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:43 smithi122 ceph-mon[36436]: pgmap v405: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-27T10:00:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.230+0000 7f2f67400700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2f540b2a70 0x7f2f540b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:44.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.230+0000 7f2f67400700 1 -- 172.21.15.71:0/1204740482 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8513+0+0 (secure 0 0 0) 0x7f2f5c0e3960 con 0x7f2f7010af40 2024-05-27T10:00:44.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.230+0000 7f2f6ea00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2f540b2a70 0x7f2f540b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.231+0000 7f2f6ea00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2f540b2a70 0x7f2f540b4f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009d20 tx=0x7f2f60009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:44.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.232+0000 7f2f67400700 1 -- 172.21.15.71:0/1204740482 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2f5c030020 con 0x7f2f7010af40 2024-05-27T10:00:44.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:43 smithi072 ceph-mon[35951]: pgmap v405: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-27T10:00:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.518+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f700512b0 con 0x7f2f7010af40 2024-05-27T10:00:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.519+0000 7f2f67400700 1 -- 172.21.15.71:0/1204740482 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11857 (secure 0 0 0) 0x7f2f5c0b1090 con 0x7f2f7010af40 2024-05-27T10:00:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T10:00:44.520 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:59:41.465301+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T10:00:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.522+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2f540b2a70 msgr2=0x7f2f540b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.522+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2f540b2a70 0x7f2f540b4f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009d20 tx=0x7f2f60009260 comp rx=0 tx=0).stop 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.522+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7010af40 msgr2=0x7f2f7019d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.522+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7010af40 0x7f2f7019d420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c000c00 tx=0x7f2f5c009580 comp rx=0 tx=0).stop 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.522+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 shutdown_connections 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.523+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f2f540b2a70 0x7f2f540b4f80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.523+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f7010b890 0x7f2f701a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.523+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70106610 0x7f2f7019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.523+0000 7f2f6fe00700 1 --2- 172.21.15.71:0/1204740482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7010af40 0x7f2f7019d420 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.523+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 >> 172.21.15.71:0/1204740482 conn(0x7f2f70102020 msgr2=0x7f2f7010a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.523+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 shutdown_connections 2024-05-27T10:00:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:44.523+0000 7f2f6fe00700 1 -- 172.21.15.71:0/1204740482 wait complete. 2024-05-27T10:00:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 34 2024-05-27T10:00:45.227 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:44 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1204740482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T10:00:45.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:44 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1204740482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T10:00:45.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:44 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1204740482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T10:00:45.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-05-27T10:00:45.749 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:46.200 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:45 smithi071 ceph-mon[31451]: pgmap v406: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-27T10:00:46.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:45 smithi122 ceph-mon[36436]: pgmap v406: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-27T10:00:46.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:45 smithi072 ceph-mon[35951]: pgmap v406: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-27T10:00:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.908+0000 7f2579400700 1 -- 172.21.15.71:0/3738336400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2574109840 msgr2=0x7f25741111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.908+0000 7f2579400700 1 --2- 172.21.15.71:0/3738336400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2574109840 0x7f25741111a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f256c00b0d0 tx=0x7f256c00b3e0 comp rx=0 tx=0).stop 2024-05-27T10:00:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.909+0000 7f2579400700 1 -- 172.21.15.71:0/3738336400 shutdown_connections 2024-05-27T10:00:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.909+0000 7f2579400700 1 --2- 172.21.15.71:0/3738336400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2574109840 0x7f25741111a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.909+0000 7f2579400700 1 --2- 172.21.15.71:0/3738336400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25741045c0 0x7f25741049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.909+0000 7f2579400700 1 --2- 172.21.15.71:0/3738336400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 0x7f2574109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.909+0000 7f2579400700 1 -- 172.21.15.71:0/3738336400 >> 172.21.15.71:0/3738336400 conn(0x7f25740ffe90 msgr2=0x7f25741022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.909+0000 7f2579400700 1 -- 172.21.15.71:0/3738336400 shutdown_connections 2024-05-27T10:00:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.909+0000 7f2579400700 1 -- 172.21.15.71:0/3738336400 wait complete. 2024-05-27T10:00:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.910+0000 7f2579400700 1 Processor -- start 2024-05-27T10:00:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.911+0000 7f2579400700 1 -- start start 2024-05-27T10:00:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.911+0000 7f2579400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25741045c0 0x7f257419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.911+0000 7f2579400700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 0x7f257419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.911+0000 7f2579400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2574109840 0x7f257419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.911+0000 7f2579400700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25741144c0 con 0x7f25741045c0 2024-05-27T10:00:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.911+0000 7f2579400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2574114340 con 0x7f2574109840 2024-05-27T10:00:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.911+0000 7f2579400700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2574114640 con 0x7f2574108ef0 2024-05-27T10:00:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f2572800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25741045c0 0x7f257419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 0x7f257419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 0x7f257419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:54992/0 (socket says 172.21.15.71:54992) 2024-05-27T10:00:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 -- 172.21.15.71:0/1945052093 learned_addr learned my addr 172.21.15.71:0/1945052093 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:00:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f2573200700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2574109840 0x7f257419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 -- 172.21.15.71:0/1945052093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2574109840 msgr2=0x7f257419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2574109840 0x7f257419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 -- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25741045c0 msgr2=0x7f257419adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25741045c0 0x7f257419adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 -- 172.21.15.71:0/1945052093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257419fc80 con 0x7f2574108ef0 2024-05-27T10:00:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f2573200700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2574109840 0x7f257419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:00:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.912+0000 7f256be00700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 0x7f257419b350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e970 tx=0x7f255c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.913+0000 7f256b400700 1 -- 172.21.15.71:0/1945052093 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c00cbd0 con 0x7f2574108ef0 2024-05-27T10:00:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.913+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257419ff70 con 0x7f2574108ef0 2024-05-27T10:00:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.913+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25741a7890 con 0x7f2574108ef0 2024-05-27T10:00:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.913+0000 7f256b400700 1 -- 172.21.15.71:0/1945052093 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255c00cd70 con 0x7f2574108ef0 2024-05-27T10:00:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.913+0000 7f256b400700 1 -- 172.21.15.71:0/1945052093 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c005680 con 0x7f2574108ef0 2024-05-27T10:00:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.914+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2550005330 con 0x7f2574108ef0 2024-05-27T10:00:47.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.917+0000 7f256b400700 1 -- 172.21.15.71:0/1945052093 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f255c0479e0 con 0x7f2574108ef0 2024-05-27T10:00:47.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.918+0000 7f256b400700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25580b2a70 0x7f25580b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.919+0000 7f256b400700 1 -- 172.21.15.71:0/1945052093 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8513+0+0 (secure 0 0 0) 0x7f255c0e25d0 con 0x7f2574108ef0 2024-05-27T10:00:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.919+0000 7f2572800700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25580b2a70 0x7f25580b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.920+0000 7f2572800700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25580b2a70 0x7f25580b4f80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2564009c60 tx=0x7f2564009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:47.921+0000 7f256b400700 1 -- 172.21.15.71:0/1945052093 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f255c0a9f50 con 0x7f2574108ef0 2024-05-27T10:00:48.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.213+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2550005620 con 0x7f2574108ef0 2024-05-27T10:00:48.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:47 smithi071 ceph-mon[31451]: pgmap v407: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:48.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.214+0000 7f256b400700 1 -- 172.21.15.71:0/1945052093 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11857 (secure 0 0 0) 0x7f255c0a9850 con 0x7f2574108ef0 2024-05-27T10:00:48.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T10:00:48.214 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14373,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/947679216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":947679216},{"type":"v1","addr":"172.21.15.71:6835","nonce":947679216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14379,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/95773383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":95773383},{"type":"v1","addr":"172.21.15.71:6837","nonce":95773383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/840166541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":840166541},{"type":"v1","addr":"172.21.15.72:6833","nonce":840166541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1541332524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1541332524},{"type":"v1","addr":"172.21.15.122:6833","nonce":1541332524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/730426075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":730426075},{"type":"v1","addr":"172.21.15.72:6835","nonce":730426075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/132326532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":132326532},{"type":"v1","addr":"172.21.15.122:6835","nonce":132326532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-27T09:43:51.731640+0000","modified":"2024-05-27T09:59:41.465301+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24530,"mds_1":24518,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.72:6837/4192538973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4192538973},{"type":"v1","addr":"172.21.15.72:6837","nonce":4192538973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/1257572460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1257572460},{"type":"v1","addr":"172.21.15.122:6837","nonce":1257572460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":112,"addr":"172.21.15.122:6839/3712813671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":3712813671},{"type":"v1","addr":"172.21.15.122:6839","nonce":3712813671}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6841/1086406252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6840","nonce":1086406252},{"type":"v1","addr":"172.21.15.71:6841","nonce":1086406252}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6839/1043512787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6838","nonce":1043512787},{"type":"v1","addr":"172.21.15.72:6839","nonce":1043512787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26434":{"gid":26434,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3914343352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3914343352},{"type":"v1","addr":"172.21.15.71:6839","nonce":3914343352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24518,24530,24508]},"id":1}]} 2024-05-27T10:00:48.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.217+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25580b2a70 msgr2=0x7f25580b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.217+0000 7f2579400700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25580b2a70 0x7f25580b4f80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2564009c60 tx=0x7f2564009260 comp rx=0 tx=0).stop 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.217+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 msgr2=0x7f257419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.217+0000 7f2579400700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 0x7f257419b350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e970 tx=0x7f255c00ec80 comp rx=0 tx=0).stop 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 shutdown_connections 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f25580b2a70 0x7f25580b4f80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2574109840 0x7f257419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25741045c0 0x7f257419adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 --2- 172.21.15.71:0/1945052093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2574108ef0 0x7f257419b350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 >> 172.21.15.71:0/1945052093 conn(0x7f25740ffe90 msgr2=0x7f2574108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 shutdown_connections 2024-05-27T10:00:48.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:48.218+0000 7f2579400700 1 -- 172.21.15.71:0/1945052093 wait complete. 2024-05-27T10:00:48.219 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 34 2024-05-27T10:00:48.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:47 smithi122 ceph-mon[36436]: pgmap v407: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:48.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:47 smithi072 ceph-mon[35951]: pgmap v407: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:49.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-27T10:00:49.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:48 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/1945052093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T10:00:49.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:48 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/1945052093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T10:00:49.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:48 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/1945052093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-27T10:00:49.540 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:50.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:49 smithi122 ceph-mon[36436]: pgmap v408: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T10:00:50.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:49 smithi071 ceph-mon[31451]: pgmap v408: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T10:00:50.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:49 smithi072 ceph-mon[35951]: pgmap v408: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-27T10:00:51.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 -- 172.21.15.71:0/2765708094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c102ee0 msgr2=0x7fd94c110f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 --2- 172.21.15.71:0/2765708094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c102ee0 0x7fd94c110f70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b0a0 tx=0x7fd94400b3b0 comp rx=0 tx=0).stop 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 -- 172.21.15.71:0/2765708094 shutdown_connections 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 --2- 172.21.15.71:0/2765708094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c102ee0 0x7fd94c110f70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 --2- 172.21.15.71:0/2765708094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c109100 0x7fd94c109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 --2- 172.21.15.71:0/2765708094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102590 0x7fd94c1029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 -- 172.21.15.71:0/2765708094 >> 172.21.15.71:0/2765708094 conn(0x7fd94c0783a0 msgr2=0x7fd94c0787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 -- 172.21.15.71:0/2765708094 shutdown_connections 2024-05-27T10:00:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.754+0000 7fd94b200700 1 -- 172.21.15.71:0/2765708094 wait complete. 2024-05-27T10:00:51.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.755+0000 7fd94b200700 1 Processor -- start 2024-05-27T10:00:51.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.755+0000 7fd94b200700 1 -- start start 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd94b200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c102590 0x7fd94c103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd94b200700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102ee0 0x7fd94c103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd94b200700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c109100 0x7fd94c1041f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd94b200700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1143f0 con 0x7fd94c102ee0 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd94b200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c114270 con 0x7fd94c102590 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd94b200700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c114570 con 0x7fd94c109100 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd941400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102ee0 0x7fd94c103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd941400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102ee0 0x7fd94c103cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56096/0 (socket says 172.21.15.71:56096) 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd941400700 1 -- 172.21.15.71:0/4097888478 learned_addr learned my addr 172.21.15.71:0/4097888478 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd94a800700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c109100 0x7fd94c1041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.756+0000 7fd949e00700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c102590 0x7fd94c103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd94a800700 1 -- 172.21.15.71:0/4097888478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c102590 msgr2=0x7fd94c103770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd94a800700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c102590 0x7fd94c103770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:51.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd94a800700 1 -- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102ee0 msgr2=0x7fd94c103cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:51.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd94a800700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102ee0 0x7fd94c103cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:51.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd94a800700 1 -- 172.21.15.71:0/4097888478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c1a9080 con 0x7fd94c109100 2024-05-27T10:00:51.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd941400700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102ee0 0x7fd94c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:00:51.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd94a800700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c109100 0x7fd94c1041f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b070 tx=0x7fd944004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:51.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd943400700 1 -- 172.21.15.71:0/4097888478 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944021070 con 0x7fd94c109100 2024-05-27T10:00:51.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd943400700 1 -- 172.21.15.71:0/4097888478 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd944007e30 con 0x7fd94c109100 2024-05-27T10:00:51.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd943400700 1 -- 172.21.15.71:0/4097888478 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9440045f0 con 0x7fd94c109100 2024-05-27T10:00:51.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.757+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c1a9310 con 0x7fd94c109100 2024-05-27T10:00:51.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.758+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c1a9770 con 0x7fd94c109100 2024-05-27T10:00:51.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.759+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94c1058b0 con 0x7fd94c109100 2024-05-27T10:00:51.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.762+0000 7fd943400700 1 -- 172.21.15.71:0/4097888478 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd944007980 con 0x7fd94c109100 2024-05-27T10:00:51.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.764+0000 7fd943400700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9300b2a70 0x7fd9300b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:51.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.764+0000 7fd943400700 1 -- 172.21.15.71:0/4097888478 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8513+0+0 (secure 0 0 0) 0x7fd94400f020 con 0x7fd94c109100 2024-05-27T10:00:51.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.764+0000 7fd949e00700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9300b2a70 0x7fd9300b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:51.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.765+0000 7fd949e00700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9300b2a70 0x7fd9300b4f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd94c075f90 tx=0x7fd93c009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:51.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.765+0000 7fd943400700 1 -- 172.21.15.71:0/4097888478 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd94402a020 con 0x7fd94c109100 2024-05-27T10:00:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:51.998+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd94c02e7a0 con 0x7fd94c109100 2024-05-27T10:00:52.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.001+0000 7fd943400700 1 -- 172.21.15.71:0/4097888478 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+23070 (secure 0 0 0) 0x7fd9440ab730 con 0x7fd94c109100 2024-05-27T10:00:52.001 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-05-27T10:00:52.001 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":97,"fsid":"13785e2a-1c0c-11ef-bc9b-c7b262605968","created":"2024-05-27T09:34:13.084307+0000","modified":"2024-05-27T10:00:15.538316+0000","last_up_change":"2024-05-27T09:42:31.745548+0000","last_in_change":"2024-05-27T09:42:11.264909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T09:38:13.148765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T09:43:41.957802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T09:43:46.824583+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0188f94-bc15-4782-acb2-e6934d1f09b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6803","nonce":335199757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6805","nonce":335199757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6809","nonce":335199757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":335199757},{"type":"v1","addr":"172.21.15.71:6807","nonce":335199757}]},"public_addr":"172.21.15.71:6803/335199757","cluster_addr":"172.21.15.71:6805/335199757","heartbeat_back_addr":"172.21.15.71:6809/335199757","heartbeat_front_addr":"172.21.15.71:6807/335199757","state":["exists","up"]},{"osd":1,"uuid":"1cc3fd0a-077b-4a70-9463-2793467d8a99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6801","nonce":936392023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6803","nonce":936392023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6807","nonce":936392023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":936392023},{"type":"v1","addr":"172.21.15.72:6805","nonce":936392023}]},"public_addr":"172.21.15.72:6801/936392023","cluster_addr":"172.21.15.72:6803/936392023","heartbeat_back_addr":"172.21.15.72:6807/936392023","heartbeat_front_addr":"172.21.15.72:6805/936392023","state":["exists","up"]},{"osd":2,"uuid":"9e67be5c-649c-4120-8108-deed9131b2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6801","nonce":631250224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6803","nonce":631250224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6807","nonce":631250224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":631250224},{"type":"v1","addr":"172.21.15.122:6805","nonce":631250224}]},"public_addr":"172.21.15.122:6801/631250224","cluster_addr":"172.21.15.122:6803/631250224","heartbeat_back_addr":"172.21.15.122:6807/631250224","heartbeat_front_addr":"172.21.15.122:6805/631250224","state":["exists","up"]},{"osd":3,"uuid":"a813baa5-456d-4d6c-9c1f-3ff8f850ecba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6811","nonce":4167682826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6813","nonce":4167682826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6817","nonce":4167682826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":4167682826},{"type":"v1","addr":"172.21.15.71:6815","nonce":4167682826}]},"public_addr":"172.21.15.71:6811/4167682826","cluster_addr":"172.21.15.71:6813/4167682826","heartbeat_back_addr":"172.21.15.71:6817/4167682826","heartbeat_front_addr":"172.21.15.71:6815/4167682826","state":["exists","up"]},{"osd":4,"uuid":"48ad0f18-5577-4ed4-b5d7-ee731834d30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6809","nonce":3529630414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6811","nonce":3529630414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6815","nonce":3529630414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3529630414},{"type":"v1","addr":"172.21.15.72:6813","nonce":3529630414}]},"public_addr":"172.21.15.72:6809/3529630414","cluster_addr":"172.21.15.72:6811/3529630414","heartbeat_back_addr":"172.21.15.72:6815/3529630414","heartbeat_front_addr":"172.21.15.72:6813/3529630414","state":["exists","up"]},{"osd":5,"uuid":"5d87f6a2-4ba3-46be-8f09-2e33f90b49dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6809","nonce":3344426333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6811","nonce":3344426333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6815","nonce":3344426333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3344426333},{"type":"v1","addr":"172.21.15.122:6813","nonce":3344426333}]},"public_addr":"172.21.15.122:6809/3344426333","cluster_addr":"172.21.15.122:6811/3344426333","heartbeat_back_addr":"172.21.15.122:6815/3344426333","heartbeat_front_addr":"172.21.15.122:6813/3344426333","state":["exists","up"]},{"osd":6,"uuid":"e5c500cb-9e6e-4e19-86a4-854af29aa3c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6819","nonce":1007330832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6821","nonce":1007330832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6825","nonce":1007330832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1007330832},{"type":"v1","addr":"172.21.15.71:6823","nonce":1007330832}]},"public_addr":"172.21.15.71:6819/1007330832","cluster_addr":"172.21.15.71:6821/1007330832","heartbeat_back_addr":"172.21.15.71:6825/1007330832","heartbeat_front_addr":"172.21.15.71:6823/1007330832","state":["exists","up"]},{"osd":7,"uuid":"32d0220b-a785-43b4-901a-d503071d14e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6817","nonce":2828879424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6819","nonce":2828879424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6823","nonce":2828879424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2828879424},{"type":"v1","addr":"172.21.15.72:6821","nonce":2828879424}]},"public_addr":"172.21.15.72:6817/2828879424","cluster_addr":"172.21.15.72:6819/2828879424","heartbeat_back_addr":"172.21.15.72:6823/2828879424","heartbeat_front_addr":"172.21.15.72:6821/2828879424","state":["exists","up"]},{"osd":8,"uuid":"d3f8c4a1-f8eb-4c5c-b274-c09bf383869d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6817","nonce":2821031673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6819","nonce":2821031673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6823","nonce":2821031673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2821031673},{"type":"v1","addr":"172.21.15.122:6821","nonce":2821031673}]},"public_addr":"172.21.15.122:6817/2821031673","cluster_addr":"172.21.15.122:6819/2821031673","heartbeat_back_addr":"172.21.15.122:6823/2821031673","heartbeat_front_addr":"172.21.15.122:6821/2821031673","state":["exists","up"]},{"osd":9,"uuid":"4c875335-1ab1-4f1d-9ffd-895c97f78d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6827","nonce":3462604941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6829","nonce":3462604941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6833","nonce":3462604941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3462604941},{"type":"v1","addr":"172.21.15.71:6831","nonce":3462604941}]},"public_addr":"172.21.15.71:6827/3462604941","cluster_addr":"172.21.15.71:6829/3462604941","heartbeat_back_addr":"172.21.15.71:6833/3462604941","heartbeat_front_addr":"172.21.15.71:6831/3462604941","state":["exists","up"]},{"osd":10,"uuid":"d03bc669-3810-4dd5-897c-3672443f1671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6825","nonce":3492113822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6827","nonce":3492113822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6831","nonce":3492113822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3492113822},{"type":"v1","addr":"172.21.15.72:6829","nonce":3492113822}]},"public_addr":"172.21.15.72:6825/3492113822","cluster_addr":"172.21.15.72:6827/3492113822","heartbeat_back_addr":"172.21.15.72:6831/3492113822","heartbeat_front_addr":"172.21.15.72:6829/3492113822","state":["exists","up"]},{"osd":11,"uuid":"bc33924e-d7e4-4173-95f8-a72e6cc81e04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6825","nonce":1471732856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6827","nonce":1471732856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6831","nonce":1471732856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1471732856},{"type":"v1","addr":"172.21.15.122:6829","nonce":1471732856}]},"public_addr":"172.21.15.122:6825/1471732856","cluster_addr":"172.21.15.122:6827/1471732856","heartbeat_back_addr":"172.21.15.122:6831/1471732856","heartbeat_front_addr":"172.21.15.122:6829/1471732856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:19.856098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:37:45.761780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:09.809118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:38:44.722689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:10.954022+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:39:35.415535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:10.503337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:40:36.978301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:02.088254+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:41:37.799045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:04.611864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T09:42:28.886042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6801/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6800/1797397372":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/1381797399":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/705076844":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/4081778329":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/2074945861":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/2822189872":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/1615143192":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/193022273":"2024-05-28T09:47:45.456631+0000","172.21.15.71:0/3742035998":"2024-05-28T09:35:22.974518+0000","172.21.15.71:0/226136634":"2024-05-28T09:34:47.199375+0000","172.21.15.71:6801/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1853756508":"2024-05-28T09:35:22.974518+0000","172.21.15.71:6800/1765745384":"2024-05-28T09:34:47.199375+0000","172.21.15.71:0/4261728686":"2024-05-28T09:47:45.456631+0000","172.21.15.71:6801/1765745384":"2024-05-28T09:34:47.199375+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:00:52.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9300b2a70 msgr2=0x7fd9300b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:52.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9300b2a70 0x7fd9300b4f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd94c075f90 tx=0x7fd93c009260 comp rx=0 tx=0).stop 2024-05-27T10:00:52.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c109100 msgr2=0x7fd94c1041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:52.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c109100 0x7fd94c1041f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b070 tx=0x7fd944004c80 comp rx=0 tx=0).stop 2024-05-27T10:00:52.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 shutdown_connections 2024-05-27T10:00:52.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fd9300b2a70 0x7fd9300b4f80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:52.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94c109100 0x7fd94c1041f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:52.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c102590 0x7fd94c103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:52.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 --2- 172.21.15.71:0/4097888478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd94c102ee0 0x7fd94c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:52.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 >> 172.21.15.71:0/4097888478 conn(0x7fd94c0783a0 msgr2=0x7fd94c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:52.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 shutdown_connections 2024-05-27T10:00:52.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:52.004+0000 7fd94b200700 1 -- 172.21.15.71:0/4097888478 wait complete. 2024-05-27T10:00:52.033 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:51 smithi071 ceph-mon[31451]: pgmap v409: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:52.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:51 smithi122 ceph-mon[36436]: pgmap v409: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:52.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:51 smithi072 ceph-mon[35951]: pgmap v409: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-27T10:00:52.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs fail cephfs 2024-05-27T10:00:53.397 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:52 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/4097888478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T10:00:53.398 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:52 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/4097888478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T10:00:53.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:52 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/4097888478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-27T10:00:53.858 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:54.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:53 smithi122 ceph-mon[36436]: pgmap v410: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T10:00:54.253 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:53 smithi071 ceph-mon[31451]: pgmap v410: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T10:00:54.278 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:53 smithi072 ceph-mon[35951]: pgmap v410: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T10:00:56.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 -- 172.21.15.71:0/799083907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc075d20 msgr2=0x7fc9fc076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:56.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 --2- 172.21.15.71:0/799083907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc075d20 0x7fc9fc076130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009990 tx=0x7fc9ec009ca0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 -- 172.21.15.71:0/799083907 shutdown_connections 2024-05-27T10:00:56.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 --2- 172.21.15.71:0/799083907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9fc110b90 0x7fc9fc112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 --2- 172.21.15.71:0/799083907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc075d20 0x7fc9fc076130 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 --2- 172.21.15.71:0/799083907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc076670 0x7fc9fc110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 -- 172.21.15.71:0/799083907 >> 172.21.15.71:0/799083907 conn(0x7fc9fc100030 msgr2=0x7fc9fc102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:56.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 -- 172.21.15.71:0/799083907 shutdown_connections 2024-05-27T10:00:56.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.130+0000 7fca01c00700 1 -- 172.21.15.71:0/799083907 wait complete. 2024-05-27T10:00:56.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:55 smithi071 ceph-mon[31451]: pgmap v411: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T10:00:56.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.132+0000 7fca01c00700 1 Processor -- start 2024-05-27T10:00:56.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.132+0000 7fca01c00700 1 -- start start 2024-05-27T10:00:56.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fca01c00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9fc075d20 0x7fc9fc19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:56.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fca01c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc076670 0x7fc9fc19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:56.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fca01c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc110b90 0x7fc9fc1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:56.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fca01c00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc116680 con 0x7fc9fc075d20 2024-05-27T10:00:56.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fca01c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc116500 con 0x7fc9fc110b90 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fca01c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc116800 con 0x7fc9fc076670 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fc9fa000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc076670 0x7fc9fc19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fc9fb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc110b90 0x7fc9fc1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fc9faa00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9fc075d20 0x7fc9fc19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fc9fa000700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc076670 0x7fc9fc19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:36778/0 (socket says 172.21.15.71:36778) 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fc9fa000700 1 -- 172.21.15.71:0/3694452945 learned_addr learned my addr 172.21.15.71:0/3694452945 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.133+0000 7fc9fb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc110b90 0x7fc9fc1a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38912/0 (socket says 172.21.15.71:38912) 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.134+0000 7fc9fb400700 1 -- 172.21.15.71:0/3694452945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc076670 msgr2=0x7fc9fc19d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.134+0000 7fc9fb400700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc076670 0x7fc9fc19d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.134+0000 7fc9fb400700 1 -- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9fc075d20 msgr2=0x7fc9fc19d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.134+0000 7fc9fb400700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9fc075d20 0x7fc9fc19d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.134+0000 7fc9fb400700 1 -- 172.21.15.71:0/3694452945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc1a1f00 con 0x7fc9fc110b90 2024-05-27T10:00:56.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.134+0000 7fc9fb400700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc110b90 0x7fc9fc1a1860 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc077bc0 tx=0x7fc9f400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:56.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.135+0000 7fc9f3400700 1 -- 172.21.15.71:0/3694452945 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4003a00 con 0x7fc9fc110b90 2024-05-27T10:00:56.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.135+0000 7fc9f3400700 1 -- 172.21.15.71:0/3694452945 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f400ce50 con 0x7fc9fc110b90 2024-05-27T10:00:56.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.135+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc1a21f0 con 0x7fc9fc110b90 2024-05-27T10:00:56.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.135+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc1a9b10 con 0x7fc9fc110b90 2024-05-27T10:00:56.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.135+0000 7fc9f3400700 1 -- 172.21.15.71:0/3694452945 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40046e0 con 0x7fc9fc110b90 2024-05-27T10:00:56.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.136+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9fc0512b0 con 0x7fc9fc110b90 2024-05-27T10:00:56.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.139+0000 7fc9f3400700 1 -- 172.21.15.71:0/3694452945 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fc9f4012050 con 0x7fc9fc110b90 2024-05-27T10:00:56.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.140+0000 7fc9f3400700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc9e00b2a70 0x7fc9e00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:00:56.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.140+0000 7fc9f3400700 1 -- 172.21.15.71:0/3694452945 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8513+0+0 (secure 0 0 0) 0x7fc9f40e20d0 con 0x7fc9fc110b90 2024-05-27T10:00:56.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.140+0000 7fc9faa00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc9e00b2a70 0x7fc9e00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.141+0000 7fc9faa00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc9e00b2a70 0x7fc9e00b4f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006010 tx=0x7fc9ec00b280 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.142+0000 7fc9f3400700 1 -- 172.21.15.71:0/3694452945 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc9f4022060 con 0x7fc9fc110b90 2024-05-27T10:00:56.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:55 smithi122 ceph-mon[36436]: pgmap v411: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T10:00:56.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:55 smithi072 ceph-mon[35951]: pgmap v411: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-27T10:00:56.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.417+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc9fc02e5e0 con 0x7fc9fc110b90 2024-05-27T10:00:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.433+0000 7fc9f3400700 1 -- 172.21.15.71:0/3694452945 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7fc9f4010040 con 0x7fc9fc110b90 2024-05-27T10:00:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc9e00b2a70 msgr2=0x7fc9e00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc9e00b2a70 0x7fc9e00b4f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006010 tx=0x7fc9ec00b280 comp rx=0 tx=0).stop 2024-05-27T10:00:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc110b90 msgr2=0x7fc9fc1a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:00:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc110b90 0x7fc9fc1a1860 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc077bc0 tx=0x7fc9f400c3a0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 shutdown_connections 2024-05-27T10:00:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fc9e00b2a70 0x7fc9e00b4f80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9fc110b90 0x7fc9fc1a1860 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9fc075d20 0x7fc9fc19d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 --2- 172.21.15.71:0/3694452945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9fc076670 0x7fc9fc19d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:00:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 >> 172.21.15.71:0/3694452945 conn(0x7fc9fc100030 msgr2=0x7fc9fc1006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:00:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 shutdown_connections 2024-05-27T10:00:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:00:56.436+0000 7fca01c00700 1 -- 172.21.15.71:0/3694452945 wait complete. 2024-05-27T10:00:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-27T10:00:56.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31447]: 2024-05-27T10:00:56.421+0000 7f2cf8a00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T10:00:56.757 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a[74267]: ignoring --setuser ceph since I am not root 2024-05-27T10:00:56.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a[74267]: ignoring --setgroup ceph since I am not root 2024-05-27T10:00:56.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mds[74271]: -- 172.21.15.71:0/1622107558 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565521d3da40 con 0x565521d85600 2024-05-27T10:00:56.758 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a[74267]: starting mds.a at 2024-05-27T10:00:56.758 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:00:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: ignoring --setuser ceph since I am not root 2024-05-27T10:00:56.758 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:00:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: ignoring --setgroup ceph since I am not root 2024-05-27T10:00:56.758 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mds[73885]: -- 172.21.15.71:0/575718068 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637677a1a40 con 0x5637677e9600 2024-05-27T10:00:56.758 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:00:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: starting mds.g at 2024-05-27T10:00:56.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:00:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h[65897]: ignoring --setuser ceph since I am not root 2024-05-27T10:00:56.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:00:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h[65897]: ignoring --setgroup ceph since I am not root 2024-05-27T10:00:56.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mds[65901]: -- 172.21.15.72:0/1484081417 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56193b6f9a40 con 0x56193b741180 2024-05-27T10:00:56.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:00:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h[65897]: starting mds.h at 2024-05-27T10:00:56.777 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: ignoring --setuser ceph since I am not root 2024-05-27T10:00:56.777 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: ignoring --setgroup ceph since I am not root 2024-05-27T10:00:56.777 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mds[66216]: -- 172.21.15.72:0/3931366120 <== mon.2 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f98987a40 con 0x555f989cf600 2024-05-27T10:00:56.777 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: starting mds.b at 2024-05-27T10:00:56.952 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c[67504]: ignoring --setuser ceph since I am not root 2024-05-27T10:00:56.953 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c[67504]: ignoring --setgroup ceph since I am not root 2024-05-27T10:00:56.953 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mds[67508]: -- 172.21.15.122:0/4280549675 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb9b749a40 con 0x55cb9b791a80 2024-05-27T10:00:56.953 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c[67504]: starting mds.c at 2024-05-27T10:00:56.954 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:00:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: ignoring --setuser ceph since I am not root 2024-05-27T10:00:56.954 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:00:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: ignoring --setgroup ceph since I am not root 2024-05-27T10:00:56.954 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mds[67810]: -- 172.21.15.122:0/2774747358 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563b04d2ba40 con 0x563b04d73a80 2024-05-27T10:00:56.954 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:00:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: starting mds.i at 2024-05-27T10:00:57.228 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3694452945' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-27T10:00:57.228 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-27T10:00:57.228 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-27T10:00:57.229 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T10:00:57.229 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-05-27T10:00:57.229 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-27T10:00:57.229 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: osdmap e98: 12 total, 12 up, 12 in 2024-05-27T10:00:57.229 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:56 smithi071 ceph-mon[31451]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-27T10:00:57.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3694452945' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-27T10:00:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-27T10:00:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-27T10:00:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T10:00:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-05-27T10:00:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-27T10:00:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: osdmap e98: 12 total, 12 up, 12 in 2024-05-27T10:00:57.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:56 smithi122 ceph-mon[36436]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-27T10:00:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3694452945' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-27T10:00:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-27T10:00:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-27T10:00:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T10:00:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-05-27T10:00:57.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-27T10:00:57.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: osdmap e98: 12 total, 12 up, 12 in 2024-05-27T10:00:57.277 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:56 smithi072 ceph-mon[35951]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-27T10:00:57.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-27T10:00:57.774 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:00:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6836/2851425526,v1:172.21.15.122:6838/2851425526] up:boot 2024-05-27T10:00:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.122:6837/169271494,v1:172.21.15.122:6839/169271494] up:boot 2024-05-27T10:00:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.72:6836/367404801,v1:172.21.15.72:6837/367404801] up:boot 2024-05-27T10:00:58.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.72:6838/3178276672,v1:172.21.15.72:6839/3178276672] up:boot 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6838/3047524196,v1:172.21.15.71:6840/3047524196] up:boot 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: mds.? [v2:172.21.15.71:6839/3765465274,v1:172.21.15.71:6841/3765465274] up:boot 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T10:00:58.509 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:58 smithi071 ceph-mon[31451]: pgmap v413: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-27T10:00:58.729 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6836/2851425526,v1:172.21.15.122:6838/2851425526] up:boot 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.122:6837/169271494,v1:172.21.15.122:6839/169271494] up:boot 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.72:6836/367404801,v1:172.21.15.72:6837/367404801] up:boot 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.72:6838/3178276672,v1:172.21.15.72:6839/3178276672] up:boot 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6838/3047524196,v1:172.21.15.71:6840/3047524196] up:boot 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: mds.? [v2:172.21.15.71:6839/3765465274,v1:172.21.15.71:6841/3765465274] up:boot 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T10:00:58.730 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T10:00:58.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T10:00:58.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T10:00:58.731 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:58 smithi122 ceph-mon[36436]: pgmap v413: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-27T10:00:58.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6836/2851425526,v1:172.21.15.122:6838/2851425526] up:boot 2024-05-27T10:00:58.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.122:6837/169271494,v1:172.21.15.122:6839/169271494] up:boot 2024-05-27T10:00:58.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.72:6836/367404801,v1:172.21.15.72:6837/367404801] up:boot 2024-05-27T10:00:58.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.72:6838/3178276672,v1:172.21.15.72:6839/3178276672] up:boot 2024-05-27T10:00:58.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6838/3047524196,v1:172.21.15.71:6840/3047524196] up:boot 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: mds.? [v2:172.21.15.71:6839/3765465274,v1:172.21.15.71:6841/3765465274] up:boot 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: from='mgr.25057 172.21.15.71:0/2682648189' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-27T10:00:58.777 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:58 smithi072 ceph-mon[35951]: pgmap v413: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-27T10:01:00.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 -- 172.21.15.71:0/701940939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 msgr2=0x7faa181049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:00.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 --2- 172.21.15.71:0/701940939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 0x7faa181049f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa080099c0 tx=0x7faa08009cd0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 -- 172.21.15.71:0/701940939 shutdown_connections 2024-05-27T10:01:00.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 --2- 172.21.15.71:0/701940939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa18109860 0x7faa181111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 --2- 172.21.15.71:0/701940939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 0x7faa181049f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 --2- 172.21.15.71:0/701940939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 0x7faa18109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 -- 172.21.15.71:0/701940939 >> 172.21.15.71:0/701940939 conn(0x7faa18100030 msgr2=0x7faa18102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:01:00.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 -- 172.21.15.71:0/701940939 shutdown_connections 2024-05-27T10:01:00.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.027+0000 7faa1e600700 1 -- 172.21.15.71:0/701940939 wait complete. 2024-05-27T10:01:00.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.028+0000 7faa1e600700 1 Processor -- start 2024-05-27T10:01:00.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.028+0000 7faa1e600700 1 -- start start 2024-05-27T10:01:00.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa1e600700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 0x7faa18075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:00.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa1e600700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 0x7faa18075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:00.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa1e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa18109860 0x7faa18076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:00.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa1e600700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa18114490 con 0x7faa18108f10 2024-05-27T10:01:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa1e600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa18114310 con 0x7faa18109860 2024-05-27T10:01:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa1e600700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa18114610 con 0x7faa181045e0 2024-05-27T10:01:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa16a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 0x7faa18075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa16a00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 0x7faa18075ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59494/0 (socket says 172.21.15.71:59494) 2024-05-27T10:01:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa16a00700 1 -- 172.21.15.71:0/3381280149 learned_addr learned my addr 172.21.15.71:0/3381280149 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:01:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.029+0000 7faa17400700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 0x7faa18075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17e00700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa18109860 0x7faa18076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:00.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17400700 1 -- 172.21.15.71:0/3381280149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa18109860 msgr2=0x7faa18076530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:00.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17400700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa18109860 0x7faa18076530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17400700 1 -- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 msgr2=0x7faa18075ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:00.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17400700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 0x7faa18075ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17400700 1 -- 172.21.15.71:0/3381280149 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa181a9180 con 0x7faa181045e0 2024-05-27T10:01:00.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17e00700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa18109860 0x7faa18076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa16a00700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 0x7faa18075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.030+0000 7faa17400700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 0x7faa18075ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa080098e0 tx=0x7faa080045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.031+0000 7faa0fe00700 1 -- 172.21.15.71:0/3381280149 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08026070 con 0x7faa181045e0 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.031+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa181a9410 con 0x7faa181045e0 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.031+0000 7faa0fe00700 1 -- 172.21.15.71:0/3381280149 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa0800f460 con 0x7faa181045e0 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.031+0000 7faa0fe00700 1 -- 172.21.15.71:0/3381280149 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08009e60 con 0x7faa181045e0 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.031+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa181a98c0 con 0x7faa181045e0 2024-05-27T10:01:00.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.032+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa180512b0 con 0x7faa181045e0 2024-05-27T10:01:00.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.034+0000 7faa0fe00700 1 -- 172.21.15.71:0/3381280149 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7faa08029070 con 0x7faa181045e0 2024-05-27T10:01:00.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:00:59 smithi071 ceph-mon[31451]: pgmap v414: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-27T10:01:00.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.036+0000 7faa0fe00700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9fc0b29f0 0x7fa9fc0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:00.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.036+0000 7faa0fe00700 1 -- 172.21.15.71:0/3381280149 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8727+0+0 (secure 0 0 0) 0x7faa080e2e60 con 0x7faa181045e0 2024-05-27T10:01:00.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.036+0000 7faa16a00700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9fc0b29f0 0x7fa9fc0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:00.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.037+0000 7faa16a00700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9fc0b29f0 0x7fa9fc0b4f00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faa18107910 tx=0x7faa0400b480 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:01:00.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.041+0000 7faa0fe00700 1 -- 172.21.15.71:0/3381280149 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faa08013070 con 0x7faa181045e0 2024-05-27T10:01:00.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:00:59 smithi122 ceph-mon[36436]: pgmap v414: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-27T10:01:00.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:00:59 smithi072 ceph-mon[35951]: pgmap v414: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-27T10:01:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.320+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7faa1802e5e0 con 0x7faa181045e0 2024-05-27T10:01:00.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.967+0000 7faa0fe00700 1 -- 172.21.15.71:0/3381280149 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7faa080aa7a0 con 0x7faa181045e0 2024-05-27T10:01:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9fc0b29f0 msgr2=0x7fa9fc0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9fc0b29f0 0x7fa9fc0b4f00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faa18107910 tx=0x7faa0400b480 comp rx=0 tx=0).stop 2024-05-27T10:01:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 msgr2=0x7faa18075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 0x7faa18075ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa080098e0 tx=0x7faa080045e0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 shutdown_connections 2024-05-27T10:01:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7fa9fc0b29f0 0x7fa9fc0b4f00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa18109860 0x7faa18076530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa181045e0 0x7faa18075ab0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 --2- 172.21.15.71:0/3381280149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa18108f10 0x7faa18075ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.972+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 >> 172.21.15.71:0/3381280149 conn(0x7faa18100030 msgr2=0x7faa18108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:01:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.973+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 shutdown_connections 2024-05-27T10:01:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:00.973+0000 7faa1e600700 1 -- 172.21.15.71:0/3381280149 wait complete. 2024-05-27T10:01:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:00 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3381280149' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T10:01:01.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:00 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T10:01:01.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:00 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3381280149' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T10:01:01.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:00 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T10:01:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:00 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3381280149' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T10:01:01.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:00 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-27T10:01:01.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-27T10:01:02.172 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:01:02.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:01 smithi122 ceph-mon[36436]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-27T10:01:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:01 smithi122 ceph-mon[36436]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-27T10:01:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:01 smithi122 ceph-mon[36436]: Cluster is now healthy 2024-05-27T10:01:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:01 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-27T10:01:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:01 smithi122 ceph-mon[36436]: fsmap 12 up:standby 2024-05-27T10:01:02.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:01 smithi122 ceph-mon[36436]: pgmap v415: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-27T10:01:02.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:01 smithi071 ceph-mon[31451]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-27T10:01:02.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:01 smithi071 ceph-mon[31451]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-27T10:01:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:01 smithi071 ceph-mon[31451]: Cluster is now healthy 2024-05-27T10:01:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:01 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-27T10:01:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:01 smithi071 ceph-mon[31451]: fsmap 12 up:standby 2024-05-27T10:01:02.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:01 smithi071 ceph-mon[31451]: pgmap v415: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-27T10:01:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:01 smithi072 ceph-mon[35951]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-27T10:01:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:01 smithi072 ceph-mon[35951]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-27T10:01:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:01 smithi072 ceph-mon[35951]: Cluster is now healthy 2024-05-27T10:01:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:01 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-27T10:01:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:01 smithi072 ceph-mon[35951]: fsmap 12 up:standby 2024-05-27T10:01:02.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:01 smithi072 ceph-mon[35951]: pgmap v415: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-27T10:01:04.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:03 smithi071 ceph-mon[31451]: pgmap v416: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-27T10:01:04.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:03 smithi122 ceph-mon[36436]: pgmap v416: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-27T10:01:04.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:03 smithi072 ceph-mon[35951]: pgmap v416: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-27T10:01:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 -- 172.21.15.71:0/295535914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 msgr2=0x7f5e0410ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 --2- 172.21.15.71:0/295535914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 0x7f5e0410ad90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009990 tx=0x7f5df0009ca0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 -- 172.21.15.71:0/295535914 shutdown_connections 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 --2- 172.21.15.71:0/295535914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e0410b2d0 0x7f5e04117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 --2- 172.21.15.71:0/295535914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e04110960 0x7f5e04110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 --2- 172.21.15.71:0/295535914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 0x7f5e0410ad90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 -- 172.21.15.71:0/295535914 >> 172.21.15.71:0/295535914 conn(0x7f5e04077c70 msgr2=0x7f5e040780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 -- 172.21.15.71:0/295535914 shutdown_connections 2024-05-27T10:01:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.474+0000 7f5e0a800700 1 -- 172.21.15.71:0/295535914 wait complete. 2024-05-27T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.476+0000 7f5e0a800700 1 Processor -- start 2024-05-27T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.476+0000 7f5e0a800700 1 -- start start 2024-05-27T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.476+0000 7f5e0a800700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 0x7f5e041a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.476+0000 7f5e0a800700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e0410b2d0 0x7f5e041a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e0a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e04110960 0x7f5e041a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e0a800700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0411aad0 con 0x7f5e0410a980 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e0a800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0411a950 con 0x7f5e04110960 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e0a800700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0411ac50 con 0x7f5e0410b2d0 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e0410b2d0 0x7f5e041a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e03400700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 0x7f5e041a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e0410b2d0 0x7f5e041a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.71:34172/0 (socket says 172.21.15.71:34172) 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 -- 172.21.15.71:0/3688787929 learned_addr learned my addr 172.21.15.71:0/3688787929 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e03e00700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e04110960 0x7f5e041a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 -- 172.21.15.71:0/3688787929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e04110960 msgr2=0x7f5e041a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e04110960 0x7f5e041a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 -- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 msgr2=0x7f5e041a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 0x7f5e041a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.477+0000 7f5e02a00700 1 -- 172.21.15.71:0/3688787929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e041a6370 con 0x7f5e0410b2d0 2024-05-27T10:01:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.478+0000 7f5e02a00700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e0410b2d0 0x7f5e041a1a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df00057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:01:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.478+0000 7f5dfbe00700 1 -- 172.21.15.71:0/3688787929 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0027070 con 0x7f5e0410b2d0 2024-05-27T10:01:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.478+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e041a6600 con 0x7f5e0410b2d0 2024-05-27T10:01:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.478+0000 7f5dfbe00700 1 -- 172.21.15.71:0/3688787929 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df0022470 con 0x7f5e0410b2d0 2024-05-27T10:01:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.478+0000 7f5dfbe00700 1 -- 172.21.15.71:0/3688787929 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0017650 con 0x7f5e0410b2d0 2024-05-27T10:01:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.478+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e041adf80 con 0x7f5e0410b2d0 2024-05-27T10:01:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.479+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0410c070 con 0x7f5e0410b2d0 2024-05-27T10:01:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.482+0000 7f5dfbe00700 1 -- 172.21.15.71:0/3688787929 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f5df002a070 con 0x7f5e0410b2d0 2024-05-27T10:01:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.484+0000 7f5dfbe00700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5de80b29f0 0x7f5de80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.484+0000 7f5dfbe00700 1 -- 172.21.15.71:0/3688787929 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8727+0+0 (secure 0 0 0) 0x7f5df00e3660 con 0x7f5e0410b2d0 2024-05-27T10:01:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.484+0000 7f5e03400700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5de80b29f0 0x7f5de80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.485+0000 7f5e03400700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5de80b29f0 0x7f5de80b4f00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e0407d0e0 tx=0x7f5df4009260 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:01:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.486+0000 7f5dfbe00700 1 -- 172.21.15.71:0/3688787929 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5df0013070 con 0x7f5e0410b2d0 2024-05-27T10:01:04.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.720+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e040512b0 con 0x7f5e0410b2d0 2024-05-27T10:01:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.967+0000 7f5dfbe00700 1 -- 172.21.15.71:0/3688787929 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) ==== 181+0+0 (secure 0 0 0) 0x7f5df00aafa0 con 0x7f5e0410b2d0 2024-05-27T10:01:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.975+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5de80b29f0 msgr2=0x7f5de80b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.975+0000 7f5e0a800700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5de80b29f0 0x7f5de80b4f00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e0407d0e0 tx=0x7f5df4009260 comp rx=0 tx=0).stop 2024-05-27T10:01:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.975+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e0410b2d0 msgr2=0x7f5e041a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.975+0000 7f5e0a800700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e0410b2d0 0x7f5e041a1a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df00057c0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.976+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 shutdown_connections 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.976+0000 7f5e0a800700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f5de80b29f0 0x7f5de80b4f00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.976+0000 7f5e0a800700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e04110960 0x7f5e041a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.976+0000 7f5e0a800700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e0410a980 0x7f5e041a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.976+0000 7f5e0a800700 1 --2- 172.21.15.71:0/3688787929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e0410b2d0 0x7f5e041a1a40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.976+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 >> 172.21.15.71:0/3688787929 conn(0x7f5e04077c70 msgr2=0x7f5e0407b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.977+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 shutdown_connections 2024-05-27T10:01:04.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:04.977+0000 7f5e0a800700 1 -- 172.21.15.71:0/3688787929 wait complete. 2024-05-27T10:01:04.979 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2024-05-27T10:01:05.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:04 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/3688787929' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:05.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:04 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:05.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:04 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/3688787929' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:05.259 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:04 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:04 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/3688787929' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:05.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:04 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:05.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d shell --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-27T10:01:06.223 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/mon.a/config 2024-05-27T10:01:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:05 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-27T10:01:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:05 smithi122 ceph-mon[36436]: osdmap e99: 12 total, 12 up, 12 in 2024-05-27T10:01:06.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:05 smithi122 ceph-mon[36436]: pgmap v418: 65 pgs: 65 active+clean; 125 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:05 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-27T10:01:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:05 smithi071 ceph-mon[31451]: osdmap e99: 12 total, 12 up, 12 in 2024-05-27T10:01:06.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:05 smithi071 ceph-mon[31451]: pgmap v418: 65 pgs: 65 active+clean; 125 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:05 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-27T10:01:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:05 smithi072 ceph-mon[35951]: osdmap e99: 12 total, 12 up, 12 in 2024-05-27T10:01:06.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:05 smithi072 ceph-mon[35951]: pgmap v418: 65 pgs: 65 active+clean; 125 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:07 smithi071 ceph-mon[31451]: pgmap v419: 65 pgs: 65 active+clean; 125 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:08.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:07 smithi122 ceph-mon[36436]: pgmap v419: 65 pgs: 65 active+clean; 125 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:08.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:07 smithi072 ceph-mon[35951]: pgmap v419: 65 pgs: 65 active+clean; 125 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:08.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 -- 172.21.15.71:0/976648647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e98109670 msgr2=0x7f8e98110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:08.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/976648647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e98109670 0x7f8e98110fd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009f90 tx=0x7f8e9000b330 comp rx=0 tx=0).stop 2024-05-27T10:01:08.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 -- 172.21.15.71:0/976648647 shutdown_connections 2024-05-27T10:01:08.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/976648647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e98109670 0x7f8e98110fd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/976648647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e981043f0 0x7f8e98104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/976648647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e98108d20 0x7f8e98109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 -- 172.21.15.71:0/976648647 >> 172.21.15.71:0/976648647 conn(0x7f8e98079d00 msgr2=0x7f8e9807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:01:08.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 -- 172.21.15.71:0/976648647 shutdown_connections 2024-05-27T10:01:08.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.397+0000 7f8e9ca00700 1 -- 172.21.15.71:0/976648647 wait complete. 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.398+0000 7f8e9ca00700 1 Processor -- start 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.398+0000 7f8e9ca00700 1 -- start start 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e9ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e981043f0 0x7f8e9819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e9ca00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e98108d20 0x7f8e9819d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e9ca00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e98109670 0x7f8e981a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e9ca00700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981142f0 con 0x7f8e98108d20 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e9ca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98114170 con 0x7f8e981043f0 2024-05-27T10:01:08.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e9ca00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98114470 con 0x7f8e98109670 2024-05-27T10:01:08.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e96800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e981043f0 0x7f8e9819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:08.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e96800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e981043f0 0x7f8e9819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:57202/0 (socket says 172.21.15.71:57202) 2024-05-27T10:01:08.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e96800700 1 -- 172.21.15.71:0/2417597434 learned_addr learned my addr 172.21.15.71:0/2417597434 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-05-27T10:01:08.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e8fe00700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e98108d20 0x7f8e9819d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.399+0000 7f8e97200700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e98109670 0x7f8e981a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e96800700 1 -- 172.21.15.71:0/2417597434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e98109670 msgr2=0x7f8e981a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e96800700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e98109670 0x7f8e981a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e96800700 1 -- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e98108d20 msgr2=0x7f8e9819d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e96800700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e98108d20 0x7f8e9819d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e96800700 1 -- 172.21.15.71:0/2417597434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e981a1cf0 con 0x7f8e981043f0 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e97200700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e98109670 0x7f8e981a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e96800700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e981043f0 0x7f8e9819ce20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800e9a0 tx=0x7f8e8800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e8f400700 1 -- 172.21.15.71:0/2417597434 <== mon.2 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800c9c0 con 0x7f8e981043f0 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e8f400700 1 -- 172.21.15.71:0/2417597434 <== mon.2 v2:172.21.15.72:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e8800cb60 con 0x7f8e981043f0 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e8f400700 1 -- 172.21.15.71:0/2417597434 <== mon.2 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88018680 con 0x7f8e981043f0 2024-05-27T10:01:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.400+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e981a1fe0 con 0x7f8e981043f0 2024-05-27T10:01:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.401+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e981a9900 con 0x7f8e981043f0 2024-05-27T10:01:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.402+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e980512b0 con 0x7f8e981043f0 2024-05-27T10:01:08.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.404+0000 7f8e8f400700 1 -- 172.21.15.71:0/2417597434 <== mon.2 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f8e88010430 con 0x7f8e981043f0 2024-05-27T10:01:08.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.406+0000 7f8e8f400700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8e7c0b2a70 0x7f8e7c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:01:08.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.406+0000 7f8e8f400700 1 -- 172.21.15.71:0/2417597434 <== mon.2 v2:172.21.15.72:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8231+0+0 (secure 0 0 0) 0x7f8e880e2ae0 con 0x7f8e981043f0 2024-05-27T10:01:08.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.406+0000 7f8e8fe00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8e7c0b2a70 0x7f8e7c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:01:08.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.407+0000 7f8e8fe00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8e7c0b2a70 0x7f8e7c0b4f80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e981101e0 tx=0x7f8e80009310 comp rx=0 tx=0).ready entity=mgr.25057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:01:08.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.408+0000 7f8e8f400700 1 -- 172.21.15.71:0/2417597434 <== mon.2 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8e880aa580 con 0x7f8e981043f0 2024-05-27T10:01:08.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.642+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8e9802e5e0 con 0x7f8e981043f0 2024-05-27T10:01:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.970+0000 7f8e8f400700 1 -- 172.21.15.71:0/2417597434 <== mon.2 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) ==== 169+0+0 (secure 0 0 0) 0x7f8e880a9e80 con 0x7f8e981043f0 2024-05-27T10:01:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8e7c0b2a70 msgr2=0x7f8e7c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8e7c0b2a70 0x7f8e7c0b4f80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e981101e0 tx=0x7f8e80009310 comp rx=0 tx=0).stop 2024-05-27T10:01:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e981043f0 msgr2=0x7f8e9819ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:01:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e981043f0 0x7f8e9819ce20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800e9a0 tx=0x7f8e8800ecb0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 shutdown_connections 2024-05-27T10:01:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:6800/813597445,v1:172.21.15.71:6801/813597445] conn(0x7f8e7c0b2a70 0x7f8e7c0b4f80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e98109670 0x7f8e981a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e981043f0 0x7f8e9819ce20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 --2- 172.21.15.71:0/2417597434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e98108d20 0x7f8e9819d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:01:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.977+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 >> 172.21.15.71:0/2417597434 conn(0x7f8e98079d00 msgr2=0x7f8e98110cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:01:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.978+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 shutdown_connections 2024-05-27T10:01:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-05-27T10:01:08.978+0000 7f8e9ca00700 1 -- 172.21.15.71:0/2417597434 wait complete. 2024-05-27T10:01:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2024-05-27T10:01:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:08 smithi122 ceph-mon[36436]: from='client.? 172.21.15.71:0/2417597434' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:09.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:08 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:09.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:08 smithi071 ceph-mon[31451]: from='client.? 172.21.15.71:0/2417597434' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:09.257 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:08 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:09.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:08 smithi072 ceph-mon[35951]: from='client.? 172.21.15.71:0/2417597434' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:09.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:08 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-27T10:01:09.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-27T10:01:09.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-27T10:01:09.902 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-27T10:01:09.931 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-27T10:01:09.931 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-27T10:01:09.988 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-27T10:01:10.003 DEBUG:teuthology.orchestra.run.smithi122:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-27T10:01:10.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:09 smithi071 ceph-mon[31451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-27T10:01:10.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:09 smithi071 ceph-mon[31451]: osdmap e100: 12 total, 12 up, 12 in 2024-05-27T10:01:10.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:09 smithi071 ceph-mon[31451]: pgmap v421: 1 pgs: 1 active+clean; 577 KiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:10.019 INFO:tasks.cephadm:Stopping all daemons... 2024-05-27T10:01:10.019 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-27T10:01:10.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a 2024-05-27T10:01:10.229 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:09 smithi122 ceph-mon[36436]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-27T10:01:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:09 smithi122 ceph-mon[36436]: osdmap e100: 12 total, 12 up, 12 in 2024-05-27T10:01:10.230 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:09 smithi122 ceph-mon[36436]: pgmap v421: 1 pgs: 1 active+clean; 577 KiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:09 smithi072 ceph-mon[35951]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-27T10:01:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:09 smithi072 ceph-mon[35951]: osdmap e100: 12 total, 12 up, 12 in 2024-05-27T10:01:10.276 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:09 smithi072 ceph-mon[35951]: pgmap v421: 1 pgs: 1 active+clean; 577 KiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-27T10:01:10.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:10 smithi071 systemd[1]: Stopping Ceph mon.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:11.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:10 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31447]: 2024-05-27T10:01:10.583+0000 7f2cff800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:11.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:10 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a[31447]: 2024-05-27T10:01:10.583+0000 7f2cff800700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-27T10:01:11.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:10 smithi071 podman[131812]: 2024-05-27 10:01:10.831077819 +0000 UTC m=+0.386637140 container died dc62176e2d2186dbfa31d471577020cd8edc7903ea4a9f669dfd269ef3075eaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-27T10:01:11.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:11 smithi071 podman[131812]: 2024-05-27 10:01:11.268669117 +0000 UTC m=+0.824228424 container cleanup dc62176e2d2186dbfa31d471577020cd8edc7903ea4a9f669dfd269ef3075eaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-27T10:01:11.508 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:11 smithi071 bash[131812]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a 2024-05-27T10:01:12.007 INFO:journalctl@ceph.mon.a.smithi071.stdout:May 27 10:01:11 smithi071 podman[131825]: 2024-05-27 10:01:11.536603109 +0000 UTC m=+0.693673123 container remove dc62176e2d2186dbfa31d471577020cd8edc7903ea4a9f669dfd269ef3075eaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-27T10:01:12.103 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.a.service' 2024-05-27T10:01:12.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:12.221 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-27T10:01:12.221 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-27T10:01:12.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.b 2024-05-27T10:01:12.522 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:12 smithi072 systemd[1]: Stopping Ceph mon.b for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-b[35947]: 2024-05-27T10:01:12.522+0000 7f578bf3a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-b[35947]: 2024-05-27T10:01:12.522+0000 7f578bf3a700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-27T10:01:12.776 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:12 smithi072 podman[72591]: 2024-05-27 10:01:12.573933303 +0000 UTC m=+0.163247023 container died 21c841bd7e4cf76c460eb3413aabd6092772447f83103a7830147357adca3cf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240521) 2024-05-27T10:01:13.112 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:12 smithi072 podman[72591]: 2024-05-27 10:01:12.910217067 +0000 UTC m=+0.499530777 container cleanup 21c841bd7e4cf76c460eb3413aabd6092772447f83103a7830147357adca3cf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:01:13.112 INFO:journalctl@ceph.mon.b.smithi072.stdout:May 27 10:01:12 smithi072 bash[72591]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-b 2024-05-27T10:01:13.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.b.service' 2024-05-27T10:01:13.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:13.376 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-27T10:01:13.376 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-27T10:01:13.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.c 2024-05-27T10:01:13.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:13 smithi122 systemd[1]: Stopping Ceph mon.c for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:13.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c[36410]: 2024-05-27T10:01:13.697+0000 7f3934d77700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:13.979 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c[36410]: 2024-05-27T10:01:13.697+0000 7f3934d77700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-27T10:01:13.980 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:13 smithi122 podman[74178]: 2024-05-27 10:01:13.728469578 +0000 UTC m=+0.159472496 container died 385673cfaac7acfc1c11ab00a5b2e22c890bf0afa52d4a99f38c85e42a88f31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux ) 2024-05-27T10:01:14.349 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:14 smithi122 podman[74178]: 2024-05-27 10:01:14.09788711 +0000 UTC m=+0.528890036 container cleanup 385673cfaac7acfc1c11ab00a5b2e22c890bf0afa52d4a99f38c85e42a88f31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-27T10:01:14.349 INFO:journalctl@ceph.mon.c.smithi122.stdout:May 27 10:01:14 smithi122 bash[74178]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mon-c 2024-05-27T10:01:14.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mon.c.service' 2024-05-27T10:01:14.572 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:14.572 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-27T10:01:14.573 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-27T10:01:14.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.x 2024-05-27T10:01:15.007 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:14 smithi071 systemd[1]: Stopping Ceph mgr.x for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:15.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:15 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T10:01:15.136+0000 7f2f24e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:15.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:15 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x[31680]: 2024-05-27T10:01:15.136+0000 7f2f24e00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-27T10:01:15.508 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:15 smithi071 podman[131933]: 2024-05-27 10:01:15.242563966 +0000 UTC m=+0.242665625 container stop aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:01:15.509 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:15 smithi071 podman[131933]: 2024-05-27 10:01:15.268742005 +0000 UTC m=+0.268843624 container died aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-27T10:01:15.967 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:15 smithi071 podman[131933]: 2024-05-27 10:01:15.706554805 +0000 UTC m=+0.706656428 container cleanup aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS) 2024-05-27T10:01:15.967 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:15 smithi071 bash[131933]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x 2024-05-27T10:01:16.257 INFO:journalctl@ceph.mgr.x.smithi071.stdout:May 27 10:01:15 smithi071 podman[131947]: 2024-05-27 10:01:15.966260148 +0000 UTC m=+0.705212825 container remove aed1cd15b2fe7a0ce0b52dd945434064d6a0d11abcc399befa51e41eda69c977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6507388dd5057528934822c0163b0c347ef1d5d, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-27T10:01:16.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.x.service' 2024-05-27T10:01:16.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:16.595 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-27T10:01:16.595 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-27T10:01:16.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.y 2024-05-27T10:01:16.933 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 10:01:16 smithi072 systemd[1]: Stopping Ceph mgr.y for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:17.196 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 10:01:16 smithi072 podman[72712]: 2024-05-27 10:01:16.933077302 +0000 UTC m=+0.141965676 container died 2bd69f4d1afbb5427f1144e680c1bdf5720b58b6b3ad8242f14a511ec351415e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True) 2024-05-27T10:01:17.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 10:01:17 smithi072 podman[72712]: 2024-05-27 10:01:17.388252407 +0000 UTC m=+0.597140780 container cleanup 2bd69f4d1afbb5427f1144e680c1bdf5720b58b6b3ad8242f14a511ec351415e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-27T10:01:17.526 INFO:journalctl@ceph.mgr.y.smithi072.stdout:May 27 10:01:17 smithi072 bash[72712]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-y 2024-05-27T10:01:17.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.y.service' 2024-05-27T10:01:17.836 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:17.837 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-27T10:01:17.837 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-27T10:01:17.837 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.z 2024-05-27T10:01:18.191 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 10:01:17 smithi122 systemd[1]: Stopping Ceph mgr.z for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:18.462 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 10:01:18 smithi122 podman[74298]: 2024-05-27 10:01:18.191460327 +0000 UTC m=+0.156929076 container died c4ba584c3e785aba10c1e35c030966f8691aa7fe58b7abf3509d0ca5b8e59051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:01:18.729 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 10:01:18 smithi122 podman[74298]: 2024-05-27 10:01:18.544277984 +0000 UTC m=+0.509746741 container cleanup c4ba584c3e785aba10c1e35c030966f8691aa7fe58b7abf3509d0ca5b8e59051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-27T10:01:18.729 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 10:01:18 smithi122 bash[74298]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z 2024-05-27T10:01:19.117 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 10:01:18 smithi122 podman[74310]: 2024-05-27 10:01:18.92913569 +0000 UTC m=+0.736089261 container remove c4ba584c3e785aba10c1e35c030966f8691aa7fe58b7abf3509d0ca5b8e59051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-27T10:01:19.118 INFO:journalctl@ceph.mgr.z.smithi122.stdout:May 27 10:01:18 smithi122 systemd[1]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-27T10:01:19.127 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mgr.z.service' 2024-05-27T10:01:19.163 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:19.164 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-27T10:01:19.164 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-27T10:01:19.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.0 2024-05-27T10:01:19.508 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:19 smithi071 systemd[1]: Stopping Ceph osd.0 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:20.008 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0[46530]: 2024-05-27T10:01:19.741+0000 7feb9ae00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:20.008 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0[46530]: 2024-05-27T10:01:19.741+0000 7feb9ae00700 -1 osd.0 100 *** Got signal Terminated *** 2024-05-27T10:01:20.008 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0[46530]: 2024-05-27T10:01:19.741+0000 7feb9ae00700 -1 osd.0 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:01:25.758 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:25 smithi071 podman[132067]: 2024-05-27 10:01:25.45385209 +0000 UTC m=+5.843827418 container died 43926b252591b783ce23dcaaa32e44ee2e9cbcfdfc913f222e60d31d79ebec48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:01:26.129 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:25 smithi071 podman[132067]: 2024-05-27 10:01:25.927968266 +0000 UTC m=+6.317943634 container cleanup 43926b252591b783ce23dcaaa32e44ee2e9cbcfdfc913f222e60d31d79ebec48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-27T10:01:26.129 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:25 smithi071 bash[132067]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0 2024-05-27T10:01:26.507 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:26 smithi071 podman[132086]: 2024-05-27 10:01:26.128355728 +0000 UTC m=+0.654237484 container remove 43926b252591b783ce23dcaaa32e44ee2e9cbcfdfc913f222e60d31d79ebec48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-27T10:01:27.250 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:26 smithi071 podman[132172]: 2024-05-27 10:01:26.844752808 +0000 UTC m=+0.034165407 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:01:27.250 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:26 smithi071 podman[132172]: 2024-05-27 10:01:26.962888451 +0000 UTC m=+0.152301082 container create 0dc941406cdeb21217f9749d7942924c3e1f2e1f0912c75541464b79f5ec7e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS) 2024-05-27T10:01:27.508 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:27 smithi071 podman[132172]: 2024-05-27 10:01:27.249623965 +0000 UTC m=+0.439036606 container init 0dc941406cdeb21217f9749d7942924c3e1f2e1f0912c75541464b79f5ec7e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0-deactivate, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521) 2024-05-27T10:01:27.508 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:27 smithi071 podman[132172]: 2024-05-27 10:01:27.262069567 +0000 UTC m=+0.451482168 container start 0dc941406cdeb21217f9749d7942924c3e1f2e1f0912c75541464b79f5ec7e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-27T10:01:27.508 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:27 smithi071 podman[132172]: 2024-05-27 10:01:27.365327102 +0000 UTC m=+0.554739780 container attach 0dc941406cdeb21217f9749d7942924c3e1f2e1f0912c75541464b79f5ec7e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240521, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:01:28.008 INFO:journalctl@ceph.osd.0.smithi071.stdout:May 27 10:01:27 smithi071 podman[132172]: 2024-05-27 10:01:27.721613653 +0000 UTC m=+0.911026340 container died 0dc941406cdeb21217f9749d7942924c3e1f2e1f0912c75541464b79f5ec7e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-27T10:01:28.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.0.service' 2024-05-27T10:01:28.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:28.585 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-27T10:01:28.585 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-27T10:01:28.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.1 2024-05-27T10:01:28.881 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:28 smithi072 systemd[1]: Stopping Ceph osd.1 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:29.276 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1[40520]: 2024-05-27T10:01:28.880+0000 7fce135fe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:29.276 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1[40520]: 2024-05-27T10:01:28.880+0000 7fce135fe700 -1 osd.1 100 *** Got signal Terminated *** 2024-05-27T10:01:29.276 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1[40520]: 2024-05-27T10:01:28.880+0000 7fce135fe700 -1 osd.1 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:01:34.526 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:34 smithi072 podman[72839]: 2024-05-27 10:01:34.238221955 +0000 UTC m=+5.457061310 container died 437c7fa56287d9f641d17927b112ceae88473debef554eac60b2d04862f0376b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, io.buildah.version=1.33.5) 2024-05-27T10:01:34.796 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:34 smithi072 podman[72839]: 2024-05-27 10:01:34.568710688 +0000 UTC m=+5.787550046 container cleanup 437c7fa56287d9f641d17927b112ceae88473debef554eac60b2d04862f0376b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:01:34.796 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:34 smithi072 bash[72839]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1 2024-05-27T10:01:35.236 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:34 smithi072 podman[72854]: 2024-05-27 10:01:34.796638849 +0000 UTC m=+0.558431870 container remove 437c7fa56287d9f641d17927b112ceae88473debef554eac60b2d04862f0376b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-27T10:01:35.487 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:35 smithi072 podman[72943]: 2024-05-27 10:01:35.140255279 +0000 UTC m=+0.017139398 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:01:35.487 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:35 smithi072 podman[72943]: 2024-05-27 10:01:35.257288175 +0000 UTC m=+0.134172321 container create be84db098ba19584614a04f37bad271461185c9a99edd0dcc665765e58f190f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-27T10:01:35.776 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:35 smithi072 podman[72943]: 2024-05-27 10:01:35.487949953 +0000 UTC m=+0.364834070 container init be84db098ba19584614a04f37bad271461185c9a99edd0dcc665765e58f190f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1-deactivate, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-05-27T10:01:35.776 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:35 smithi072 podman[72943]: 2024-05-27 10:01:35.491180269 +0000 UTC m=+0.368064372 container start be84db098ba19584614a04f37bad271461185c9a99edd0dcc665765e58f190f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:01:35.777 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:35 smithi072 podman[72943]: 2024-05-27 10:01:35.57996113 +0000 UTC m=+0.456845252 container attach be84db098ba19584614a04f37bad271461185c9a99edd0dcc665765e58f190f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-27T10:01:36.067 INFO:journalctl@ceph.osd.1.smithi072.stdout:May 27 10:01:35 smithi072 podman[72943]: 2024-05-27 10:01:35.782018847 +0000 UTC m=+0.658902986 container died be84db098ba19584614a04f37bad271461185c9a99edd0dcc665765e58f190f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:01:36.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.1.service' 2024-05-27T10:01:36.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:36.399 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-27T10:01:36.399 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-27T10:01:36.399 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.2 2024-05-27T10:01:36.691 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:36 smithi122 systemd[1]: Stopping Ceph osd.2 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:36.979 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2[41593]: 2024-05-27T10:01:36.689+0000 7f3e8c5a3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:36.979 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2[41593]: 2024-05-27T10:01:36.689+0000 7f3e8c5a3700 -1 osd.2 100 *** Got signal Terminated *** 2024-05-27T10:01:36.979 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2[41593]: 2024-05-27T10:01:36.689+0000 7f3e8c5a3700 -1 osd.2 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:01:42.558 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:42 smithi122 podman[74434]: 2024-05-27 10:01:42.241177751 +0000 UTC m=+5.649893626 container died cd8772c910f3b99a9bfcd7e19979140af32210f20808c793f5852fb5168533f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, io.buildah.version=1.33.5) 2024-05-27T10:01:42.866 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:42 smithi122 podman[74434]: 2024-05-27 10:01:42.63212896 +0000 UTC m=+6.040844810 container cleanup cd8772c910f3b99a9bfcd7e19979140af32210f20808c793f5852fb5168533f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-27T10:01:42.867 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:42 smithi122 bash[74434]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2 2024-05-27T10:01:43.200 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:42 smithi122 podman[74452]: 2024-05-27 10:01:42.866950314 +0000 UTC m=+0.624312567 container remove cd8772c910f3b99a9bfcd7e19979140af32210f20808c793f5852fb5168533f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:01:43.461 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:43 smithi122 podman[74539]: 2024-05-27 10:01:43.201027136 +0000 UTC m=+0.106530769 container create d6f37a57479d21aa25354ac1f6c4bf06da377236eb76ef54c7db430398f2a0f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-05-27T10:01:43.462 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:43 smithi122 podman[74539]: 2024-05-27 10:01:43.111772449 +0000 UTC m=+0.017276037 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:01:43.729 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:43 smithi122 podman[74539]: 2024-05-27 10:01:43.462207283 +0000 UTC m=+0.367710868 container init d6f37a57479d21aa25354ac1f6c4bf06da377236eb76ef54c7db430398f2a0f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:01:43.729 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:43 smithi122 podman[74539]: 2024-05-27 10:01:43.465573661 +0000 UTC m=+0.371077244 container start d6f37a57479d21aa25354ac1f6c4bf06da377236eb76ef54c7db430398f2a0f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2-deactivate, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-27T10:01:43.730 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:43 smithi122 podman[74539]: 2024-05-27 10:01:43.545177387 +0000 UTC m=+0.450680975 container attach d6f37a57479d21aa25354ac1f6c4bf06da377236eb76ef54c7db430398f2a0f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-27T10:01:44.123 INFO:journalctl@ceph.osd.2.smithi122.stdout:May 27 10:01:43 smithi122 podman[74539]: 2024-05-27 10:01:43.775735728 +0000 UTC m=+0.681239317 container died d6f37a57479d21aa25354ac1f6c4bf06da377236eb76ef54c7db430398f2a0f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:01:44.444 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.2.service' 2024-05-27T10:01:44.481 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:44.482 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-27T10:01:44.482 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-27T10:01:44.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.3 2024-05-27T10:01:45.008 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:44 smithi071 systemd[1]: Stopping Ceph osd.3 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:45.508 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3[53456]: 2024-05-27T10:01:45.076+0000 7f7de0000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:45.508 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3[53456]: 2024-05-27T10:01:45.076+0000 7f7de0000700 -1 osd.3 100 *** Got signal Terminated *** 2024-05-27T10:01:45.508 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:45 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3[53456]: 2024-05-27T10:01:45.076+0000 7f7de0000700 -1 osd.3 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:01:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:46.587+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:47.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:46 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:46.820+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:47.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:47 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:47.460+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:47.539+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:48.257 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:48 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3[53456]: 2024-05-27T10:01:48.109+0000 7f7ddb800700 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:22.586109+0000 front 2024-05-27T10:01:22.585901+0000 (oldest deadline 2024-05-27T10:01:47.285844+0000) 2024-05-27T10:01:48.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:47 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:47.869+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:48.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:48 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:48.469+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:48.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:48.507+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:49.257 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:49 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3[53456]: 2024-05-27T10:01:49.078+0000 7f7ddb800700 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:22.586109+0000 front 2024-05-27T10:01:22.585901+0000 (oldest deadline 2024-05-27T10:01:47.285844+0000) 2024-05-27T10:01:49.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:48 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:48.888+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:49.584 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:49.269+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:49.585 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:49.374+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:49.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:49 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:49.429+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:49.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:49 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:49.486+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:50.257 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:50 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3[53456]: 2024-05-27T10:01:50.033+0000 7f7ddb800700 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:22.586109+0000 front 2024-05-27T10:01:22.585901+0000 (oldest deadline 2024-05-27T10:01:47.285844+0000) 2024-05-27T10:01:50.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:49 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:49.930+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:50.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:50.356+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:50.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:50.251+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:50.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:50 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:50.450+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:50.758 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:50 smithi071 podman[132276]: 2024-05-27 10:01:50.570873313 +0000 UTC m=+5.645796320 container died f54e43aed96016f975a68c59a47506135f8620c3bbff2965b99abdde0ef0613d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-05-27T10:01:50.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:50 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:50.454+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:51.258 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:51 smithi071 podman[132276]: 2024-05-27 10:01:51.110814688 +0000 UTC m=+6.185737732 container cleanup f54e43aed96016f975a68c59a47506135f8620c3bbff2965b99abdde0ef0613d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3, org.label-schema.build-date=20240521, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:01:51.258 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:51 smithi071 bash[132276]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3 2024-05-27T10:01:51.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:50 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:50.899+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:51.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:51.289+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:51.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:51.366+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:51.757 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:51 smithi071 podman[132295]: 2024-05-27 10:01:51.295676289 +0000 UTC m=+0.709047176 container remove f54e43aed96016f975a68c59a47506135f8620c3bbff2965b99abdde0ef0613d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-27T10:01:51.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:51 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:51.465+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:51.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:51 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:51.466+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:52.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:51 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:51.915+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:52.257 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:52 smithi071 podman[132382]: 2024-05-27 10:01:52.028833341 +0000 UTC m=+0.034173159 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:01:52.257 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:52 smithi071 podman[132382]: 2024-05-27 10:01:52.137964789 +0000 UTC m=+0.143304631 container create bec8cbf3d941bccd6e9022e45f27c71762e40ae5658fc8cb6f9d5d97abddba2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:01:52.590 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:52 smithi071 podman[132382]: 2024-05-27 10:01:52.466693924 +0000 UTC m=+0.472033762 container init bec8cbf3d941bccd6e9022e45f27c71762e40ae5658fc8cb6f9d5d97abddba2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3-deactivate, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-27T10:01:52.591 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:52 smithi071 podman[132382]: 2024-05-27 10:01:52.477814654 +0000 UTC m=+0.483154485 container start bec8cbf3d941bccd6e9022e45f27c71762e40ae5658fc8cb6f9d5d97abddba2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-05-27T10:01:52.591 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:52 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:52.457+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:52.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:52.304+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:52.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:52.412+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:52.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:52 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:52.418+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:52.922 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:52 smithi071 podman[132382]: 2024-05-27 10:01:52.590790013 +0000 UTC m=+0.596129837 container attach bec8cbf3d941bccd6e9022e45f27c71762e40ae5658fc8cb6f9d5d97abddba2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:01:53.257 INFO:journalctl@ceph.osd.3.smithi071.stdout:May 27 10:01:52 smithi071 podman[132413]: 2024-05-27 10:01:52.993416849 +0000 UTC m=+0.031747042 container died bec8cbf3d941bccd6e9022e45f27c71762e40ae5658fc8cb6f9d5d97abddba2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-27T10:01:53.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:52 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:52.921+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:53.627 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:53 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:53.428+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:53.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.3.service' 2024-05-27T10:01:53.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:53.289+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:53.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:53.448+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:53.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:01:53.753 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-27T10:01:53.753 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-27T10:01:53.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.4 2024-05-27T10:01:53.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:53 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:53.400+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:54.060 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:53 smithi072 systemd[1]: Stopping Ceph osd.4 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:01:54.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:53 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:53.957+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:54.450 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T10:01:54.060+0000 7f04fc3d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:01:54.450 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T10:01:54.060+0000 7f04fc3d8700 -1 osd.4 100 *** Got signal Terminated *** 2024-05-27T10:01:54.451 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T10:01:54.060+0000 7f04fc3d8700 -1 osd.4 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:01:54.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:54.496+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:54.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:54.323+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:54.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:54.323+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:01:54.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:54.471+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:54.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:54 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:54.446+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:55.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:01:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:01:54.958+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:01:55.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:54 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:54.957+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:55.526 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:55 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T10:01:55.214+0000 7f04f898e700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.034035+0000 front 2024-05-27T10:01:30.034068+0000 (oldest deadline 2024-05-27T10:01:54.734266+0000) 2024-05-27T10:01:55.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:55 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:55.405+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:55.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:55.342+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:55.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:55.342+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:01:55.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:55.520+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:55.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:55.520+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:01:55.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:55 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:55.437+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:55.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:55 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:55.437+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:01:56.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:55 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:55.919+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:56.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:55 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:55.919+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:01:56.374 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:01:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:01:55.998+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:01:56.526 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T10:01:56.236+0000 7f04f898e700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.034035+0000 front 2024-05-27T10:01:30.034068+0000 (oldest deadline 2024-05-27T10:01:54.734266+0000) 2024-05-27T10:01:56.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:56 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:56.376+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:56.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:56.375+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:56.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:56.375+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:01:56.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:56.514+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:56.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:56.514+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:01:56.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:56.404+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:56.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:56.404+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:01:57.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:01:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:01:56.976+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:01:57.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:56.895+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:57.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:56 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:56.895+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:01:57.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:57 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:57.401+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:57.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:57 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:57.401+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:01:57.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:57 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:57.536+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:57.731 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:57 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:57.536+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:01:57.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:57 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:57.416+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:57.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:57 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:57.416+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:01:57.776 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:57 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T10:01:57.277+0000 7f04f898e700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.034035+0000 front 2024-05-27T10:01:30.034068+0000 (oldest deadline 2024-05-27T10:01:54.734266+0000) 2024-05-27T10:01:57.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:57 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:57.396+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:58.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:57 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:57.936+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:58.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:57 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:57.936+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:01:58.397 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:01:57 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:01:57.999+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:01:58.526 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:58 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4[47303]: 2024-05-27T10:01:58.258+0000 7f04f898e700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.034035+0000 front 2024-05-27T10:01:30.034068+0000 (oldest deadline 2024-05-27T10:01:54.734266+0000) 2024-05-27T10:01:58.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:58 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:58.379+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:58.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:58 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:58.379+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:01:58.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:58 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:58.397+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:58.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:58 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:58.397+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:01:58.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:58 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:58.540+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:58.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:58 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:58.540+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:01:58.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:58 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:58.375+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:58.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:58 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:58.375+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:01:59.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:01:58 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:01:58.971+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:01:59.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:58 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:58.887+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:01:59.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:58 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:58.887+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:01:59.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:01:59 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:01:59.001+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:01:59.637 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:59 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:59.358+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:01:59.638 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:01:59 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:01:59.358+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:01:59.638 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:59 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:59.493+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:01:59.638 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:01:59 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:01:59.493+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:01:59.681 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:59 smithi072 podman[73059]: 2024-05-27 10:01:59.443015282 +0000 UTC m=+5.494818664 container died 6e5fa9280e353f1a2e1b16295062af8ad6f868c17cf2238857ccac51274633b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-27T10:01:59.681 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:59 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:59.386+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:01:59.681 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:01:59 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:01:59.386+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:01:59.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:59 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:59.327+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:01:59.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:01:59 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:01:59.327+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:01:59.950 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:59 smithi072 podman[73059]: 2024-05-27 10:01:59.773035842 +0000 UTC m=+5.824839218 container cleanup 6e5fa9280e353f1a2e1b16295062af8ad6f868c17cf2238857ccac51274633b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-27T10:01:59.950 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:59 smithi072 bash[73059]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4 2024-05-27T10:02:00.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:01:59 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:01:59.941+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:00.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:59 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:59.904+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:00.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:01:59 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:01:59.904+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:00.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:00 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:00.015+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:00.276 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:01:59 smithi072 podman[73076]: 2024-05-27 10:01:59.950656142 +0000 UTC m=+0.508903635 container remove 6e5fa9280e353f1a2e1b16295062af8ad6f868c17cf2238857ccac51274633b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-27T10:02:00.691 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:00 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:00.420+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:00.691 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:00 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:00.420+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:00.691 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:02:00 smithi072 podman[73164]: 2024-05-27 10:02:00.378704048 +0000 UTC m=+0.103118758 container create 90203c647b31f1921a3fe614d81714b693432604bc06fa4bb84d1330c68f0ce5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:00.691 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:02:00 smithi072 podman[73164]: 2024-05-27 10:02:00.293011997 +0000 UTC m=+0.017426714 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:00.691 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:02:00 smithi072 podman[73164]: 2024-05-27 10:02:00.608299723 +0000 UTC m=+0.332714432 container init 90203c647b31f1921a3fe614d81714b693432604bc06fa4bb84d1330c68f0ce5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:02:00.692 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:02:00 smithi072 podman[73164]: 2024-05-27 10:02:00.611523395 +0000 UTC m=+0.335938107 container start 90203c647b31f1921a3fe614d81714b693432604bc06fa4bb84d1330c68f0ce5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:02:00.692 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:02:00 smithi072 podman[73164]: 2024-05-27 10:02:00.691378325 +0000 UTC m=+0.415793043 container attach 90203c647b31f1921a3fe614d81714b693432604bc06fa4bb84d1330c68f0ce5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-27T10:02:00.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:00 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:00.394+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:02:00.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:00 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:00.394+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:02:00.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:00 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:00.454+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:00.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:00 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:00.454+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:00.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:00.304+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:00.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:00.304+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:00.978 INFO:journalctl@ceph.osd.4.smithi072.stdout:May 27 10:02:00 smithi072 podman[73164]: 2024-05-27 10:02:00.900647951 +0000 UTC m=+0.625062661 container died 90203c647b31f1921a3fe614d81714b693432604bc06fa4bb84d1330c68f0ce5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-27T10:02:01.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:00 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:00.960+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:01.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:00.920+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:01.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:00.920+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:01.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:00 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:00.977+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:01.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.4.service' 2024-05-27T10:02:01.575 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:01.575 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-27T10:02:01.576 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-27T10:02:01.576 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.5 2024-05-27T10:02:01.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:01.459+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:01.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:01.459+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:01.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:01.388+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:02:01.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:01.388+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:02:01.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:01 smithi122 systemd[1]: Stopping Ceph osd.5 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:02:01.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:01 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:01.351+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:01.759 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:01 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:01.351+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:01.777 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:01 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:01.454+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:01.777 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:01 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:01.454+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:02.231 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:01.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:02.231 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:01.885+0000 7f2f931d1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:02:02.232 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:01.885+0000 7f2f931d1700 -1 osd.5 100 *** Got signal Terminated *** 2024-05-27T10:02:02.232 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:01 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:01.885+0000 7f2f931d1700 -1 osd.5 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:02:02.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:01 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:01.935+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:02.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:01 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:01.935+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:02.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:01 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:01.966+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:02.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:02 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:02.436+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:02.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:02 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:02.436+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:02.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:02 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:02.359+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:02:02.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:02 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:02.359+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:02:02.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:02 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:02.364+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:02.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:02 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:02.364+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:02.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:02 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:02.454+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:02.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:02 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:02.454+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:03.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:02 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:02.941+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:03.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:02 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:02.941+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:03.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:02 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:02.926+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:03.395 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:03.008+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:03.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:03.445+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:03.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:03.445+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:03.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:03.395+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:02:03.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:03.395+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:02:03.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:03.395+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:37.769314+0000 front 2024-05-27T10:01:37.769353+0000 (oldest deadline 2024-05-27T10:02:03.069414+0000) 2024-05-27T10:02:03.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:03 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:03.362+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:03.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:03 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:03.362+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:03.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:03 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:03.461+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:03.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:03 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:03.461+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:03.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:03 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:03.461+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:04.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:03 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:03.925+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:04.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:03 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:03.925+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:04.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:03 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:03.920+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:04.356 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:03 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:03.996+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:04.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:04 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:04.466+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:04.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:04 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:04.466+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:04.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:04 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:04.466+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:04.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:04 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:04.355+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:02:04.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:04 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:04.355+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:02:04.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:04 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:04.355+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:37.769314+0000 front 2024-05-27T10:01:37.769353+0000 (oldest deadline 2024-05-27T10:02:03.069414+0000) 2024-05-27T10:02:04.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:04 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:04.360+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:04.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:04 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:04.360+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:04.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:04 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:04.465+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:04.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:04 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:04.465+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:04.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:04 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:04.465+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:05.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:04 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:04.951+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:05.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:04 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:04.951+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:05.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:04 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:04.951+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:05.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:04 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:04.946+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:05.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:04 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:04.946+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:05.391 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:05 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:05.022+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:05.549 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:05 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:05.490+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:05.550 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:05 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:05.490+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:05.550 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:05 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:05.490+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:05.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:05 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:05.391+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:02:05.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:05 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:05.391+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:02:05.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:05 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:05.391+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:37.769314+0000 front 2024-05-27T10:01:37.769353+0000 (oldest deadline 2024-05-27T10:02:03.069414+0000) 2024-05-27T10:02:05.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:05 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:05.420+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:05.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:05 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:05.420+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:05.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:05 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:05.420+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:05.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:05 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:05.401+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:05.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:05 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:05.401+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:06.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:05 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:05.968+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:06.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:05 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:05.968+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:06.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:05 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:05.968+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:06.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:05 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:05.961+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:06.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:05 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:05.961+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:06.349 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:06 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:06.029+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:06.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:06 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:06.349+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.367896+0000 front 2024-05-27T10:01:24.367527+0000 (oldest deadline 2024-05-27T10:01:48.467252+0000) 2024-05-27T10:02:06.729 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:06 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:06.349+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.568245+0000 front 2024-05-27T10:01:32.568368+0000 (oldest deadline 2024-05-27T10:01:54.268226+0000) 2024-05-27T10:02:06.730 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:06 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5[48531]: 2024-05-27T10:02:06.349+0000 7f2f8b77f700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:37.769314+0000 front 2024-05-27T10:01:37.769353+0000 (oldest deadline 2024-05-27T10:02:03.069414+0000) 2024-05-27T10:02:06.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:06 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:06.388+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:06.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:06 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:06.388+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:06.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:06 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:06.388+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:06.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:06.355+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:06.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:06.355+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:06.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:06.355+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:06.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:06 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:06.527+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:06.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:06 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:06.527+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:06.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:06 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:06.527+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:07.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:06.947+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:07.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:06.947+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:07.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:06.947+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:07.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:06 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:06.995+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:07.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:06 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:06.995+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:07.376 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:07 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:07.033+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:07.676 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:07 smithi122 podman[74660]: 2024-05-27 10:02:07.377283399 +0000 UTC m=+5.597568707 container died 0d63438dbb69f1926570a28e03c726474b772fca86c730326b19ac79d53c6f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-27T10:02:07.676 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:07 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:07.392+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:07.676 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:07 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:07.392+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:07.677 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:07 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:07.392+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:07.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:07 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:07.351+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:07.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:07 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:07.351+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:07.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:07 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:07.351+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:07.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:07 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:07.485+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:07.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:07 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:07.485+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:07.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:07 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:07.485+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:07.979 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:07 smithi122 podman[74660]: 2024-05-27 10:02:07.676975399 +0000 UTC m=+5.897260709 container cleanup 0d63438dbb69f1926570a28e03c726474b772fca86c730326b19ac79d53c6f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-05-27T10:02:07.980 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:07 smithi122 bash[74660]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5 2024-05-27T10:02:07.980 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:07 smithi122 podman[74677]: 2024-05-27 10:02:07.886655862 +0000 UTC m=+0.511179823 container remove 0d63438dbb69f1926570a28e03c726474b772fca86c730326b19ac79d53c6f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-27T10:02:08.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:07 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:07.934+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:08.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:07 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:07.934+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:08.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:07 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:07.934+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:08.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:08 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:08.003+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:08.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:08 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:08.003+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:08.295 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:08 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:08.006+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:08.295 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:08 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:08.006+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:08.597 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:08 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:08.378+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:08.598 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:08 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:08.378+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:08.598 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:08 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:08.378+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:08.598 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:08 smithi122 podman[74764]: 2024-05-27 10:02:08.198378345 +0000 UTC m=+0.016958879 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:08.598 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:08 smithi122 podman[74764]: 2024-05-27 10:02:08.295818155 +0000 UTC m=+0.114398723 container create 75ab2b7f1fea99f43be15f799f8ecca6aef14f43aa330b8e8011c38c22e97e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-27T10:02:08.598 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:08 smithi122 podman[74764]: 2024-05-27 10:02:08.523867442 +0000 UTC m=+0.342447975 container init 75ab2b7f1fea99f43be15f799f8ecca6aef14f43aa330b8e8011c38c22e97e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux ) 2024-05-27T10:02:08.598 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:08 smithi122 podman[74764]: 2024-05-27 10:02:08.527104859 +0000 UTC m=+0.345685391 container start 75ab2b7f1fea99f43be15f799f8ecca6aef14f43aa330b8e8011c38c22e97e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=) 2024-05-27T10:02:08.598 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:08 smithi122 podman[74764]: 2024-05-27 10:02:08.598233447 +0000 UTC m=+0.416813974 container attach 75ab2b7f1fea99f43be15f799f8ecca6aef14f43aa330b8e8011c38c22e97e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5-deactivate, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS) 2024-05-27T10:02:08.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:08 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:08.346+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:08.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:08 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:08.346+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:08.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:08 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:08.346+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:08.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:08 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:08.447+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:08.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:08 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:08.447+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:08.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:08 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:08.447+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:08.979 INFO:journalctl@ceph.osd.5.smithi122.stdout:May 27 10:02:08 smithi122 podman[74764]: 2024-05-27 10:02:08.819937869 +0000 UTC m=+0.638518403 container died 75ab2b7f1fea99f43be15f799f8ecca6aef14f43aa330b8e8011c38c22e97e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-27T10:02:09.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:08 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:08.937+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:09.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:08 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:08.937+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:09.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:08 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:08.937+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:09.364 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:09 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:09.013+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:09.364 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:09 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:09.013+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:09.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.5.service' 2024-05-27T10:02:09.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:09.419 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-27T10:02:09.420 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-27T10:02:09.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.6 2024-05-27T10:02:09.465 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:09 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:09.028+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:09.465 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:09 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:09.028+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:09.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:09 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:09.363+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:09.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:09 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:09.363+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:09.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:09 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:09.363+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:09.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:09.297+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:09.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:09.297+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:09.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:09.297+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:09.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:09 smithi071 systemd[1]: Stopping Ceph osd.6 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:02:09.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:09 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:09.464+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:09.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:09 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:09.464+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:09.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:09 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:09.464+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:10.257 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:09.968+0000 7f33cd000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:02:10.258 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:09.968+0000 7f33cd000700 -1 osd.6 100 *** Got signal Terminated *** 2024-05-27T10:02:10.258 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:09.968+0000 7f33cd000700 -1 osd.6 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:02:10.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:09.985+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:10.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:09.985+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:10.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:09 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:09.985+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:10.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:10 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:10.012+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:10.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:10 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:10.012+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:10.399 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:10.004+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:10.399 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:10.004+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:10.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:10.399+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:10.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:10.399+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:10.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:10 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:10.399+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:10.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:10 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:10.303+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:10.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:10 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:10.303+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:10.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:10 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:10.303+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:10.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:10 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:10.435+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:10.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:10 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:10.435+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:10.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:10 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:10.435+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:11.264 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:11.007+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:11.264 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:11.007+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:11.264 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:11.007+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:11.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:10 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:10.975+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:11.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:10 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:10.975+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:11.392 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:11.042+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:11.393 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:11.042+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:11.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:11.392+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:11.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:11.392+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:11.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:11.392+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:11.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:11.263+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:11.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:11.263+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:11.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:11.263+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:11.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:11.395+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:11.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:11.395+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:11.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:11.395+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:11.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:11.395+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:12.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:11.975+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:12.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:11.975+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:12.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:11.975+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:12.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:11.983+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:12.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:11 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:11.983+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:12.430 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:11.996+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:12.431 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:11.996+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:12.431 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:11 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:11.996+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:12.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:12 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:12.430+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:12.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:12 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:12.430+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:12.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:12 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:12.430+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:12.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:12 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:12.430+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:12.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:12.304+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:12.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:12.304+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:12.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:12.304+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:12.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:12.304+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.304282+0000 front 2024-05-27T10:01:47.304416+0000 (oldest deadline 2024-05-27T10:02:11.404292+0000) 2024-05-27T10:02:12.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:12.378+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:12.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:12.378+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:12.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:12.378+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:12.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:12.378+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:13.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:12.938+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:13.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:12.938+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:13.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:12.938+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:13.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:12 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:12.938+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:13.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:12.953+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:13.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:12.953+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:13.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:12 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:12.953+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:13.425 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:12 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:12.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:13.426 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:12 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:12.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:13.426 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:12 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:12.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:13.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:13.425+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:13.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:13.425+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:13.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:13.425+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:13.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:13.425+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:13.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:13.258+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:13.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:13.258+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:13.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:13.259+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:13.758 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:13.259+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.304282+0000 front 2024-05-27T10:01:47.304416+0000 (oldest deadline 2024-05-27T10:02:11.404292+0000) 2024-05-27T10:02:13.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:13 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:13.364+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:13.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:13 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:13.364+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:13.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:13 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:13.364+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:13.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:13 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:13.364+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:14.213 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:13.931+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:14.213 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:13.931+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:14.213 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:13.931+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:14.213 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:13 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:13.931+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:14.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:13.999+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:14.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:13.999+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:14.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:13.999+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:14.400 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:13.995+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:14.400 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:13.995+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:14.400 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:13 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:13.995+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:14.507 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:14.212+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:21.095086+0000 front 2024-05-27T10:01:21.094092+0000 (oldest deadline 2024-05-27T10:01:46.994285+0000) 2024-05-27T10:02:14.508 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:14.212+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:29.896712+0000 front 2024-05-27T10:01:29.896869+0000 (oldest deadline 2024-05-27T10:01:54.596964+0000) 2024-05-27T10:02:14.508 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:14.212+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.502005+0000 front 2024-05-27T10:01:41.501906+0000 (oldest deadline 2024-05-27T10:02:05.602108+0000) 2024-05-27T10:02:14.508 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6[60074]: 2024-05-27T10:02:14.212+0000 7f33c8800700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.304282+0000 front 2024-05-27T10:01:47.304416+0000 (oldest deadline 2024-05-27T10:02:11.404292+0000) 2024-05-27T10:02:14.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:14 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:14.400+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:14.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:14 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:14.400+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:14.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:14 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:14.400+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:14.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:14 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:14.400+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:14.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:14.338+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:14.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:14.338+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:14.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:14.338+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:14.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:14.338+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:15.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:14.955+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:15.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:14.955+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:15.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:14.955+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:15.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:14 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:14.955+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:15.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:14.998+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:15.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:14.998+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:15.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:14 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:14.998+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:15.414 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:14 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:14.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:15.414 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:14 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:14.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:15.414 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:14 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:14.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:15.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:15 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:15.414+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:15.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:15 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:15.414+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:15.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:15 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:15.414+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:15.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:15 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:15.414+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:15.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:15 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:15.379+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:15.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:15 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:15.379+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:15.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:15 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:15.379+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:15.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:15 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:15.379+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:15.964 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:15 smithi071 podman[132501]: 2024-05-27 10:02:15.67093534 +0000 UTC m=+5.838255515 container died bf5fe6fff2b9d07195d6e82d620d1ac893b8d493ba4b5c1415da659416544cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-27T10:02:16.219 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:16 smithi071 podman[132501]: 2024-05-27 10:02:16.19538778 +0000 UTC m=+6.362707949 container cleanup bf5fe6fff2b9d07195d6e82d620d1ac893b8d493ba4b5c1415da659416544cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-27T10:02:16.219 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:16 smithi071 bash[132501]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6 2024-05-27T10:02:16.220 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:15 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:15.963+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:16.220 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:15 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:15.963+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:16.220 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:15 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:15.963+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:16.220 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:15 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:15.963+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:16.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:15 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:15.982+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:16.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:15 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:15.982+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:16.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:15 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:15.982+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:16.457 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:15 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:15.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:16.457 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:15 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:15.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:16.458 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:15 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:15.983+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:16.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:16.457+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:16.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:16.457+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:16.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:16.457+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:16.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:16.457+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:16.757 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:16 smithi071 podman[132518]: 2024-05-27 10:02:16.463519559 +0000 UTC m=+0.782354427 container remove bf5fe6fff2b9d07195d6e82d620d1ac893b8d493ba4b5c1415da659416544cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:02:16.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:16 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:16.399+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:16.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:16 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:16.399+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:16.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:16 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:16.399+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:16.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:16 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:16.399+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:17.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:16.940+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:17.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:16.940+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:17.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:16 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:16.940+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:17.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:16 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:16.930+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:17.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:16 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:16.930+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:17.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:16 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:16.930+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:17.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:16 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:16.930+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:17.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:16 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:16.996+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:17.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:16 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:16.996+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:17.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:16 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:16.996+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:17.618 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:17 smithi071 podman[132603]: 2024-05-27 10:02:17.212757143 +0000 UTC m=+0.037333996 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:17.618 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:17 smithi071 podman[132603]: 2024-05-27 10:02:17.347698522 +0000 UTC m=+0.172275409 container create 9e5d3149dede10be6f28ae1bc60d7e19a7b681282772d5b3a3ac90093c554a7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2) 2024-05-27T10:02:17.618 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:17 smithi071 podman[132603]: 2024-05-27 10:02:17.618123926 +0000 UTC m=+0.442700817 container init 9e5d3149dede10be6f28ae1bc60d7e19a7b681282772d5b3a3ac90093c554a7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:02:17.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:17 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:17.475+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:17.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:17 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:17.475+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:17.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:17 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:17.475+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:17.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:17 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:17.475+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:17.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:17 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:17.405+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:17.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:17 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:17.405+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:17.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:17 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:17.405+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:17.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:17 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:17.405+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:17.912 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:17 smithi071 podman[132603]: 2024-05-27 10:02:17.629767555 +0000 UTC m=+0.454344413 container start 9e5d3149dede10be6f28ae1bc60d7e19a7b681282772d5b3a3ac90093c554a7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS) 2024-05-27T10:02:17.912 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:17 smithi071 podman[132603]: 2024-05-27 10:02:17.708371362 +0000 UTC m=+0.532948283 container attach 9e5d3149dede10be6f28ae1bc60d7e19a7b681282772d5b3a3ac90093c554a7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:02:18.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:17 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:17.915+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:18.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:17 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:17.915+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:18.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:17 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:17.915+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:18.257 INFO:journalctl@ceph.osd.6.smithi071.stdout:May 27 10:02:18 smithi071 podman[132603]: 2024-05-27 10:02:18.085255517 +0000 UTC m=+0.909832391 container died 9e5d3149dede10be6f28ae1bc60d7e19a7b681282772d5b3a3ac90093c554a7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-6-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-27T10:02:18.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:17.909+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:18.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:17.909+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:18.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:17.909+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:18.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:17.909+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:18.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:17 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:17.996+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:18.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:17 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:17.996+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:18.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:17 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:17.996+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:18.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:18 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:18.438+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:18.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:18 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:18.438+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:18.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:18 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:18.438+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:18.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:18 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:18.438+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:18.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:18 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:18.404+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:18.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:18 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:18.404+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:18.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:18 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:18.404+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:18.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:18 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:18.404+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:18.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.6.service' 2024-05-27T10:02:18.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:18.987 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-27T10:02:18.987 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-27T10:02:18.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.7 2024-05-27T10:02:19.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:18 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:18.912+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:19.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:18 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:18.912+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:19.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:18 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:18.912+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:19.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:18 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:18.937+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:19.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:18 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:18.937+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:19.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:18 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:18.937+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:19.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:18 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:18.937+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:19.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:19.014+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:19.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:19.014+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:19.277 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:19.014+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:19.277 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:19 smithi072 systemd[1]: Stopping Ceph osd.7 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:02:19.512 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:19 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:19.477+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:19.512 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:19 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:19.477+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:19.512 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:19 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:19.477+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:19.512 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:19 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:19.477+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:19.776 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:19.281+0000 7f7af6665700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:02:19.776 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:19.281+0000 7f7af6665700 -1 osd.7 100 *** Got signal Terminated *** 2024-05-27T10:02:19.776 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:19.281+0000 7f7af6665700 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:02:19.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:19.385+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:19.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:19.385+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:19.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:19.385+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:19.777 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:19 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:19.385+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:20.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:19 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:19.876+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:20.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:19 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:19.876+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:20.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:19 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:19.876+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:20.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:19.921+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:20.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:19.921+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:20.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:19.921+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:20.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:19.921+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:20.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:19 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:19.921+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:20.378 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:20.377+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:20.378 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:20.048+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:20.378 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:20.048+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:20.379 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:20.049+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:20.729 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:20 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:20.526+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:20.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:20 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:20.526+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:20.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:20 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:20.526+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:20.730 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:20 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:20.526+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:20.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:20.377+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:20.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:20.377+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:20.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:20.377+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:20.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:20 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:20.377+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:21.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:20 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:20.923+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:21.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:20 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:20.923+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:21.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:20 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:20.923+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:21.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:20.945+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:21.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:20.945+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:21.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:20.945+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:21.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:20.945+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:21.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:20 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:20.945+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:21.404 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:21.071+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:21.404 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:21.071+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:21.404 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:21.071+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:21.404 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:21.071+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:56.936184+0000 front 2024-05-27T10:01:56.936235+0000 (oldest deadline 2024-05-27T10:02:20.436293+0000) 2024-05-27T10:02:21.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:21.403+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:21.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:21.403+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:21.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:21.403+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:21.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:21.403+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:21.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:21 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:21.403+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:21.880 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:21 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:21.514+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:21.880 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:21 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:21.514+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:21.880 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:21 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:21.514+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:21.880 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:21 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:21.514+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:22.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:21 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:21.879+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:22.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:21 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:21.879+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:22.231 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:21 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:21.879+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:22.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:21.982+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:22.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:21.982+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:22.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:21.982+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:22.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:21.982+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:22.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:21 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:21.982+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:22.453 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:22.067+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:22.453 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:22.067+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:22.453 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:22.067+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:22.453 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:22.067+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:56.936184+0000 front 2024-05-27T10:01:56.936235+0000 (oldest deadline 2024-05-27T10:02:20.436293+0000) 2024-05-27T10:02:22.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:22.451+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:22.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:22.451+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:22.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:22.451+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:22.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:22.451+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:22.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:22 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:22.451+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:22.917 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:22 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:22.508+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:22.917 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:22 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:22.508+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:22.917 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:22 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:22.508+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:22.917 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:22 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:22.508+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:23.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:22 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:22.917+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:23.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:22 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:22.917+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:23.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:22 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:22.917+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:23.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:22.999+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:23.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:22.999+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:23.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:22.999+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:23.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:22.999+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:23.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:22.999+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:23.480 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:23.034+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:23.481 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:23.034+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:23.481 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:23.034+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:23.481 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:23.034+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:56.936184+0000 front 2024-05-27T10:01:56.936235+0000 (oldest deadline 2024-05-27T10:02:20.436293+0000) 2024-05-27T10:02:23.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:23.480+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:23.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:23.480+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:23.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:23.480+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:23.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:23.480+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:23.776 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:23.480+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:23.930 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:23.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:23.930 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:23.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:23.930 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:23.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:23.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:23.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:23.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:23.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:24.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:23.930+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:24.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:23.930+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:24.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:23.930+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:24.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:23 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:23.930+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:24.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:23.988+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:24.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:23.988+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:24.257 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:23.988+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:24.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:23.988+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:24.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:23 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:23.988+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:24.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:24.016+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:33.532527+0000 front 2024-05-27T10:01:33.532567+0000 (oldest deadline 2024-05-27T10:01:58.832710+0000) 2024-05-27T10:02:24.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:24.016+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.833213+0000 front 2024-05-27T10:01:38.833356+0000 (oldest deadline 2024-05-27T10:02:04.133316+0000) 2024-05-27T10:02:24.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:24.016+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.835090+0000 front 2024-05-27T10:01:48.834781+0000 (oldest deadline 2024-05-27T10:02:12.235110+0000) 2024-05-27T10:02:24.276 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7[54269]: 2024-05-27T10:02:24.016+0000 7f7aeec13700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:56.936184+0000 front 2024-05-27T10:01:56.936235+0000 (oldest deadline 2024-05-27T10:02:20.436293+0000) 2024-05-27T10:02:24.769 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:24.434+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:24.769 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:24.434+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:24.769 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:24.434+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:24.769 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:24.434+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:24.769 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:24 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:24.434+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:24.938 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:24.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:24.938 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:24.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:24.938 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:24.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:24.938 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:24.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:24.939 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:24.523+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:25.026 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:24 smithi072 podman[73282]: 2024-05-27 10:02:24.768942598 +0000 UTC m=+5.582632880 container died cf98d28a2496cca89cd425053d1372f5b03303c1851829b8140f7c2cf019a4ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-27T10:02:25.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:24.938+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:25.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:24.938+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:25.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:24.938+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:25.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:24 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:24.938+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:25.388 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:25 smithi072 podman[73282]: 2024-05-27 10:02:25.126632387 +0000 UTC m=+5.940322667 container cleanup cf98d28a2496cca89cd425053d1372f5b03303c1851829b8140f7c2cf019a4ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-27T10:02:25.388 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:25 smithi072 bash[73282]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7 2024-05-27T10:02:25.507 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:25.015+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:25.507 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:25.015+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:25.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:25.015+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:25.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:25.015+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:25.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:25 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:25.015+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:25.743 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:25 smithi072 podman[73299]: 2024-05-27 10:02:25.3891517 +0000 UTC m=+0.621302994 container remove cf98d28a2496cca89cd425053d1372f5b03303c1851829b8140f7c2cf019a4ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-27T10:02:25.743 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:25 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:25.483+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:25.743 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:25 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:25.483+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:25.743 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:25 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:25.483+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:25.743 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:25 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:25.483+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:25.743 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:25 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:25.483+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:25.968 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:25.488+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:25.968 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:25.488+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:25.968 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:25.488+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:25.969 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:25.488+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:25.969 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:25.488+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:26.026 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:25 smithi072 podman[73390]: 2024-05-27 10:02:25.646096387 +0000 UTC m=+0.017107499 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:26.026 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:25 smithi072 podman[73390]: 2024-05-27 10:02:25.749228208 +0000 UTC m=+0.120239304 container create 8d38aad5e212a92f6a63511098c6bd21cf969f99ab3f2c085d439fd5bc978a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-27T10:02:26.026 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:25 smithi072 podman[73390]: 2024-05-27 10:02:25.969998049 +0000 UTC m=+0.341009153 container init 8d38aad5e212a92f6a63511098c6bd21cf969f99ab3f2c085d439fd5bc978a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521) 2024-05-27T10:02:26.026 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:25 smithi072 podman[73390]: 2024-05-27 10:02:25.973195114 +0000 UTC m=+0.344206219 container start 8d38aad5e212a92f6a63511098c6bd21cf969f99ab3f2c085d439fd5bc978a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:26.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:25.968+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:26.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:25.968+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:26.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:25.968+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:26.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:25 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:25.968+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:26.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:26.061+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:26.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:26.061+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:26.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:26.062+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:26.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:26.062+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:26.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:26 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:26.062+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:26.282 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:26 smithi072 podman[73390]: 2024-05-27 10:02:26.046884559 +0000 UTC m=+0.417895683 container attach 8d38aad5e212a92f6a63511098c6bd21cf969f99ab3f2c085d439fd5bc978a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.build-date=20240521) 2024-05-27T10:02:26.609 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:26 smithi072 podman[73390]: 2024-05-27 10:02:26.282978837 +0000 UTC m=+0.653989945 container died 8d38aad5e212a92f6a63511098c6bd21cf969f99ab3f2c085d439fd5bc978a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7-deactivate, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:02:26.610 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:26 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:26.506+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:26.610 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:26 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:26.506+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:26.610 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:26 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:26.506+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:26.610 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:26 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:26.506+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:26.610 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:26 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:26.506+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:26.871 INFO:journalctl@ceph.osd.7.smithi072.stdout:May 27 10:02:26 smithi072 podman[73417]: 2024-05-27 10:02:26.845634364 +0000 UTC m=+0.557066610 container remove 8d38aad5e212a92f6a63511098c6bd21cf969f99ab3f2c085d439fd5bc978a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-7-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:02:26.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.7.service' 2024-05-27T10:02:26.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:26.912 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-27T10:02:26.913 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-27T10:02:26.913 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.8 2024-05-27T10:02:26.938 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:26 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:26.532+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:26.938 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:26 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:26.532+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:26.939 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:26 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:26.532+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:26.939 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:26 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:26.532+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:26.939 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:26 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:26.532+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:27.212 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:26 smithi122 systemd[1]: Stopping Ceph osd.8 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:02:27.213 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:27.010+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:27.213 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:27.010+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:27.213 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:27.010+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:27.213 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:27.010+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:27.213 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:27.211+0000 7f4e9d9a2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:02:27.213 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:27.211+0000 7f4e9d9a2700 -1 osd.8 100 *** Got signal Terminated *** 2024-05-27T10:02:27.213 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:27.211+0000 7f4e9d9a2700 -1 osd.8 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:02:27.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:27 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:27.018+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:27.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:27 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:27.018+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:27.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:27 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:27.018+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:27.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:27 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:27.018+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:27.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:27 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:27.018+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:27.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:27.548+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:27.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:27.548+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:27.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:27.548+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:27.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:27.548+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:27.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:27 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:27.548+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:28.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:27 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:27.553+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:28.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:27 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:27.553+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:28.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:27 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:27.553+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:28.027 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:27 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:27.553+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:28.027 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:27 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:27.553+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:28.479 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:28.014+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:28.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:28.014+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:28.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:28.014+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:28.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:28.014+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:28.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:28.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:28.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:28.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:28.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:28.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:28.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:28.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:28.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:28.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:28.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:28 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:28.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:28.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:28.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:28.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:28.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:28.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:28.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:28.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:28.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:28.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:28 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:28.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:29.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:28.583+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:29.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:28.583+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:29.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:28.583+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:29.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:28.583+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:29.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:28 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:28.583+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:29.479 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:29.040+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:29.479 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:29.040+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:29.479 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:29.040+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:29.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:29.040+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:29.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:29.040+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.000155+0000 front 2024-05-27T10:02:06.000213+0000 (oldest deadline 2024-05-27T10:02:28.900236+0000) 2024-05-27T10:02:29.507 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:29.076+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:29.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:29.076+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:29.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:29.076+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:29.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:29.076+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:29.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:29.076+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:29.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:29 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:29.076+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:29.942 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:29.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:29.942 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:29.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:29.942 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:29.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:29.943 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:29.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:29.943 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:29.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:29.943 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:29 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:29.530+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:30.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:29 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:29.541+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:30.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:29 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:29.541+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:30.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:29 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:29.541+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:30.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:29 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:29.541+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:30.027 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:29 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:29.541+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:30.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:30.056+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:30.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:30.056+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:30.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:30.056+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:30.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:30.056+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:30.230 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:30.056+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.000155+0000 front 2024-05-27T10:02:06.000213+0000 (oldest deadline 2024-05-27T10:02:28.900236+0000) 2024-05-27T10:02:30.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:30.064+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:30.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:30.064+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:30.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:30.064+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:30.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:30.064+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:30.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:30.064+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:30.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:30 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:30.064+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:30.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:30.572+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:30.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:30.572+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:30.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:30.572+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:30.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:30.572+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:30.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:30.572+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:30.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:30 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:30.572+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:31.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:30 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:30.586+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:31.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:30 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:30.586+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:31.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:30 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:30.586+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:31.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:30 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:30.586+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:31.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:30 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:30.586+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:31.482 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:31.064+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:31.482 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:31.064+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:31.482 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:31.064+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:31.482 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:31.064+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:31.482 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:31.064+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.000155+0000 front 2024-05-27T10:02:06.000213+0000 (oldest deadline 2024-05-27T10:02:28.900236+0000) 2024-05-27T10:02:31.507 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:31.072+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:31.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:31.072+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:31.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:31.072+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:31.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:31.072+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:31.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:31.072+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:31.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:31 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:31.072+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:31.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:31.604+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:31.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:31.604+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:31.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:31.604+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:31.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:31.604+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:31.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:31.604+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:31.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:31 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:31.604+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:32.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:31 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:31.585+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:32.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:31 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:31.585+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:32.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:31 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:31.585+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:32.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:31 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:31.585+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:32.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:31 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:31.585+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:32.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:32.035+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:30.593388+0000 front 2024-05-27T10:01:30.593412+0000 (oldest deadline 2024-05-27T10:01:54.693424+0000) 2024-05-27T10:02:32.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:32.035+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.496378+0000 front 2024-05-27T10:01:41.496342+0000 (oldest deadline 2024-05-27T10:02:07.396536+0000) 2024-05-27T10:02:32.480 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:32.035+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:47.897697+0000 front 2024-05-27T10:01:47.897866+0000 (oldest deadline 2024-05-27T10:02:11.997508+0000) 2024-05-27T10:02:32.481 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:32.035+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.399335+0000 front 2024-05-27T10:01:58.399232+0000 (oldest deadline 2024-05-27T10:02:23.099162+0000) 2024-05-27T10:02:32.481 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8[55503]: 2024-05-27T10:02:32.035+0000 7f4e95f50700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.000155+0000 front 2024-05-27T10:02:06.000213+0000 (oldest deadline 2024-05-27T10:02:28.900236+0000) 2024-05-27T10:02:32.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:32 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:32.050+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:32.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:32 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:32.050+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:32.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:32 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:32.050+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:32.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:32 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:32.050+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:32.509 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:32 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:32.050+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:32.509 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:32 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:32.050+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:32.821 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 podman[74881]: 2024-05-27 10:02:32.569017185 +0000 UTC m=+5.454588327 container died 8ac46ca9fd6a3332e9643877ec41b4c0412160f7a3caab2d1522c7420968a4be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-27T10:02:32.822 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:32.632+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:32.822 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:32.632+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:32.822 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:32.632+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:32.823 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:32.632+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:32.823 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:32.632+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:32.823 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:32 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:32.632+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:33.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:32 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:32.555+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:33.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:32 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:32.555+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:33.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:32 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:32.555+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:33.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:32 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:32.555+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:33.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:32 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:32.555+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:33.027 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:32 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:32.555+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:33.180 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 podman[74881]: 2024-05-27 10:02:32.929707467 +0000 UTC m=+5.815278609 container cleanup 8ac46ca9fd6a3332e9643877ec41b4c0412160f7a3caab2d1522c7420968a4be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-27T10:02:33.180 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:32 smithi122 bash[74881]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8 2024-05-27T10:02:33.479 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:33 smithi122 podman[74897]: 2024-05-27 10:02:33.180883906 +0000 UTC m=+0.612139166 container remove 8ac46ca9fd6a3332e9643877ec41b4c0412160f7a3caab2d1522c7420968a4be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-05-27T10:02:33.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:33 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:33.037+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:33.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:33 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:33.037+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:33.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:33 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:33.037+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:33.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:33 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:33.037+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:33.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:33 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:33.037+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:33.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:33 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:33.037+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:33.842 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:33 smithi122 podman[74981]: 2024-05-27 10:02:33.447079973 +0000 UTC m=+0.016720427 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:33 smithi122 podman[74981]: 2024-05-27 10:02:33.558374207 +0000 UTC m=+0.128014642 container create c40ac5ced2466c872586dc7e77a4303a585f07c2a8fbb9b306427cca3ab94e8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, CEPH_POINT_RELEASE=) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:33 smithi122 podman[74981]: 2024-05-27 10:02:33.767243497 +0000 UTC m=+0.336883932 container init c40ac5ced2466c872586dc7e77a4303a585f07c2a8fbb9b306427cca3ab94e8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:33 smithi122 podman[74981]: 2024-05-27 10:02:33.770183023 +0000 UTC m=+0.339823460 container start c40ac5ced2466c872586dc7e77a4303a585f07c2a8fbb9b306427cca3ab94e8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:33 smithi122 podman[74981]: 2024-05-27 10:02:33.842241213 +0000 UTC m=+0.411881652 container attach c40ac5ced2466c872586dc7e77a4303a585f07c2a8fbb9b306427cca3ab94e8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:33.615+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:33.615+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:33.615+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:33.615+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:33.615+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:33.843 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:33 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:33.615+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:34.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:33.535+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:34.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:33.535+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:34.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:33.535+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:34.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:33.535+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:34.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:33.535+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:34.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:33.535+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:34.229 INFO:journalctl@ceph.osd.8.smithi122.stdout:May 27 10:02:34 smithi122 podman[74981]: 2024-05-27 10:02:34.063990857 +0000 UTC m=+0.633631296 container died c40ac5ced2466c872586dc7e77a4303a585f07c2a8fbb9b306427cca3ab94e8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-27T10:02:34.507 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:34 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:34.040+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:34.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:34 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:34.040+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:34.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:34 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:34.040+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:34.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:34 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:34.040+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:34.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:34 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:34.040+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:34.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:34 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:34.040+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:34.685 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.8.service' 2024-05-27T10:02:34.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:34.763 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-27T10:02:34.763 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-27T10:02:34.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.9 2024-05-27T10:02:34.927 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:34 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:34.546+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:34.928 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:34 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:34.546+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:34.928 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:34 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:34.546+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:34.928 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:34 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:34.546+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:34.928 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:34 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:34.546+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:34.928 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:34 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:34.546+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:34.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:34 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:34.643+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:34.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:34 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:34.643+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:34.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:34 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:34.643+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:34.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:34 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:34.643+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:34.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:34 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:34.643+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:34.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:34 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:34.643+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:35.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:34 smithi071 systemd[1]: Stopping Ceph osd.9 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:02:35.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.086+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:35.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.086+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:35.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.086+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:35.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.086+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:35.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.086+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:35.259 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.086+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:35.757 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.302+0000 7fc492a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:02:35.757 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.302+0000 7fc492a00700 -1 osd.9 100 *** Got signal Terminated *** 2024-05-27T10:02:35.758 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:35 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:35.302+0000 7fc492a00700 -1 osd.9 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:02:35.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:35.642+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:35.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:35.642+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:35.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:35.642+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:35.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:35.642+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:35.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:35.642+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:35.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:35 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:35.642+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:36.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:35.569+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:36.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:35.570+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:36.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:35.570+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:36.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:35.570+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:36.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:35.570+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:36.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:35 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:35.570+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:36.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:36.106+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:36.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:36.106+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:36.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:36.106+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:36.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:36.106+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:36.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:36.106+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:36.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:36 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:36.106+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:36.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:36.648+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:36.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:36.648+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:36.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:36.648+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:36.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:36.648+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:36.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:36.648+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:36.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:36 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:36.648+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:37.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:36.577+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:37.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:36.577+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:37.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:36.577+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:37.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:36.577+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:37.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:36.577+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:37.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:36 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:36.577+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:37.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:37 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:37.074+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:37.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:37 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:37.074+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:37.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:37 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:37.074+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:37.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:37 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:37.074+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:37.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:37 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:37.074+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:37.258 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:37 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:37.074+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:37.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:37.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:37.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:37.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:37.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:37.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:37.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:37.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:37.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:37.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:37.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:37 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:37.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:38.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:37.591+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:38.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:37.591+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:38.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:37.591+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:38.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:37.591+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:38.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:37.591+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:38.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:37 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:37.591+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:38.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:38.068+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:38.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:38.068+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:38.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:38.068+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:38.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:38.068+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:38.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:38.068+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:38.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:38.068+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:38.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:38 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:38.068+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:11.898092+0000 front 2024-05-27T10:02:11.898168+0000 (oldest deadline 2024-05-27T10:02:37.197734+0000) 2024-05-27T10:02:38.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:38.636+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:38.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:38.636+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:38.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:38.636+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:38.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:38.636+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:38.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:38.636+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:38.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:38.636+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:39.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:38.635+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:39.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:38.635+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:39.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:38.635+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:39.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:38.635+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:39.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:38.635+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:39.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:38.635+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:39.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:38 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:38.635+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:39.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:39.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:39.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:39.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:39.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:39.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:39.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:39.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:39.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:39.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:39.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:39.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:39.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:39 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:39.055+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:11.898092+0000 front 2024-05-27T10:02:11.898168+0000 (oldest deadline 2024-05-27T10:02:37.197734+0000) 2024-05-27T10:02:39.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:39.618+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:39.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:39.618+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:39.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:39.618+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:39.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:39.618+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:39.981 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:39.618+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:39.981 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:39 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:39.618+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:40.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:39.667+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:40.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:39.667+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:40.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:39.667+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:40.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:39.667+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:40.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:39.667+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:40.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:39.667+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:40.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:39 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:39.667+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:40.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:40.022+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:23.373927+0000 front 2024-05-27T10:01:23.373164+0000 (oldest deadline 2024-05-27T10:01:46.273218+0000) 2024-05-27T10:02:40.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:40.022+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:31.575887+0000 front 2024-05-27T10:01:31.575958+0000 (oldest deadline 2024-05-27T10:01:55.076133+0000) 2024-05-27T10:02:40.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:40.022+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:41.480564+0000 front 2024-05-27T10:01:41.480664+0000 (oldest deadline 2024-05-27T10:02:04.380821+0000) 2024-05-27T10:02:40.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:40.022+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:48.285895+0000 front 2024-05-27T10:01:48.285677+0000 (oldest deadline 2024-05-27T10:02:12.385947+0000) 2024-05-27T10:02:40.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:40.022+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:58.189210+0000 front 2024-05-27T10:01:58.189348+0000 (oldest deadline 2024-05-27T10:02:19.790572+0000) 2024-05-27T10:02:40.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:40.022+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:06.793841+0000 front 2024-05-27T10:02:06.793920+0000 (oldest deadline 2024-05-27T10:02:27.795609+0000) 2024-05-27T10:02:40.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9[67068]: 2024-05-27T10:02:40.022+0000 7fc48e200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:11.898092+0000 front 2024-05-27T10:02:11.898168+0000 (oldest deadline 2024-05-27T10:02:37.197734+0000) 2024-05-27T10:02:40.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:40.666+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:40.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:40.666+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:40.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:40.666+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:40.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:40.666+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:40.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:40.666+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:40.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:40 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:40.666+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:41.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:40.656+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:41.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:40.656+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:41.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:40.656+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:41.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:40.656+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:41.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:40.656+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:41.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:40.656+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:41.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:40 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:40.656+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:41.201 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:40 smithi071 podman[132719]: 2024-05-27 10:02:40.923298728 +0000 UTC m=+5.739177895 container died d031ed1569f34dcf258751ac9eaa7f271caa4b6b1d8f36b9019f4bfd73b0e8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-27T10:02:41.507 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:41 smithi071 podman[132719]: 2024-05-27 10:02:41.412371729 +0000 UTC m=+6.228250902 container cleanup d031ed1569f34dcf258751ac9eaa7f271caa4b6b1d8f36b9019f4bfd73b0e8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:02:41.507 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:41 smithi071 bash[132719]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9 2024-05-27T10:02:41.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:41.655+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:41.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:41.655+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:41.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:41.655+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:41.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:41.655+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:41.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:41.655+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:41.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:41.655+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:42.007 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:41 smithi071 podman[132737]: 2024-05-27 10:02:41.655765661 +0000 UTC m=+0.717916419 container remove d031ed1569f34dcf258751ac9eaa7f271caa4b6b1d8f36b9019f4bfd73b0e8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-27T10:02:42.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:41.692+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:42.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:41.692+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:42.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:41.692+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:42.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:41.692+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:42.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:41.692+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:42.027 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:41.692+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:42.027 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:41 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:41.692+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:42.726 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:42 smithi071 podman[132826]: 2024-05-27 10:02:42.319234168 +0000 UTC m=+0.034511676 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:42.727 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:42 smithi071 podman[132826]: 2024-05-27 10:02:42.439858757 +0000 UTC m=+0.155136295 container create aa973c1a36c343976b5dabdefd5bc3886bbe79f2b7d73235fec5896cc73ed819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:02:42.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:42.700+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:42.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:42.700+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:42.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:42.700+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:42.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:42.700+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:42.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:42.700+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:42.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:42 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:42.700+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:43.008 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:42 smithi071 podman[132826]: 2024-05-27 10:02:42.726688462 +0000 UTC m=+0.441966006 container init aa973c1a36c343976b5dabdefd5bc3886bbe79f2b7d73235fec5896cc73ed819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:43.008 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:42 smithi071 podman[132826]: 2024-05-27 10:02:42.738642887 +0000 UTC m=+0.453920395 container start aa973c1a36c343976b5dabdefd5bc3886bbe79f2b7d73235fec5896cc73ed819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5) 2024-05-27T10:02:43.008 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:42 smithi071 podman[132826]: 2024-05-27 10:02:42.825420426 +0000 UTC m=+0.540698004 container attach aa973c1a36c343976b5dabdefd5bc3886bbe79f2b7d73235fec5896cc73ed819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521) 2024-05-27T10:02:43.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:42.676+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:43.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:42.676+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:43.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:42.676+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:43.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:42.676+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:43.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:42.676+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:43.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:42.676+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:43.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:42 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:42.676+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:43.508 INFO:journalctl@ceph.osd.9.smithi071.stdout:May 27 10:02:43 smithi071 podman[132852]: 2024-05-27 10:02:43.237284545 +0000 UTC m=+0.031467427 container died aa973c1a36c343976b5dabdefd5bc3886bbe79f2b7d73235fec5896cc73ed819 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-27T10:02:43.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.9.service' 2024-05-27T10:02:43.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:43.942 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-27T10:02:43.942 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-27T10:02:43.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.10 2024-05-27T10:02:43.968 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:43.637+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:43.968 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:43.637+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:43.968 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:43.637+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:43.968 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:43.637+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:43.968 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:43.637+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:43.968 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:43.637+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:43.968 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:43.637+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:43.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:43 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:43.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:43.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:43 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:43.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:43.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:43 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:43.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:43.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:43 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:43.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:43.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:43 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:43.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:43.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:43 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:43.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:44.235 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:43 smithi072 systemd[1]: Stopping Ceph osd.10 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:02:44.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.235+0000 7f53c86f5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:02:44.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.235+0000 7f53c86f5700 -1 osd.10 100 *** Got signal Terminated *** 2024-05-27T10:02:44.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.235+0000 7f53c86f5700 -1 osd.10 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:02:44.973 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.612+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:44.973 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.612+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:44.973 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.612+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:44.973 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.612+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:44.973 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.612+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:44.973 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.612+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:44.973 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:44 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:44.612+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:44.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:44 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:44.657+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:44.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:44 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:44.657+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:44.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:44 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:44.657+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:44.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:44 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:44.657+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:44.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:44 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:44.657+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:44.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:44 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:44.657+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:45.625 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:45.624+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:45.625 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:45.624+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:45.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:45.624+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:45.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:45.624+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:45.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:45.624+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:45.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:45.624+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:46.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:45 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:45.629+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:46.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:45 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:45.629+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:46.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:45 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:45.629+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:46.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:45 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:45.629+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:46.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:45 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:45.629+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:46.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:45 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:45.629+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:46.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:45 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:45.629+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:46.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:46.635+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:46.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:46.635+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:46.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:46.635+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:46.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:46.635+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:46.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:46.635+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:46.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:46 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:46.635+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:46.636+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:46.636+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:46.636+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:46.636+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:46.636+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:46.636+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:47.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:46 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:46.636+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:47.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:47 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:47.644+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:47.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:47 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:47.644+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:47.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:47 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:47.644+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:47.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:47 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:47.644+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:47.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:47 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:47.644+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:47.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:47 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:47.644+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:47.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:47 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:47.644+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:47.632+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:47.632+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:47.632+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:47.632+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:47.632+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:47.632+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:48.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:47 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:47.632+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:48.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:48.599+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:48.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:48.599+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:48.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:48.599+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:48.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:48.599+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:48.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:48.599+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:48.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:48.599+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:48.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:48 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:48.599+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:49.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:48.594+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:24.725767+0000 front 2024-05-27T10:01:24.725721+0000 (oldest deadline 2024-05-27T10:01:45.825799+0000) 2024-05-27T10:02:49.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:48.594+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.128243+0000 front 2024-05-27T10:01:32.128277+0000 (oldest deadline 2024-05-27T10:01:58.028405+0000) 2024-05-27T10:02:49.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:48.594+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:38.529573+0000 front 2024-05-27T10:01:38.529499+0000 (oldest deadline 2024-05-27T10:02:03.229502+0000) 2024-05-27T10:02:49.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:48.594+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:49.631688+0000 front 2024-05-27T10:01:49.631523+0000 (oldest deadline 2024-05-27T10:02:10.731199+0000) 2024-05-27T10:02:49.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:48.594+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:54.732551+0000 front 2024-05-27T10:01:54.732582+0000 (oldest deadline 2024-05-27T10:02:20.032704+0000) 2024-05-27T10:02:49.026 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:48.594+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:05.333823+0000 front 2024-05-27T10:02:05.333917+0000 (oldest deadline 2024-05-27T10:02:32.333965+0000) 2024-05-27T10:02:49.027 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:48 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10[60868]: 2024-05-27T10:02:48.594+0000 7f53c0ca3700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.71:6822 osd.6 since back 2024-05-27T10:02:12.334631+0000 front 2024-05-27T10:02:12.334792+0000 (oldest deadline 2024-05-27T10:02:38.234472+0000) 2024-05-27T10:02:49.882 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:49.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:49.882 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:49.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:49.883 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:49.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:49.883 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:49.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:49.883 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:49.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:49.883 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:49.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:49.883 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:49.603+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:49.946 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:49 smithi072 podman[73508]: 2024-05-27 10:02:49.695272257 +0000 UTC m=+5.554405722 container died 7204fe5928f8fd23909666e05ed8f4b1e3b731ce2b16130c6dc98150880b66f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-05-27T10:02:50.207 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 podman[73508]: 2024-05-27 10:02:50.022763476 +0000 UTC m=+5.881896939 container cleanup 7204fe5928f8fd23909666e05ed8f4b1e3b731ce2b16130c6dc98150880b66f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:50.208 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 bash[73508]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10 2024-05-27T10:02:50.526 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 podman[73524]: 2024-05-27 10:02:50.208387676 +0000 UTC m=+0.515290040 container remove 7204fe5928f8fd23909666e05ed8f4b1e3b731ce2b16130c6dc98150880b66f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:02:50.897 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:50.633+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:50.897 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:50.633+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:50.897 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:50.633+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:50.897 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:50.633+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:50.897 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:50.633+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:50.897 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:50.633+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:50.897 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:50 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:50.633+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:50.906 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 podman[73613]: 2024-05-27 10:02:50.626539298 +0000 UTC m=+0.104514387 container create bd502e2d60a37ec49fa0d496d1f7100140f674b53b9de2f44fda29bce4087788 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-27T10:02:50.906 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 podman[73613]: 2024-05-27 10:02:50.53867196 +0000 UTC m=+0.016647049 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:50.907 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 podman[73613]: 2024-05-27 10:02:50.830510767 +0000 UTC m=+0.308485855 container init bd502e2d60a37ec49fa0d496d1f7100140f674b53b9de2f44fda29bce4087788 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-27T10:02:50.907 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 podman[73613]: 2024-05-27 10:02:50.833443678 +0000 UTC m=+0.311418763 container start bd502e2d60a37ec49fa0d496d1f7100140f674b53b9de2f44fda29bce4087788 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-27T10:02:50.907 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:50 smithi072 podman[73613]: 2024-05-27 10:02:50.907305326 +0000 UTC m=+0.385280418 container attach bd502e2d60a37ec49fa0d496d1f7100140f674b53b9de2f44fda29bce4087788 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240521, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:02:51.276 INFO:journalctl@ceph.osd.10.smithi072.stdout:May 27 10:02:51 smithi072 podman[73613]: 2024-05-27 10:02:51.124061237 +0000 UTC m=+0.602036322 container died bd502e2d60a37ec49fa0d496d1f7100140f674b53b9de2f44fda29bce4087788 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:51.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.10.service' 2024-05-27T10:02:51.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:51.772 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-27T10:02:51.772 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-27T10:02:51.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.11 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:51.645+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:51.645+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:51.645+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:51.645+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:51.645+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:51.645+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:51.645+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:51.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:51 smithi122 systemd[1]: Stopping Ceph osd.11 for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:02:52.479 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.072+0000 7fdff633e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:02:52.479 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.073+0000 7fdff633e700 -1 osd.11 100 *** Got signal Terminated *** 2024-05-27T10:02:52.479 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.073+0000 7fdff633e700 -1 osd.11 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-27T10:02:52.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.689+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:52.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.689+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:52.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.689+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:52.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.689+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:52.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.689+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:52.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.689+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:52.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:52 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:52.689+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:53.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:53.694+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:53.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:53.694+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:53.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:53.694+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:53.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:53.694+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:53.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:53.694+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:53.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:53.694+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:53.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:53 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:53.694+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:54.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:54.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:54.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:54.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:54.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:54.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:54.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:54.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:54 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:54.670+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6820 osd.8 since back 2024-05-27T10:02:32.145486+0000 front 2024-05-27T10:02:32.145511+0000 (oldest deadline 2024-05-27T10:02:53.845456+0000) 2024-05-27T10:02:55.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.691+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:55.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.692+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:55.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.692+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:55.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.692+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:55.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.692+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:55.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.692+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:55.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.692+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:55.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:55 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:55.692+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6820 osd.8 since back 2024-05-27T10:02:32.145486+0000 front 2024-05-27T10:02:32.145511+0000 (oldest deadline 2024-05-27T10:02:53.845456+0000) 2024-05-27T10:02:56.979 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-05-27T10:01:19.934398+0000 front 2024-05-27T10:01:19.934046+0000 (oldest deadline 2024-05-27T10:01:49.334699+0000) 2024-05-27T10:02:56.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6804 osd.1 since back 2024-05-27T10:01:32.235872+0000 front 2024-05-27T10:01:32.236029+0000 (oldest deadline 2024-05-27T10:01:55.135826+0000) 2024-05-27T10:02:56.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-05-27T10:01:40.838048+0000 front 2024-05-27T10:01:40.838077+0000 (oldest deadline 2024-05-27T10:02:04.238708+0000) 2024-05-27T10:02:56.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.71:6814 osd.3 since back 2024-05-27T10:01:50.040480+0000 front 2024-05-27T10:01:50.040556+0000 (oldest deadline 2024-05-27T10:02:12.340343+0000) 2024-05-27T10:02:56.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6812 osd.4 since back 2024-05-27T10:01:57.041469+0000 front 2024-05-27T10:01:57.041386+0000 (oldest deadline 2024-05-27T10:02:22.941355+0000) 2024-05-27T10:02:56.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-05-27T10:02:04.642240+0000 front 2024-05-27T10:02:04.642261+0000 (oldest deadline 2024-05-27T10:02:28.742231+0000) 2024-05-27T10:02:56.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.72:6820 osd.7 since back 2024-05-27T10:02:22.744786+0000 front 2024-05-27T10:02:22.744828+0000 (oldest deadline 2024-05-27T10:02:46.844553+0000) 2024-05-27T10:02:56.980 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:56 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11[62519]: 2024-05-27T10:02:56.667+0000 7fdfee8ec700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.122:6820 osd.8 since back 2024-05-27T10:02:32.145486+0000 front 2024-05-27T10:02:32.145511+0000 (oldest deadline 2024-05-27T10:02:53.845456+0000) 2024-05-27T10:02:57.832 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:57 smithi122 podman[75111]: 2024-05-27 10:02:57.532818462 +0000 UTC m=+5.545327829 container died 81926f23bb909bad59ea52a73c82f541338a7a5a87cf44590f55b427b1241cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:58.083 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:57 smithi122 podman[75111]: 2024-05-27 10:02:57.923518657 +0000 UTC m=+5.936028015 container cleanup 81926f23bb909bad59ea52a73c82f541338a7a5a87cf44590f55b427b1241cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5) 2024-05-27T10:02:58.083 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:57 smithi122 bash[75111]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11 2024-05-27T10:02:58.479 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:58 smithi122 podman[75128]: 2024-05-27 10:02:58.083199722 +0000 UTC m=+0.543693260 container remove 81926f23bb909bad59ea52a73c82f541338a7a5a87cf44590f55b427b1241cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux ) 2024-05-27T10:02:58.777 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:58 smithi122 podman[75217]: 2024-05-27 10:02:58.483856545 +0000 UTC m=+0.106919339 container create b4dd913c4b3a53b234a5100387de5a281a53d7e74ba0a8abc17de5792f55f60f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:58.777 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:58 smithi122 podman[75217]: 2024-05-27 10:02:58.39411551 +0000 UTC m=+0.017178291 image pull 850a06a84d28fb71dec1431a907aeab5c3ccf2f0fcd791cd2cbd1ea45413ef76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6 2024-05-27T10:02:58.777 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:58 smithi122 podman[75217]: 2024-05-27 10:02:58.702956248 +0000 UTC m=+0.326019024 container init b4dd913c4b3a53b234a5100387de5a281a53d7e74ba0a8abc17de5792f55f60f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:02:58.777 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:58 smithi122 podman[75217]: 2024-05-27 10:02:58.706346219 +0000 UTC m=+0.329408992 container start b4dd913c4b3a53b234a5100387de5a281a53d7e74ba0a8abc17de5792f55f60f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240521) 2024-05-27T10:02:58.778 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:58 smithi122 podman[75217]: 2024-05-27 10:02:58.777720552 +0000 UTC m=+0.400783324 container attach b4dd913c4b3a53b234a5100387de5a281a53d7e74ba0a8abc17de5792f55f60f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-27T10:02:59.229 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:58 smithi122 podman[75217]: 2024-05-27 10:02:58.993109036 +0000 UTC m=+0.616171809 container died b4dd913c4b3a53b234a5100387de5a281a53d7e74ba0a8abc17de5792f55f60f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5) 2024-05-27T10:02:59.540 INFO:journalctl@ceph.osd.11.smithi122.stdout:May 27 10:02:59 smithi122 podman[75244]: 2024-05-27 10:02:59.522468159 +0000 UTC m=+0.523894498 container remove b4dd913c4b3a53b234a5100387de5a281a53d7e74ba0a8abc17de5792f55f60f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.build-date=20240521, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-27T10:02:59.545 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@osd.11.service' 2024-05-27T10:02:59.582 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:02:59.582 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-27T10:02:59.583 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-27T10:02:59.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.a 2024-05-27T10:03:00.007 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:02:59 smithi071 systemd[1]: Stopping Ceph mds.a for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:00.507 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:03:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a[74267]: 2024-05-27T10:03:00.179+0000 7fe222200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:00.507 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:03:00 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a[74267]: 2024-05-27T10:03:00.179+0000 7fe222200700 -1 mds.a *** got signal Terminated *** 2024-05-27T10:03:04.502 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:03:04 smithi071 podman[132955]: 2024-05-27 10:03:04.210294362 +0000 UTC m=+4.180636201 container died 86704f9fb198f33c3f780d78292c6b8d800ad07699207de096d7e1c2d890c30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:03:04.757 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:03:04 smithi071 podman[132955]: 2024-05-27 10:03:04.614010738 +0000 UTC m=+4.584352564 container cleanup 86704f9fb198f33c3f780d78292c6b8d800ad07699207de096d7e1c2d890c30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:03:04.757 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:03:04 smithi071 bash[132955]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a 2024-05-27T10:03:05.367 INFO:journalctl@ceph.mds.a.smithi071.stdout:May 27 10:03:05 smithi071 podman[132967]: 2024-05-27 10:03:05.03194847 +0000 UTC m=+0.807043450 container remove 86704f9fb198f33c3f780d78292c6b8d800ad07699207de096d7e1c2d890c30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2) 2024-05-27T10:03:05.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.a.service' 2024-05-27T10:03:05.512 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:05.512 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-27T10:03:05.512 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-27T10:03:05.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.d 2024-05-27T10:03:06.007 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 10:03:05 smithi071 systemd[1]: Stopping Ceph mds.d for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:06.507 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 10:03:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d[73109]: 2024-05-27T10:03:06.115+0000 7f777f400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:06.507 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 10:03:06 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d[73109]: 2024-05-27T10:03:06.115+0000 7f777f400700 -1 mds.d *** got signal Terminated *** 2024-05-27T10:03:10.465 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 10:03:10 smithi071 podman[133076]: 2024-05-27 10:03:10.148691167 +0000 UTC m=+4.161907651 container died 339a9ca34e3e1adc60cf57d70f46cec143fb251c7a31263d9b12a76e3082cfe2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:03:10.757 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 10:03:10 smithi071 podman[133076]: 2024-05-27 10:03:10.634274936 +0000 UTC m=+4.647491444 container cleanup 339a9ca34e3e1adc60cf57d70f46cec143fb251c7a31263d9b12a76e3082cfe2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-05-27T10:03:10.757 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 10:03:10 smithi071 bash[133076]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d 2024-05-27T10:03:11.234 INFO:journalctl@ceph.mds.d.smithi071.stdout:May 27 10:03:10 smithi071 podman[133092]: 2024-05-27 10:03:10.969253982 +0000 UTC m=+0.806510639 container remove 339a9ca34e3e1adc60cf57d70f46cec143fb251c7a31263d9b12a76e3082cfe2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-d, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240521) 2024-05-27T10:03:11.270 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.d.service' 2024-05-27T10:03:11.372 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:11.372 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-27T10:03:11.372 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-27T10:03:11.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.g 2024-05-27T10:03:11.757 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:03:11 smithi071 systemd[1]: Stopping Ceph mds.g for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:12.257 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:03:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: 2024-05-27T10:03:11.911+0000 7f163ca00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:12.257 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:03:11 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g[73881]: 2024-05-27T10:03:11.911+0000 7f163ca00700 -1 mds.g *** got signal Terminated *** 2024-05-27T10:03:16.219 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:03:15 smithi071 podman[133196]: 2024-05-27 10:03:15.944727633 +0000 UTC m=+4.165324718 container died 5ea437c5523b55b617354fa92e920d0125060d981ff017845441eecd0ad331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:03:16.507 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:03:16 smithi071 podman[133196]: 2024-05-27 10:03:16.338130898 +0000 UTC m=+4.558727980 container cleanup 5ea437c5523b55b617354fa92e920d0125060d981ff017845441eecd0ad331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-27T10:03:16.508 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:03:16 smithi071 bash[133196]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g 2024-05-27T10:03:17.007 INFO:journalctl@ceph.mds.g.smithi071.stdout:May 27 10:03:16 smithi071 podman[133209]: 2024-05-27 10:03:16.623020875 +0000 UTC m=+0.662701679 container remove 5ea437c5523b55b617354fa92e920d0125060d981ff017845441eecd0ad331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-g, org.label-schema.build-date=20240521, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=) 2024-05-27T10:03:17.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.g.service' 2024-05-27T10:03:17.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:17.239 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-27T10:03:17.239 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-27T10:03:17.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.j 2024-05-27T10:03:17.510 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 10:03:17 smithi071 systemd[1]: Stopping Ceph mds.j for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:18.257 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 10:03:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j[72691]: 2024-05-27T10:03:17.797+0000 7fc16d000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:18.257 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 10:03:17 smithi071 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j[72691]: 2024-05-27T10:03:17.797+0000 7fc16d000700 -1 mds.j *** got signal Terminated *** 2024-05-27T10:03:22.107 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 10:03:21 smithi071 podman[133314]: 2024-05-27 10:03:21.822918869 +0000 UTC m=+4.160466391 container died 3f3b81a867fcc51f0fd96dada825bcba062ab6a7cd0460e44d72d030fd666fc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-27T10:03:22.443 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 10:03:22 smithi071 podman[133314]: 2024-05-27 10:03:22.250227425 +0000 UTC m=+4.587774987 container cleanup 3f3b81a867fcc51f0fd96dada825bcba062ab6a7cd0460e44d72d030fd666fc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, org.label-schema.build-date=20240521) 2024-05-27T10:03:22.444 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 10:03:22 smithi071 bash[133314]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j 2024-05-27T10:03:22.757 INFO:journalctl@ceph.mds.j.smithi071.stdout:May 27 10:03:22 smithi071 podman[133325]: 2024-05-27 10:03:22.442871786 +0000 UTC m=+0.601371950 container remove 3f3b81a867fcc51f0fd96dada825bcba062ab6a7cd0460e44d72d030fd666fc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:03:22.865 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.j.service' 2024-05-27T10:03:22.966 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:22.967 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-27T10:03:22.967 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-27T10:03:22.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.b 2024-05-27T10:03:23.268 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:03:23 smithi072 systemd[1]: Stopping Ceph mds.b for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:23.526 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:03:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: 2024-05-27T10:03:23.267+0000 7f80b1d4e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:23.526 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:03:23 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b[66212]: 2024-05-27T10:03:23.267+0000 7f80b1d4e700 -1 mds.b *** got signal Terminated *** 2024-05-27T10:03:24.776 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:03:24 smithi072 podman[73719]: 2024-05-27 10:03:24.518101698 +0000 UTC m=+1.352093913 container died 5f8559384c0f52c5c263fd1a2f36f799c402d07cbb61b315a601b23156aa2c16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-27T10:03:25.231 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:03:24 smithi072 podman[73719]: 2024-05-27 10:03:24.98618779 +0000 UTC m=+1.820180001 container cleanup 5f8559384c0f52c5c263fd1a2f36f799c402d07cbb61b315a601b23156aa2c16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:03:25.231 INFO:journalctl@ceph.mds.b.smithi072.stdout:May 27 10:03:24 smithi072 bash[73719]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-b 2024-05-27T10:03:25.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.b.service' 2024-05-27T10:03:25.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:25.403 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-27T10:03:25.404 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-27T10:03:25.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.e 2024-05-27T10:03:25.735 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 10:03:25 smithi072 systemd[1]: Stopping Ceph mds.e for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:26.026 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 10:03:25 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e[65591]: 2024-05-27T10:03:25.735+0000 7fdf52cf9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:26.026 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 10:03:25 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e[65591]: 2024-05-27T10:03:25.735+0000 7fdf52cf9700 -1 mds.e *** got signal Terminated *** 2024-05-27T10:03:29.777 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 10:03:29 smithi072 podman[73850]: 2024-05-27 10:03:29.481937021 +0000 UTC m=+3.858773195 container died aa23f9e7c292efd221670c4ada5656eb6a627f08d8cc047dd13e9a3ac1b82333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-27T10:03:30.202 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 10:03:29 smithi072 podman[73850]: 2024-05-27 10:03:29.812713388 +0000 UTC m=+4.189549552 container cleanup aa23f9e7c292efd221670c4ada5656eb6a627f08d8cc047dd13e9a3ac1b82333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:03:30.203 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 10:03:29 smithi072 bash[73850]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e 2024-05-27T10:03:30.475 INFO:journalctl@ceph.mds.e.smithi072.stdout:May 27 10:03:30 smithi072 podman[73863]: 2024-05-27 10:03:30.200256845 +0000 UTC m=+0.712050298 container remove aa23f9e7c292efd221670c4ada5656eb6a627f08d8cc047dd13e9a3ac1b82333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-e, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-27T10:03:30.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.e.service' 2024-05-27T10:03:30.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:30.527 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-27T10:03:30.528 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-27T10:03:30.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.h 2024-05-27T10:03:30.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:03:30 smithi072 systemd[1]: Stopping Ceph mds.h for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:31.276 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:03:30 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h[65897]: 2024-05-27T10:03:30.869+0000 7f4795fe9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:31.276 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:03:30 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h[65897]: 2024-05-27T10:03:30.869+0000 7f4795fe9700 -1 mds.h *** got signal Terminated *** 2024-05-27T10:03:32.776 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:03:32 smithi072 podman[73969]: 2024-05-27 10:03:32.518674952 +0000 UTC m=+1.765292239 container died d818b28baf420584cd84bd3bea3addfd9ba11cbd5be4d6471c3a41ac7f780542 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-27T10:03:33.261 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:03:32 smithi072 podman[73969]: 2024-05-27 10:03:32.855550337 +0000 UTC m=+2.102167633 container cleanup d818b28baf420584cd84bd3bea3addfd9ba11cbd5be4d6471c3a41ac7f780542 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-27T10:03:33.261 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:03:32 smithi072 bash[73969]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h 2024-05-27T10:03:33.261 INFO:journalctl@ceph.mds.h.smithi072.stdout:May 27 10:03:33 smithi072 podman[73980]: 2024-05-27 10:03:33.03414743 +0000 UTC m=+0.510327209 container remove d818b28baf420584cd84bd3bea3addfd9ba11cbd5be4d6471c3a41ac7f780542 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-27T10:03:33.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.h.service' 2024-05-27T10:03:33.312 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:33.313 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-27T10:03:33.313 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-27T10:03:33.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.k 2024-05-27T10:03:33.620 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 10:03:33 smithi072 systemd[1]: Stopping Ceph mds.k for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:33.950 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 10:03:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k[65275]: 2024-05-27T10:03:33.620+0000 7f861702f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:33.950 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 10:03:33 smithi072 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k[65275]: 2024-05-27T10:03:33.620+0000 7f861702f700 -1 mds.k *** got signal Terminated *** 2024-05-27T10:03:37.230 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 10:03:36 smithi072 podman[74090]: 2024-05-27 10:03:36.908087567 +0000 UTC m=+3.383466191 container died 1087580b2c1ebb62dc05a390c33eee0bb34d3939c38cd47818525d3e94d5b8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-27T10:03:37.230 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 10:03:37 smithi072 podman[74090]: 2024-05-27 10:03:37.231220419 +0000 UTC m=+3.706599027 container cleanup 1087580b2c1ebb62dc05a390c33eee0bb34d3939c38cd47818525d3e94d5b8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-27T10:03:37.526 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 10:03:37 smithi072 bash[74090]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k 2024-05-27T10:03:37.526 INFO:journalctl@ceph.mds.k.smithi072.stdout:May 27 10:03:37 smithi072 podman[74102]: 2024-05-27 10:03:37.418185646 +0000 UTC m=+0.503959468 container remove 1087580b2c1ebb62dc05a390c33eee0bb34d3939c38cd47818525d3e94d5b8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521) 2024-05-27T10:03:37.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.k.service' 2024-05-27T10:03:37.692 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:37.692 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-27T10:03:37.692 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-27T10:03:37.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.c 2024-05-27T10:03:37.981 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:03:37 smithi122 systemd[1]: Stopping Ceph mds.c for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:38.235 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:03:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c[67504]: 2024-05-27T10:03:38.105+0000 7fcbad155700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:38.235 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:03:38 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c[67504]: 2024-05-27T10:03:38.105+0000 7fcbad155700 -1 mds.c *** got signal Terminated *** 2024-05-27T10:03:40.807 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:03:40 smithi122 podman[75324]: 2024-05-27 10:03:40.515578908 +0000 UTC m=+2.625331972 container died c917bd5528697ddbecfe3368745a586192445cd0cda5630ab437a2d62a564cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-27T10:03:41.131 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:03:40 smithi122 podman[75324]: 2024-05-27 10:03:40.897580249 +0000 UTC m=+3.007333314 container cleanup c917bd5528697ddbecfe3368745a586192445cd0cda5630ab437a2d62a564cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-27T10:03:41.131 INFO:journalctl@ceph.mds.c.smithi122.stdout:May 27 10:03:40 smithi122 bash[75324]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-c 2024-05-27T10:03:41.272 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.c.service' 2024-05-27T10:03:41.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:41.307 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-27T10:03:41.307 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-27T10:03:41.307 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.f 2024-05-27T10:03:41.729 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 10:03:41 smithi122 systemd[1]: Stopping Ceph mds.f for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:41.729 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 10:03:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f[67192]: 2024-05-27T10:03:41.633+0000 7f4040bfe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:41.729 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 10:03:41 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f[67192]: 2024-05-27T10:03:41.633+0000 7f4040bfe700 -1 mds.f *** got signal Terminated *** 2024-05-27T10:03:44.393 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 10:03:44 smithi122 podman[75456]: 2024-05-27 10:03:44.111321837 +0000 UTC m=+2.586833082 container stop 2744fe3a12dcf346ef03e66bcc1db9ac8ff3c06d1fd9562a125ec8b2734a03ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, CEPH_POINT_RELEASE=) 2024-05-27T10:03:44.393 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 10:03:44 smithi122 podman[75456]: 2024-05-27 10:03:44.138404704 +0000 UTC m=+2.613915961 container died 2744fe3a12dcf346ef03e66bcc1db9ac8ff3c06d1fd9562a125ec8b2734a03ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-27T10:03:44.644 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 10:03:44 smithi122 podman[75456]: 2024-05-27 10:03:44.48450972 +0000 UTC m=+2.960020959 container cleanup 2744fe3a12dcf346ef03e66bcc1db9ac8ff3c06d1fd9562a125ec8b2734a03ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:03:44.644 INFO:journalctl@ceph.mds.f.smithi122.stdout:May 27 10:03:44 smithi122 bash[75456]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-f 2024-05-27T10:03:44.851 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.f.service' 2024-05-27T10:03:44.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:44.883 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-27T10:03:44.883 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-27T10:03:44.884 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.i 2024-05-27T10:03:45.205 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:03:44 smithi122 systemd[1]: Stopping Ceph mds.i for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:45.480 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:03:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T10:03:45.204+0000 7f7d7f09a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:45.480 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:03:45 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i[67806]: 2024-05-27T10:03:45.204+0000 7f7d7f09a700 -1 mds.i *** got signal Terminated *** 2024-05-27T10:03:48.772 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:03:48 smithi122 podman[75580]: 2024-05-27 10:03:48.515122768 +0000 UTC m=+3.417256616 container died c0408e3305e74864560f39a64bfec0a0cba6965bd1eeab8260f94d3cfa85b77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:03:49.139 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:03:48 smithi122 podman[75580]: 2024-05-27 10:03:48.880268928 +0000 UTC m=+3.782402767 container cleanup c0408e3305e74864560f39a64bfec0a0cba6965bd1eeab8260f94d3cfa85b77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-27T10:03:49.139 INFO:journalctl@ceph.mds.i.smithi122.stdout:May 27 10:03:48 smithi122 bash[75580]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-i 2024-05-27T10:03:49.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.i.service' 2024-05-27T10:03:49.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:49.339 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-27T10:03:49.339 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-27T10:03:49.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.l 2024-05-27T10:03:49.730 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 10:03:49 smithi122 systemd[1]: Stopping Ceph mds.l for 13785e2a-1c0c-11ef-bc9b-c7b262605968... 2024-05-27T10:03:49.730 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 10:03:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l[66890]: 2024-05-27T10:03:49.641+0000 7ff953791700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-27T10:03:49.730 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 10:03:49 smithi122 ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l[66890]: 2024-05-27T10:03:49.641+0000 7ff953791700 -1 mds.l *** got signal Terminated *** 2024-05-27T10:03:53.979 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 10:03:53 smithi122 podman[75701]: 2024-05-27 10:03:53.655532475 +0000 UTC m=+4.105039631 container died 8e37ca59b9a5053a6e27d6e8ede9f0e7e21c6525267cd84809ba9f0ab8911664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738) 2024-05-27T10:03:54.351 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 10:03:54 smithi122 podman[75701]: 2024-05-27 10:03:54.100494306 +0000 UTC m=+4.550001454 container cleanup 8e37ca59b9a5053a6e27d6e8ede9f0e7e21c6525267cd84809ba9f0ab8911664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:40667fa40b383802316dd30b2fb5cc99041435f0e277cde147e3c3dc5c88e9a6, name=ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240521.105740-debug-a650738, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-27T10:03:54.351 INFO:journalctl@ceph.mds.l.smithi122.stdout:May 27 10:03:54 smithi122 bash[75701]: ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968-mds-l 2024-05-27T10:03:54.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-13785e2a-1c0c-11ef-bc9b-c7b262605968@mds.l.service' 2024-05-27T10:03:54.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-27T10:03:54.546 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-27T10:03:54.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 --force --keep-logs 2024-05-27T10:03:54.860 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T10:03:59.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 --force --keep-logs 2024-05-27T10:03:59.723 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T10:04:02.049 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 --force --keep-logs 2024-05-27T10:04:02.242 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T10:04:04.525 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-27T10:04:04.616 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-27T10:04:04.647 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-27T10:04:04.673 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-27T10:04:04.675 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi071/crash 2024-05-27T10:04:04.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash -- . 2024-05-27T10:04:04.774 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-05-27T10:04:04.775 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-05-27T10:04:04.779 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi072/crash 2024-05-27T10:04:04.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash -- . 2024-05-27T10:04:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:tar: /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-05-27T10:04:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:tar: Error is not recoverable: exiting now 2024-05-27T10:04:04.865 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi122/crash 2024-05-27T10:04:04.866 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash -- . 2024-05-27T10:04:04.898 INFO:teuthology.orchestra.run.smithi122.stderr:tar: /var/lib/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-05-27T10:04:04.899 INFO:teuthology.orchestra.run.smithi122.stderr:tar: Error is not recoverable: exiting now 2024-05-27T10:04:04.900 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-27T10:04:04.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-27T10:04:05.006 INFO:teuthology.orchestra.run.smithi071.stdout:2024-05-27T09:50:33.548757+0000 mds.i (mds.2) 2 : cluster [WRN] Scrub error on inode 0x100000002b5 (/volumes/qa/sv_1/616bd330-493f-4a98-a838-adf26d894d14/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.i log and `damage ls` output for details 2024-05-27T10:04:05.007 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-05-27T10:04:05.007 INFO:tasks.cephadm:Compressing logs... 2024-05-27T10:04:05.008 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-27T10:04:05.012 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-27T10:04:05.014 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-27T10:04:05.037 INFO:teuthology.orchestra.run.smithi122.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-27T10:04:05.037 INFO:teuthology.orchestra.run.smithi122.stderr:: No such file or directory 2024-05-27T10:04:05.038 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log 2024-05-27T10:04:05.038 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.f.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.f.log: /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.c.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.5.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.c.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.z.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.i.log 2024-05-27T10:04:05.041 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.z.log: 87.1% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log.gz 2024-05-27T10:04:05.048 INFO:teuthology.orchestra.run.smithi122.stderr: 90.4% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-05-27T10:04:05.048 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-05-27T10:04:05.048 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.11.log 2024-05-27T10:04:05.049 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log: 83.8% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-05-27T10:04:05.049 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.8.log 2024-05-27T10:04:05.049 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.11.log: 94.5% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.f.log.gz 2024-05-27T10:04:05.049 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:: No such file or directory 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.7.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log: /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.b.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose --/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.7.log: /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.y.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.h.log 2024-05-27T10:04:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.10.log 2024-05-27T10:04:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.h.log: 90.3% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-05-27T10:04:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:gzip 87.1% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log.gz 2024-05-27T10:04:05.052 INFO:teuthology.orchestra.run.smithi072.stderr: -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-05-27T10:04:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.e.log 2024-05-27T10:04:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log: 83.8% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-05-27T10:04:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log 2024-05-27T10:04:05.053 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.8.log: 92.2% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.z.log.gz 2024-05-27T10:04:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.e.log: 94.4% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.e.log.gz 2024-05-27T10:04:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.b.log 2024-05-27T10:04:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log: 92.1% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.y.log.gz 2024-05-27T10:04:05.058 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.l.log 2024-05-27T10:04:05.065 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.k.log 2024-05-27T10:04:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-27T10:04:05.067 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-05-27T10:04:05.067 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-05-27T10:04:05.067 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log 2024-05-27T10:04:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log 2024-05-27T10:04:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.g.log 2024-05-27T10:04:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.j.log 2024-05-27T10:04:05.071 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log: /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-05-27T10:04:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-05-27T10:04:05.072 INFO:teuthology.orchestra.run.smithi071.stderr: 87.1% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.log.gz 2024-05-27T10:04:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-05-27T10:04:05.073 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-05-27T10:04:05.073 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.k.log: 94.3% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.k.log.gz 2024-05-27T10:04:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.x.log 2024-05-27T10:04:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.a.log 2024-05-27T10:04:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.6.log 2024-05-27T10:04:05.079 INFO:teuthology.orchestra.run.smithi122.stderr: 94.5% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.l.log.gz 2024-05-27T10:04:05.080 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.a.log: 94.1%/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.6.log: -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-27T10:04:05.080 INFO:teuthology.orchestra.run.smithi071.stderr: 94.4% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.j.log.gz 2024-05-27T10:04:05.080 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-05-27T10:04:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.a.log 2024-05-27T10:04:05.082 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log: 84.1% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-05-27T10:04:05.083 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log 2024-05-27T10:04:05.085 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.a.log: /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.d.log 2024-05-27T10:04:05.091 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.9.log 2024-05-27T10:04:05.106 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.9.log: 94.2% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.d.log.gz 2024-05-27T10:04:05.113 INFO:teuthology.orchestra.run.smithi071.stderr: 90.9% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-05-27T10:04:05.125 INFO:teuthology.orchestra.run.smithi122.stderr: 94.2% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.c.log.gz 2024-05-27T10:04:05.162 INFO:teuthology.orchestra.run.smithi072.stderr: 94.2% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.h.log.gz 2024-05-27T10:04:05.324 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.a.log.gz 2024-05-27T10:04:05.494 INFO:teuthology.orchestra.run.smithi122.stderr: 94.5% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.i.log.gz 2024-05-27T10:04:05.531 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mgr.x.log.gz 2024-05-27T10:04:05.605 INFO:teuthology.orchestra.run.smithi122.stderr: 91.6% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.c.log.gz 2024-05-27T10:04:05.676 INFO:teuthology.orchestra.run.smithi072.stderr: 91.6% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.b.log.gz 2024-05-27T10:04:06.564 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mon.a.log.gz 2024-05-27T10:04:08.143 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.9.log.gz 2024-05-27T10:04:08.453 INFO:teuthology.orchestra.run.smithi071.stderr: 95.6% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.g.log.gz 2024-05-27T10:04:08.546 INFO:teuthology.orchestra.run.smithi122.stderr: 94.0% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-05-27T10:04:08.911 INFO:teuthology.orchestra.run.smithi122.stderr: 93.7% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.11.log.gz 2024-05-27T10:04:09.020 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.10.log.gz 2024-05-27T10:04:09.125 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-05-27T10:04:09.535 INFO:teuthology.orchestra.run.smithi122.stderr: 94.0% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.8.log.gz 2024-05-27T10:04:09.578 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-05-27T10:04:09.593 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-05-27T10:04:09.827 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-05-27T10:04:10.532 INFO:teuthology.orchestra.run.smithi122.stderr: 94.0% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-05-27T10:04:10.533 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-05-27T10:04:10.533 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m5.505s 2024-05-27T10:04:10.534 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m17.844s 2024-05-27T10:04:10.534 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.649s 2024-05-27T10:04:12.155 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.7.log.gz 2024-05-27T10:04:13.025 INFO:teuthology.orchestra.run.smithi071.stderr: 94.0% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-osd.6.log.gz 2024-05-27T10:04:13.029 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-05-27T10:04:13.029 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m7.986s 2024-05-27T10:04:13.029 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m23.929s 2024-05-27T10:04:13.030 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m1.995s 2024-05-27T10:04:44.420 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/13785e2a-1c0c-11ef-bc9b-c7b262605968/ceph-mds.b.log.gz 2024-05-27T10:04:44.421 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-05-27T10:04:44.421 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m39.392s 2024-05-27T10:04:44.422 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m57.858s 2024-05-27T10:04:44.422 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m1.944s 2024-05-27T10:04:44.422 INFO:tasks.cephadm:Archiving logs... 2024-05-27T10:04:44.423 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi071/log 2024-05-27T10:04:44.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-27T10:04:47.554 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi072/log 2024-05-27T10:04:47.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-27T10:04:55.490 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi122/log 2024-05-27T10:04:55.491 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-27T10:04:57.981 INFO:tasks.cephadm:Removing cluster... 2024-05-27T10:04:57.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 --force 2024-05-27T10:04:58.304 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T10:04:58.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 --force 2024-05-27T10:04:59.111 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T10:04:59.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 13785e2a-1c0c-11ef-bc9b-c7b262605968 --force 2024-05-27T10:04:59.616 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: 13785e2a-1c0c-11ef-bc9b-c7b262605968 2024-05-27T10:04:59.906 INFO:tasks.cephadm:Removing cephadm ... 2024-05-27T10:04:59.907 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-27T10:04:59.963 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-27T10:04:59.979 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-27T10:04:59.994 INFO:tasks.cephadm:Teardown complete 2024-05-27T10:04:59.995 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-27T10:05:00.007 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-27T10:05:00.007 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-27T10:05:00.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-27T10:05:00.022 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-27T10:05:00.158 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-27T10:05:00.169 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-27T10:05:00.169 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T10:05:00.177 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T10:05:00.179 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T10:05:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-05-27T10:05:00.193 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-05-27T10:05:00.194 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T10:05:00.195 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-05-27T10:05:00.195 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +833us[ +840us] +/- 57ms 2024-05-27T10:05:00.195 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -1621us[-1621us] +/- 76ms 2024-05-27T10:05:00.195 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +583us[ +590us] +/- 85ms 2024-05-27T10:05:00.195 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:05:00.196 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T10:05:00.196 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-05-27T10:05:00.196 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 59 +809us[ +771us] +/- 57ms 2024-05-27T10:05:00.197 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -1674us[-1713us] +/- 76ms 2024-05-27T10:05:00.197 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 58 +561us[ +523us] +/- 85ms 2024-05-27T10:05:00.197 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:05:00.221 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-05-27T10:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T10:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-05-27T10:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +818us[ +746us] +/- 57ms 2024-05-27T10:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -1628us[-1628us] +/- 76ms 2024-05-27T10:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +598us[ +526us] +/- 85ms 2024-05-27T10:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:05:00.232 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-27T10:05:00.243 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-27T10:05:00.244 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-27T10:05:00.254 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-27T10:05:00.463 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-27T10:05:00.530 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-27T10:05:00.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T10:05:00.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:05:00.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T10:05:00.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:05:00.719 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T10:05:00.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:05:00.745 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-27T10:05:00.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-27T10:05:00.791 INFO:teuthology.task.internal:Duration was 2443.902758 seconds 2024-05-27T10:05:00.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-27T10:05:00.802 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-27T10:05:00.803 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-27T10:05:00.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-27T10:05:00.813 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-27T10:05:00.846 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T10:05:00.849 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T10:05:00.947 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T10:05:01.327 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-27T10:05:01.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-05-27T10:05:01.328 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-27T10:05:01.403 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T10:05:01.403 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-27T10:05:01.429 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-05-27T10:05:01.430 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-27T10:05:01.454 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-27T10:05:01.457 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-27T10:05:01.464 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-27T10:05:01.473 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-27T10:05:01.544 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-27T10:05:01.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-27T10:05:01.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-27T10:05:01.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-27T10:05:02.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-27T10:05:02.570 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-27T10:05:02.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-27T10:05:02.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-27T10:05:02.683 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-27T10:05:02.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-27T10:05:02.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-27T10:05:02.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-27T10:05:02.733 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-27T10:05:02.755 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-05-27T10:05:02.774 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-05-27T10:05:02.820 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-05-27T10:05:02.862 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-27T10:05:02.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:05:02.911 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-27T10:05:02.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:05:02.928 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-27T10:05:02.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:05:02.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-27T10:05:02.956 INFO:teuthology.task.internal:Transferring archived files... 2024-05-27T10:05:02.957 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi071 2024-05-27T10:05:02.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-27T10:05:03.074 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi072 2024-05-27T10:05:03.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-27T10:05:03.114 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-27_06:46:53-fs-wip-vshankar-testing-20240521.105740-debug-testing-default-smithi/7727695/remote/smithi122 2024-05-27T10:05:03.114 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-27T10:05:03.152 INFO:teuthology.task.internal:Removing archive directory... 2024-05-27T10:05:03.153 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-27T10:05:03.160 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-27T10:05:03.163 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-27T10:05:03.214 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-27T10:05:03.228 INFO:teuthology.task.internal:Not uploading archives. 2024-05-27T10:05:03.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-27T10:05:03.241 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-27T10:05:03.241 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-27T10:05:03.247 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-27T10:05:03.249 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-27T10:05:03.264 INFO:teuthology.orchestra.run.smithi072.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 27 10:05 /home/ubuntu/cephtest 2024-05-27T10:05:03.265 INFO:teuthology.orchestra.run.smithi122.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 27 10:05 /home/ubuntu/cephtest 2024-05-27T10:05:03.299 INFO:teuthology.orchestra.run.smithi071.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 27 10:05 /home/ubuntu/cephtest 2024-05-27T10:05:03.300 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-27T10:05:03.313 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-27T10:05:03.342 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} duration: 2443.902758359909 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_vshankar@teuthology status: fail success: false 2024-05-27T10:05:03.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-27T10:05:03.456 INFO:teuthology.run:FAIL